DB2 - Problem description
Problem IT37514 | Status: Closed |
db2 crash due to log missing required by a rollback. | |
product: | |
DB2 FOR LUW / DB2FORLUW / B50 - DB2 | |
Problem description: | |
db2 crash due to log missing required by a rollback. db2diag reports "EBADF (9) "Bad file number"" 2019-05-18-04.28.46.864072-240 E209675468A1303 LEVEL: Error (OS) PID : 9371968 TID : 8740 PROC : db2sysc 0 INSTANCE: db2inst1 NODE : 000 DB : XXXXXX HOSTNAME: XXXXXXXXXX EDUID : 8740 EDUNAME: db2loggr (XXXXXX) 0 FUNCTION: DB2 UDB, oper system services, sqloReadBlocks, probe:60 MESSAGE : ZRC=0x860F000A=-2045837302=SQLO_FNEX "File not found." DIA8411C A file "" could not be found. CALLED : OS, -, pread OSERR : EBADF (9) "Bad file number" CALLSTCK: (Static functions may not be resolved correctly, as they are resolved to the nearest symbol) [0] 0x09000000111A27FC oss_log__FP9OSSLogFacUiN32UlN26iPPc + 0x1BC [1] 0x09000000111A2C8C ossLogSysRC + 0x6C [2] 0x09000000111B9FD8 ossErrorIOAnalysis__FCPC21OSSErrorAnalysisParam + 0xDD8 [3] 0x0900000000CE3FD0 sqloSystemErrorHandler + 0x390 [4] 0x0900000000C4EC74 sqloReadBlocks + 0x3F4 [5] 0x0900000004DE43B0 sqlpgReadNLogPages__FR12SQLO_FHANDLECPvClCUlCPUlCUsP17sqlexCiphe rTicketCb + 0x90 [6] 0x0900000004DE6700 sqlpgarl__FP9SQLP_DBCBCUl + 0xC20 Extent Number = 1076299 DATA #1 : String, 27 bytes Log stream id / arlRequest: DATA #2 : db2LogStreamIDType, PD_TYPE_DB2_LOG_STREAM_ID, 2 bytes 0 DATA #3 : SQLPG_ARL_REQUEST, PD_TYPE_SQLPG_ARL_REQUEST, 40 bytes iReadEduId = 207877 iReadReqLso = 305226280231157 iReadBlocks = 8 2019-05-18-04.28.46.873254-240 I209703852A165 LEVEL: Error PID:9371968 TID:207877 NODE:000 Title: SQLP_DBCB Dump File:/diag/db2inst1/9371968.207877.000.dump.bin 2019-05-18-04.28.47.007496-240 I209724664A165 LEVEL: Error PID:9371968 TID:207877 NODE:000 Title: SQLP_DBCB Dump File:/diag/db2inst1/9371968.207877.000.dump.bin 2019-05-18-05.15.20.351423-240 I229917119A1623 LEVEL: Info PID : 11469278 TID : 7454 PROC : db2sysc 0 INSTANCE: db2inst1 NODE : 000 DB : XXXXXX APPHDL : 0-8 APPID: xxxxxxxx AUTHID : xxxxxxxx HOSTNAME: XXXXXXXXXX EDUID : 7454 EDUNAME: db2agent (XXXXXX) 0 FUNCTION: DB2 UDB, recovery manager, sqlpresr, probe:300 DATA #1 : Crash recovery started. Recovery status for log stream 0 lowtranlsn: 00004A95BCEBAC27 minbufflsn: 00004A95BC59226F headlsn: 00004A95BC59226F streamLowTranLfsLsnDbRedo: 0/0000000000000000 recoveryStartingLFSLSN: 0/0000000000000000 initialRecoveryStartingLFSLSN: 0/0000000000000000 groupHeadLsn: 00004A95BC59226F groupMinBuffLSN: 00004A95BC59226F FileCount: 100 FileArray[0]: 1076294 HeadExtentID: 1076294 GroupHeadExtentID: 1076294 lastExtNeededForRecovery: 1076299 2019-05-18-05.17.18.061309-240 I229931822A861 LEVEL: Info PID : 11469278 TID : 107686 PROC : db2sysc 0 INSTANCE: db2inst1 NODE : 000 DB : XXXXXX APPHDL : 0-8 APPID: xxxxxxxx AUTHID : xxxxxxxx HOSTNAME: XXXXXXXXXX EDUID : 107686 EDUNAME: db2shred (XXXXXX) 0 FUNCTION: DB2 UDB, recovery manager, sqlpshrEdu, probe:9999 MESSAGE : Shredder worker finished. DATA #1 : db2LogStreamIDType, PD_TYPE_DB2_LOG_STREAM_ID, 2 bytes 0 DATA #2 : unsigned integer, 8 bytes 305226375385644 DATA #3 : unsigned integer, 8 bytes 305226375385645 DATA #4 : LFS/LSN, PD_TYPE_SQLP_LFS_LSN_PAIR, 16 bytes 18855497941/00004A95BCF3E861 DATA #5 : LFS/LSN, PD_TYPE_SQLP_LFS_LSN_PAIR, 16 bytes 0/0000000000000000 DATA #6 : Hex integer, 8 bytes 0x0000000000000002 2019-05-18-05.17.18.482171-240 I229937635A1642 LEVEL: Info FUNCTION: DB2 UDB, recovery manager, sqlpPRecReadLog, probe:4000 DATA #1 : End of redo phase. Recovery status for log stream 0 lowtranlsn: 00004A95BCEBAC27 minbufflsn: 00004A95BC5922AE FileArray[0]: 1076294 HeadExtentID: 1076294 GroupHeadExtentID: 1076294 lastExtNeededForRecovery: 1076299 nextLso: 305226375385645 nextLsn: 00004A95BCF3E862 2019-05-18-05.40.46.460925-240 E230187973A432 LEVEL: Info PID : 11469278 TID : 8997 PROC : db2sysc 0 INSTANCE: db2inst1 NODE : 000 DB : XXXXXX HOSTNAME: XXXXXXXXXX EDUID : 8997 EDUNAME: db2logmgr (XXXXXX) 0 FUNCTION: DB2 UDB, data protection services, sqlpgArchiveLogFile, probe:3108 DATA #1 : Started archive for log file S1076299.LOG. | |
Problem Summary: | |
**************************************************************** * USERS AFFECTED: * * all * **************************************************************** * PROBLEM DESCRIPTION: * * db2 crash due to log missing required by a rollback. * * db2diag reports "EBADF (9) "Bad file number"" * * * * * * 2019-05-18-04.28.46.864072-240 E209675468A1303 LEVEL: * * Error * * (OS) * * PID : 9371968 TID : 8740 PROC : * * db2sysc 0 * * INSTANCE: db2inst1 NODE : 000 DB : * * XXXXXX * * HOSTNAME: XXXXXXXXXX * * EDUID : 8740 EDUNAME: db2loggr (XXXXXX) 0 * * FUNCTION: DB2 UDB, oper system services, sqloReadBlocks, * * probe:60 * * MESSAGE : ZRC=0x860F000A=-2045837302=SQLO_FNEX "File not * * found." * * DIA8411C A file "" could not be found. * * CALLED : OS, -, pread * * OSERR : EBADF (9) "Bad file number" * * * * * * CALLSTCK: (Static functions may not be resolved correctly, * * as * * they are resolved to the nearest symbol) * * [0] 0x09000000111A27FC oss_log__FP9OSSLogFacUiN32UlN26iPPc * * + * * 0x1BC * * [1] 0x09000000111A2C8C ossLogSysRC + 0x6C * * [2] 0x09000000111B9FD8 * * ossErrorIOAnalysis__FCPC21OSSErrorAnalysisParam + 0xDD8 * * [3] 0x0900000000CE3FD0 sqloSystemErrorHandler + 0x390 * * [4] 0x0900000000C4EC74 sqloReadBlocks + 0x3F4 * * [5] 0x0900000004DE43B0 * * sqlpgReadNLogPages__FR12SQLO_FHANDLECPvClCUlCPUlCUsP17sqlexC * * iphe * * rTicketCb + 0x90 * * [6] 0x0900000004DE6700 sqlpgarl__FP9SQLP_DBCBCUl + 0xC20 * * * * Extent Number = 1076299 * * * * DATA #1 : String, 27 bytes * * Log stream id / arlRequest: * * DATA #2 : db2LogStreamIDType, PD_TYPE_DB2_LOG_STREAM_ID, 2 * * bytes * * 0 * * DATA #3 : SQLPG_ARL_REQUEST, PD_TYPE_SQLPG_ARL_REQUEST, 40 * * bytes * * iReadEduId = 207877 * * iReadReqLso = 305226280231157 * * iReadBlocks = 8 * * * * * * 2019-05-18-04.28.46.873254-240 I209703852A165 LEVEL: * * Error * * PID:9371968 TID:207877 NODE:000 Title: SQLP_DBCB * * Dump File:/diag/db2inst1/9371968.207877.000.dump.bin * * * * * * 2019-05-18-04.28.47.007496-240 I209724664A165 LEVEL: * * Error * * PID:9371968 TID:207877 NODE:000 Title: SQLP_DBCB * * Dump File:/diag/db2inst1/9371968.207877.000.dump.bin * * * * * * * * 2019-05-18-05.15.20.351423-240 I229917119A1623 LEVEL: * * Info * * PID : 11469278 TID : 7454 PROC : * * db2sysc 0 * * INSTANCE: db2inst1 NODE : 000 DB : * * XXXXXX * * APPHDL : 0-8 APPID: xxxxxxxx * * AUTHID : xxxxxxxx HOSTNAME: XXXXXXXXXX * * EDUID : 7454 EDUNAME: db2agent (XXXXXX) 0 * * FUNCTION: DB2 UDB, recovery manager, sqlpresr, probe:300 * * DATA #1 : * * Crash recovery started. * * Recovery status for log stream 0 * * lowtranlsn: 00004A95BCEBAC27 * * minbufflsn: 00004A95BC59226F * * headlsn: 00004A95BC59226F * * streamLowTranLfsLsnDbRedo: 0/0000000000000000 * * recoveryStartingLFSLSN: 0/0000000000000000 * * initialRecoveryStartingLFSLSN: 0/0000000000000000 * * groupHeadLsn: 00004A95BC59226F * * groupMinBuffLSN: 00004A95BC59226F * * FileCount: 100 * * FileArray[0]: 1076294 * * HeadExtentID: 1076294 * * GroupHeadExtentID: 1076294 * * lastExtNeededForRecovery: 1076299 * * * * * * 2019-05-18-05.17.18.061309-240 I229931822A861 LEVEL: * * Info * * PID : 11469278 TID : 107686 PROC : * * db2sysc 0 * * INSTANCE: db2inst1 NODE : 000 DB : * * XXXXXX * * APPHDL : 0-8 APPID: xxxxxxxx * * AUTHID : xxxxxxxx HOSTNAME: XXXXXXXXXX * * EDUID : 107686 EDUNAME: db2shred (XXXXXX) 0 * * FUNCTION: DB2 UDB, recovery manager, sqlpshrEdu, probe:9999 * * MESSAGE : Shredder worker finished. * * DATA #1 : db2LogStreamIDType, PD_TYPE_DB2_LOG_STREAM_ID, 2 * * bytes * * 0 * * DATA #2 : unsigned integer, 8 bytes * * 305226375385644 * * DATA #3 : unsigned integer, 8 bytes * * 305226375385645 * * DATA #4 : LFS/LSN, PD_TYPE_SQLP_LFS_LSN_PAIR, 16 bytes * * 18855497941/00004A95BCF3E861 * * DATA #5 : LFS/LSN, PD_TYPE_SQLP_LFS_LSN_PAIR, 16 bytes * * 0/0000000000000000 * * DATA #6 : Hex integer, 8 bytes * * 0x0000000000000002 * * * * * * 2019-05-18-05.17.18.482171-240 I229937635A1642 LEVEL: * * Info * * FUNCTION: DB2 UDB, recovery manager, sqlpPRecReadLog, * * probe:4000 * * DATA #1 : * * End of redo phase. * * Recovery status for log stream 0 * * * * lowtranlsn: 00004A95BCEBAC27 * * minbufflsn: 00004A95BC5922AE * * FileArray[0]: 1076294 * * HeadExtentID: 1076294 * * GroupHeadExtentID: 1076294 * * lastExtNeededForRecovery: 1076299 * * nextLso: 305226375385645 * * nextLsn: 00004A95BCF3E862 * * * * * * * * * * 2019-05-18-05.40.46.460925-240 E230187973A432 LEVEL: * * Info * * PID : 11469278 TID : 8997 PROC : * * db2sysc 0 * * INSTANCE: db2inst1 NODE : 000 DB : * * XXXXXX * * HOSTNAME: XXXXXXXXXX * * EDUID : 8997 EDUNAME: db2logmgr (XXXXXX) 0 * * FUNCTION: DB2 UDB, data protection services, * * sqlpgArchiveLogFile, probe:3108 * * DATA #1 : * * Started archive for log file S1076299.LOG. * **************************************************************** * RECOMMENDATION: * * Upgrade to 11.5 FP7 or later * **************************************************************** | |
Local Fix: | |
Solution | |
Workaround | |
**************************************************************** * USERS AFFECTED: * * all * **************************************************************** * PROBLEM DESCRIPTION: * * db2 crash due to log missing required by a rollback. * * db2diag reports "EBADF (9) "Bad file number"" * * * * * * 2019-05-18-04.28.46.864072-240 E209675468A1303 LEVEL: * * Error * * (OS) * * PID : 9371968 TID : 8740 PROC : * * db2sysc 0 * * INSTANCE: db2inst1 NODE : 000 DB : * * XXXXXX * * HOSTNAME: XXXXXXXXXX * * EDUID : 8740 EDUNAME: db2loggr (XXXXXX) 0 * * FUNCTION: DB2 UDB, oper system services, sqloReadBlocks, * * probe:60 * * MESSAGE : ZRC=0x860F000A=-2045837302=SQLO_FNEX "File not * * found." * * DIA8411C A file "" could not be found. * * CALLED : OS, -, pread * * OSERR : EBADF (9) "Bad file number" * * * * * * CALLSTCK: (Static functions may not be resolved correctly, * * as * * they are resolved to the nearest symbol) * * [0] 0x09000000111A27FC oss_log__FP9OSSLogFacUiN32UlN26iPPc * * + * * 0x1BC * * [1] 0x09000000111A2C8C ossLogSysRC + 0x6C * * [2] 0x09000000111B9FD8 * * ossErrorIOAnalysis__FCPC21OSSErrorAnalysisParam + 0xDD8 * * [3] 0x0900000000CE3FD0 sqloSystemErrorHandler + 0x390 * * [4] 0x0900000000C4EC74 sqloReadBlocks + 0x3F4 * * [5] 0x0900000004DE43B0 * * sqlpgReadNLogPages__FR12SQLO_FHANDLECPvClCUlCPUlCUsP17sqlexC * * iphe * * rTicketCb + 0x90 * * [6] 0x0900000004DE6700 sqlpgarl__FP9SQLP_DBCBCUl + 0xC20 * * * * Extent Number = 1076299 * * * * DATA #1 : String, 27 bytes * * Log stream id / arlRequest: * * DATA #2 : db2LogStreamIDType, PD_TYPE_DB2_LOG_STREAM_ID, 2 * * bytes * * 0 * * DATA #3 : SQLPG_ARL_REQUEST, PD_TYPE_SQLPG_ARL_REQUEST, 40 * * bytes * * iReadEduId = 207877 * * iReadReqLso = 305226280231157 * * iReadBlocks = 8 * * * * * * 2019-05-18-04.28.46.873254-240 I209703852A165 LEVEL: * * Error * * PID:9371968 TID:207877 NODE:000 Title: SQLP_DBCB * * Dump File:/diag/db2inst1/9371968.207877.000.dump.bin * * * * * * 2019-05-18-04.28.47.007496-240 I209724664A165 LEVEL: * * Error * * PID:9371968 TID:207877 NODE:000 Title: SQLP_DBCB * * Dump File:/diag/db2inst1/9371968.207877.000.dump.bin * * * * * * * * 2019-05-18-05.15.20.351423-240 I229917119A1623 LEVEL: * * Info * * PID : 11469278 TID : 7454 PROC : * * db2sysc 0 * * INSTANCE: db2inst1 NODE : 000 DB : * * XXXXXX * * APPHDL : 0-8 APPID: xxxxxxxx * * AUTHID : xxxxxxxx HOSTNAME: XXXXXXXXXX * * EDUID : 7454 EDUNAME: db2agent (XXXXXX) 0 * * FUNCTION: DB2 UDB, recovery manager, sqlpresr, probe:300 * * DATA #1 : * * Crash recovery started. * * Recovery status for log stream 0 * * lowtranlsn: 00004A95BCEBAC27 * * minbufflsn: 00004A95BC59226F * * headlsn: 00004A95BC59226F * * streamLowTranLfsLsnDbRedo: 0/0000000000000000 * * recoveryStartingLFSLSN: 0/0000000000000000 * * initialRecoveryStartingLFSLSN: 0/0000000000000000 * * groupHeadLsn: 00004A95BC59226F * * groupMinBuffLSN: 00004A95BC59226F * * FileCount: 100 * * FileArray[0]: 1076294 * * HeadExtentID: 1076294 * * GroupHeadExtentID: 1076294 * * lastExtNeededForRecovery: 1076299 * * * * * * 2019-05-18-05.17.18.061309-240 I229931822A861 LEVEL: * * Info * * PID : 11469278 TID : 107686 PROC : * * db2sysc 0 * * INSTANCE: db2inst1 NODE : 000 DB : * * XXXXXX * * APPHDL : 0-8 APPID: xxxxxxxx * * AUTHID : xxxxxxxx HOSTNAME: XXXXXXXXXX * * EDUID : 107686 EDUNAME: db2shred (XXXXXX) 0 * * FUNCTION: DB2 UDB, recovery manager, sqlpshrEdu, probe:9999 * * MESSAGE : Shredder worker finished. * * DATA #1 : db2LogStreamIDType, PD_TYPE_DB2_LOG_STREAM_ID, 2 * * bytes * * 0 * * DATA #2 : unsigned integer, 8 bytes * * 305226375385644 * * DATA #3 : unsigned integer, 8 bytes * * 305226375385645 * * DATA #4 : LFS/LSN, PD_TYPE_SQLP_LFS_LSN_PAIR, 16 bytes * * 18855497941/00004A95BCF3E861 * * DATA #5 : LFS/LSN, PD_TYPE_SQLP_LFS_LSN_PAIR, 16 bytes * * 0/0000000000000000 * * DATA #6 : Hex integer, 8 bytes * * 0x0000000000000002 * * * * * * 2019-05-18-05.17.18.482171-240 I229937635A1642 LEVEL: * * Info * * FUNCTION: DB2 UDB, recovery manager, sqlpPRecReadLog, * * probe:4000 * * DATA #1 : * * End of redo phase. * * Recovery status for log stream 0 * * * * lowtranlsn: 00004A95BCEBAC27 * * minbufflsn: 00004A95BC5922AE * * FileArray[0]: 1076294 * * HeadExtentID: 1076294 * * GroupHeadExtentID: 1076294 * * lastExtNeededForRecovery: 1076299 * * nextLso: 305226375385645 * * nextLsn: 00004A95BCF3E862 * * * * * * * * * * 2019-05-18-05.40.46.460925-240 E230187973A432 LEVEL: * * Info * * PID : 11469278 TID : 8997 PROC : * * db2sysc 0 * * INSTANCE: db2inst1 NODE : 000 DB : * * XXXXXX * * HOSTNAME: XXXXXXXXXX * * EDUID : 8997 EDUNAME: db2logmgr (XXXXXX) 0 * * FUNCTION: DB2 UDB, data protection services, * * sqlpgArchiveLogFile, probe:3108 * * DATA #1 : * * Started archive for log file S1076299.LOG. * **************************************************************** * RECOMMENDATION: * * Upgrade to 11.5 FP7 or later * **************************************************************** | |
Comment | |
Upgrade to 11.5 FP7 or later | |
Timestamps | |
Date - problem reported : Date - problem closed : Date - last modified : | 05.07.2021 21.11.2021 21.11.2021 |
Problem solved at the following versions (IBM BugInfos) | |
Problem solved according to the fixlist(s) of the following version(s) |