Crash might show db2diag.log entries such as:
014-08-01-14.08.23.407859-300 I235043A1249 LEVEL: Error
PID : 7012434 TID : 48318 PROC :
db2sysc 8
INSTANCE: argrptp1 NODE : 008 DB : MYDB
APPHDL : 8-63 APPID:
*LOCAL.db2inst1.141023105242
AUTHID : DB2INST1 HOSTNAME: myhost
EDUID : 48318 EDUNAME: db2pcsd (MYDB) 8
FUNCTION: DB2 UDB, base sys utilities, sqleagnt_sigsegvh,
probe:8
MESSAGE : Error in agent servicing application with
AUTHORIZATION ID:
DATA #1 : Hexdump, 129 bytes
0x0780000003138F69 : 4544 4C57 5458 5020 0000 0000 0000 0000
DB2INST1 ........
0x0780000003138F79 : 0000 0000 0000 0000 0000 0000 0000 0000
................
0x0780000003138F89 : 0000 0000 0000 0000 0000 0000 0000 0000
................
0x0780000003138F99 : 0000 0000 0000 0000 0000 0000 0000 0000
................
0x0780000003138FA9 : 0000 0000 0000 0000 0000 0000 0000 0000
................
0x0780000003138FB9 : 0000 0000 0000 0000 0000 0000 0000 0000
................
0x0780000003138FC9 : 0000 0000 0000 0000 0000 0000 0000 0000
................
0x0780000003138FD9 : 0000 0000 0000 0000 0000 0000 0000 0000
................
0x0780000003138FE9 : 00
.
2014-08-01-14.08.23.408435-300 I236293A607 LEVEL: Error
PID : 7012434 TID : 48318 PROC :
db2sysc 8
INSTANCE: argrptp1 NODE : 008 DB : MYDB
APPHDL : 8-63 APPID:
*LOCAL.db2inst1.141023105242
AUTHID : DB2INST1 HOSTNAME: myhost
EDUID : 48318 EDUNAME: db2pcsd (MYDB) 8
FUNCTION: DB2 UDB, base sys utilities, sqleagnt_sigsegvh,
probe:9
MESSAGE : Error in agent servicing application with PRODUCT
SIGNATURE:
DATA #1 : Hexdump, 8 bytes
0x078000000313AA8C : 5351 4C30 3930 3736
SQL09076
2014-08-01-14.08.23.408887-300 I236901A606 LEVEL: Error
PID : 7012434 TID : 48318 PROC :
db2sysc 8
INSTANCE: argrptp1 NODE : 008 DB : MYDB
APPHDL : 8-63 APPID:
*LOCAL.db2inst1.141023105242
AUTHID : DB2INST1 HOSTNAME: myhost
EDUID : 48318 EDUNAME: db2pcsd (MYDB) 8
FUNCTION: DB2 UDB, base sys utilities, sqleagnt_sigsegvh,
probe:10
MESSAGE : Error in agent servicing application with APPLICATION
NAME:
DATA #1 : Hexdump, 7 bytes
0x078000000313A962 : 6462 3270 6373 64
db2pcsd
2014-08-01-14.08.23.492440-300 I237508A595 LEVEL:
Severe
PID : 7012434 TID : 48318 PROC :
db2sysc 8
INSTANCE: argrptp1 NODE : 008 DB : MYDB
APPHDL : 8-63 APPID:
*LOCAL.db2inst1.141023105242
AUTHID : DB2INST1 HOSTNAME: myhost
EDUID : 48318 EDUNAME: db2pcsd (MYDB) 8
FUNCTION: DB2 UDB, RAS/PD component,
pdResilienceIsSafeToSustain, probe:800
DATA #1 : String, 37 bytes
Trap Sustainability Criteria Checking
DATA #2 : Hex integer, 8 bytes
0x2000000400001051
DATA #3 : Boolean, 1 bytes
false
2014-08-01-14.13.23.541671-300 I250403A501 LEVEL:
Warning
PID : 7012434 TID : 48318 PROC :
db2sysc 8
INSTANCE: argrptp1 NODE : 008 DB : MYDB
APPHDL : 8-63 APPID:
*LOCAL.db2inst1.141023105242
AUTHID : DB2INST1 HOSTNAME: myhost
EDUID : 48318 EDUNAME: db2pcsd (MYDB) 8
FUNCTION: DB2 UDB, trace services,
pdInvokeCalloutScriptViaVendorAPI, probe:35
DATA #1 : <preformatted>
PD Vendor Return Code: 0
2014-08-01-14.13.23.542117-300 I250905A522 LEVEL:
Severe
PID : 7012434 TID : 48318 PROC :
db2sysc 8
INSTANCE: argrptp1 NODE : 008 DB : MYDB
APPHDL : 8-63 APPID:
*LOCAL.db2inst1.141023105242
AUTHID : DB2INST1 HOSTNAME: myhost
EDUID : 48318 EDUNAME: db2pcsd (MYDB) 8
FUNCTION: DB2 UDB, relation data serv, sqlrr_signal_handler,
probe:100
MESSAGE : DIA0505I Execution of a component signal handling
function has begun.
2014-08-01-14.13.23.542545-300 I251428A659 LEVEL:
Severe
PID : 7012434 TID : 48318 PROC :
db2sysc 8
INSTANCE: argrptp1 NODE : 008 DB : MYDB
APPHDL : 8-63 APPID:
*LOCAL.db2inst1.141023105242
AUTHID : DB2INST1 HOSTNAME: myhost
EDUID : 48318 EDUNAME: db2pcsd (MYDB) 8
FUNCTION: DB2 UDB, relation data serv, sqlrr_signal_handler,
probe:125
MESSAGE : MASTER TIME INFO
DATA #1 : Hexdump, 32 bytes
0x0A0001007E9FBBD0 : 0000 0000 53DA D54A 002F 0000 0000 B81A
....S..J./......
0x0A0001007E9FBBE0 : 0014 899C 75EB BAC7 0000 0000 001F 4000
....u.........@.
2014-08-01-14.13.23.548186-300 I253314A685 LEVEL:
Severe
PID : 7012434 TID : 48318 PROC :
db2sysc 8
INSTANCE: argrptp1 NODE : 008 DB : MYDB
APPHDL : 8-63 APPID:
*LOCAL.db2inst1.141023105242
AUTHID : DB2INST1 HOSTNAME: myhost
EDUID : 48318 EDUNAME: db2pcsd (MYDB) 8
FUNCTION: DB2 UDB, trace services, sqlt_logerr_data (secondary
logging function), probe:50
MESSAGE : RDS UCINTFC: pCurrentPID->rdbname =
DATA #1 : Hexdump, 18 bytes
0x0000000116A92F18 : 0000 0000 0000 0000 0000 0000 0000 0000
................
0x0000000116A92F28 : 0000
..
2014-08-01-14.13.23.548553-300 I254000A607 LEVEL:
Severe
PID : 7012434 TID : 48318 PROC :
db2sysc 8
INSTANCE: argrptp1 NODE : 008 DB : MYDB
APPHDL : 8-63 APPID:
*LOCAL.db2inst1.141023105242
AUTHID : DB2INST1 HOSTNAME: myhost
EDUID : 48318 EDUNAME: db2pcsd (MYDB) 8
FUNCTION: DB2 UDB, trace services, sqlt_logerr_data (secondary
logging function), probe:50
MESSAGE : RDS UCINTFC: pCurrentPID->rdbcolidLen =
DATA #1 : Hexdump, 2 bytes
0x0000000116A92EE8 : 0000
Stack for this PID.TID would show something like this:
<StackTrace>
-------Frame------ ------Function + Offset------
0x090000000619103C
sqlra_cache_del_var__FP8sqlrr_cbP16sqlra_cached_variP23sqlra_cac
hed_dependency + 0x48C
0x0900000005A290DC
sqlra_csm_drop_var__FP8sqlrr_cbPP16sqlra_cached_variP23sqlra_cac
hed_dependencyPi + 0x344
0x0900000005A296B8 sqlra_csm_clean_lru__FP8sqlrr_cbPb + 0x28
0x0900000005A272A8 sqlra_cache_space_mgmt__FP8sqlrr_cbUl + 0x414
0x090000000438198C sqleIndCoordProcessRequest__FP8sqeAgent +
0x77A4
0x09000000043668B8 sqleIndCoordProcessRequest__FP8sqeAgent +
0xF84
0x0900000004876770 RunEDU__8sqeAgentFv + 0xF0
0x0900000005C1CE58 EDUDriver__9sqzEDUObjFv + 0x128
0x0900000004C418D8 sqloEDUEntry + 0x3A0
</StackTrace>
The function sqlra_csm_clean_lru is the key indicator for the
APAR.
This APAR is DPF-specific. The variation is sent from different
partition, it doesn't impact variation from local compilation.
This problem MAY occur when:
1. There's a sensitive timing hole where the variation is being
removed while another agent tries to reference it OR
2. There's overflow among the statement anchors in the package
cache (different from package cache overflow) |
