Sorting might crashed in stmmStopSortListMonitorOnFailure()
called by sqlsinsr() after disk full happened to system
temporary tablespace.
You will probably see following messages in db2diag.log.
================================================================
=====
2010-01-01-19.45.03.278076+480 I45881212A2803 LEVEL: Severe
PID : 471692 TID : 14788 PROC : db2sysc
30
INSTANCE: db2inst1 NODE : 030 DB : SAMPLE
APPHDL : 0-4287 APPID:
132.228.87.19.40456.09122910292
AUTHID : DB2INST1
EDUID : 14788 EDUNAME: db2agntp (SAMPLE) 30
FUNCTION: DB2 UDB, sort/list services, sqlsusda, probe:50
MESSAGE : ZRC=0x850F000C=-2062614516=SQLO_DISK "Disk full."
DIA8312C Disk was full.
DATA #1 : String, 14 bytes
SRT file error
DATA #2 : Hexdump, 296 bytes
0x0700000010605310 : 0000 0003 0000 0004 0700 0001 1DBC CC80
................
0x0700000010605320 : 0000 00AA 0000 0000 0700 0000 104F 7A20
.............Oz
0x0700000010605330 : 0001 0005 2F64 6232 6461 7461 2F64 6232
..../db2data/db2
0x0700000010605340 : 686F 6D65 2F6A 7363 7465 6477 2F6A 7363
home/db2inst1/db2
0x0700000010605350 : 7465 6477 2F4E 4F44 4530 3033 302F 5351
inst1/NODE0030/SQ
0x0700000010605360 : 4C30 3030 3031 2F30 3030 3330 3030 342E
L00001/00030004.
0x0700000010605370 : 5352 5400 0000 0000 0000 0000 0000 0000
SRT.............
<...skipped...>
DATA #3 : signed integer, 4 bytes
1
CALLSTCK:
[0] 0x0900000003734D18 pdLog + 0x88
[1] 0x090000000302B068 pdLog@glue32C + 0xF4
[2] 0x0900000003DB8EBC
sqlsusda__FP8sqeAgentP10SQLS_SLDESP10SQLS_SORTS8SQLZ_RIDi +
0x14C
[3] 0x0900000003578540
sqlswrit__FP8sqeAgentP10SQLS_SLDESP10SQLS_SORTSi + 0x13C
[4] 0x09000000036ABE38
.sqlrsinsr__FP8sqlrr_cbP10sqlri_iudo_fdprpro_clone_1685 + 0x1C
[5] 0x0000000000000000 ?unknown + 0x0
[6] 0xFFFFFFFFFFFFFFFC ?unknown + 0xFFFFFFFF
[7] 0x0900000003693768
.sqlrisr2__FP8sqlrr_cb_fdprpro_clone_211 + 0x7C
[8] 0x0900000003693484
sqldEvalDataPred__FP13SQLD_DFM_WORKPUlP10SQLD_DPRED + 0x1C
[9] 0x0900000003694DA8 sqldReadNorm__FP13SQLD_DFM_WORKl + 0x80
2010-01-01-19.45.03.299315+480 I45884016A2181 LEVEL: Severe
PID : 471692 TID : 14788 PROC : db2sysc
30
INSTANCE: db2inst1 NODE : 030 DB : SAMPLE
APPHDL : 0-4287 APPID:
132.228.87.19.40456.09122910292
AUTHID : DB2INST1
EDUID : 14788 EDUNAME: db2agntp (SAMPLE) 30
FUNCTION: DB2 UDB, sort/list services, sqlsGetSRTChecksum,
probe:20
MESSAGE : ZRC=0x82130001=-2112684031=SQLS_NONSEVERE_PE
"Sort List Services programming error."
DIA8532C An internal processing error has occurred.
DATA #1 : unsigned integer, 8 bytes
0
DATA #2 : Hexdump, 296 bytes
0x0700000010605310 : 0000 0003 0000 0004 0700 0001 1DBC CC80
................
0x0700000010605320 : 0000 00AA 0000 0000 0000 0000 0000 0000
................
0x0700000010605330 : 0001 0005 2F64 6232 6461 7461 2F64 6232
..../db2data/db2
0x0700000010605340 : 686F 6D65 2F6A 7363 7465 6477 2F6A 7363
home/db2inst1/db2
0x0700000010605350 : 7465 6477 2F4E 4F44 4530 3033 302F 5351
inst1/NODE0030/SQ
0x0700000010605360 : 4C30 3030 3031 2F30 3030 3330 3030 342E
L00001/00030004.
0x0700000010605370 : 5352 5400 0000 0000 0000 0000 0000 0000
SRT.............
<...skipped...>
2010-01-01-19.45.03.313226+480 I45886198A583 LEVEL: Error
PID : 471692 TID : 14788 PROC : db2sysc
30
INSTANCE: db2inst1 NODE : 030 DB : SAMPLE
APPHDL : 0-4287 APPID:
132.228.87.19.40456.09122910292
AUTHID : DB2INST1
EDUID : 14788 EDUNAME: db2agntp (SAMPLE) 30
FUNCTION: DB2 UDB, runtime interpreter, sqlricls_complex,
probe:3871
RETCODE : ZRC=0x82130001=-2112684031=SQLS_NONSEVERE_PE
"Sort List Services programming error."
DIA8532C An internal processing error has occurred.
2010-01-01-19.45.03.252545+480 I45886782A583 LEVEL: Error
PID : 336930 TID : 15407 PROC : db2sysc
27
INSTANCE: db2inst1 NODE : 027 DB : SAMPLE
APPHDL : 0-4287 APPID:
132.228.87.19.40456.09122910292
AUTHID : DB2INST1
EDUID : 15407 EDUNAME: db2agntp (SAMPLE) 27
FUNCTION: DB2 UDB, runtime interpreter, sqlricls_complex,
probe:3871
RETCODE : ZRC=0x82130001=-2112684031=SQLS_NONSEVERE_PE
"Sort List Services programming error."
DIA8532C An internal processing error has occurred.
<...skipped...>
2010-01-01-19.46.06.650821+480 I45989276A570 LEVEL: Error
PID : 374364 TID : 16687 PROC : db2sysc
29
INSTANCE: db2inst1 NODE : 029 DB : SAMPLE
APPHDL : 0-4287 APPID:
132.228.87.19.40456.09122910292
AUTHID : DB2INST1
EDUID : 16687 EDUNAME: db2agntp (SAMPLE) 29
FUNCTION: DB2 UDB, base sys utilities, sqleagnt_sigsegvh,
probe:1
MESSAGE : Error in agent servicing application with coor_node:
DATA #1 : Hexdump, 2 bytes
0x07000001C7C09760 : 0000
..
<...skipped...>
2010-01-01-19.47.13.168987+480 E46670502A549 LEVEL: Severe
PID : 409938 TID : 258 PROC : db2wdog
4
INSTANCE: db2inst1 NODE : 004
EDUID : 258 EDUNAME: db2wdog 4
FUNCTION: DB2 UDB, base sys utilities, sqleWatchDog, probe:20
MESSAGE : ADM0503C An unexpected internal processing error has
occurred. ALL
DB2 PROCESSES ASSOCIATED WITH THIS INSTANCE HAVE BEEN
SHUTDOWN.
Diagnostic information has been recorded. Contact IBM
Support for
further assistance.
================================================================
=====
Here are samples for probable stack trace:
<StackTrace>
@102@3@stmmStopSortListMonitorOnFailure__FP8sqeAgentP10SQLS_SLDE
Si
+ 0x460
.sqlrsinsr__FP8sqlrr_cbP10sqlri_iudo_fdprpro_clone_1685 + 0x3C
</StackTrace>
<StackTrace>
@102@3@stmmStopSortListMonitorOnFailure__FP8sqeAgentP10SQLS_SLDE
Si
+ 0x460
sqlsinsr__FP8sqeAgentPcPUcP12sqlri_vectorPP10SQLD_VALUE + 0x44
sqlrsinsr__FP8sqlrr_cbP10sqlri_iudo + 0x44
sqlrisr2__FP8sqlrr_cb + 0xFC
@145@sqli_proc_leaf__FP7SQLI_CBi + 0x290
sqlischf__FP7SQLI_CBUsUi + 0x184
sqliFirstTreeSearch__FP7SQLI_CBP11SQLI_SFGLOB + 0x4C
sqlirdk__FP8sqeAgentP10SQLI_IXPCRP9SQLD_IXCBUlP8SQLD_KEYP12SQLI_
KEYDATAP9sqli_scanPi
- 0x6A0
sqldIndexFetch__FP8SQLD_CCBP8SQLZ_RID + 0x38
sqldIndexFetch__FP8SQLD_CCBP8SQLZ_RID@glueC17 + 0x70
sqldRowFetch__FP8sqeAgentP8SQLD_CCBUlT3PP10SQLD_VALUEP8SQLZ_RIDT
3P12SQLD_ID_LISTP9SQLP_LSN8
+ 0x50
sqlritaSimplePerm__FP8sqlrr_cb - 0x4C8
sqlriExecThread__FP8sqlrr_cbP12sqlri_opparm@glue10AA + 0x30
sqlrihsjn__FP8sqlrr_cb + 0xC
sqlriExecThread__FP8sqlrr_cbP12sqlri_opparm@glue10AA + 0x3C
sqlrihsjn__FP8sqlrr_cb + 0xC
sqlriExecThread__FP8sqlrr_cbP12sqlri_opparm@glue10AA + 0x3C
sqlrihsjn__FP8sqlrr_cb + 0xC
sqlriSectInvoke__FP8sqlrr_cbP12sqlri_opparm - 0x814
sqlrr_dss_router__FP8sqlrr_cb + 0x464
sqlrr_subagent_router__FP8sqeAgentP12SQLE_DB2RA_T + 0xF68
sqleSubRequestRouter__FP8sqeAgentPUiT2 + 0x7E8
sqleProcessSubRequest__FP8sqeAgent + 0x120
RunEDU__8sqeAgentFv + 0x300
EDUDriver__9sqzEDUObjFv + 0x94
sqloEDUEntry + 0x57C
</StackTrace> |
****************************************************************
* USERS AFFECTED: *
* ALL *
****************************************************************
* PROBLEM DESCRIPTION: *
* Sorting might crashed in stmmStopSortListMonitorOnFailure() *
* *
* called by sqlsinsr() after disk full happened to system *
* *
* temporary tablespace. *
* *
* *
* *
* You will probably see following messages in db2diag.log. *
* *
* ============================================================ *
* == *
* ===== *
* *
* 2010-01-01-19.45.03.278076+480 I45881212A2803 LEVEL: *
* Severe *
* PID : 471692 TID : 14788 PROC : *
* db2sysc *
* 30 *
* *
* INSTANCE: db2inst1 NODE : 030 DB : *
* SAMPLE *
* APPHDL : 0-4287 APPID: *
* *
* 132.228.87.19.40456.09122910292 *
* *
* AUTHID : DB2INST1 *
* *
* EDUID : 14788 EDUNAME: db2agntp (SAMPLE) 30 *
* *
* FUNCTION: DB2 UDB, sort/list services, sqlsusda, probe:50 *
* *
* MESSAGE : ZRC=0x850F000C=-2062614516=SQLO_DISK "Disk full." *
* *
* DIA8312C Disk was full. *
* *
* DATA #1 : String, 14 bytes *
* *
* SRT file error *
* *
* DATA #2 : Hexdump, 296 bytes *
* *
* 0x0700000010605310 : 0000 0003 0000 0004 0700 0001 1DBC CC80 *
* *
* ................ *
* *
* 0x0700000010605320 : 0000 00AA 0000 0000 0700 0000 104F 7A20 *
* *
* .............Oz *
* *
* 0x0700000010605330 : 0001 0005 2F64 6232 6461 7461 2F64 6232 *
* *
* ..../db2data/db2 *
* *
* 0x0700000010605340 : 686F 6D65 2F6A 7363 7465 6477 2F6A 7363 *
* *
* home/db2inst1/db2 *
* *
* 0x0700000010605350 : 7465 6477 2F4E 4F44 4530 3033 302F 5351 *
* *
* inst1/NODE0030/SQ *
* *
* 0x0700000010605360 : 4C30 3030 3031 2F30 3030 3330 3030 342E *
* *
* L00001/00030004. *
* *
* 0x0700000010605370 : 5352 5400 0000 0000 0000 0000 0000 0000 *
* *
* SRT............. *
* *
* <...skipped...> *
* *
* DATA #3 : signed integer, 4 bytes *
* *
* 1 *
* *
* CALLSTCK: *
* *
* [0] 0x0900000003734D18 pdLog + 0x88 *
* *
* [1] 0x090000000302B068 pdLog@glue32C + 0xF4 *
* *
* [2] 0x0900000003DB8EBC *
* *
* sqlsusda__FP8sqeAgentP10SQLS_SLDESP10SQLS_SORTS8SQLZ_RIDi + *
* *
* 0x14C *
* *
* [3] 0x0900000003578540 *
* *
* sqlswrit__FP8sqeAgentP10SQLS_SLDESP10SQLS_SORTSi + 0x13C *
* *
* [4] 0x09000000036ABE38 *
* *
* .sqlrsinsr__FP8sqlrr_cbP10sqlri_iudo_fdprpro_clone_1685 + *
* 0x1C *
* [5] 0x0000000000000000 ?unknown + 0x0 *
* *
* [6] 0xFFFFFFFFFFFFFFFC ?unknown + 0xFFFFFFFF *
* *
* [7] 0x0900000003693768 *
* *
* .sqlrisr2__FP8sqlrr_cb_fdprpro_clone_211 + 0x7C *
* *
* [8] 0x0900000003693484 *
* *
* sqldEvalDataPred__FP13SQLD_DFM_WORKPUlP10SQLD_DPRED + 0x1C *
* *
* [9] 0x0900000003694DA8 sqldReadNorm__FP13SQLD_DFM_WORKl + *
* 0x80 *
* *
* *
* 2010-01-01-19.45.03.299315+480 I45884016A2181 LEVEL: *
* Severe *
* PID : 471692 TID : 14788 PROC : *
* db2sysc *
* 30 *
* *
* INSTANCE: db2inst1 NODE : 030 DB : *
* SAMPLE *
* APPHDL : 0-4287 APPID: *
* *
* 132.228.87.19.40456.09122910292 *
* *
* AUTHID : DB2INST1 *
* *
* EDUID : 14788 EDUNAME: db2agntp (SAMPLE) 30 *
* *
* FUNCTION: DB2 UDB, sort/list services, sqlsGetSRTChecksum, *
* *
* probe:20 *
* *
* MESSAGE : ZRC=0x82130001=-2112684031=SQLS_NONSEVERE_PE *
* *
* "Sort List Services programming error." *
* *
* DIA8532C An internal processing error has *
* occurred. *
* DATA #1 : unsigned integer, 8 bytes *
* *
* 0 *
* *
* DATA #2 : Hexdump, 296 bytes *
* *
* 0x0700000010605310 : 0000 0003 0000 0004 0700 0001 1DBC CC80 *
* *
* ................ *
* *
* 0x0700000010605320 : 0000 00AA 0000 0000 0000 0000 0000 0000 *
* *
* ................ *
* *
* 0x0700000010605330 : 0001 0005 2F64 6232 6461 7461 2F64 6232 *
* *
* ..../db2data/db2 *
* *
* 0x0700000010605340 : 686F 6D65 2F6A 7363 7465 6477 2F6A 7363 *
* *
* home/db2inst1/db2 *
* *
* 0x0700000010605350 : 7465 6477 2F4E 4F44 4530 3033 302F 5351 *
* *
* inst1/NODE0030/SQ *
* *
* 0x0700000010605360 : 4C30 3030 3031 2F30 3030 3330 3030 342E *
* *
* L00001/00030004. *
* *
* 0x0700000010605370 : 5352 5400 0000 0000 0000 0000 0000 0000 *
* *
* SRT............. *
* *
* <...skipped...> *
* *
* *
* *
* 2010-01-01-19.45.03.313226+480 I45886198A583 LEVEL: *
* Error *
* PID : 471692 TID : 14788 PROC : *
* db2sysc *
* 30 *
* *
* INSTANCE: db2inst1 NODE : 030 DB : *
* SAMPLE *
* APPHDL : 0-4287 APPID: *
* *
* 132.228.87.19.40456.09122910292 *
* *
* AUTHID : DB2INST1 *
* *
* EDUID : 14788 EDUNAME: db2agntp (SAMPLE) 30 *
* *
* FUNCTION: DB2 UDB, runtime interpreter, sqlricls_complex, *
* *
* probe:3871 *
* *
* RETCODE : ZRC=0x82130001=-2112684031=SQLS_NONSEVERE_PE *
* *
* "Sort List Services programming error." *
* *
* DIA8532C An internal processing error has *
* occurred. *
* *
* *
* 2010-01-01-19.45.03.252545+480 I45886782A583 LEVEL: *
* Error *
* PID : 336930 TID : 15407 PROC : *
* db2sysc *
* 27 *
* *
* INSTANCE: db2inst1 NODE : 027 DB : *
* SAMPLE *
* APPHDL : 0-4287 APPID: *
* *
* 132.228.87.19.40456.09122910292 *
* *
* AUTHID : DB2INST1 *
* *
* EDUID : 15407 EDUNAME: db2agntp (SAMPLE) 27 *
* *
* FUNCTION: DB2 UDB, runtime interpreter, sqlricls_complex, *
* *
* probe:3871 *
* *
* RETCODE : ZRC=0x82130001=-2112684031=SQLS_NONSEVERE_PE *
* *
* "Sort List Services programming error." *
* *
* DIA8532C An internal processing error has *
* occurred. *
* *
* *
* <...skipped...> *
* *
* *
* *
* 2010-01-01-19.46.06.650821+480 I45989276A570 LEVEL: *
* Error *
* PID : 374364 TID : 16687 PROC : *
* db2sysc *
* 29 *
* *
* INSTANCE: db2inst1 NODE : 029 DB : *
* SAMPLE *
* APPHDL : 0-4287 APPID: *
* *
* 132.228.87.19.40456.09122910292 *
* *
* AUTHID : DB2INST1 *
* *
* EDUID : 16687 EDUNAME: db2agntp (SAMPLE) 29 *
* *
* FUNCTION: DB2 UDB, base sys utilities, sqleagnt_sigsegvh, *
* *
* probe:1 *
* *
* MESSAGE : Error in agent servicing application with *
* coor_node: *
* DATA #1 : Hexdump, 2 bytes *
* *
* 0x07000001C7C09760 : 0000 *
* *
* .. *
* *
* *
* *
* <...skipped...> *
* *
* *
* *
* 2010-01-01-19.47.13.168987+480 E46670502A549 LEVEL: *
* Severe *
* PID : 409938 TID : 258 PROC : *
* db2wdog *
* 4 *
* *
* INSTANCE: db2inst1 NODE : 004 *
* *
* EDUID : 258 EDUNAME: db2wdog 4 *
* *
* FUNCTION: DB2 UDB, base sys utilities, sqleWatchDog, *
* probe:20 *
* MESSAGE : ADM0503C An unexpected internal processing error *
* has *
* occurred. ALL *
* *
* DB2 PROCESSES ASSOCIATED WITH THIS INSTANCE HAVE *
* BEEN *
* SHUTDOWN. *
* *
* Diagnostic information has been recorded. Contact *
* IBM *
* Support for *
* *
* further assistance. *
* *
* ============================================================ *
* == *
* ===== *
* *
* *
* *
* *
* *
* *
* *
* Here are samples for probable stack trace: *
* *
* *
* *
* <StackTrace> *
* *
* @102@3@stmmStopSortListMonitorOnFailure__FP8sqeAgentP10SQLS_ *
* SL *
* Si *
* *
* + 0x460 *
* *
* .sqlrsinsr__FP8sqlrr_cbP10sqlri_iudo_fdprpro_clone_1685 + *
* 0x3C *
* </StackTrace> *
* *
* *
* *
* <StackTrace> *
* *
* @102@3@stmmStopSortListMonitorOnFailure__FP8sqeAgentP10SQLS_ *
* SL *
* Si *
* *
* + 0x460 *
* *
* sqlsinsr__FP8sqeAgentPcPUcP12sqlri_vectorPP10SQLD_VALUE + *
* 0x44 *
* sqlrsinsr__FP8sqlrr_cbP10sqlri_iudo + 0x44 *
* *
* sqlrisr2__FP8sqlrr_cb + 0xFC *
* *
* @145@sqli_proc_leaf__FP7SQLI_CBi + 0x290 *
* *
* sqlischf__FP7SQLI_CBUsUi + 0x184 *
* *
* sqliFirstTreeSearch__FP7SQLI_CBP11SQLI_SFGLOB + 0x4C *
* *
* sqlirdk__FP8sqeAgentP10SQLI_IXPCRP9SQLD_IXCBUlP8SQLD_KEYP12S *
* QL *
* KEYDATAP9sqli_scanPi *
* *
* - 0x6A0 *
* *
* sqldIndexFetch__FP8SQLD_CCBP8SQLZ_RID + 0x38 *
* *
* sqldIndexFetch__FP8SQLD_CCBP8SQLZ_RID@glueC17 + 0x70 *
* *
* sqldRowFetch__FP8sqeAgentP8SQLD_CCBUlT3PP10SQLD_VALUEP8SQLZ_ *
* RI *
* 3P12SQLD_ID_LISTP9SQLP_LSN8 *
* *
* + 0x50 *
* *
* sqlritaSimplePerm__FP8sqlrr_cb - 0x4C8 *
* *
* sqlriExecThread__FP8sqlrr_cbP12sqlri_opparm@glue10AA + 0x30 *
* *
* sqlrihsjn__FP8sqlrr_cb + 0xC *
* *
* sqlriExecThread__FP8sqlrr_cbP12sqlri_opparm@glue10AA + 0x3C *
* *
* sqlrihsjn__FP8sqlrr_cb + 0xC *
* *
* sqlriExecThread__FP8sqlrr_cbP12sqlri_opparm@glue10AA + 0x3C *
* *
* sqlrihsjn__FP8sqlrr_cb + 0xC *
* *
* sqlriSectInvoke__FP8sqlrr_cbP12sqlri_opparm - 0x814 *
* *
* sqlrr_dss_router__FP8sqlrr_cb + 0x464 *
* *
* sqlrr_subagent_router__FP8sqeAgentP12SQLE_DB2RA_T + 0xF68 *
* *
* sqleSubRequestRouter__FP8sqeAgentPUiT2 + 0x7E8 *
* *
* sqleProcessSubRequest__FP8sqeAgent + 0x120 *
* *
* RunEDU__8sqeAgentFv + 0x300 *
* *
* EDUDriver__9sqzEDUObjFv + 0x94 *
* *
* sqloEDUEntry + 0x57C *
* *
* </StackTrace> *
****************************************************************
* RECOMMENDATION: *
* Upgrade to DB2 V91fp11 *
**************************************************************** |
