Troubleshooting
Problem
For cases where DMPJVM or WRKJVMJOB/GENJVMDMP is not be functioning properly due to the current state of the JVM, an alternative that can provide the thread stack information is the Processinfo Advanced Analysis Macro.
Environment
IBM i OS
Resolving The Problem
For cases where DMPJVM or WRKJVMJOB/GENJVMDMP is not functioning properly due to the state of the JVM, an alternative that can provide the thread stack information is the Processinfo Advanced Analysis Macro. To use the Processinfo macro, do the following:
DISPLAY/ALTER/DUMP 07/06/05 10:25:51 PAGE
Running macro: PROCESSINFO -NAMES 390739
There are 6202 tasks in the system. The processes are...
====================================================================================================
Process: BILLG51 QEJBSVR 390739 Task number.....................864
TDE......................B00930000C39D000 Process priority................0xB0
Resident PCB Ptr.........C000010B875E6580 CPU used in secondary threads...1134.436 seconds
NonResident PCB Ptr......FC58EA09EF000100 Initiated threads...............7685
Active threads..................88
Parent non-res PCB Ptr...F4038D60FF000100 Temp Aux storage used...........69353472 bytes
Chain available TCSs.....0000000000000000 Available TCSs found............0
Queue Space Ptr..........334B8608CB000000 Handle Mapper Ptr...............E3E6CEDC3A000020
Chain active Res LWPCB...B00C700004183BC0 Signals process area Ptr........F66AED492C208100
PASE process object Ptr.........0000000000000000
Current process state....0x4020 = Problem Phase
Previous states..........0x4010 = Initialization Phase
0x4000 = Process operational
0x3000 = Initiate in progress
0x2000 = PCS available
----------------------------------------------------------------------------------------------------
Thread Id..................0000000000000069 Task name...................MITHREAD
TDE.......................B00930000C39D000 Thread priority delta.......0x06
Resident LWPCB Ptr........B00930000C39DBC0 CPU used (by the thread)....23.302 seconds
Non-resident LWPCB Ptr....ED80E806CD000450 Last wait object Ptr........FFFFFFFFFFFFFFFF
Next resident LWPCB Ptr...0000000000000000 Wait object description.....JDE-JAVA Destroy Wait
Prev resident LWPCB Ptr...0000000000000000 Kernel flag.................0x00 (User Mode)
Hold prc/thd flight rec...F66AED492C402C80 Pend. intrpt mask (pista)...0x0000
TIA TDE Ptr.................0000000000000000
Hold process/thread flight recorder information:
*** No active hold process entries ***
*** No active hold thread entries ***
Pending interrupt counts:
*** No pending interrupts ***
Thread object Ptr.........D84490C72909B800 Implicit handle.............0x00000000
Pupil Ptr.................E7605A6BBF094000 EM thread area Ptr..........ED80E806CD002000
Primary thread LS Ptr.....E3B7408946002580 Signals thread area Ptr.....ED80E806CD0008C0
Secondary thread LS Ptr...F8C8109C47001100 PASE thread object Ptr......0000000000000000
Current thread state......0x4012 = Running user
Previous states...........0x4012 = Running user
0x4011 = Running SLIC
0x2001 = Thread created
0x1001 = Creating thread
0x9001 = Destroy in Progress
*** This thread is in a long wait receive ***
RMPR thread area Ptr.....B00930000C39DE80 Receiver Ptr.............ED80E806CDFFF0A0
Wait status flags........0x00040001 Wait environment.........0x00 (OS/400)
- (MI wait) Java wait
- (Internal) In an MI wait
Wait object Ptr..........C65F1ADBB80570E0 Time to wait.............0xFFFFFFFFFFFFFFFF
Interrupt level..........20 MPL stay option..........NO-STAY
ISF=ED80E806CDFFEF60 NIA=FFFFFFFFC18E6E40 module RmprLongWaitRcvCounter+0x420
ISF=ED80E806CDFFF060 NIA=FFFFFFFFC6DFF610 module JavaThreadManager+0x8F0
ISF=ED80E806CDFFF180 NIA=FFFFFFFFC5B23C00 module JavaVM+0x40D0
DISPLAY/ALTER/DUMP 07/06/05 10:25:51
ISF=ED80E806CDFFF3C0 NIA=FFFFFFFFC6BE9058 module JavaDestroyJVM+0x188
ISF=ED80E806CDFFF4C0 NIA=FFFFFFFFFE91C2D4 module #cfmir+0xEC
ISF=ED80E806CDFFF580 NIA=FFFFFFFFFF0508F8 module cfscv0a+0x130
ISF=FC9CB1AB63FFEE20 NIA=29FE185A8101B074 srvpgm QSYS/QJVAJNI-QJVAJNI:DestroyJavaVM+0x1F4 Stmt# 40
ISF=FC9CB1AB63FFEFA0 NIA=2A1332C25807BD84 srvpgm QEJBAS51/QEJBCMN-WSJVM:DestroyJavaVM__7JavaVM_Fv+0xA4 Stmt# 1267
ISF=FC9CB1AB63FFF0A0 NIA=2A1332C25807B910 srvpgm QEJBAS51/QEJBCMN-WSJVM:destroyJVM__5WsJVMFi+0x3C0 Stmt# 2348
ISF=FC9CB1AB63FFF220 NIA=199F06CB69036F30 srvpgm QEJBAS51/QEJBPROC-SSLAUNCHER:SsLaunchApplicationServer__FiPPc+0xF70 Stmt# 3353
ISF=FC9CB1AB63FFF4A0 NIA=176A681D9A028810 progrm QEJBAS51/QEJBSTRSVR-SSSTRSVR2:main+0x53E0 Stmt# 5003
ISF=FC9CB1AB63FFFD40 NIA=176A681D9A00EC78 progrm QEJBAS51/QEJBSTRSVR-SSSTRSVR2:_CXX_PEP+0x2E8 Stmt# 5038
ISF=FC9CB1AB63FFFEA0 NIA=FFFFFFFFFFFF81D0 module #cfcblat+0x1D0
ISF=ED80E806CDFFF5E0 NIA=FFFFFFFFFEA44838 module AiUpcallPortalUser+0xC8
ISF=D50ECCD918FFF7E0 NIA=0A76666BAA004954 progrm QSYS/QCMD+0x33D4 Inst# 0x1B8
ISF=D50ECCD918FFFEC0 NIA=FFFFFFFFFEB51278 module #excctrp+0x0
This frame is trapped for Callee Cleanup......
Its true NIA=FFFFFFFFFFFF81D0 module #cfcblat+0x1D0
ISF=ED80E806CDFFF820 NIA=FFFFFFFFFEA44638 module AiUpcallPortalMach+0x58
ISF=ED80E806CDFFFA60 NIA=FFFFFFFFCC3C2980 module pminitiateprocess+0x680
ISF=ED80E806CDFFFF20 NIA=0000000000000000 Not valid instruction address
Stack unwind complete
----------------------------------------------------------------------------------------------------
Thread Id..................0000000000001E6B Task name...................MSTHREAD
TDE.......................B00C700004183000 Thread priority delta.......0x06
Resident LWPCB Ptr........B00C700004183BC0 CPU used (by the thread)....0.000 seconds
Non-resident LWPCB Ptr....ECCE7A8042000450 Last wait object Ptr........D4ED2E28D2000580
Next resident LWPCB Ptr...B00930000C811BC0 Wait object description.....JUW-JAVA User Wait
Prev resident LWPCB Ptr...0000000000000000 Kernel flag.................0x00 (User Mode)
Hold prc/thd flight rec...0000000000000000 Pend. intrpt mask (pista)...0x0000
TIA TDE Ptr.................0000000000000000
Hold process/thread flight recorder information:
*** No hold process/thread flight recorder ***
Pending interrupt counts:
*** No pending interrupts ***
Thread object Ptr.........D84490C729297400 Implicit handle.............0x00000000
Pupil Ptr.................E7605A6BBF076800 EM thread area Ptr..........ECCE7A8042002000
Primary thread LS Ptr.....E3B740894602CA70 Signals thread area Ptr.....ECCE7A80420008C0
Secondary thread LS Ptr...F2D30A2DDC039CD0 PASE thread object Ptr......0000000000000000
Current thread state......0x4012 = Running user
Previous states...........0x4011 = Running SLIC
0x2001 = Thread created
0x1001 = Creating thread
0x9001 = Destroy in Progress
*** This thread is in a long wait receive ***
RMPR thread area Ptr.....B00C700004183E80 Receiver Ptr.............ECCE7A8042FFECF8
Wait status flags........0x00040001 Wait environment.........0x00 (OS/400)
- (MI wait) Java wait
- (Internal) In an MI wait
Wait object Ptr..........F7DCE039CDAB7260 Time to wait.............0x00000055D4A80000
Interrupt level..........20 MPL stay option..........NO-STAY
ISF=ECCE7A8042FFEBA0 NIA=FFFFFFFFC18E6E40 module RmprLongWaitRcvCounter+0x420
ISF=ECCE7A8042FFECA0 NIA=FFFFFFFFC553BCF4 module JavaInterruptManager+0x374
ISF=ECCE7A8042FFEE40 NIA=FFFFFFFFC5F42260 module java_lang_Object__1_4+0xE60
ISF=ECCE7A8042FFF020 NIA=FFFFFFFFFE9F4C2C module JavaDeToSlicNativeMethodSCV+0x12C
ISF=ECCE7A8042FFF0C0 NIA=FFFFFFFFFF0502F0 module cfscv23+0x140
ISF=FBEA4424D8FFF7C0 NIA=CB1D0C1D5D13AD64 Address could not be translated to SLIC or MI program
DISPLAY/ALTER/DUMP 07/06/05 10:25:51
Java Method: com/ibm/ws/util/BoundedBuffer.poll(J)Ljava/lang/Object;
ISF=FBEA4424D8FFF8E0 NIA=CB1D0C1D5D13CC2C Address could not be translated to SLIC or MI program
Java Method: com/ibm/ws/util/ThreadPool.getTask()Ljava/lang/Runnable;
ISF=FBEA4424D8FFFA00 NIA=CB1D0C1D5D13E494 Address could not be translated to SLIC or MI program
Java Method: com/ibm/ws/util/ThreadPool$Worker.run()V
.
.
<Purposely deleted records for brevity>
.
.
Stack unwind complete
===============================================================
Total number of processes information provided for...1
Total number of threads information provided for.....88
Total number of tasks in the system..................6202
*** End of processinfo macro output ***
DISPLAY/ALTER/DUMP
****** END OF DUMP ******
The PROCESSINFO macro also provides helpful information such as the CPU used for each thread, the CPU used for the entire process, and the current wait object description for each thread. The callstack information is more complete than running the DMPJVM or WRKJVMJOB/GENJVMDMP command because it also shows SLIC programs.
|
1. |
Note the Job Name/User/Number. Any one of these three attributes can be used for the Processinfo parameter. For this example, it is BILLG51/QEJBSVR/390739. |
| 2. | Sign on SST. |
| 3. | Select Option 1, Start Service Tool, and press the Enter key. |
| 4. | Select Option 4, Display/Alter/Dump, and press the Enter key. |
| 5. | Select Option 2, Dump to Printer, and press the Enter key. |
| 6. | Select Option 2, License Internal Code Data, and press the Enter key. |
| 7. | Select Option 14, Advanced Analysis Macros, and press the Enter key. |
| 8. | Select Option 1 on Processinfo, and press the Enter key. |
| 9. | In the Options screen, type -names <Job Name, User, Or Number>. In the following example, number 390739 was used. |
| 10. | Press the Enter key two times to dump. |
| 11. | After receiving the message at the bottom of the screen indicating Dump Completed Normally, exit the Service Tools. |
| 12. | View the spooled file generated. |
DISPLAY/ALTER/DUMP 07/06/05 10:25:51 PAGE
Running macro: PROCESSINFO -NAMES 390739
There are 6202 tasks in the system. The processes are...
====================================================================================================
Process: BILLG51 QEJBSVR 390739 Task number.....................864
TDE......................B00930000C39D000 Process priority................0xB0
Resident PCB Ptr.........C000010B875E6580 CPU used in secondary threads...1134.436 seconds
NonResident PCB Ptr......FC58EA09EF000100 Initiated threads...............7685
Active threads..................88
Parent non-res PCB Ptr...F4038D60FF000100 Temp Aux storage used...........69353472 bytes
Chain available TCSs.....0000000000000000 Available TCSs found............0
Queue Space Ptr..........334B8608CB000000 Handle Mapper Ptr...............E3E6CEDC3A000020
Chain active Res LWPCB...B00C700004183BC0 Signals process area Ptr........F66AED492C208100
PASE process object Ptr.........0000000000000000
Current process state....0x4020 = Problem Phase
Previous states..........0x4010 = Initialization Phase
0x4000 = Process operational
0x3000 = Initiate in progress
0x2000 = PCS available
----------------------------------------------------------------------------------------------------
Thread Id..................0000000000000069 Task name...................MITHREAD
TDE.......................B00930000C39D000 Thread priority delta.......0x06
Resident LWPCB Ptr........B00930000C39DBC0 CPU used (by the thread)....23.302 seconds
Non-resident LWPCB Ptr....ED80E806CD000450 Last wait object Ptr........FFFFFFFFFFFFFFFF
Next resident LWPCB Ptr...0000000000000000 Wait object description.....JDE-JAVA Destroy Wait
Prev resident LWPCB Ptr...0000000000000000 Kernel flag.................0x00 (User Mode)
Hold prc/thd flight rec...F66AED492C402C80 Pend. intrpt mask (pista)...0x0000
TIA TDE Ptr.................0000000000000000
Hold process/thread flight recorder information:
*** No active hold process entries ***
*** No active hold thread entries ***
Pending interrupt counts:
*** No pending interrupts ***
Thread object Ptr.........D84490C72909B800 Implicit handle.............0x00000000
Pupil Ptr.................E7605A6BBF094000 EM thread area Ptr..........ED80E806CD002000
Primary thread LS Ptr.....E3B7408946002580 Signals thread area Ptr.....ED80E806CD0008C0
Secondary thread LS Ptr...F8C8109C47001100 PASE thread object Ptr......0000000000000000
Current thread state......0x4012 = Running user
Previous states...........0x4012 = Running user
0x4011 = Running SLIC
0x2001 = Thread created
0x1001 = Creating thread
0x9001 = Destroy in Progress
*** This thread is in a long wait receive ***
RMPR thread area Ptr.....B00930000C39DE80 Receiver Ptr.............ED80E806CDFFF0A0
Wait status flags........0x00040001 Wait environment.........0x00 (OS/400)
- (MI wait) Java wait
- (Internal) In an MI wait
Wait object Ptr..........C65F1ADBB80570E0 Time to wait.............0xFFFFFFFFFFFFFFFF
Interrupt level..........20 MPL stay option..........NO-STAY
ISF=ED80E806CDFFEF60 NIA=FFFFFFFFC18E6E40 module RmprLongWaitRcvCounter+0x420
ISF=ED80E806CDFFF060 NIA=FFFFFFFFC6DFF610 module JavaThreadManager+0x8F0
ISF=ED80E806CDFFF180 NIA=FFFFFFFFC5B23C00 module JavaVM+0x40D0
DISPLAY/ALTER/DUMP 07/06/05 10:25:51
ISF=ED80E806CDFFF3C0 NIA=FFFFFFFFC6BE9058 module JavaDestroyJVM+0x188
ISF=ED80E806CDFFF4C0 NIA=FFFFFFFFFE91C2D4 module #cfmir+0xEC
ISF=ED80E806CDFFF580 NIA=FFFFFFFFFF0508F8 module cfscv0a+0x130
ISF=FC9CB1AB63FFEE20 NIA=29FE185A8101B074 srvpgm QSYS/QJVAJNI-QJVAJNI:DestroyJavaVM+0x1F4 Stmt# 40
ISF=FC9CB1AB63FFEFA0 NIA=2A1332C25807BD84 srvpgm QEJBAS51/QEJBCMN-WSJVM:DestroyJavaVM__7JavaVM_Fv+0xA4 Stmt# 1267
ISF=FC9CB1AB63FFF0A0 NIA=2A1332C25807B910 srvpgm QEJBAS51/QEJBCMN-WSJVM:destroyJVM__5WsJVMFi+0x3C0 Stmt# 2348
ISF=FC9CB1AB63FFF220 NIA=199F06CB69036F30 srvpgm QEJBAS51/QEJBPROC-SSLAUNCHER:SsLaunchApplicationServer__FiPPc+0xF70 Stmt# 3353
ISF=FC9CB1AB63FFF4A0 NIA=176A681D9A028810 progrm QEJBAS51/QEJBSTRSVR-SSSTRSVR2:main+0x53E0 Stmt# 5003
ISF=FC9CB1AB63FFFD40 NIA=176A681D9A00EC78 progrm QEJBAS51/QEJBSTRSVR-SSSTRSVR2:_CXX_PEP+0x2E8 Stmt# 5038
ISF=FC9CB1AB63FFFEA0 NIA=FFFFFFFFFFFF81D0 module #cfcblat+0x1D0
ISF=ED80E806CDFFF5E0 NIA=FFFFFFFFFEA44838 module AiUpcallPortalUser+0xC8
ISF=D50ECCD918FFF7E0 NIA=0A76666BAA004954 progrm QSYS/QCMD+0x33D4 Inst# 0x1B8
ISF=D50ECCD918FFFEC0 NIA=FFFFFFFFFEB51278 module #excctrp+0x0
This frame is trapped for Callee Cleanup......
Its true NIA=FFFFFFFFFFFF81D0 module #cfcblat+0x1D0
ISF=ED80E806CDFFF820 NIA=FFFFFFFFFEA44638 module AiUpcallPortalMach+0x58
ISF=ED80E806CDFFFA60 NIA=FFFFFFFFCC3C2980 module pminitiateprocess+0x680
ISF=ED80E806CDFFFF20 NIA=0000000000000000 Not valid instruction address
Stack unwind complete
----------------------------------------------------------------------------------------------------
Thread Id..................0000000000001E6B Task name...................MSTHREAD
TDE.......................B00C700004183000 Thread priority delta.......0x06
Resident LWPCB Ptr........B00C700004183BC0 CPU used (by the thread)....0.000 seconds
Non-resident LWPCB Ptr....ECCE7A8042000450 Last wait object Ptr........D4ED2E28D2000580
Next resident LWPCB Ptr...B00930000C811BC0 Wait object description.....JUW-JAVA User Wait
Prev resident LWPCB Ptr...0000000000000000 Kernel flag.................0x00 (User Mode)
Hold prc/thd flight rec...0000000000000000 Pend. intrpt mask (pista)...0x0000
TIA TDE Ptr.................0000000000000000
Hold process/thread flight recorder information:
*** No hold process/thread flight recorder ***
Pending interrupt counts:
*** No pending interrupts ***
Thread object Ptr.........D84490C729297400 Implicit handle.............0x00000000
Pupil Ptr.................E7605A6BBF076800 EM thread area Ptr..........ECCE7A8042002000
Primary thread LS Ptr.....E3B740894602CA70 Signals thread area Ptr.....ECCE7A80420008C0
Secondary thread LS Ptr...F2D30A2DDC039CD0 PASE thread object Ptr......0000000000000000
Current thread state......0x4012 = Running user
Previous states...........0x4011 = Running SLIC
0x2001 = Thread created
0x1001 = Creating thread
0x9001 = Destroy in Progress
*** This thread is in a long wait receive ***
RMPR thread area Ptr.....B00C700004183E80 Receiver Ptr.............ECCE7A8042FFECF8
Wait status flags........0x00040001 Wait environment.........0x00 (OS/400)
- (MI wait) Java wait
- (Internal) In an MI wait
Wait object Ptr..........F7DCE039CDAB7260 Time to wait.............0x00000055D4A80000
Interrupt level..........20 MPL stay option..........NO-STAY
ISF=ECCE7A8042FFEBA0 NIA=FFFFFFFFC18E6E40 module RmprLongWaitRcvCounter+0x420
ISF=ECCE7A8042FFECA0 NIA=FFFFFFFFC553BCF4 module JavaInterruptManager+0x374
ISF=ECCE7A8042FFEE40 NIA=FFFFFFFFC5F42260 module java_lang_Object__1_4+0xE60
ISF=ECCE7A8042FFF020 NIA=FFFFFFFFFE9F4C2C module JavaDeToSlicNativeMethodSCV+0x12C
ISF=ECCE7A8042FFF0C0 NIA=FFFFFFFFFF0502F0 module cfscv23+0x140
ISF=FBEA4424D8FFF7C0 NIA=CB1D0C1D5D13AD64 Address could not be translated to SLIC or MI program
DISPLAY/ALTER/DUMP 07/06/05 10:25:51
Java Method: com/ibm/ws/util/BoundedBuffer.poll(J)Ljava/lang/Object;
ISF=FBEA4424D8FFF8E0 NIA=CB1D0C1D5D13CC2C Address could not be translated to SLIC or MI program
Java Method: com/ibm/ws/util/ThreadPool.getTask()Ljava/lang/Runnable;
ISF=FBEA4424D8FFFA00 NIA=CB1D0C1D5D13E494 Address could not be translated to SLIC or MI program
Java Method: com/ibm/ws/util/ThreadPool$Worker.run()V
.
.
<Purposely deleted records for brevity>
.
.
Stack unwind complete
===============================================================
Total number of processes information provided for...1
Total number of threads information provided for.....88
Total number of tasks in the system..................6202
*** End of processinfo macro output ***
DISPLAY/ALTER/DUMP
****** END OF DUMP ******
The PROCESSINFO macro also provides helpful information such as the CPU used for each thread, the CPU used for the entire process, and the current wait object description for each thread. The callstack information is more complete than running the DMPJVM or WRKJVMJOB/GENJVMDMP command because it also shows SLIC programs.
[{"Type":"MASTER","Line of Business":{"code":"LOB68","label":"Power HW"},"Business Unit":{"code":"BU070","label":"IBM Infrastructure"},"Product":{"code":"SWG60","label":"IBM i"},"ARM Category":[{"code":"a8m0z0000000CH5AAM","label":"Java Development Kit"}],"ARM Case Number":"","Platform":[{"code":"PF012","label":"IBM i"}],"Version":"All Versions"}]
Historical Number
383507103
Was this topic helpful?
Document Information
Modified date:
21 April 2025
UID
nas8N1000038