Reports generated with the -t flag
The report generated with the -t flag includes the data shown in the default report, and also includes a detailed report on thread status that includes the amount of time the thread was in application and system call mode, what system calls the thread made, processor affinity, the number of times the thread was dispatched, and to which CPUs it was dispatched.
The report also includes dispatch wait time and details
of interrupts:
...(lines omitted)...
--------------------------------------------------------------------------------
Report for Thread Id: 48841 (hex bec9) Pid: 143984 (hex 23270)
Process Name: oracle
---------------------
Total Application Time (ms): 70.324465
Total System Call Time (ms): 53.014910
Total Hypervisor Call Time (ms): 0.077000
Thread System Call Summary
--------------------------
Count Total Time Avg Time Min Time Max Time SVC (Address)
(msec) (msec) (msec) (msec)
======== =========== =========== =========== =========== ================
69 34.0819 0.4939 0.1666 1.2762 kwrite(169ff8)
77 12.0026 0.1559 0.0474 0.2889 kread(16a01c)
510 4.9743 0.0098 0.0029 0.0467 times(f1e14)
73 1.2045 0.0165 0.0105 0.0306 select(1d1704)
68 0.6000 0.0088 0.0023 0.0445 lseek(16a094)
12 0.1516 0.0126 0.0071 0.0241 getrusage(f1be0)
No Errors Returned by System Calls
Pending System Calls Summary
----------------------------
Accumulated SVC (Address)
Time (msec)
============ ==========================
0.1420 kread(16a01c)
Thread Hypervisor Calls Summary
--------------------------------
Count Total Time % sys Avg Time Min Time Max Time HCALL (Address)
(msec) time (msec) (msec) (msec)
======== =========== ====== ======== ======== ======== =================
4 0.0077 0.00% 0.0019 0.0014 0.0025 H_XIRR(3ada19c)
Pending Hypervisor Calls Summary
--------------------------------
Accumulated HCALL (Address)
Time (msec)
============ =========================
0.0066 H_XIRR(3ada19c)
processor affinity: 0.583333
Dispatch Histogram for thread (CPUid : times_dispatched).
CPU 0 : 23
CPU 1 : 23
CPU 2 : 9
CPU 3 : 9
CPU 4 : 8
CPU 5 : 14
CPU 6 : 17
CPU 7 : 19
CPU 8 : 1
CPU 9 : 4
CPU 10 : 1
CPU 11 : 4
total number of dispatches: 131
total number of redispatches due to interupts being disabled: 1
avg. dispatch wait time (ms): 8.273515
Data on Interrupts that Occurred while Thread was Running
Type of Interrupt Count
=============================== ============================
Data Access Page Faults (DSI): 115
Instr. Fetch Page Faults (ISI): 0
Align. Error Interrupts: 0
IO (external) Interrupts: 0
Program Check Interrupts: 0
FP Unavailable Interrupts: 0
FP Imprecise Interrupts: 0
RunMode Interrupts: 0
Decrementer Interrupts: 18
Queued (Soft level) Interrupts: 15
...(lines omitted)...
If the thread belongs to an NFS kernel process, the report
will include information on NFS operations instead of System calls:
Report for Thread Id: 1966273 (hex 1e00c1) Pid: 1007854 (hex f60ee)
Process Name: nfsd
---------------------
Total Kernel Time (ms): 3.198998
Total Operation Time (ms): 28.839927
Total Hypervisor Call Time (ms): 0.000000
Thread NFS Call Summary
-----------------------
Count Total Time Avg Time Min Time Max Time % Tot Total ETime Avg ETime Min ETime Max ETime % Tot % Tot Opcode
(msec) (msec) (msec) (msec) Time (msec) (msec) (msec) (msec) ETime Count
======== =========== ======== ======== ======== ===== =========== ========= ========= ========= ===== ===== =============
28 12.2661 0.4381 0.3815 0.4841 42.73 32.0893 1.1460 0.4391 16.6283 11.46 11.52 RFS3_READDIRPLUS
63 3.8953 0.0618 0.0405 0.1288 13.57 23.1031 0.3667 0.0405 7.0886 8.25 25.93 RFS3_LOOKUP
49 3.2795 0.0669 0.0527 0.0960 11.42 103.8431 2.1192 0.0534 35.3617 37.09 20.16 RFS3_READ
18 2.8464 0.1581 0.1099 0.2264 9.91 7.9129 0.4396 0.1258 4.3503 2.83 7.41 RFS3_WRITE
29 1.3331 0.0460 0.0348 0.0620 4.64 1.4953 0.0516 0.0348 0.0940 0.53 11.93 RFS3_GETATTR
5 1.2763 0.2553 0.2374 0.3036 4.45 45.0798 9.0160 0.9015 21.7257 16.10 2.06 RFS3_REMOVE
8 1.1001 0.1375 0.1180 0.1719 3.83 53.6532 6.7067 1.4293 19.9199 19.17 3.29 RFS3_COMMIT
20 0.9262 0.0463 0.0367 0.0507 3.23 1.2060 0.0603 0.0367 0.1314 0.43 8.23 RFS3_READLINK
15 0.6798 0.0453 0.0386 0.0519 2.37 0.8015 0.0534 0.0386 0.0788 0.29 6.17 RFS3_ACCESS
2 0.4033 0.2017 0.1982 0.2051 1.40 0.5355 0.2677 0.2677 0.2677 0.19 0.82 RFS3_READDIR
1 0.3015 0.3015 0.3015 0.3015 1.05 6.2614 6.2614 6.2614 6.2614 2.24 0.41 RFS3_CREATE
2 0.2531 0.1265 0.1000 0.1531 0.88 3.7756 1.8878 0.1000 3.6756 1.35 0.82 RFS3_SETATTR
2 0.0853 0.0426 0.0413 0.0440 0.30 0.1333 0.0667 0.0532 0.0802 0.05 0.82 RFS3_FSINFO
1 0.0634 0.0634 0.0634 0.0634 0.22 0.0634 0.0634 0.0634 0.0634 0.02 0.41 RFS3_FSSTAT
-------- ----------- -------- -------- -------- ----- ----------- --------- --------- --------- ----- ----- -------------
243 28.7094 0.1181 279.9534 1.1521 NFS V3 TOTAL
4 0.0777 0.0194 0.0164 0.0232 10.00 0.0523 0.0131 0.0115 0.0152 10.00 10.00 LINK
-------- ----------- -------- -------- -------- ----- ----------- --------- ---------- --------- ----- ----- -------------
4 0.0777 0.0194 0.0523 0.0131 NFS V4 CLIENT TOTAL
Pending NFS Calls Summary
-------------------------
Accumulated Accumulated Sequence Number
Time (msec) ETime (msec) Opcode
============ ============ ===============
0.1305 182.6903 1038932778
0.0123 102.6324 NFS4_ATTRCACHE
The following information is included in the threads summary:
Item | Descriptor |
---|---|
Thread ID | The Thread ID of the thread. |
Process ID | The Process ID that the thread belongs to. |
Process Name | The process name, if known, that the thread belongs to. |
Total Application Time (ms) | The amount of time, expressed in milliseconds, that the thread spent in application mode. |
Total System Call Time (ms) | The amount of time, expressed in milliseconds, that the thread spent in system call mode. |
Thread System Call Summary | A system call summary for the thread; this has the same fields as the global System Calls Summary. It also includes elapsed time if the -e flag is specified and error information if the -s flag is specified. |
Pending System Calls Summary | If the thread was executing a system call at the end of the trace, a pending system call summary will be printed. This has the Accumulated Time and Supervisor Call (SVC Address) fields. It also includes elapsed time if the -e flag is specified. |
Thread Hypervisor Calls Summary | The hypervisor call summary for the thread; this has the same fields as the global Hypervisor Calls Summary. It also includes elapsed time if the -e flag is specified. |
Pending Hypervisor Calls Summary | If the thread was executing a hypervisor call at the end of the trace, a pending hypervisor call summary will be printed. This has the Accumulated Time and Hypervisor Call fields. It also includes elapsed time if the -e flag is specified. |
Thread NFS Calls Summary | An NFS call summary for the thread. This has the same fields as the global System NFS Call Summary. It also includes elapsed time if the -e flag is specified. |
Pending NFS Calls Summary | If the thread was executing an NFS call at the end of the trace, a pending NFS call summary will be printed. This has the Accumulated Time and Sequence Number or, in the case of NFS V4, Opcode, fields. It also includes elapsed time if the -e flag is specified. |
processor affinity | The process affinity, which is the probability that, for any dispatch of the thread, the thread was dispatched to the same processor on which it last executed. |
Dispatch Histogram for thread | Shows the number of times the thread was dispatched to each CPU in the system. |
total number of dispatches | The total number of times the thread was dispatched (not including redispatches). |
total number of redispatches due to interrupts being disabled | The number of redispatches due to interrupts being disabled, which is when the dispatch code is forced to dispatch the same thread that is currently running on that particular CPU because the thread had disabled some interrupts. This total is only reported if the value is non-zero. |
avg. dispatch wait time (ms) | The average dispatch wait time is the average elapsed time for the thread from being undispatched and its next dispatch. |
Data on Interrupts that occurred while Thread was Running | Count of how many times each type of FLIH occurred while this thread was executing. |