Availability Scenario
Consider the following scenario:
- You get a phone call from one of your users: Resource RVBASIC is not available. Find out why and start it.
Here are the steps to make the resource available:
-
In this step, find out the details about RVBASIC resource, especially its status information.
-
Display details of RVBASIC, using the INGLIST RVBASIC command.
Suppose you get a following output screen. RVBASIC has a compound status of SATISFACTORY. It results from the fact that the observed status, SOFTDOWN, fulfills the desired status of UNAVAILABLE even though you expect it to be available. This panel also shows that RVBASIC is a BASIC APG, which can be available until all its remembers are available.
INGKYST0 SA z/OS - Command Dialogs Line 1 of 1 Domain Id = AOFDA -------- INGLIST --------- Date = 01/13/19 Operator Id = SADEMO Sysplex = SYSPLEX1 Time = 10:28:23 A Update B Start C Stop D INGRELS E INGVOTE F INGINFO G Members H DISPTRG I INGSCHED J INGGROUP K INGCICS L INGIMS M DISPMTR P INGPAC R Resume S Suspend T INGTWS U User X INGWHY / scroll CMD Name Type System Compound Desired Observed Nature --- ------------ ---- -------- ------------ ----------- ---------- -------- __ RVBASIC APG MVSA SATISFACTORY UNAVAILABLE SOFTDOWN BASIC -
Display the members of RVBASIC APG to investigate more details, by using the G (Members) action
code. Enter
gin the CMD column next to RVBASIC, and press enter.
Suppose you get an output screen as below. It shows that RVBASIC group has four members, RV01, RV02, RV05, and RV06, which are all SOFTDOWN. These members must be available, before the RVBASIC group can be available.INGKYST0 SA z/OS - Command Dialogs Line 1 of 1 Domain Id = AOFDA -------- INGLIST --------- Date = 01/13/19 Operator Id = SADEMO Sysplex = SYSPLEX1 Time = 10:28:57 A Update B Start C Stop D INGRELS E INGVOTE F INGINFO G Members H DISPTRG I INGSCHED J INGGROUP K INGCICS L INGIMS M DISPMTR P INGPAC R Resume S Suspend T INGTWS U User X INGWHY / scroll CMD Name Type System Compound Desired Observed Nature --- ------------ ---- -------- ------------ ----------- ---------- -------- __ RV01 APL MVSA SATISFACTORY UNAVAILABLE SOFTDOWN __ RV02 APL MVSA SATISFACTORY UNAVAILABLE SOFTDOWN __ RV05 APL MVSA SATISFACTORY UNAVAILABLE SOFTDOWN __ RV06 APL MVSA SATISFACTORY UNAVAILABLE SOFTDOWN -
Display all the affected resources that you're going to start using the following command, as
they all start with "RV".
INGLIST RV*RVBASIC and its members are displayed.INGKYST0 SA z/OS - Command Dialogs Line 1 of 1 Domain Id = AOFDA -------- INGLIST --------- Date = 01/03/19 Operator Id = SADEMO Sysplex = SYSPLEX1 Time = 10:29:06 A Update B Start C Stop D INGRELS E INGVOTE F INGINFO G Members H DISPTRG I INGSCHED J INGGROUP K INGCICS L INGIMS M DISPMTR P INGPAC R Resume S Suspend T INGTWS U User X INGWHY / scroll CMD Name Type System Compound Desired Observed Nature --- ------------ ---- -------- ------------ ----------- ---------- -------- __ RVBASIC APG MVSA SATISFACTORY UNAVAILABLE SOFTDOWN BASIC __ RV01 APL MVSA SATISFACTORY UNAVAILABLE SOFTDOWN __ RV02 APL MVSA SATISFACTORY UNAVAILABLE SOFTDOWN __ RV05 APL MVSA SATISFACTORY UNAVAILABLE SOFTDOWN __ RV06 APL MVSA SATISFACTORY UNAVAILABLE SOFTDOWN
-
Display details of RVBASIC, using the INGLIST RVBASIC command.
-
In this step, use the INGWHY command to find out what caused RVBASIC group to be unexpectedly
unavailable (SOFTDOWN). Enter
xin the CMD column next to it, and press Enter.
The following panel is displayed, which shows that RVBASIC was stopped intentionally by the operator (SASTUD1). So to start RVBASIC, you need to remove this operator stop request.INGKYST0 SA z/OS - Command Dialogs Line 1 of 1 Domain Id = AOFDA -------- INGLIST --------- Date = 01/03/19 Operator Id = SADEMO Sysplex = SYSPLEX1 Time = 10:29:15 Analyzed Resource: RVBASIC/APG/MVSA Status Compound: SATISFACTORY Desired: UNAVAILABLE Observed: SOFTDOWN ------------------------------------------------------------------------------ SITUATION: RVBASIC/APG/MVSA is unavailable. REASON: RVBASIC/APG/MVSA is desired to be UNAVAILABLE. RVBASIC/APG/MVSA got a MAKEUNAVAILABLE request. The request was issed by OPERATOR SASTUD1. ACTION: INGWHYSA(A0107401) Refer to your company's rules in order to take the appropriate action. No action required. -
In this step, remove the stop request of RVBASIC to allow it to become available again.
-
Press PF3 to go back to the INGLIST panel, and enter
e(INGVOTE) in the CMD column next to RVBASIC to display its vote.
From the following displayed INGVOTE panel, you can see that there is an operator MakeUnAvailable request to stop the resource, which has obviously been satisfied.INGKYRQ0 SA z/OS - Command Dialogs Line 1 of 5 Domain Id = AOFDA ---------- INGVOTE ---------- Date = 01/03/19 Operator Id = SADEMO Sysplex = SYSPLEX1 Time = 10:29:51 Resource ==> RVBASIC/APG/MVSA System ==> System name, Domain Id or sysplex name Desired Availaible..: Always Cmd: C cancel request K Kill request S show request details Cmd Action WIN Request/Vote Data --- ------ --- --------------------------------------------------------------- __ STOP Y Request : MakeUnAvailable Created : 2019-01-02 22:43:25 Originator : OPERATOR(SASTUD1) Priority : 01720000 Should Be Down - Operator Status : Winning/Satisfied -
Remove the stop request either using option C (cancel request), which prompts you to verify the
affected resources before canceling the request, or using option K (kill request) without
verification.
The following panel shows that the stop request is removed.
INGKYRQ0 SA z/OS - Command Dialogs Line 1 of 5 Domain Id = AOFDA ---------- INGVOTE ---------- Date = 01/03/19 Operator Id = SADEMO Sysplex = SYSPLEX1 Time = 10:30:04 Resource ==> RVBASIC/APG/MVSA System ==> System name, Domain Id or sysplex name Desired Availaible..: Always Cmd: C cancel request K Kill request S show request details Cmd Action WIN Request/Vote Data --- ------ --- --------------------------------------------------------------- **CANCELLED** Created : 2019-01-10 22:43:25 Originator : OPERATOR(SASTUD1) Priority : 01720000 Should Be Down - Operator Status : Winning/Satisfied -
Press PF3 to return to INGLIST panel, and press PF9 to refresh the panel.
Suppose the following panel is displayed. You can see that only the RV02 member is started, and the compound status of RVBASIC group is INAUTO, not expected SATISFACTORY status. Why INAUTO? This needs further investigation.INGKYST0 SA z/OS - Command Dialogs Line 1 of 1 Domain Id = AOFDA -------- INGLIST --------- Date = 01/03/19 Operator Id = SADEMO Sysplex = SYSPLEX1 Time = 10:30:16 A Update B Start C Stop D INGRELS E INGVOTE F INGINFO G Members H DISPTRG I INGSCHED J INGGROUP K INGCICS L INGIMS M DISPMTR P INGPAC R Resume S Suspend T INGTWS U User X INGWHY / scroll CMD Name Type System Compound Desired Observed Nature --- ------------ ---- -------- ------------ ----------- ---------- -------- __ RVBASIC APG MVSA INAUTO AVAILABLE STARTING BASIC __ RV01 APL MVSA AWITING AVAILABLE SOFTDOWN __ RV02 APL MVSA SATISFACTORY AVAILABLE AVAILABLE __ RV05 APL MVSA SATISFACTORY UNAVAILABLE SOFTDOWN __ RV06 APL MVSA SATISFACTORY UNAVAILABLE SOFTDOWN
-
Press PF3 to go back to the INGLIST panel, and enter
-
In this step, use INGWHY command to further investigate why RVBASIC cannot start after its stop
vote is removed.
-
Enter
xnext to RVBASIC and press Enter. The first panel shows that RVBASIC is desired to be always available, but tells no clue why it cannot be available.INGKYAN2 SA z/OS - Command Dialogs Line 1 of 17 Domain Id . : AOFDA ------------ INGWHY ------------ Date . . : 01/03/19 Operator Id : SADEMO Sysplex = SYSPLEX1 Time . . : 10:30:27 Analyzed Resource: RVBASIC/APL/MVSA Status Compound: INAUTO Desired: AVAILABLE Observed: STARTING ------------------------------------------------------------------------------ SITUATION: RVBASIC/APG/MVSA is starting or waiting to be started. REASON 1 of 4: The 'Desired Availability' of RVBASIC/APG/MVSA is set to 'Always'. RVBASIC/APG/MVSA is started by default once its dependencies are satisfied. ACTION: INGWHYSA(A0106900) Refer to your company's rules in order to take the appropriate action. No action required. -
Press PF11 to display Reason 2. As the following panel shows, the member RV05 was stopped by
the RV56SVP schedule, which prevents RVBASIC from starting.
SITUATION: RVBASIC/APG/MVSA is starting or waiting to be started. REASON 2 of 4: RVBASIC/APG/MVSA has a dependency on RV05/APL/MVSA. RV05/APL/MVSA is desired to be UNAVAILABLE becasue of a MAKEAVAILABLE vote. The vote was caused by SCHEDULE RV56SVP. ACTION:INGWHYSA(A0107200) Refer to your company's rules in order to take the appropriate action. No action required. -
Press PF11 to display Reason 3. It shows that the member RV01 cannot start because a startup
event is unset for its trigger RV01TRIG.
SITUATION: RVBASIC/APG/MVSA is starting or waiting to be started. REASON 3 of 4: RVBASIC/APG/MVSA has a dependency on RV01/APL/MVSA. RV01/APL/MVSA is desired to be Available. RV01/APL/MVSA is controlled by trigger RV01TRIG. A startup event of RV01TRIG is unset. ACTION: INGWHYSA(A0702800) Refer to your company's rules in order to take the appropriate action. Consider the following commands to investigate RV01/APL/MVSA: - DISPTRG - INGEVENT - INGTRIG -
Press PF11 again to display Reason 4. As same as RV05 in Reason 2, RV06 is also stopped by the
same schedule RV56SVP.
SITUATION: RVBASIC/APG/MVSA is starting or waiting to be started. REASON 4 of 4: RVBASIC/APG/MVSA has a dependency on RV06/APL/MVSA. RV05/APL/MVSA is desired to be UNAVAILABLE becasue of a MAKEAVAILABLE vote. The vote was caused by SCHEDULE RV56SVP. ACTION: INGWHYSA(A0107200) Refer to your company's rules in order to take the appropriate action. No action required.
In summary, INGWHY shows the following reasons that inhibits RVBASIC from starting.- RV01 has a trigger connected to it. One startup condition for that trigger must be fulfilled to make RV01 available. See step 5.
- RV05 and RV06 are both controlled by a schedule. The downtime schedule need to be modified. See step 6.
-
Enter
-
In this step, you start RV01, whose trigger is not satisfied.
-
Display the trigger of RV01 using the DISPTRG command. Enter action code
hagainst RV01 and press Enter. It displays the triggers and their events for the selected resource.
In the following displayed panel in this scenario, you can see that trigger RV01EVT has a startup condition that is fulfilled if event RV01EVT is set. This is what you need to find out in the next step.AOFLT000 SA z/OS - Command Dialogs Line 1 of 1 Domain Id = AOFDA ---------- DISPTRG ---------- Date = 01/03/19 Operator Id = SADEMO System = MVSA Time = 10:31:58 Resource ==> RV01/APL/MVSA Target ==> System name, Domain Id or sysplex name Trigger. . . : RV01TRIG Observed status : SOFTDOWN Cmd: S show details Cmd Type Events --- -------- -------- -------- -------- -------- -------- -------- --------- s STARTUP RV01EVT -
To see more details about an event (or the condition), enter action code
sin the CMD column.
The following panel is displayed. You can see that the event RV01EVT is not set (the Status column containsUNSET).AOFLT100 SA z/OS - Command Dialogs Line 1 of 1 Domain Id = AOFDA --- Trigger Condition List ---- Date = 01/03/19 Operator Id = SADEMO System = MVSA Time = 10:32:02 Trigger . . . . : RV01TRIG Condition type. : STARTUP Resource. . . . : RV01/APL/MVSA Observed status : SOFTDOWN Cmd: D show resources S set event for resource U unset event for resource Cmd Event Status Unset Description --- -------- ----------- ----- --------------------------------------------- s RV01EVT UNSET UP -
Enter
snext to the event and press Enter. This step sets the event to fulfill the startup condition for trigger RV01TRIG, thus allowing the resource RV01 to start. -
Press PF3 multiple times until you return to the INGLIST panel, and press PF9 to refresh. You
can see that RV01 is now available.
CMD Name Type System Compound Desired Observed Nature --- ------------ ---- -------- ------------ ----------- ---------- -------- __ RVBASIC APG MVSA INAUTO AVAILABLE STARTING BASIC __ RV01 APL MVSA SATISFACTORY AVAILABLE AVAILABLE __ RV02 APL MVSA SATISFACTORY AVAILABLE AVAILABLE __ RV05 APL MVSA SATISFACTORY UNAVAILABLE SOFTDOWN __ RV06 APL MVSA SATISFACTORY UNAVAILABLE SOFTDOWN
-
Display the trigger of RV01 using the DISPTRG command. Enter action code
-
In this step, you start RV02 and RV05, which are both stopped by the RV56SVP schedule.
-
Display the schedules that are defined in this sysplex by entering the INGSCHED command.
RV56SVP schedule is displayed.
INGKYSP0 SA z/OS - Command Dialogs Line 1 of 1 Domain Id . : AOFDA ------------ INGSCHED ------------ Date . . : 01/03/19 Operator Id : SADEMO Sysplex = SYSPLEX1 Time . . : 10:32:47 Cmd: A Show Details B Show Overrides C Show Resources Cmd Schedule Description --- -------- ---------------------------------------- __ RV56SVP Schedule for RV05 and RV06 -
Enter C against the schedule to show the resources linked to it. You can see that only RV05 and
RV06 use the schedule.
INGKYSP3 SA z/OS - Command Dialogs Line 1 of 2 Domain Id . : AOFDA ------------ INGSCHED ------------ Date . . : 01/11/19 Operator Id : SADEMO Sysplex = SYSPLEX1 Time . . : 10:32:55 Schedule. . : RV56SVP Schedule for RV05 and RV06 Cmd: S Show Overrides Cmd Resource Type System Description --- -------- ---- -------- ---------------------------------------- __ RV05 APL MVSA RV05 Appl has service period RV56SVP __ RV06 APL MVSA RV06 Appl has service period RV56SVP -
Use the S action code to check if any resource override respectively for both RV05 and RV06.
Suppose the following service windows are displayed for both resources, and the service windows are in green color. Green color means that there are no overrides to the base schedule. You can see that the current time (10:33:01) is within today's requested downtime (0100 - 2100). Then, you need to override the RV56SVP base schedule to start RV05 and RV06.INGKYSP2 SA z/OS - Command Dialogs Domain Id = AOFDA ---------- INGSCHED ---------- Date = 01/03/19 Operator Id = SADEMO Sysplex = SYSPLEX1 Time = 10:33:01 Resource . . . : RV05/APL/MVSA Schedule . . : RV56SVP Starting date => 01 / 03 / 2019 (mm/dd/yyyy) C Date Pri From-To From-To From-To From-To From-To - ------------ -- --- --------- --------- --------- --------- --------- 01/03/19 Tue UP L DN L 0100 2100 01/04/19 Wed UP L DN L 0100 2100 01/05/19 Thu UP L DN L 0100 2100 01/06/19 Fri UP L DN L 0100 2100 -
Press PF3 until you return to the INGSCHED panel, enter
bagainst RV56SVP schedule, and press Enter to show overrides of the schedule.INGKYSP0 SA z/OS - Command Dialogs Line 1 of 1 Domain Id . : AOFDA ------------ INGSCHED ------------ Date . . : 01/03/19 Operator Id : SADEMO Sysplex = SYSPLEX1 Time . . : 10:33:17 Cmd: A Show Details B Show Overrides C Show Resources Cmd Schedule Description --- -------- ---------------------------------------- b RV56SVP Schedule for RV05 and RV06 -
Overwrite the end time of today's downtime to some minutes later, and press Enter. A FUNCTION
COMPLETED message is displayed to show the override success. In this scenario, the current time is
10:33, and you can override the end time to 10:34. When it turns 10:34, SA will start RV05 and RV06,
as both resources get a default MakeAvailabe vote from the RVBASIC group.
INGKYSP2 SA z/OS - Command Dialogs Domain Id = AOFDA ---------- INGSCHED ---------- Date = 01/03/19 Operator Id = SADEMO Sysplex = SYSPLEX1 Time = 10:33:20 Resource . . . : RV05/APL/MVSA Schedule . . : RV56SVP Starting date => 01 / 03 / 2019 (mm/dd/yyyy) C Date Pri From-To From-To From-To From-To From-To - ------------ -- --- --------- --------- --------- --------- --------- 01/03/19 Thu UP L DN L 0100 1034 01/04/19 Fri UP L DN L 0100 2100 01/05/19 Sat UP L DN L 0100 2100 01/06/19 Sun UP L DN L 0100 2100 -
Press PF3 until you return to the INGLIST panel, wait until the end time you specified (10:34
in this case), and then press PF9 to refresh the panel.
You can see RV02 and RV05 are now started.INGKYST0 SA z/OS - Command Dialogs Line 1 of 1 Domain Id = AOFDA -------- INGLIST --------- Date = 01/03/19 Operator Id = SADEMO Sysplex = SYSPLEX1 Time = 10:34:02 A Update B Start C Stop D INGRELS E INGVOTE F INGINFO G Members H DISPTRG I INGSCHED J INGGROUP K INGCICS L INGIMS M DISPMTR P INGPAC R Resume S Suspend T INGTWS U User X INGWHY / scroll CMD Name Type System Compound Desired Observed Nature --- ------------ ---- -------- ------------ ----------- ---------- -------- __ RVBASIC APG MVSA SATISFACTORY AVAILABLE AVAILABLE BASIC __ RV01 APL MVSA SATISFACTORY AVAILABLE AVAILABLE __ RV02 APL MVSA SATISFACTORY AVAILABLE AVAILABLE __ RV05 APL MVSA SATISFACTORY AVAILABLE AVAILABLE __ RV06 APL MVSA SATISFACTORY AVAILABLE AVAILABLE
-
Display the schedules that are defined in this sysplex by entering the INGSCHED command.
RV56SVP schedule is displayed.
RVBASIC is now available, after all its members are available.