ZZ00543: ICO 2402 HA DEPLOY FAILS ON CENTRAL SERVER 2 DURING [CONFIGURE ORCHESTRATOR SECURITY FOR BPM] STEP.

IBM Cloud Orchestrator Fix Pack 4 (2.4.0.4) for 2.4

APAR status

• Closed as fixed if next.

Error description

• While the secondary  central server 2 node of the HA pair is
  
  being configured for BPM security, it encounters an error
  
  during the 'wsadmin' script.
  
  
  
  ################################################################
  
  2016-01-26T10:53:40+00:00] ERROR: execute[configure
  orchestrator
  security for BPM] (bpm::bpm_configure line 221) had an error:
  
  Mixlib::ShellOut::ShellCommandFailed: Expected process to exit
  
  with [0], but received '105'
  
  
  
  [2016-01-26 10:53:40,714] secondaryCS2.int.com ----
  
  Begin output of ./wsadmin.sh -conntype SOAP -lang jython -host
  
  secondaryCS2 -port 8879 -f
  
  /opt/ibm/BPM/ico/tmp/configure_orchestrator_security_for_bpm.py
  PCCell1 IWD_Auth_Alias admin Node2 ...
  
  
  
  [2016-01-26 10:53:40,715] secondaryCS2.int.com STDOUT:
  
  WASX7023E: Error creating "SOAP" connection to host
  
  "secondaryCS2";
  
  exception information:
  
  com.ibm.websphere.management.exception
  .ConnectorNotAvailableExce
  ption:
  
  [SOAPException: faultCode=SOAP-ENV:Client; msg=Unable to find a
  valid IP for host secondaryCS2]
  
  ################################################################
  
  
  
  The problem is caused by missing code logic in the
  
  bpm_configure.rb which fails to handle the secondary CS2 as the
  secondary.  Instead the code picks up the secondary CS2 and
  
  handles as a primary node, which in turn attempts to run the
  
  wsadmin script pointing the host parameter to the secondary
  
  ip/host.  This is incorrect and will fail because the secondary
  node is not running DMGR (the primary CS2 should be) and thus
  
  the secondary CS2 is not listening on port 8879 for the wsadmin
  SOAP request.
  

Local fix

• You can try this out by running the following command from the
  
  deployment server:
  
  knife search node 'roles:bpm' -c /etc/chef/knife.rb
  
  
  
  If this command returns two nodes
  
  (primary and secondary CS2 nodes) please run/test
  
  the following command to further filter the list of returned
  
  nodes for role pcg (pcg exists only as single instance in HA):
  
  
  
  knife search node 'roles:bpm AND roles:pcg' -c
  
  /etc/chef/knife.rb
  
  If this returns the expected primary node you can try to
  
  run the central server install/upgrade using a modified recipe
  
  (bpm_configure.rb) using the following steps on the deployment
  
  server:
  
  
  
  1) knife cookbook download bpm -d /tmp/ico2402 -c
  
  /etc/chef/knife.rb
  
  2) mv /tmp/ico2402/bpm-0.1.5/ /tmp/ico2402/bpm
  
  3) vi /tmp/ico2402/bpm/recipes/bpm_configure.rb
  
  
  
  Change
  
  
  
  if not $i_am_the_master
  
  $query.search(:node,
  
  "chef_environment:#{node.chef_environment[0..42]} AND
  
  roles:bpm")
  
  {|item| bpm_deploy_manager_hostname = item[:ipaddress]}
  
  bpm_node_name = node[:bpm][:node_agent_2_name]
  
  bpm_node_profile_location =
  
  "#{$bpm_home}/profiles/#{node[:bpm][:node_agent_2_profile_name]}
  
  "
  
  bpm_server_name = node[:bpm][:server_2_name]
  
  end
  
  
  
  to
  
  if not $i_am_the_master
  
  $query.search(:node,
  
  "chef_environment:#{node.chef_environment[0..42]} AND roles:bpm
  AND roles:pcg") {|item| bpm_deploy_manager_hostname =
  
  item[:ipaddress]}
  
  puts "[INFO] bpm_deploy_manager_hostname:
  
  #{bpm_deploy_manager_hostname}"
  
  bpm_node_name = node[:bpm][:node_agent_2_name]
  
  bpm_node_profile_location =
  
  "#{$bpm_home}/profiles/#{node[:bpm][:node_agent_2_profile_name]}
  
  "
  
  bpm_server_name = node[:bpm][:server_2_name]
  
  end
  
  
  
  4) knife cookbook upload bpm -o /tmp/ico2402 -c
  
  /etc/chef/knife.rb
  
  5) Run the central server deploy
  

Problem summary

• ****************************************************************
  
  * USERS AFFECTED:
  
  All users of IBM Cloud Orchestrator 2.4 upgrading a HA topoly
  landscape with FP3.
  
  
  ****************************************************************
  
  * PROBLEM DESCRIPTION:
  
  The executed upgrade installer code does not identify unique the
  central server which acts as master related to the BPM
  installation
  
  
  ****************************************************************
  
  * RECOMMENDATION:
  
  While using the FP3 upgrade installer to upgrade to FP3 target
  in HA topology execute the following steps to workaround:
  
  
  1) knife cookbook download bpm -d /tmp/ico2402 -c
  /etc/chef/knife.rb
  2) mv /tmp/ico2402/bpm-0.1.5/ /tmp/ico2402/bpm
  
  3) vi /tmp/ico2402/bpm/recipes/bpm_configure.rb
  
      Change
  
  if not $i_am_the_master
  
    $query.search(:node, "chef_environment:#{node
  .chef_environment[0..42]} AND roles:bpm") {|item|
  bpm_deploy_manager_hostname = item[:ipaddress]}
    bpm_node_name = node[:bpm][:node_agent_2_name]
  
    bpm_node_profile_location = "#{$bpm_home}/profiles/#{node[:bpm
  ][:node_agent_2_profile_name]}"
    bpm_server_name = node[:bpm][:server_2_name]
  
  end
  
      to
  
  if not $i_am_the_master
  
    $query.search(:node, "chef_environment:#{node
  .chef_environment[0..42]} AND roles:bpm AND roles:pcg") {|item|
  bpm_deploy_manager_hostname = item[:ipaddress]}
    puts "[INFO] bpm_deploy_manager_hostname:
  #{bpm_deploy_manager_hostname}"
    bpm_node_name = node[:bpm][:node_agent_2_name]
  
    bpm_node_profile_location = "#{$bpm_home}/profiles/#{node[:bpm
  ][:node_agent_2_profile_name]}"
    bpm_server_name = node[:bpm][:server_2_name]
  
  end
  
  4) knife cookbook upload bpm -o /tmp/ico2402 -c
  /etc/chef/knife.rb
  5) Run the central server install/upgrade
  

Problem conclusion

Temporary fix

Comments

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Fix information

Applicable component levels

• R240 PSY

     UP