IC96797: IDS CAN CRASH WHEN IN CONTINOUS LOG RESTORE (CLR) AND STORAGE MANAGER (VERITAS) IS TURNED OFF.

APAR status

• Closed as program error.

Error description

• When running in Continous Log Restore (CLR), if Storage Manager
  (Veritas) is turned off, onbar goes into aborted instead of
  suspended mode and engine crashed with following stack and
  following messages in online.log and bar_act.log
  
  
  11:02:24  Stack for thread: 992 ontape
  
  
  
  afstack
  afhandler
  afcrash_interface
  rsclose_lgr
  tbj_log_close_restore
  sqmain
  listen_verify
  spawn_thread
  th_init_initgls
  startup
  
  online.log shows:
  
  10:56:27  Resuming Logical Restore
  10:56:43  Logical Log 1200392 Complete, timestamp: 0xc51e9dfe.
  10:57:04  Logical Log 1200393 Complete, timestamp: 0xc521277e.
  10:57:25  Logical Log 1200394 Complete, timestamp: 0xc52251b7.
  10:57:46  Logical Log 1200395 Complete, timestamp: 0xc52395a2.
  10:58:07  Logical Log 1200396 Complete, timestamp: 0xc524bf98.
  10:58:19  Suspending Logical Restore
  10:58:50  Resuming Logical Restore
  10:59:07  Suspending Logical Restore
  10:59:39  Resuming Logical Restore
  11:00:25  Logical Recovery ABORTED.
   Aborted by client.
  11:02:24  Assert Failed: Logical Recovery ABORTED.
   Dynamic Server must abort
  11:02:24  IBM Informix Dynamic Server Version 11.70.FC7W2
  11:02:24   Who: Session(755, informix@xxxx1, 6514, 68916d860)
    Thread(992, ontape, 68913c928, 8)
    File: rslgr.c Line: 1342
  11:02:24  stack trace for pid 7824 written to
  /var/tmp/af.7c81e80
  
  bar_act.log shows:
  
   2013-10-08 10:58:50 6391  6389 /usr/informix/bin/onbar_d -r -l
  -C
   2013-10-08 10:58:50 6391  6389 Working with veritas-netbackup
  as generic storage manager.
   2013-10-08 10:58:50 6391  6389 Successfully connected to
  Storage Manager.
   2013-10-08 10:59:07 6391  6389 XBSA Error: (BSAGetObject) A
  system error occurred. Aborting XBSA session.
   2013-10-08 10:59:07 6391  6389 Object information: bar_objdesc
       obj_id 0 obj_name '1200398' obj_type 'L' act_id 0 act_type
  2 act_status 0
       act_start '2013-10-08 10:58:50'  act_end '2013-10-08
  10:58:15'
       ins_time 0 rsam_time 0 seal_time 1381244277 prev_seal_time
  1381244247 level 0 copyid hi:lo 1:1381244281 req_act_id 1446
       logstream 0 est_pages hi:lo 0:0 first_log 0 chpt_log
  1200398 last_log 0
       partial_flag 0 do_query 0 ins_sm_id 0 ins_sm_name ''
       ins_verify 0 ins_verify_date '' restore order 0:0
       objInfo ''
       retry 0 in_catalog 1 in_bootfile 0 child_pid 0 child_state
  0
       bkup_host '' backup_order 0
   2013-10-08 10:59:07 6391  6389 (-43294) ON-Bar was unable to
  get the backup record of logical log 1200398 from the
  storage manager.
   2013-10-08 10:59:07 6391  6389 (-43168) ON-Bar suspended the
  logical restore on log 1200398 (expected to
  restore to 2147483647).
   2013-10-08 10:59:07 6391  6389 /usr/informix/bin/onbar_d
  complete, returning 131 (0x83)
  2013-10-08 10:59:38 6514  6512 /usr/informix/bin/onbar_d -r -l
  -C
   2013-10-08 10:59:38 6514  6512 Working with veritas-netbackup
  as generic storage manager.
   2013-10-08 10:59:39 6514  6512 Successfully connected to
  Storage Manager.
   2013-10-08 11:00:24 6514  6512 XBSA Error: (BSABeginTxn) A
  system error occurred. Aborting XBSA session.
  
  
  Veritas log shows:
  
  10/08/2013 10:58:50 - begin Restore
  10/08/2013 10:58:51 - restoring from image bnhsrvr1_1381244281
  10/08/2013 10:58:51 - requesting resource @aaabL
  10/08/2013 10:59:01 - Info bprd (pid=13674) Restoring from copy
  1 of image created Tue Oct 08 10:58:01 2013
  10/08/2013 10:59:01 - granted resource
  MediaID=@aaabL;DiskVolume=/storage-1;DiskPool=nyinas2b-storage-1
  ;Path=/storage-1;StorageServer=fmgbk1-red;MediaServer=fmgbk1-red
  10/08/2013 10:59:04 - Info bpbrm (pid=1634) bnyifx1 is the host
  to restore to
  10/08/2013 10:59:04 - Info bpbrm (pid=1634) reading file list
  from client
  10/08/2013 10:59:04 - Info bpbrm (pid=1634) listening for client
  connection
  10/08/2013 10:59:06 - end Restore; elapsed time 0:00:16
  10/08/2013 10:59:07 - Info bpbrm (pid=1634) accepted connection
  from client
  10/08/2013 10:59:07 - Info tar (pid=0) done. status: 150:
  termination requested by administrator
  10/08/2013 10:59:07 - Error bpbrm (pid=1634) client restore EXIT
  STATUS 150: termination requested by administrator
  termination requested by administrator  (150)
  

Local fix

Problem summary

• ****************************************************************
  * USERS AFFECTED:                                              *
  * Users using OnBar                                            *
  ****************************************************************
  * PROBLEM DESCRIPTION:                                         *
  * See Error Description                                        *
  ****************************************************************
  * RECOMMENDATION:                                              *
  * Update to IDS-11.70.xC8                                      *
  ****************************************************************
  

Problem conclusion

• Problem Fixed In IDS-11.70.xC8
  

Temporary fix

Comments

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Fix information

• Fixed component name

  INFORMIX SERVER

• Fixed component ID

  5725A3900

Applicable component levels

• RA10 PSN

     UP

• RA10 PSY

     UP

• RB10 PSN

     UP

• RB10 PSY

     UP

• RB50 PSN

     UP

• RB50 PSY

     UP

• RB70 PSN

     UP

• RB70 PSY

     UP

• RC10 PSN

     UP

• RC10 PSY

     UP