JR54654: WHEN MANY TIMERS ARE SCHEDULED TO FIRE SIMULTANEOUSLY, SOME FAILAND YOU RECEIVE CWLLG ERRORS

8.5.6.2-WS-BPM-IFJR54654
8.0.1.3-WS-BPM-IFJR54654
8.5.5.0-WS-BPM-IFJR54654
Version 8.5 Refresh Pack 7 for the IBM Business Process Manager products

APAR status

• Closed as program error.

Error description

• When many timers are scheduled to fire at the same time, not all
  of them succeed and you receive the following CWLLG errors:
  
  CWLLG2103W: The retry limit of 5 was exceeded in
  ProgrammaticTransactionSupport.
  CWLLG0185E: An exception occurred while loading task...
  Error: PreparedStatementCallback; SQL [...]; DB2 SQL Error:
  SQLCODE=-911, SQLSTATE=40001, SQLERRMC=2, DRIVER=4.13.80; nested
  exception is
  com.ibm.db2.jcc.am.SqlTransactionRollbackException: DB2 SQL
  Error: SQLCODE=-911, SQLSTATE=40001, SQLERRMC=2, DRIVER=4.13.80
  org.springframework.dao.ConcurrencyFailureException:
  PreparedStatementCallback; SQL [...]; DB2 SQL Error:
  SQLCODE=-911, SQLSTATE=40001, SQLERRMC=2, DRIVER=4.13.80; nested
  exception is com.ibm.db2.jcc.am.SqlTransactionRollbackException:
  DB2 SQL Error: SQLCODE=-911, SQLSTATE=40001, SQLERRMC=2,
  DRIVER=4.13.80
  at org.springframework.jdbc.support.
    SQLExceptionSubclassTranslator.translate
    (SQLExceptionSubclassTranslator.java:52)
  at org.springframework.jdbc.support.
    SQLErrorCodeSQLExceptionTranslator.translate
    (SQLErrorCodeSQLExceptionTranslator.java:237)
  at org.springframework.jdbc.core.JdbcTemplate.
    execute(JdbcTemplate.java:607)
  at org.springframework.jdbc.core.JdbcTemplate.
    query(JdbcTemplate.java:641)
  at org.springframework.jdbc.core.JdbcTemplate.
    query(JdbcTemplate.java:670)
  at org.springframework.jdbc.core.JdbcTemplate.
    query(JdbcTemplate.java:678)
  at com.lombardisoftware.server.scheduler.Engine.
    loadTasksIfOwnerInternal(Engine.java:1475)
  

Local fix

Problem summary

• A different cluster member already locked the event manager
  tasks in the database. As a result, the database throws a
  deadlock exception and you receive the previously mentioned
  CWLLG errors. Although IBM BPM tries to release those event
  manager tasks, they remain locked.
  

Problem conclusion

• A fix is/will be available for IBM BPM V8.5.5 that solves the
  deadlock situation by keeping those event manager tasks in the
  memory to be retried later.
  
  On Fix Central (http://www.ibm.com/support/fixcentral), search
  for JR54654:
  
  1. Select IBM Business Process Manager with your edition from
    the product selector, the installed version to the fix pack
    level, and your platform, and then click Continue.
  
  2. Select APAR or SPR, enter JR54654, and click Continue.
  
  When you download fix packages, ensure that you also download
  the readme file for each fix. Review each readme file for
  additional installation instructions and information about the
  fix.
  

Temporary fix

• Not applicable
  

Comments

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Fix information

• Fixed component name

  BPM STANDARD

• Fixed component ID

  5725C9500

Applicable component levels

• R855 PSY

     UP