APAR status
Closed as program error.
Error description
If there are more tasks scheduled than can be read during a single transaction, then a Transaction Timeout Exception is thrown during AppTarget server startup. Two typical stacktraces are: [10/1/13 1:09:40:742 EDT] 00000005 TimeoutManage I WTRN0124I: When the timeout occurred the thread with which the transaction is, or was most recently, associated was Thread[server.startup : 0,5,main]. The stack trace of this thread when the timeout occurred was: java.io.FileOutputStream.writeBytes(Native Method) java.io.FileOutputStream.write(FileOutputStream.java:282) com.ibm.ejs.ras.WrappingFileOutputStream.write(WrappingFileOutp utStream.java:408) java.io.PrintStream.write(PrintStream.java:443) sun.nio.cs.StreamEncoder$CharsetSE.writeBytes(StreamEncoder.jav a:343) sun.nio.cs.StreamEncoder$CharsetSE.implFlushBuffer(StreamEncode r.java:413) sun.nio.cs.StreamEncoder.flushBuffer(StreamEncoder.java:126) java.io.OutputStreamWriter.flushBuffer(OutputStreamWriter.java: 176) java.io.PrintStream.write(PrintStream.java:490) java.io.PrintStream.print(PrintStream.java:632) java.io.PrintStream.println(PrintStream.java:769) com.ibm.ejs.ras.TraceLogger.doLog(TraceLogger.java:333) com.ibm.ejs.ras.TraceLogger.processEvent(TraceLogger.java:319) com.ibm.ws.logging.WsHandlerWrapper.publish(WsHandlerWrapper.ja va:43) java.util.logging.Logger.log(Logger.java:1122) com.ibm.ejs.ras.Tr.logToJSR47Logger(Tr.java:1681) com.ibm.ejs.ras.Tr.fireEvent(Tr.java:1643) com.ibm.ejs.ras.Tr.fireTraceEvent(Tr.java:1565) com.ibm.ejs.ras.Tr.debug(Tr.java:626) com.ibm.ejs.cm.logger.TraceWriter.formatTrace(TraceWriter.java: 115) com.ibm.ejs.cm.logger.TraceWriter.write(TraceWriter.java:85) java.io.PrintWriter.newLine(PrintWriter.java:436) java.io.PrintWriter.println(PrintWriter.java:585) java.io.PrintWriter.println(PrintWriter.java:682) com.ibm.db2.jcc.t4.i.a(i.java:419) com.ibm.db2.jcc.t4.i.a(i.java:281) com.ibm.db2.jcc.t4.z.b(z.java:218) com.ibm.db2.jcc.t4.z.c(z.java:259) com.ibm.db2.jcc.t4.z.c(z.java:372) com.ibm.db2.jcc.t4.z.v(z.java:1147) com.ibm.db2.jcc.t4.db.c(db.java:30) com.ibm.db2.jcc.t4.r.a(r.java:32) com.ibm.db2.jcc.t4.j.Zb(j.java:263) com.ibm.db2.jcc.am.wm.X(wm.java:3697) com.ibm.db2.jcc.t4.d.rb(d.java:1974) com.ibm.db2.jcc.t4.d.m(d.java:2162) com.ibm.db2.jcc.t4.d.n(d.java:2174) com.ibm.db2.jcc.t4.d.a(d.java:160) com.ibm.db2.jcc.t4.d.b(d.java:506) com.ibm.db2.jcc.am.hc.a(hc.java:208) com.ibm.db2.jcc.t4.d.a(d.java:109) com.ibm.db2.jcc.am.wm.c(wm.java:381) com.ibm.db2.jcc.am.wm.next(wm.java:308) com.ibm.ws.rsadapter.jdbc.WSJdbcResultSet.next(WSJdbcResultSet. java:3120) com.ibm.ws.scheduler.TaskStoreImpl.nextWithRetry(TaskStoreImpl. java:1708) com.ibm.ws.scheduler.TaskStoreImpl.findByName(TaskStoreImpl.jav a:1518) com.ibm.ws.scheduler.SchedulerImpl$7.run(SchedulerImpl.java:191 2) java.security.AccessController.doPrivileged(AccessController.ja va:251) com.ibm.ws.scheduler.SchedulerImpl.findByName(SchedulerImpl.jav a:1881) com.ibm.ws.scheduler.SchedulerImpl.findByName(SchedulerImpl.jav a:1865) com.ibm.ws.scheduler.SchedulerImpl.findTasksByName(SchedulerImp l.java:1828) com.ibm.task.framework.ServiceSessionBean.deleteSuperfluousSche dulerItems(ServiceSessionBean.java:879) com.ibm.task.framework.ServiceSessionBean.createScheduledItem(S erviceSessionBean.java:626) com.ibm.task.framework.EJSLocalStatelessTaskServiceManagerBean_ fd52dd76.createScheduledItem(Unknown Source) com.ibm.task.core.scheduler.HTMSchedulerImpl.create(HTMSchedule rImpl.java:141) com.ibm.task.core.scheduler.HTMScheduler.createSchedulerItem(HT MScheduler.java:910) com.ibm.task.daemon.Daemon.update(Daemon.java:686) com.ibm.task.daemon.Daemon.start(Daemon.java:502) com.ibm.task.daemon.RefreshDaemon.start(RefreshDaemon.java:203) com.ibm.task.framework.StartUpBean.start(StartUpBean.java:232) com.ibm.websphere.startupservice.EJSRemoteStatefulTaskContainer StartUpBean_f06b01a0.start(Unknown Source) com.ibm.websphere.startupservice._AppStartUp_Stub.start(_AppSta rtUp_Stub.java:252) com.ibm.ws.startupservice.StartBeanInfo.start(StartBeanInfo.jav a:287) com.ibm.ws.startupservice.StartUpModule.appStart(StartUpModule. java:152) com.ibm.ws.startupservice.StartUpApplication.start(StartUpAppli cation.java:105) com.ibm.ws.startupservice.StartUpService.stateChanged(StartUpSe rvice.java:476) com.ibm.ws.runtime.component.ApplicationMgrImpl.stateChanged(Ap plicationMgrImpl.java:1079) com.ibm.ws.runtime.component.DeployedApplicationImpl.fireDeploy edObjectEvent(DeployedApplicationImpl.java:1302) com.ibm.ws.runtime.component.DeployedApplicationImpl.setState(D eployedApplicationImpl.java:281) com.ibm.ws.runtime.component.DeployedApplicationImpl.setState(D eployedApplicationImpl.java:276) com.ibm.ws.runtime.component.DeployedApplicationImpl.start(Depl oyedApplicationImpl.java:954) com.ibm.ws.runtime.component.ApplicationMgrImpl.startApplicatio n(ApplicationMgrImpl.java:740) com.ibm.ws.runtime.component.ApplicationMgrImpl.start(Applicati onMgrImpl.java:2051) com.ibm.ws.runtime.component.CompositionUnitMgrImpl.start(Compo sitionUnitMgrImpl.java:385) com.ibm.ws.runtime.component.CompositionUnitImpl.start(Composit ionUnitImpl.java:123) com.ibm.ws.runtime.component.CompositionUnitMgrImpl.start(Compo sitionUnitMgrImpl.java:328) com.ibm.ws.runtime.component.CompositionUnitMgrImpl.access$300( CompositionUnitMgrImpl.java:113) com.ibm.ws.runtime.component.CompositionUnitMgrImpl$CUInitializ er.run(CompositionUnitMgrImpl.java:895) com.ibm.wsspi.runtime.component.WsComponentImpl$_AsynchInitiali zer.run(WsComponentImpl.java:349) com.ibm.ws.util.ThreadPool$Worker.run(ThreadPool.java:1613) and: [10/1/13 1:09:50:251 EDT] 00000018 LocalExceptio E CNTR0019E: EJB threw an unexpected (non-declared) exception during invocation of method "createScheduledItem". Exception data: com.ibm.websphere.csi.CSITransactionRolledbackException: Transaction rolled back; nested exception is: javax.transaction.TransactionRolledbackException: Transaction is ended due to timeout at com.ibm.ejs.csi.TransactionControlImpl.completeTxTimeout(Transac tionControlImpl.java:1376) at com.ibm.ejs.csi.TransactionControlImpl.preInvoke(TransactionCont rolImpl.java:274) at com.ibm.ejs.csi.UOWControlImpl.preInvoke(UOWControlImpl.java:254 ) at com.ibm.ejs.container.EJSContainer.preInvokeActivate(EJSContaine r.java:3897) at com.ibm.ejs.container.EJSContainer.preInvoke(EJSContainer.java:3 269) at com.ibm.task.framework.EJSLocalStatelessTaskServiceManagerBean_f d52dd76.createScheduledItem(Unknown Source) at com.ibm.task.core.scheduler.HTMSchedulerImpl.create(HTMScheduler Impl.java:147) at com.ibm.task.core.scheduler.HTMScheduler.createSchedulerItem(HTM Scheduler.java:910) at com.ibm.task.daemon.Daemon.update(Daemon.java:686) at com.ibm.task.daemon.Daemon.start(Daemon.java:502) at com.ibm.task.daemon.RefreshDaemon.start(RefreshDaemon.java:203) at com.ibm.task.framework.StartUpBean.start(StartUpBean.java:232) at com.ibm.websphere.startupservice.EJSRemoteStatefulTaskContainerS tartUpBean_f06b01a0.start(Unknown Source) at com.ibm.websphere.startupservice._AppStartUp_Stub.start(_AppStar tUp_Stub.java:252) at com.ibm.ws.startupservice.StartBeanInfo.start(StartBeanInfo.java :287) at com.ibm.ws.startupservice.StartUpModule.appStart(StartUpModule.j ava:152) at com.ibm.ws.startupservice.StartUpApplication.start(StartUpApplic ation.java:105) at com.ibm.ws.startupservice.StartUpService.stateChanged(StartUpSer vice.java:476) at com.ibm.ws.runtime.component.ApplicationMgrImpl.stateChanged(App licationMgrImpl.java:1079) at com.ibm.ws.runtime.component.DeployedApplicationImpl.fireDeploye dObjectEvent(DeployedApplicationImpl.java:1302) at com.ibm.ws.runtime.component.DeployedApplicationImpl.setState(De ployedApplicationImpl.java:281) at com.ibm.ws.runtime.component.DeployedApplicationImpl.setState(De ployedApplicationImpl.java:276) at com.ibm.ws.runtime.component.DeployedApplicationImpl.start(Deplo yedApplicationImpl.java:954) at com.ibm.ws.runtime.component.ApplicationMgrImpl.startApplication (ApplicationMgrImpl.java:740) at com.ibm.ws.runtime.component.ApplicationMgrImpl.start(Applicatio nMgrImpl.java:2051) at com.ibm.ws.runtime.component.CompositionUnitMgrImpl.start(Compos itionUnitMgrImpl.java:385) at com.ibm.ws.runtime.component.CompositionUnitImpl.start(Compositi onUnitImpl.java:123) at com.ibm.ws.runtime.component.CompositionUnitMgrImpl.start(Compos itionUnitMgrImpl.java:328) at com.ibm.ws.runtime.component.CompositionUnitMgrImpl.access$300(C ompositionUnitMgrImpl.java:113) at com.ibm.ws.runtime.component.CompositionUnitMgrImpl$CUInitialize r.run(CompositionUnitMgrImpl.java:895) at com.ibm.wsspi.runtime.component.WsComponentImpl$_AsynchInitializ er.run(WsComponentImpl.java:349) at com.ibm.ws.util.ThreadPool$Worker.run(ThreadPool.java:1613) Caused by: javax.transaction.TransactionRolledbackException: Transaction is ended due to timeout at com.ibm.ws.tx.jta.TranManagerImpl.completeTxTimeout(TranManagerI mpl.java:527) at com.ibm.ws.tx.jta.TranManagerSet.completeTxTimeout(TranManagerSe t.java:639) at com.ibm.ejs.csi.TransactionControlImpl.completeTxTimeout(Transac tionControlImpl.java:1368) ... 31 more On the cluster member where the daemon runs (the one that get the lock) traces typically show repeated calls to com.ibm.task.framework.ServiceSessionBean.deleteSuperfluousSche dulerItems. As consequence, the HTM container application is stopped, and applications using human tasks cannot run properly.
Local fix
NA
Problem summary
If there are many scheduled tasks, application server starts very slowly; Human Task Manager container might fail to start. PROBLEM DETAILED DESCRIPTION: In WPS 6.1, it has been possible in some cases, that certain tasks are re-scheduled at every server start. As consequence, many equivalent tasks are scheduled, and they are running in parallel. As only one of them is necessary, the server system's CPU runs at a high load. Depending on the number of scheduled tasks, the code to find and cancel all the obsolete tasks is slowing down the server startup.
Problem conclusion
In WPS 7.0, the code to find obsolete scheduled tasks is no longer necessary. NOTE: IBM Installation Manager is required to install this interim.fix (1.4.1 or later recommended). For further details see: http://publib.boulder.ibm.com/infocenter/dmndhelp/v7r0mx/ index.jsp?topic=/com.ibm.websphere.wps.doc/doc/ tins_installingfix_manually.html NOTE: This interim fix is applicable to both a full WPS installation as well as a WPS client installation.
Temporary fix
Comments
APAR Information
APAR number
IV52983
Reported component name
BUS PRC CHOREOG
Reported component ID
5655FLW11
Reported release
700
Status
CLOSED PER
PE
NoPE
HIPER
NoHIPER
Special Attention
NoSpecatt / Xsystem
Submitted date
2013-12-09
Closed date
2014-02-12
Last modified date
2014-02-12
APAR is sysrouted FROM one or more of the following:
APAR is sysrouted TO one or more of the following:
JR48766
Fix information
Fixed component name
BUS PRC CHOREOG
Fixed component ID
5655FLW11
Applicable component levels
[{"Business Unit":{"code":"BU048","label":"IBM Software"},"Product":{"code":"SS7J6S","label":"WebSphere Enterprise Service Bus"},"Component":"","ARM Category":[],"Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"7.0","Edition":"","Line of Business":{"code":"","label":""}}]
Document Information
Modified date:
05 September 2024