Topic
  • 8 replies
  • Latest Post - ‏2013-01-25T08:09:55Z by NineTom
NineTom
NineTom
12 Posts

Pinned topic Cann't start Catalog servers

‏2012-02-21T11:19:11Z |
Hi All,

I setuped ObjectGrid environment that has 2 catalog servers. It work fine until today.
I got the error while I restart catalog servers and It cann't start after that.
Please see the error that I got.
2/21/12 10:56:32:069 GMT 00000028 Launcher E CWOBJ2409E: An exception occurred during server startup: com.ibm.websphere.objectgrid.em.PersistenceException: Unable to activate the EMFactoryImpl. See the cause for details.
  • at com.ibm.ws.objectgrid.em.EMFactoryImpl.activate(EMFactoryImpl.java:780)*
  • at com.ibm.ws.objectgrid.runtime.ServerRuntimeFrameWorkImpl.activate(ServerRuntimeFrameWorkImpl.java:1356)*
  • at com.ibm.ws.objectgrid.Launcher.launchServerRuntimeFrameWork(Launcher.java:389)*
  • at com.ibm.ws.objectgrid.ServerImpl.startCatalogService(ServerImpl.java:1307)*
  • at com.ibm.ws.objectgrid.ServerImpl.<init>(ServerImpl.java:392)*
  • at java.lang.Class.newInstanceImpl(Native Method)*
  • at java.lang.Class.newInstance(Class.java:1328)*
  • at com.ibm.websphere.objectgrid.server.ServerFactory.initialize(ServerFactory.java:189)*
  • at com.ibm.websphere.objectgrid.server.ServerFactory$2.run(ServerFactory.java:152)*
  • at java.security.AccessController.doPrivileged(AccessController.java:192)*
  • at com.ibm.websphere.objectgrid.server.ServerFactory.getInstance(ServerFactory.java:150)*
  • at com.ibm.ws.objectgrid.integration.ObjectGridCatalogComponentImpl$2.run(ObjectGridCatalogComponentImpl.java:515)*
  • at java.lang.Thread.run(Thread.java:811)*
Caused by: com.ibm.websphere.projector.MetadataException: CWOBJ3009E: An exception occurred while communicating with the entity metadata repository: null
  • at com.ibm.ws.objectgrid.em.EMFactoryImpl.storeEntityMetadata(EMFactoryImpl.java:2221)*
  • at com.ibm.ws.objectgrid.em.EMFactoryImpl.activate(EMFactoryImpl.java:752)*
  • ... 12 more*
Caused by: com.ibm.websphere.objectgrid.NoActiveTransactionException
  • at com.ibm.ws.objectgrid.SessionImpl.commit(SessionImpl.java:1130)*
  • at com.ibm.ws.objectgrid.em.EMFactoryImpl.storeEntityMetadata(EMFactoryImpl.java:2127)*
  • ... 13 more*

I try to search the error codes (CWOBJ2409E and CWOBJ3009E) from https://www.ibm.com/developerworks/wikis/display/objectgridprog/ObjectGrid+core+messages.
I can't find the root cause from logs.
Could someone please suggest me? Root causes? How to fix this?
Updated on 2013-01-25T08:09:55Z at 2013-01-25T08:09:55Z by NineTom
  • jhanders
    jhanders
    261 Posts

    Re: Cann't start Catalog servers

    ‏2012-02-22T21:49:27Z  
    What level of eXtreme Scale are you using? I pulled multiple version of the main class involved here and I am having a hard time matching the line numbers. We fixed something similar to this I believe in the last year or so, but without knowing your version of eXtreme Scale I can't recommend what level has the fix you need. Did you look at the FFDC to see if there was anything in there?

    The infocenter contains the latest information about the messages and their meaning. Use the infocenter to query error codes. Here is a link to the page:

    http://publib.boulder.ibm.com/infocenter/wxsinfo/v7r1m1/index.jsp?topic=%2Fcom.ibm.websphere.extremescale.doc%2Frxsmessages.html

    I hope this helps.

    Jared Anderson
  • jhanders
    jhanders
    261 Posts

    Re: Cann't start Catalog servers

    ‏2012-02-23T15:29:00Z  
    • jhanders
    • ‏2012-02-22T21:49:27Z
    What level of eXtreme Scale are you using? I pulled multiple version of the main class involved here and I am having a hard time matching the line numbers. We fixed something similar to this I believe in the last year or so, but without knowing your version of eXtreme Scale I can't recommend what level has the fix you need. Did you look at the FFDC to see if there was anything in there?

    The infocenter contains the latest information about the messages and their meaning. Use the infocenter to query error codes. Here is a link to the page:

    http://publib.boulder.ibm.com/infocenter/wxsinfo/v7r1m1/index.jsp?topic=%2Fcom.ibm.websphere.extremescale.doc%2Frxsmessages.html

    I hope this helps.

    Jared Anderson
    I talked to the Level 3 lead yesterday and he said we are managing this problem with a PMR. It was a problem that we fixed over a year ago and had not been put back to the 6.1.0.5 level yet. An APAR was created and a fix will be provided.

    Jared Anderson
  • NineTom
    NineTom
    12 Posts

    Re: Cann't start Catalog servers

    ‏2012-02-23T16:49:25Z  
    Thanks. I'm waiting to APAR.
    Can you give more information about root cause? Do I have any workaround without update the fix pack?
  • NineTom
    NineTom
    12 Posts

    Re: Cann't start Catalog servers

    ‏2012-02-23T16:52:09Z  
    I'm using 6.1.0.5.
  • NineTom
    NineTom
    12 Posts

    Re: Cann't start Catalog servers

    ‏2012-02-24T00:44:19Z  
    • jhanders
    • ‏2012-02-23T15:29:00Z
    I talked to the Level 3 lead yesterday and he said we are managing this problem with a PMR. It was a problem that we fixed over a year ago and had not been put back to the 6.1.0.5 level yet. An APAR was created and a fix will be provided.

    Jared Anderson
    I'm search the issues in APAR that 7.1.1 already fix.
    But I'm not sure what is the number of issue.
    D
    Is it the same with this link? http://www-01.ibm.com/support/docview.wss?uid=swg1PM26286
  • jhanders
    jhanders
    261 Posts

    Re: Cann't start Catalog servers

    ‏2012-02-24T18:40:17Z  
    • NineTom
    • ‏2012-02-24T00:44:19Z
    I'm search the issues in APAR that 7.1.1 already fix.
    But I'm not sure what is the number of issue.
    D
    Is it the same with this link? http://www-01.ibm.com/support/docview.wss?uid=swg1PM26286
    This is not the same issue as the mentioned APAR. 7.1.0.0 FIX1 did contain the fix that you are getting an APAR fix for. It isn't listed explicitly in the PM22469 close text since it is not a condition we anticipated customers hitting.

    Jared Anderson
  • jhanders
    jhanders
    261 Posts

    Re: Cann't start Catalog servers

    ‏2012-02-24T18:40:43Z  
    • NineTom
    • ‏2012-02-23T16:49:25Z
    Thanks. I'm waiting to APAR.
    Can you give more information about root cause? Do I have any workaround without update the fix pack?
    Answers are forthcoming in your PMR.
  • NineTom
    NineTom
    12 Posts

    Re: Cann't start Catalog servers

    ‏2013-01-25T08:09:55Z  
    close PMR.