LI79829: THE UPGRADE TO 5.0.7 OR 5.0.8 FAILS DUE TO UNABLE TO UPGRADE THE MAPPINGS ERROR IN ELASTICSEARCH

5.0.8.1-APIConnect-Portal-Debian7-20171030-1423
5.0.8.1-APIConnect-Portal-Debian7-20171030-1423.ova
5.0.8.1-APIConnect-Portal-Ubuntu16-20171030-1423
5.0.8.1-APIConnect-Portal-Ubuntu16-20171030-1423.ova
APIConnect_Management_5.0.8.1_20171030-0955_4c09866eee14_ef24683.ova
APIConnect_Management_5.0.8.1_20171030-0955_4c09866eee14_ef24683.vcrypt2
apiconnect-2.7.62

APAR status

• Closed as program error.

Error description

• The upgrade to 5.0.7 or 5.0.8 API Manager fails due to unable
  to upgrade the mappings error in elasticsearch
  The error stack is :
  2017-09-12T09:12:36,070][ERROR][o.e.g.GatewayMetaState   ]
  [o28WMkZ] failed to read local state, exiting...
  java.lang.IllegalStateException: unable to upgrade the mappings
  for the index [[cmc-2017.01/zEzaQ-xxxxxxx]]
  at
  org.elasticsearch.cluster.metadata.MetaDataIndexUpgradeService.c
  heckMappingsCompatibility(MetaDataIndexUpgradeService.java:152)
  ~[elasticsearch-5.1.1.jar:5.1.1]
  at
  org.elasticsearch.cluster.metadata.MetaDataIndexUpgradeService.u
  pgradeIndexMetaData(MetaDataIndexUpgradeService.java:82)
  ~[elasticsearch-5.1.1.jar:5.1.1]
  at
  org.elasticsearch.gateway.GatewayMetaState.upgradeMetaData(Gatew
  ayMetaState.java:248) ~[elasticsearch-5.1.1.jar:5.1.1]
  at
  org.elasticsearch.gateway.GatewayMetaState.<init>(GatewayMetaSta
  te.java:91) [elasticsearch-5.1.1.jar:5.1.1]
  at
  sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
  Method) ~[?:?]
  at
  sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeCons
  tructorAccessorImpl.java:88) ~[?:?]
  To identify the error, execute the below command in APIM shell:
  debug tail file var/log/elasticsearch/apiconnect_analytics.log
  

Local fix

• Contact IBM Support to move the problematic index
  

Problem summary

• A management server upgrade from V5.0.0.0 through V5.0.6.X to
  5.0.7.X or later can cause elasticsearch to hang and prevent the
  management server from starting up. This is an infrequent
  problem.  You will see elasticsearch fail to sync in
  /var/log/messages and the elasticsearch log will show a
  "java.lang.IllegalStateException: unable to upgrade the mappings
  for the index [[cmc-2017.01/zEzaQ-xxxxxxx]]" message.
  

Problem conclusion

• The problem has been fixed in API Connect 5.0.8.1.
  

Temporary fix

Comments

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Fix information

• Fixed component name

  API CONNECT ENT

• Fixed component ID

  5725Z2201

Applicable component levels

• R507 PSY

     UP