IBM Support

ICP slow performance: auth-idp is unable to connect to mongodb

Troubleshooting


Problem

This technote dicusses an issue with ICP performance.

Once you restart 5 master nodes at one time, MongoDB is not able to recover; two pods are up, but the third is unable to recover. This leads that auth-idp is unable to connect to mongodb.

Symptom

  • This is the error i see in the `platform-identity-manager` container logs:

[2020-06-14T19:40:02.997Z] ERROR: platform-identity-mgmt/17 on auth-idp-qc2vs:
    failed to get arrounts { MongoNetworkError: failed to connect to server [icp-mongodb-2.icp-mongodb.kube-system.xxx.xxxx.group:27017] on first connect [MongoNetworkError: connect ECONNREFUSED 10.182.27.70:27017]
        at Pool.<anonymous> (/opt/ibm/identity-mgmt/node_modules/mongodb-core/lib/topologies/server.js:564:11)
        at emitOne (events.js:116:13)
        at Pool.emit (events.js:211:7)
        at Connection.<anonymous> (/opt/ibm/identity-mgmt/node_modules/mongodb-core/lib/connection/pool.js:317:12)
        at Object.onceWrapper (events.js:317:30)
        at emitTwo (events.js:126:13)
        at Connection.emit (events.js:214:7)
        at TLSSocket.<anonymous> (/opt/ibm/identity-mgmt/node_modules/mongodb-core/lib/connection/connection.js:246:50)
        at Object.onceWrapper (events.js:315:30)
        at emitOne (events.js:116:13)
        at TLSSocket.emit (events.js:211:7)
        at emitErrorNT (internal/streams/destroy.js:66:8)
        at _combinedTickCallback (internal/process/next_tick.js:139:11)
        at process._tickCallback (internal/process/next_tick.js:181:9)
      name: 'MongoNetworkError',
      errorLabels: [ 'TransientTransactionError' ],
      [Symbol(mongoErrorContextSymbol)]: {} }
 
  • Also, while preparing to make request to get token, the folllowing error generated:

Failing with error: Server error. Status code: 400; message: Failed to get access token
FAILED
Server error. Status code: 400; message: Failed to get access token

Document Location

Worldwide

[{"Business Unit":{"code":"BU048","label":"IBM Software"},"Product":{"code":"SSBS6K","label":"IBM Cloud Private"},"ARM Category":[{"code":"a8m0z0000001gQiAAI","label":"OpenShift-\u003EDatabase-\u003EMongoDB"}],"ARM Case Number":"TS003822535","Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"All Version(s)","Line of Business":{"code":"LOB77","label":"Automation Platform"}}]

Log InLog in to view more of this document

This document has the abstract of a technical article that is available to authorized users once you have logged on. Please use Log in button above to access the full document. After log in, if you do not have the right authorization for this document, there will be instructions on what to do next.

Document Information

Modified date:
03 September 2020

UID

ibm16236998