IBM Support

API Connect Upgrade to 10.0.8.1 Fails with Pending Status Due to Database Replication Issue

Troubleshooting


Problem

When upgrading Cloud Pak for Integration (CP4I) from version 2023.4 to 16.1, the corresponding API Connect upgrade from version 10.0.7.0 to 10.0.8.1 may encounter an issue where the API Connect Cluster Custom Resource (CR) remains in a pending state.
 

Symptom

The issue is caused by the API Connect Management subsystem CR entering a warning state. The following status is displayed:
Commands:

oc project <project/namespace where APIC is deployed>

oc get apic 
NAME        READY   STATUS    VERSION         RECONCILED VERSION   MESSAGE                                                             AGE
apic-mgmt   18/18   Warning   10.0.8.1-1110   10.0.8.1-1110        Management is in Warning state - see status condition for details   264d
Upon reviewing the apic-mgmt Custom Resource, the following warning is observed:
oc get apic-mgmt -o yaml
will show :
  - lastTransitionTime: "2024-11-23T13:32:14Z"
    message: Database replication within the cluster is not working
    reason: DatabaseReplicationNotWorking
    status: "True"
    type: Warning
Review the logs of the database pods in API Connect.
oc logs <database pod ending with -db-(number)> -c postgres 
The logs will show following message. It has been formatted for better viewing:
{
  "level": "info",
  "ts": "2024-11-23T13:44:58Z",
  "logger": "postgres",
  "msg": "record",
  "logging_pod": "apic-mgmt-dd3369b9-db-1",
  "record": {
    "log_time": "2024-11-23 13:44:58.016 UTC",
    "user_name": "apicuser",
    "database_name": "apim",
    "process_id": "835",
    "connection_from": "10.128.2.132:33082",
    "session_id": "6741dc5a.343",
    "session_line_num": "1",
    "command_tag": "startup",
    "session_start_time": "2024-11-23 13:44:58 UTC",
    "virtual_transaction_id": "6/278",
    "transaction_id": "0",
    "error_severity": "WARNING",
    "sql_state_code": "01000",
    "message": "database \"apim\" has a collation version mismatch",
    "detail": "The database was created using collation version 2.28, but the operating system provides version 2.34.",
    "hint": "Rebuild all objects in this database that use the default collation and run ALTER DATABASE apim REFRESH COLLATION VERSION, or build PostgreSQL with the right library version.",
    "backend_type": "client backend",
    "query_id": "0"
  }
}

Document Location

Worldwide

[{"Type":"MASTER","Line of Business":{"code":"LOB77","label":"Automation Platform"},"Business Unit":{"code":"BU048","label":"IBM Software"},"Product":{"code":"SSMNED","label":"IBM API Connect"},"ARM Category":[{"code":"a8mKe000000CaZaIAK","label":"API Connect-\u003EAPIC Platform - Mgmt DB"}],"ARM Case Number":"TS017901969","Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"10.0.8"}]

Log InLog in to view more of this document

This document has the abstract of a technical article that is available to authorized users once you have logged on. Please use Log in button above to access the full document. After log in, if you do not have the right authorization for this document, there will be instructions on what to do next.

Document Information

Modified date:
07 January 2025

UID

ibm17177077