Hybrid pods fail to start

In hybrid deployments, cloud native event analytics (CNEA) is unable to connect to the backup ObjectServer, which prevents hybrid CNEA pods from starting.

Problem

Resolution

  1. CNEA is unable to connect to backup ObjectServer either due to blocked IDUC ports that gateway connects to or due to DNS issues. On the primary ObjectServer, check the IDUC ports that they are listening on.
    netstat -tunlp | grep nco
    
    [root@noi-east1 ~]# netstat -tunlp | grep nco
    tcp        0      0 9.30.101.186:4100       0.0.0.0:*               LISTEN      97106/nco_objserv
    tcp        0      0 10.11.115.87:4100       0.0.0.0:*               LISTEN      97106/nco_objserv
    tcp        0      0 9.30.101.186:4101       0.0.0.0:*               LISTEN      97255/nco_objserv
    tcp        0      0 10.11.115.87:4101       0.0.0.0:*               LISTEN      97255/nco_objserv
    tcp6       0      0 :::39313                :::*                    LISTEN      97255/nco_objserv
    tcp6       0      0 :::39847                :::*                    LISTEN      97106/nco_objserv
    
  2. Once you identify the port, test if these ports are not blocked via firewall from the OCP cluster.
    telnet <primary objectserver IP> iduc port
    telnet <backup objectserver IP> iduc port
  3. Resolve the DNS issue between cluster and development environment backup server.
Draft comment: Subhalakshmi.Moosad@ibm.com
Issue #9041