Troubleshooting
Problem
Redis pods associated to AI OpenScale keep crashing.
# oc get pods | grep -i redis
aiopenscale-ibm-aios-redis-sentinel-84689f6484-nznjs 0/1 CrashLoopBackOff 5 6m
aiopenscale-ibm-aios-redis-sentinel-84689f6484-zbqr8 0/1 CrashLoopBackOff 5 6m
aiopenscale-ibm-aios-redis-sentinel-84689f6484-zqxj4 0/1 CrashLoopBackOff 3 3m
aiopenscale-ibm-aios-redis-server-66fd6dd86f-cgj8g 1/1 Running 2 11d
aiopenscale-ibm-aios-redis-server-66fd6dd86f-wlxkv 1/1 Running 2 11d
aiopenscale-ibm-aios-redis-server-66fd6dd86f-xxz9x 1/1 Running 2 11d
redis-7d65988d5b-5pldz 1/1 Running 2 11d
redis-ha-haproxy-864d4448b4-vzmps 1/1 Running 10 11d
redis-ha-server-0 2/2 Running 4 11d
redis-ha-server-1 2/2 Running 4 11d
Symptom
The aiopenscale-ibm-aios-redis-sentinel pod shows error "ERR unknown command" as follows:
oc logs -p aiopenscale-ibm-aios-redis-sentinel-84689f6484-7s7fw
Starting redis launcher
Setting labels
Selecting proper service to execute
podIP 10.131.0.173
env:AIOPENSCALE_IBM_AIOS_REDIS_, AIOPENSCALE_IBM_AIOS_REDIS_MAS_TER_SVC_SERVICE_PORT, aIOPENSCALE_IBM_AIOS_REDIS_MAS_TER_SVC_SERVICE_HOST 6379, 172.30.188.239, 2
Launching Redis Sentinel
pod/aiopenscale-ibm-aios-redis-sentinel-84689f6484-7s7fw not labeled
Using config file /etc/redis/sentinel.conf
pod/aiopenscale-ibm-aios-redis-sentinel-84689f6484-7s7fw not labeled
Current m@ster is 10.131.2.213 10.129.2.195 10.128.2.164
ERR unknown command `10.129.2.195`, with args beginning with: `10.128.2.164`, `-p`, `6379`, `INFO`,
*** FATAL CONFIG FILE ERROR ***
Reading the configuration file, at line 1
>>> 'sentinel monitor mymaster 10.131.2.213 10.129.2.195 10.128.2.164 6379 2'
Unrecognized sentinel configuration statement.
Launch Redis Sentinel action completed
Document Location
Worldwide
[{"Line of Business":{"code":"LOB76","label":"Data Platform"},"Business Unit":{"code":"BU048","label":"IBM Software"},"Product":{"code":"SSHGYS","label":"IBM Cloud Pak for Data"},"ARM Category":[{"code":"a8m0z000000GoylAAC","label":"Troubleshooting"}],"ARM Case Number":"","Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"All Version(s)"}]
Log InLog in to view more of this document
This document has the abstract of a technical article that is available to authorized users once you have logged on. Please use Log in button above to access the full document. After log in, if you do not have the right authorization for this document, there will be instructions on what to do next.
Was this topic helpful?
Document Information
Modified date:
06 July 2021
UID
ibm16326017