Updating the NIM service in CAS ConfigMap
After you install CAS, the
cas-config
configmap must be created. It provides the nv-ingest
endpoint information. Optionally, you can set the NVIDIA re-ranker service to analyze semantic relevance and
reorder search results. This service improves precision in enterprise search applications and
optimizes AI-driven workflows.
To determine the
nv-ingest
endpoint information, you must know the namespace in
which nv-ingest
is installed. The endpoints are constructed by using the pattern
http(s)://..svc.cluster.local
. When you use the default installation namespace of
nv-ingest
and because it does not support https
by default, it
results in the following URLs:- Embed Service: http://nv-ingest-embedqa.nv-ingest.svc.cluster.local
- Ingest service: http://nv-ingest.nv-ingest.svc.cluster.local
Note: These URLs must not end with the
/
character.To complete this activity, use the oc command line tool and run the following
command:
oc apply -f - <<EOF
apiVersion: v1
kind: ConfigMap
metadata:
name: cas-config
namespace: ibm-cas
data:
NVMM_EMBED_SERVICE: <Embed Service URL as determined above>
NVMM_NIM_SERVICE: <Ingest Service URL as determined above>
EOF