Configuring a generative AI secret

To activate the generative AI feature in Decision Intelligence Client Managed Software, you must create a Kubernetes secret.

About this task

You do this configuration to connect to a watsonx.ai™ service that hosts the large language models (LLMs). Decision Intelligence calls this service when generation is triggered in a decision.

Procedure

  1. Create a Kubernetes secret to activate the generative AI feature: 
    apiVersion: v1
kind: Secret
metadata:
  name: ads-genai-secret
type: Opaque
stringData:
  genAI: |- 
    { 
      "name": "GENAI",   
      "type": "GENAI",   
      "description": null,   
      "updateTime": 0,   
      "authInfo": { 
        "authType": "IAM",
        "apiKey": "<watsonx_ai_api_key>",
        "authUrl": "https://iam.cloud.ibm.com/identity/token"   },   
        "providerAdditionalInfo": {     
            "providerType": "GENAI",
            "mlUrl": "https://<location>.ml.cloud.ibm.com/",     
            "projectId": "<project_id>"
          },   
      "version": "V1" 
    }
    where <location> in mlUrl is
    • us-south for Dallas
    • eu-gb for London
    • eu-de for Frankfurt
    • jp-tok for Tokyo
    • au-syd for Sydney

    For information about how to retrieve <watsonx_ai_api_key> and <project_id>, see the "Using generative AI to support decisions" tutorial available in Decision Intelligence Client Managed Software samples External link opens a new window or tab in the GitHub repository. You can find the tutorial in the samples > GenerativeAI folder.

  2. The secret must be referenced in spec.genai_secret_name.