Milvus is a vector database that is designed for scalable similarity search.

You can associate a Milvus vector store with a foundation model prompt to use information from documents in the store to ground the prompt input in current facts.

Before you can associate a Milvus vector store with a foundation model prompt, you must perform the one-time task of setting up a connection to the Milvus vector store.

Getting Milvus data store details manually

Collect the details about the data source connection.

  1. From the Milvus service in the watsonx.data console, make a note of the gRPC host value.

    gRPC is a Remote Procedure Call (RPC) framework that enables distributed services to communicate.

    For example, the gRPC host value might be 5c3c2a83-b4gg-4d96-8da4-5a2f1739a496.example.appdomain.cloud:30439

  2. From the IBM Cloud console, create a personal API key and store it securely.

    For more information, see Managing user API keys.

  3. From the overview page of your watsonx.ai project, click the Assets tab, and then choose New asset > Ground gen AI with vectorized documents.

  4. In the Vector database details section, choose Select or create a connection, and then choose Create connection.

  5. Add a name for the connection.

  6. For the connection details, convert the gRPC host value that you noted earlier into separate host and port properties.

    For example, if the gRPC host value is 5c3c2a83-b4gg-4d96-8da4-5a2f1739a496.example.appdomain.cloud:30439, specify the properties as follows:

    • host: Segment of the value before the colon. For example, 5c3c2a83-b4gg-4d96-8da4-5a2f1739a496.example.appdomain.cloud.
    • port: Segment of the value after the colon. For example, 30439.

  7. Define the credentials for the connection.

    • When you specify the username, use the following format:

      ibmlhapikey_<your-email-id>

    • Use the personal API key that you created earlier as the password for the connection.

  8. Verify that the Port is SSL-enabled option is selected.

  9. If you include a certificate, you must specify a certificate that is signed by a known certificate authority. A self-signed SSL certificate is not sufficient.

  10. Click Create.

Learn more