Adding a Milvus service

Milvus is a vector database that stores, indexes, and manages massive embedding vectors that are developed by deep neural networks and other machine learning (ML) models. It is developed to empower embedding similarity search and AI applications. Milvus makes unstructured data search more accessible and consistent across various environments.

watsonx.data on Red Hat® OpenShift®

watsonx.data SaaS on AWS

About this task

You can add Milvus as a service in IBM® watsonx.data through web console by using the following steps.

Procedure

  1. Log in to watsonx.data console.
  2. From the navigation menu, select Infrastructure Manager.
  3. To define and connect to a service, click Add component and select Add service.
  4. In the Add service window, select Milvus from the Type list.
    Field Description
    Display name Enter the Milvus service name to be displayed on the screen.
    Size Select the suitable size.
    • Starter: Recommended for 1 million vectors, 64 index parameters, 1024 segment size, 384 dimensions, and IVF_SQ8 index type.
    • Small: Recommended for 10 million vectors, 64 index parameters, 1024 segment size, 384 dimensions, and IVF_SQ8 index type.
    • Medium: Recommended for 50 million vectors, 64 index parameters, 1024 segment size, 384 dimensions, and IVF_SQ8 index type.
    • Large: Recommended for 100 million vectors, 64 index parameters, 1024 segment size, 384 dimensions, and IVF_SQ8 index type.
    Storage bucket For Small, Medium, and Large sizes, you must associate an external bucket. For Starter size, you can use an IBM-managed bucket or an external bucket.
    Note: To associate an external bucket, you must have the bucket configured.
    Path For external buckets, specify the path where you want to store vectorized data files.
    Important:
    • If the schema of the collection changes (an increase in the number of fields in a collection or increase in the size of the varchar field beyond 256 characters, or if multiple vector fields are added into the collection), the number of records might decrease.
    • You must provide the endpoint for buckets used by Milvus with the region for region-specific buckets like S3 and without trailing slashes. For example:
      https://s3.<REGION>.amazonaws.com

    For more information about adding external buckets, see Adding a storage-catalog pair.

  5. Click Provision.