Adding a Milvus service

Milvus is a vector database that stores, indexes, and manages massive embedding vectors that are developed by deep neural networks and other machine learning (ML) models. It is developed to empower embedding similarity search and AI applications. Milvus makes unstructured data search more accessible and consistent across various environments.

watsonx.data on Red Hat® OpenShift®

watsonx.data Developer edition

About this task

You can add Milvus as a service in IBM® watsonx.data through web console by using the following steps.

Procedure

  1. Log in to watsonx.data console.
  2. From the navigation menu, select Infrastructure Manager.
  3. To define and connect to a service, click Add component, select Milvus, and click Next.
  4. In the Add component - Milvus window, provide the following details.
    Field Description
    Display name Enter the Milvus service name to be displayed on the screen.
    Size Select the suitable size.
    • Small: Recommended for 10 million vectors, 64 index parameters, 1024 segment size, and 384 dimensions.
    • Medium: Recommended for 50 million vectors, 64 index parameters, 1024 segment size, and 384 dimensions.
    • Large: Recommended for 100 million vectors, 64 index parameters, 1024 segment size, and 384 dimensions.
    Add storage bucket For Small, Medium, and Large sizes, you must associate an external storage. For Starter size, you can use an IBM-managed storage or an external storage.
    Path For external storages, specify the path where you want to store vectorized data files.
    Important:
    • If the schema of the collection changes (an increase in the number of fields in a collection or increase in the size of the varchar field beyond 256 characters, or if multiple vector fields are added into the collection), the number of records might decrease.
    • You must provide the endpoint for storages used by Milvus with the region for region-specific storages like S3 and without trailing slashes. For example:
      https://s3.<REGION>.amazonaws.com
    Note: Milvus service can connect to a storage without a catalog. You can perform the actions on Milvus even after disabling the storage.
    For more information about adding external storages, see Adding storage.
  5. Click Provision.