Adding deployments for evaluations

To enable evaluations in the Watson OpenScale service, you must add deployments that are hosted by your machine learning providers to the Watson OpenScale Insights dashboard. To add deployments, you can click Add to dashboard to open a wizard that guides you through a series of steps to provide model details.

The following sections describe the steps that you must complete to add deployments in Watson OpenScale.

Select model location

You can choose from a list of available deployment spaces or machine learning providers to specify where your model is located.

List of deployment spaces and machine learning providers is displayed

For Watson Machine Learning deployments, if you choose a deployment space that isn't associated with a machine learning provider, you must add a new provider on the Add new provider tab in the wizard before Watson OpenScale displays a list of deployments.

Select a deployed model

Select the deployment that you want to evaluate. List of deployments that you can select is displayed

If you select a custom machine learning provider, which doesn't provide a list of deployments, you must specify the deployment name and description. You can also specify a scoring endpoint.

Select a storage type

You must choose the location where you want to store your model transactions and evaluation results. You must also specify the type of data that your deployment uses and the type of algorithm that you use to build your model. For some model deployments, Watson OpenScale automatically discovers these details, depending on what metadata is available from your deployment. If you selected your deployment from a deployment list, the model endpoint is specified automatically. If you're adding a production deployment, you can import these settings from existing pre-production deployments.

Select a location to store your model transactions and evaluation results

Review model summary

Watson OpenScale displays a summary of the model details that are discovered from your deployment. If Watson OpenScale discovers all of the required details automatically, you can click Finish and start configuring evaluations. You can also edit the details to make changes.

View summary of model details to verify accuracy and start configuring evaluations

If Watson OpenScale does not automatically discover all the required model details, you must click Save and continue to continue the guided setup by manually providing details to enable evaluations.

View summary of model details to continue guided setup

For more information, see Providing model details.

Next steps

Configuring model evaluations

Parent topic: Preparing to evaluate a model