Configuring Watson OpenScale with automatic setup
The automatic setup option for Watson OpenScale sets up a machine learning environment, a database, and a sample model for you. Follow the steps in the guided tour to learn how to evaluate the sample model in Watson OpenScale. After the setup is complete, you can add your own model to the dashboard.
Service The Watson Studio, Watson Machine Learning, Watson OpenScale, and other supplemental services are not available by default. An administrator must install these services on the IBM Cloud Pak for Data platform. To determine whether a service is installed, open the Services catalog and check whether the service is enabled.
Sample model
The automatic setup uses the sample data set German Credit Risk to demonstrate key features of Watson OpenScale.
Overview of the sample data
The German Credit Risk sample data provides a collection of records for bank customers who were used to train the sample model. It contains 20 attributes for each loan applicant. The sample models provisioned as part of the automatic setup are trained to predict level of credit risk for new customers. Two of the attributes considered for the prediction - sex and age - can be tested for bias to make sure that outcomes are consistent regarding gender or age of customers.
To evaluate the outcomes, results are divided into groups. The Reference groups are the groups that are considered most likely to have positive outcomes. In this case, the Reference groups are male customers and customers over the age of 25. The Monitored groups are the groups that you want to review to ensure that the results do not differ greatly from the results for the monitored groups. In this case, the Monitored groups are females and customers aged 19 - 25.
Running the automatic setup
To quickly see how Watson OpenScale monitors a model, run the demo scenario option that is provided when you first launch Watson OpenScale.
- Sign into your Watson OpenScale instance.
- Click the Add-ons () icon.
- Click the Watson OpenScale tile.
- Click the Open button.
- To work with the automatic setup, click Next.
- You must use the locally installed instance of Watson Machine Learning. There is no option for a remote instance. If prompted, select the local option and click Next.
- Provide either the Host name or IP address without the preceding https:// or final forward slash (/), Port, Database name, Username, and Password for your Db2 database. For Db2 options that are part of your cluster, see Services, Data Sources where you find options, such as Db2 Warehouse and Db2 Advanced Enterprise Server Edition. For an external database, you can use IBM Db2 Database. Click Prepare.
As the model evaluation services are being configured, you can review the demo scenario that displays. When configuration is complete, choose whether to take a tour or exit to the dashboard.
- To take the tour, click Start tour.
- To exit the automatic setup and go to the dashboard, click Explore on my own.
Guided tour highlights
The guided tour demonstrates these features:
- Introduction to the user interface (UI): The four main areas of the UI include Insights, Explanations, Configuration, and Support.
- Monitoring and viewing results for the German credit risk model: Use predefined monitors to evaluate your model for fairness, quality, and drift. You can also use custom monitors for model evaluation.
- Exploring Fairness monitor: Use the Fairness monitor to looks for biased outcomes from your model. If a fairness issue is found, an alert is triggered based on configurable thresholds.
- Exploring data sets: Toggle between balanced, payload, training, and debiased data sets to see how they affect the fairness score of your model.
- Introduction to transactions: Review transactions from the payload data set for group bias and individual bias.
- Explaining model outcomes: Understand the features that led to the model prediction to build trust in the model. Additionally, learn how to change feature values to receive more favorable model outcomes.
- Exploring Drift monitor: Use the Drift monitor to determine if the processing of data in the model is causing a drop in accuracy.
- Reviewing transactions: Review the transactions list to investigate the drop in accuracy.
Touring a specific page
To use the automatic setup guided tour for a specific page, follow these steps:
- Open the page for which you would like to follow the guided tour.
- Open the Support tab and select Tour this page.
Resetting the tour
To reset the automatic setup tour, open the Support tab and select Reset auto setup.
Learn more
Parent topic: Setup options for Watson OpenScale