Machine learning models

Create a model with APIs

Watson Studio Local provides sample notebooks to help users create their own custom applications that can be powered by machine learning.

To learn more about the machine learning repository client API commands and syntax that you can use inside a notebook, see Save a model in Python and Create a model in HDP.

If you use these commands and syntax, be aware that for Watson Studio Local, the repository URL is static, and you do not need to authenticate to the repository.

For each scoring iteration that you run from a notebook, Watson Studio Local automatically increments the model version. Later in the model details page, you can compare the accuracies of each version that you ran.

Create a model from a file

You can import three types of models:

PMML

An XML file written in the Predictive Model Markup Language. The PMML is scored using JPMML Evaluator (make sure you review the "Supported model types", "Not yet supported model types" and "Known Limitations").

Custom Batch

A third-party vendor model in a compressed .gz format that will perform batch scoring. If you are using the Carolina tool, see Carolina for Hadoop or Carolina Standalone product page for more details.

Requirement: You must ZIP up all scripts and dependent models into a single .gz file before you import it. You can use the utility script provided at /user-home/.scripts/common-helpers/batch/custom/createcustombatch.sh to zip the files.

Custom Online

A third-party vendor model in a .jar format that will perform online scoring. 

Requirement: If you are using the Carolina tool, run your scripts through it to generate the .jar file. See the Carolina for Integration product page for more details.

To perform the online scoring, place all third-party JAR files and license file into the /user-home/_global_/libs/ml/mlscoring/thirdparty/carolina/ folder of Watson Studio Local.

To import a model into your project from a file, complete the following steps:

1. In your project, go to the Models page and click add models.
2. In the Create Model window, click the From File tab.

   Specify the name and description.

3. In the Type file, select what kind of model you are importing.
4. Browse to the file or drag it into the box.
5. Click the Create button.

Test a model online

In the Models page of your project, click Real-time score next to the model to input data and simulate predictions on it as a pie chart or bar graph.

Batch score a model

To run batch prediction jobs that read in a data set, score the data, and output the predictions in a CSV file, complete the following steps:

1. In the Models page of your project, click Batch Score next to the model.

   

2. Select a local or remote Spark cluster, an input data set, and output data set (CSV file).
   Restriction: WML models created in the visual model builder can only use a remote data set as the input data asset. Other types of models can use a local CSV file for the input.
3. Click the Generate batch script button. Watson Studio Local automatically generates a Python script that you can edit directly in the Result view.
   Tip: This script can be customized to pre-process your data, for example, ensuring the case of the dataframe headers is suitable for ML models.
4. Click the Run now button to immediately create and run a job for the script. Alternatively, you can click Advanced settings to save the script as either a .py script or a .ipynb notebook in your project (ensure the file name is unique); then later from the Jobs page of your project, you can create a scheduled job for the script or notebook you saved with Type set to Batch scoring.
   Restriction: If you select a GPU worker for the job, you can only batch score Keras models.

   

   Requirement: If you are scoring a PMML or WML model in Python 3.5 or later, you must specify environment variable SPARK_VERSION=2.1. If you are scoring a Spark model in Python 3.5 or later, you can specify either SPARK_VERSION=2.1 or SPARK_VERSION=2.2.

From the job details page, you can click on each run to view results and logs. You can also view a batch scoring history from the model details.

Evaluate a model

To evaluate the performance of a model, complete the following steps:

1. In the Models page of your project, click Evaluate next to the model.

   

2. Select a local or remote Spark cluster.
3. Select an input data set that contains the prediction column. For each evaluator, you can opt to customize your own threshold metric and specify what fraction of the overall data must be relevant for the model to be considered healthy. For Spark 2.1 model evaluations, the output data set field is ignored.
4. Click the Generate evaluation script button. Watson Studio Local automatically generates a Python script that you can edit directly in the Result view.
   Tip: You can customize this script to pre-process your data, for example, to ensure that the case of the data frame headers is suitable for ML models.
5. Click the Run now button to immediately create and run a job for the script. Alternatively, you can click Advanced settings to save the script as either a .py script or a .ipynb notebook in your project (ensure the file name is unique); then later from the Jobs page of your project, you can create a scheduled job for the script or notebook you saved with Type set to Model evaluation.

   

   Requirement: If you are evaluating a PMML or WML model in Python 3.5 or later, you must specify environment variable SPARK_VERSION=2.1. If you are evaluating a Spark model in Python 3.5 or later, you can specify either SPARK_VERSION=2.1 or SPARK_VERSION=2.2.

From the job details page, you can click on each run to view results and logs. Go to the model details page to view the evaluation history.