Tuning Studio

Tune a foundation model with the Tuning Studio to customize the model for your needs.

Required permissions

To run tuning experiments, you must have the Admin or Editor role in a project.

Required credentials

Task credentials

Data format

Tabular: JSON, JSONL

Note: You can use the same training data with one or more tuning experiments.
Data size

50 to 10,000 input and output example pairs. The maximum file size is 200 MB.

The Tuning Studio is not available with all plans or in all data centers. The foundation models that are available for tuning in the Tuning Studio can also differ by data center. For more information, see watsonx.ai Runtime plans and Regional availability for services and features.

Before you begin

  • Make decisions about the following tuning options:

  • Create a set of example prompts to use as training data for tuning the foundation model. See Data formats.

Procedure

  1. From within a project, go to the Assets tab, click New Asset, and then click New asset > Tune a foundation model with labeled data.

  2. Name the tuning experiment.

  3. Optional: Add a description and tags. Add a description as a reminder to yourself and to help collaborators understand the goal of the tuned model. Assigning a tag gives you a way to filter your tuning assets later to show only the assets associated with a tag.

  4. Click Create.

  5. Click Select a foundation model to choose the foundation model that you want to tune.

    Click a tile to see a model card with details about the foundation model. When you find the foundation model that you want to use, click Select.

  6. Customize the tuning experiment parameters. For details, see Fine tuning.

  7. Evaluate the results of your tuning experiment after the experiment. If necessary, change the training data or the experiment parameters and run more experiments until you're satisfied with the results. See Evaluating the tuning experiment.

What to do next

A tuned model asset is not created until after you create a deployment from a completed tuning experiment. For more information, see Deploying tuned models.