Known issues and limitations for AI Factsheets

The following known issues and limitations apply to AI Factsheets.

Known issues

Limitations

Unable to load model attachments in JPG format

Applies to: 5.1.1 and later

Attaching images with a .jpg file extension results in an error.

To resolve, rename the image file to use .jpeg as the extension instead. You can then attach the file.

Factsheet does not display facts for tracked machine learning model

Applies to: 5.1.0 and later

What's happening

  1. You create a machine learning model and track the model in an AI use case.
  2. You promote the model to a space and create a deployment.

The factsheet does not display the data for the deployed model.

How to fix it

To resolve the issue, an admin can:

  1. Restart all the catalog pods: catalog-api , catalog-api-jobs and portal-catalog.
  2. Restart the factsheet pods.

You can now promote and deploy the model again. The factsheet is updated to include the data for the deployed model.

Deployment count in AI factsheet inside a space takes a long time to update

Applies to: 5.1.0 and later

In some scenarios, the number of deployments in a space can differ from the number shown in an associated factsheet. This is caused by a lag in registering the deployment with the factsheet. To resolve the discrepancy, you can refresh the number of deployments shown in the factsheet by following these steps:

  1. Evaluate the deployment.
  2. View the Lifecycle page of the associated AI use case.

The deployment will then display in the factsheet.

Last modified information for updated assets tracks both user-made and internal changes

Applies to: 5.1.0 and later

The last modified information displayed for an asset tracks both changes done directly by a user and changes done internally by services. For example, the factsheet for a tracked model might indicate that the most recent modification was done by System.

These limitations apply to AI Factsheets.

Upgrade IBM Knowledge Catalog and Watson Studio before you upgrade AI Factsheets

You must upgrade IBM Knowledge Catalog and Watson Studio before you upgrade AI Factsheets. If you try to upgrade the AI Factsheets service to latest version before you upgrade IBM Knowledge Catalog and Watson Studio, users might see some inconsistencies and unexpected results with usage of the AI Factsheets service until all of the upgrades are complete.

Integration limitation with OpenPages

When the AI Factsheets is integrated with OpenPages, the fields created in the field groups MRG-UserFacts-Model or MRG-UserFact-Model and MRG-UserFacts-ModelEntry or MRG-UserFact-ModelUseCase are synced to modelfacts_user_op and model_entry_user_op asset type definitions. However, when the fields are created from the OpenPages application, avoid specifying the fields as required, and do not specify a range of values. If you mark them as required or assign a range of values, the sync will fail.

Common namespace required for related services

For AI Factsheets to log the appropriate information, all supplemental and compatible components must be installed in the same namespace. This includes the following services:

  • Watson OpenScale
  • IBM OpenPages
  • IBM Knowledge Catalog
  • Watson Studio
  • Watson Machine Learning

Tracking pauses during upgrade process for IBM Knowledge Catalog

If you used AI Factsheets as part of IBM Knowledge Catalog before 4.6 and must install it again as a standalone service, tracking updates will be suspended from the time of the IBM Knowledge Catalog upgrade until AI Factsheets is installed. The facts for the models that are created or updated in that gap will not be tracked by AI Factsheets. You need to update the metadata of the model such as name, description, tags.

See Upgrading AI Factsheets for more details.

Parent topic: Service issues