Setting the maximum summary words

Edit online

You can set the maximum summary words for the Content Assistant in an object store. You can also set the maximum summary for each document subclass within an object store.

Setting the maximum summary words for an object store

Edit online

You can set the maximum summary words for watsonx summaries that the Content Assistant generates within an object store.

About this task

When you set the maximum summary words property for a GenAI configuration object within an object store, the Content Assistant caps the watsonx summary size for a document to the value that you specify. The Content Assistant generates a document summary of size smaller or equal to the maximum summary word size that the LLM finds appropriate.
Note: The selected large language model generates the watsonx summary for document content. Large language models do not enforce this number of words limit strictly. While LLMs generally maintain the requested maximum, you can also see responses 10-20% longer than the requested maximum. The Content Assistant has no control over this behavior of the large language model.

Procedure

  1. In the Administration Console for Content Platform Engine (ACCE), go to the object store where you want to set the maximum summary word size for a document in the object store.
  2. In the left-pane, go to Search.
  3. Click New Object Store Search.
  4. In Simple View, specify the Class as Gen AI Configuration and click Run.
    The search results display a single object.
  5. In the Properties tab for the selected object, specify the maximum summary word size in the Gen AI Max Summary Words field.

    The Content Assistant generates a document summary of size smaller or equal to the specified maximum summary word size that the LLM finds appropriate.

  6. Save your changes.

Setting the maximum summary words for a document class

Edit online

You can set the maximum summary words for the Content Assistant for each document subclass within an object store.

Procedure

  1. In the Administration Console for Content Platform Engine (ACCE), go to Data Design > Classes > Other Classes > Abstract Persistable > Gen AI Summary Prompt Definition and open the class definition.
  2. In the class definition, select Actions > Create Instance to create an instance of the class.
  3. In the new Gen AI Summary Prompt Definitionwizard, specify the value for Gen AI Summary Prompt Class property.
    1. Go to Data Design > Classes > Document.
    2. Select a document subclass for which you want to define a prompt.
      Open the class definition for the document class for which you want to use a different summary prompt template.
    3. Click Actions > Copy Object Reference.
    4. Paste the copied object reference as value for Gen AI Summary Prompt Class property in the Gen AI Summary Prompt Definition wizard.
  4. Specify a value different from the default value for Gen AI Max Summary Words field. Click Next.
    For the selected document sub-class, you can also specify a different value for the Gen AI Max Summary Words property.
  5. Complete the wizard.
  6. Repeat the steps for each document class where you want to add a custom summary prompt template.