GenaiAdhocSummary class

The GenaiAdhocSummary inherits from the GenaiBaseQuery class. The class takes a list of documents as input and generates the watsonx summary for the documents by passing a subset of the document content to the LLM. The amount of text taken from each input document depends on the number of input documents and the LLM context window.

Table 1. GenaiAdhocSummary class properties
Property Data type Description
GenaiLLMPrompt String The input prompt from the user. The maximum length for the value is 4000 characters.
GenaiLLMModelName String An optional watsonx LLM model name. The maximum length for the value is 256 characters.
GenaiLLMResponse String The response from the watsonx LLM.
GenaiLLMMaxOutputTokens Integer If you set this parameter, it overrides the LLM maximum output tokens parameter which has a default value of 4096. You cannot set a value less than 10 or greater than 8192.
GenaiContextDocuments List of Id The list of document id's that are used as context for the query.