GenaiBaseQuery class
The GenaiBaseQuery class is a subclass of the
AbstractPersistable class and enables an API caller to submit a question and
generate a response from the watsonx LLM. The base class can be used directly but it does not allow
the question to be augmented with document context.
| Property | Data type | Description |
|---|---|---|
GenaiLLMPrompt |
String | The input prompt from the user. The maximum length for the value is 4000 characters. |
GenaiLLMModelName |
String | An optional watsonx LLM model name. The maximum length for the value is 256 characters. |
GenaiLLMResponse |
String | The response from the watsonx LLM. |
GenaiLLMMaxOutputTokens |
Integer | If you set this parameter, it overrides the LLM maximum output tokens parameter which has a default value of 4096. You cannot set a value less than 10 or greater than 8192. |