Per-request inputs for a chat completion call.
Only messages, messagesHistory, and placeholderValues are accepted here.
Model parameters (temperature, max_tokens, etc.), tools, and response_format
must be configured in the OrchestrationModuleConfig passed to the constructor.
messages: [ { role:'system', content:'You are a helpful assistant answering questions about {{product}}.' }, { role:'user', content:'Can you give me an overview of its key benefits?' } ]
Per-request inputs for a chat completion call. Only
messages,messagesHistory, andplaceholderValuesare accepted here. Model parameters (temperature,max_tokens, etc.),tools, andresponse_formatmust be configured in the OrchestrationModuleConfig passed to the constructor.