Interface RequestOptions

Request options for orchestration.

interface RequestOptions {
    request?: ChatCompletionRequest;
    requestConfig?: CustomRequestConfig;
    stream?: boolean;
    streamOptions?: StreamOptions;
}

Properties

Prompt configuration.

requestConfig?: CustomRequestConfig

Custom request configuration.

stream?: boolean

Whether to stream the response.

streamOptions?: StreamOptions

Options for the stream.