SAP AI SDK for JavaScript - v2.17.0
    Preparing search index...

    Type Alias LLMModelDetails

    The model and parameters to be used for the prompt templating. This is the model that will be used to generate the response.

    type LLMModelDetails = {
        max_retries?: number;
        name: string;
        params?: Record<string, any>;
        timeout?: number;
        version?: string;
    }
    Index
    max_retries? name params? timeout? version?
    max_retries?: number

    Maximum number of retries for the LLM request. This parameter is currently ignored for Vertex AI models. Default: 2. Maximum: 5.

    name: string

    Name of the model as in LLM Access configuration

    "gpt-4o-mini"
    params?: Record<string, any>

    Additional parameters for the model. Default values are used for mandatory parameters.

    {
         *   "max_completion_tokens": 300,
         *   "temperature": 0.1,
         *   "frequency_penalty": 0,
         *   "presence_penalty": 0,
         *   "n": 2,
         *   "stream_options": {
         *     "include_usage": true
         *   }
         * }
    timeout?: number

    Timeout for the LLM request in seconds. This parameter is currently ignored for Vertex AI models. Values above 600s may not be honored due to infrastructure connection limits; in practice this primarily affects non-streaming calls where the connection may be idle while waiting for a response. Default: 600. Maximum: 1200. Minimum: 1.

    version?: string

    Version of the model to be used Default: "latest".

    Settings
    Member Visibility

    On This Page
    Properties