Optionalcache_control?: CacheControlCache control configuration for prompt caching. When provided, a cache
breakpoint is automatically applied to the last cacheable text block of
the last message so the breakpoint advances naturally as the conversation
grows. This removes the need to place cache_control on individual
content blocks manually.
Only applies to models that support cache_control through orchestration
(Anthropic Claude and Amazon Nova model families). Other models will
ignore the directive. See the
SAP AI Core prompt caching docs
for supported models and breakpoint limits.
OptionalcustomRequestConfig?: CustomRequestConfigOptionalplaceholderValues?: Record<string, string>OptionalpromptIndex?: numberOptionalresponseFormat?: ResponseFormatText | ResponseFormatJsonObject | ResponseFormatJsonSchemaOptionalstreamOptions?: StreamOptionsOptionalstrict?: booleanOptionaltools?: ChatOrchestrationToolType[]
Options for an orchestration call.