gen_ai_hub.orchestration.models.config module

class gen_ai_hub.orchestration.models.config.OrchestrationConfig(template: Template | TemplateRef, llm: LLM, filtering: ContentFiltering | None = None, data_masking: DataMasking | None = None, grounding: GroundingModule | None = None, stream_options: dict | None = None, translation: Translation | None = None)

Bases: JSONSerializable

Configuration for the Orchestration Service’s content generation process.

Defines modules for a harmonized API that combines LLM-based content generation with additional processing functionalities.

The orchestration service allows for advanced content generation by processing inputs through a series of steps: template rendering, text generation via LLMs, and optional input/output transformations such as data masking or filtering.

__init__(template: Template | TemplateRef, llm: LLM, filtering: ContentFiltering | None = None, data_masking: DataMasking | None = None, grounding: GroundingModule | None = None, stream_options: dict | None = None, translation: Translation | None = None)

Initializes the OrchestrationConfig with specified modules.

Parameters:

  • template (Union[Template, TemplateRef]) – template for rendering input prompts

  • llm (LLM) – language model for text generation

  • filtering (Optional[ContentFiltering], optional) – content filtering module, defaults to None

  • data_masking (Optional[DataMasking], optional) – data masking module, defaults to None

  • grounding (Optional[GroundingModule], optional) – document grounding module, defaults to None

  • stream_options (Optional[dict], optional) – global streaming options, defaults to None

  • translation (Optional[Translation], optional) – translation module, defaults to None

to_dict()

Converts the orchestration configuration to a dictionary format.

Returns:

dictionary representation of the orchestration configuration.

Return type:

dict