SessionOptionsConfig

class openstef_foundation_models.inference.providers.SessionOptionsConfig(**data: Any) → None

Bases: BaseConfig

A subset of ONNX Runtime SessionOptions exposed as typed config.

Parameters:

data (Any)

graph_optimization_level: Literal['DISABLE_ALL', 'ENABLE_BASIC', 'ENABLE_EXTENDED', 'ENABLE_ALL']

intra_op_num_threads: int | None

inter_op_num_threads: int | None

model_config: ClassVar[ConfigDict] = {'arbitrary_types_allowed': False, 'extra': 'ignore', 'protected_namespaces': ()}

Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].