SessionOptionsConfig#

class openstef_foundation_models.inference.SessionOptionsConfig(**data: Any) → None[source]#

Bases: BaseConfig

A subset of ONNX Runtime SessionOptions exposed as typed config.

Parameters:: data (Any)

graph_optimization_level: Literal['DISABLE_ALL', 'ENABLE_BASIC', 'ENABLE_EXTENDED', 'ENABLE_ALL']#: Graph optimization level applied when loading the model.

intra_op_num_threads: int | None#: Threads used within a single operator. None uses the ONNX Runtime default.

inter_op_num_threads: int | None#: Threads used across operators. None uses the ONNX Runtime default.

model_config: ClassVar[ConfigDict] = {'arbitrary_types_allowed': False, 'extra': 'ignore', 'protected_namespaces': ()}#: Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].