SessionOptionsConfig#
- class openstef_foundation_models.inference.SessionOptionsConfig(*, graph_optimization_level: Literal['DISABLE_ALL', 'ENABLE_BASIC', 'ENABLE_EXTENDED', 'ENABLE_ALL'] = 'ENABLE_ALL', intra_op_num_threads: int | None = None, inter_op_num_threads: int | None = None)[source]#
Bases:
BaseConfigA subset of ONNX Runtime
SessionOptionsexposed as typed config.- Parameters:
- graph_optimization_level: Literal['DISABLE_ALL', 'ENABLE_BASIC', 'ENABLE_EXTENDED', 'ENABLE_ALL']#
Graph optimization level applied when loading the model.
- intra_op_num_threads: int | None#
Threads used within a single operator. None uses the ONNX Runtime default.