CoreMLProvider#
- class openstef_foundation_models.inference.providers.CoreMLProvider(**data: Any) None[source]
Bases:
BaseConfigThe CoreML execution provider (Apple, GPU/Neural Engine).
ModelFormat=MLProgramis required for modern CoreML: the legacyNeuralNetworkformat fragments the graph and silently falls back to CPU for many ops.- Parameters:
data (
Any)
- kind: Literal['coreml']
- model_format: Literal['MLProgram', 'NeuralNetwork']
- compute_units: Literal['CPUOnly', 'CPUAndGPU', 'CPUAndNeuralEngine', 'ALL']
- to_ort() OrtProvider[source]
Compile to an ONNX Runtime provider tuple.
- model_config: ClassVar[ConfigDict] = {'arbitrary_types_allowed': False, 'extra': 'ignore', 'protected_namespaces': ()}
Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].