providers#
Typed ONNX Runtime execution-provider configuration.
Each provider is a small pydantic config that compiles to an ONNX Runtime
(name, options) tuple via ExecutionProviderConfig.to_ort(). Keeping
providers as typed configs (rather than raw strings) lets users opt into
hardware acceleration — CUDA, TensorRT FP16, CoreML/ANE — without touching
model code, and keeps the options validated and discoverable.
Classes#
|
The CoreML execution provider (Apple, GPU/Neural Engine). |
|
The default CPU execution provider. |
|
The CUDA (NVIDIA GPU) execution provider. |
|
A subset of ONNX Runtime |
|
The TensorRT execution provider (NVIDIA, ahead-of-time engine build). |