2. Acceleration

CUDA Execution Provider (Nvidia)

1. Install CUDA Toolkit 11.8 and cuDNN for Cuda 11.x

2. Install dependencies:

pip uninstall onnxruntime onnxruntime-gpu
pip install onnxruntime-gpu==1.15.1

3. Usage in case the provider is available:

python run.py --execution-provider cuda

CoreML Execution Provider (Apple Silicon)

1. Install dependencies:

pip uninstall onnxruntime onnxruntime-silicon
pip install onnxruntime-silicon==1.13.1

2. Usage in case the provider is available:

python run.py --execution-provider coreml

CoreML Execution Provider (Apple Legacy)

1. Install dependencies:

pip uninstall onnxruntime onnxruntime-coreml
pip install onnxruntime-coreml==1.13.1

2. Usage in case the provider is available:

python run.py --execution-provider coreml

DirectML Execution Provider (Windows)

1. Install dependencies:

pip uninstall onnxruntime onnxruntime-directml
pip install onnxruntime-directml==1.15.1

2. Usage in case the provider is available:

python run.py --execution-provider directml

OpenVINO™ Execution Provider (Intel)

1. Install dependencies:

pip uninstall onnxruntime onnxruntime-openvino
pip install onnxruntime-openvino==1.15.0

2. Usage in case the provider is available:

python run.py --execution-provider openvino