Skip to content

2. Acceleration

Jump to bottom
Henry Ruhs edited this page Jul 4, 2023 · 18 revisions

CUDA Execution Provider (Nvidia)

  1. Install CUDA Toolkit 11.8

  2. Install dependencies:

pip uninstall onnxruntime onnxruntime-gpu
pip install onnxruntime-gpu==1.15.0
  1. Usage in case the provider is available:
python run.py --execution-provider cuda

CoreML Execution Provider (MacOS)

  1. Install dependencies:
pip uninstall onnxruntime onnxruntime-silicon
pip install onnxruntime-silicon==1.13.1
  1. Usage in case the provider is available:
python run.py --execution-provider coreml

DirectML Execution Provider (Windows)

  1. Install dependencies:
pip uninstall onnxruntime onnxruntime-directml
pip install onnxruntime-directml

OpenVINO™ Execution Provider (Intel)

  1. Install dependencies:
pip uninstall onnxruntime onnxruntime-openvino
pip install onnxruntime-openvino==1.15.0
  1. Usage in case the provider is available:
python run.py --execution-provider openvino

ROCm Execution Provider (AMD)

  1. Build and install custom wheels from the onnxruntime source.

  2. Usage in case the provider is available:

python run.py --execution-provider rocm
Clone this wiki locally