Skip to content

2. Acceleration

Jump to bottom
Henry Ruhs edited this page Jun 27, 2023 · 18 revisions

CUDA Execution Provider (Nvidia)

  1. Install CUDA Toolkit 11.8

  2. Install dependencies:

pip uninstall onnxruntime onnxruntime-gpu
pip install onnxruntime-gpu==1.15.0
  1. Usage in case the provider is available:
python run.py --execution-provider cuda

CoreML Execution Provider (Apple)

  1. Install dependencies:
pip uninstall onnxruntime onnxruntime-silicon
pip install onnxruntime-silicon==1.13.1
  1. Usage in case the provider is available:
python run.py --execution-provider coreml

OpenVINO™ Execution Provider (Intel)

  1. Install dependencies:
pip uninstall onnxruntime onnxruntime-openvino
pip install onnxruntime-openvino==1.15.0
  1. Usage in case the provider is available:
python run.py --execution-provider openvino

ROCm Execution Provider (AMD)

  1. Build and install custom wheels from the onnxruntime source.

  2. Usage in case the provider is available:

python run.py --execution-provider rocm
Clone this wiki locally