ptq

Step-by-Step

This document is used to enable Tensorflow Keras models using Intel® Neural Compressor.

Prerequisite

1. Installation

# Install Intel® Neural Compressor
pip install neural-compressor

2. Install Intel Tensorflow

pip install intel-tensorflow

Note: Supported Tensorflow Version.

3. Prepare Pretrained model

The pretrained model is provided by Keras Applications. prepare the model, Run as follow:

prepare_model.py   --output_model=/path/to/model

--output_model the model should be saved as SavedModel format or H5 format.

Run Command

bash run_tuning.sh --config=vgg16.yaml --input_model=./path/to/model --output_model=./result
bash run_benchmark.sh --config=vgg16.yaml --input_model=./path/to/model --mode=performance