lenet5 is the simplest net in this tensorrtx project. You can learn the basic procedures of building tensorrt app from API. Including define network, build engine, set output, do inference, serialize model to file, deserialize model from file, etc.
// 1. generate lenet5.wts from https://github.com/wang-xinyu/pytorchx/tree/master/lenet
// 2. put lenet5.wts into tensorrtx/lenet
// 3. build and run
cd tensorrtx/lenet
mkdir build
cd build
cmake ..
make
sudo ./lenet -s // serialize model to plan file i.e. 'lenet5.engine'
sudo ./lenet -d // deserialize plan file and run inference
// 4. see if the output is same as pytorchx/lenet
# 1. generate lenet5.wts from https://github.com/wang-xinyu/pytorchx/tree/master/lenet
# 2. put lenet5.wts into tensorrtx/lenet
# 3. install Python dependencies (tensorrt/pycuda/numpy)
cd tensorrtx/lenet
python lenet.py -s # serialize model to plan file, i.e. 'lenet5.engine'
python lenet.py -d # deserialize plan file and run inference
# 4. see if the output is same as pytorchx/lenet