Skip to content

Latest commit

 

History

History
18 lines (15 loc) · 227 Bytes

README.md

File metadata and controls

18 lines (15 loc) · 227 Bytes

Model Inference with Cpp

Bootstrap

Run

make bootstrap
make bootstrap_python

Demo code with sentencepiece

Run

make compile
make run_encoder_demo
make run_encoder_mistral
make run_encoder_mistral_py