Integration with Hugging Face transformers library

[younesbelkada]

Hi there!

We recently created an HfQuantizer to facilitate the integration of new quantization libraries on HF transformers: https://huggingface.co/docs/transformers/main/en/hf_quantizer - the code changes should be quite easy and the whole community would benefit from an easy API !

See an example here: huggingface/transformers#28928 of a recent integration

I can also help for the integration if needed !

Thanks in advance

[SidaZh]

@younesbelkada Excellent work！We are very willing to contribute eetq to the hf community.

[younesbelkada]

Nice, thank you @SidaZh ! Let us know if you need any help kick-offing the PR ! Looking forward to your contribution !