Popular repositories Loading

1. moetify moetify Public

   The toolkit can be used for creating a mixture from models or from adapters.

   Python 5 1

2. fsdp_qlora fsdp_qlora Public

   Forked from AnswerDotAI/fsdp_qlora

   Training LLMs with QLoRA + FSDP

   Jupyter Notebook

3. transformers transformers Public

   Forked from huggingface/transformers

   🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

   Python

4. peft peft Public

   Forked from huggingface/peft

   🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

   Python

5. fms-hf-tuning fms-hf-tuning Public

   Forked from foundation-model-stack/fms-hf-tuning

   🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.

   Python

6. training training Public

   Forked from instructlab/training

   standalone deepspeed backend

   Python