Skip to content

BaohaoLiao/mefts

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

14 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

MEFTs

Official code for paper Make Your Pre-trained Model Reversible: From Parameter to Memory Efficient Fine-Tuning

Features

  • BERT on GLUE
  • RoBERTa on GLUE
  • BART on GLUE
  • OPT on Question-Answering

Installation

conda create -n mefts python=3.8
conda activate mefts
pip install torch==1.13.1+cu117 torchvision==0.14.1+cu117 torchaudio==0.13.1 --extra-index-url https://download.pytorch.org/whl/cu117
pip install -r requirements.txt

Fine-Tuning

Run GLUE Experiments with BERT

Citation

If you find our work or code useful, please cite as:

@misc{liao2023make,
    title={Make Your Pre-trained Model Reversible: From Parameter to Memory Efficient Fine-Tuning}, 
    author={Baohao Liao and Shaomu Tan and Christof Monz},
    year={2023},
    eprint={2306.00477},
    archivePrefix={arXiv},
    primaryClass={cs.CL}
}

Releases

No releases published

Packages

No packages published