In this folder, we provide the code for CDKD and various baseline models to ensure the authenticity and reproducibility of the paper.


For various baseline models, their environment configurations follow the original paper. Specific parameters and code are provided by this folder.


For CDKD, its environment configuration and training method are consistent with Simcc. Specific parameters are provided in the 'config' folder.


Train the teacher model before training the student model. Follow the training guidelines of Simcc for the teacher model. Before training the student model, modify the path of the teacher model in the configuration file.