Training Data

[ThomasCai35]

Thanks for your excellent work! You mentioned that Theia model had much much smaller training dataset, smaller model size, and smaller resolution compared to those teacher models. Plus, you mentioned that you thought training data could outweigh supervision on vision task. So I launched an issue. Would Theia model work better with the development of the training dataset? If so, did you have any recommendation or ideas about training dataset which would develop the performance possibly. Thanks.

[jshang-bdai]

I guess datasets larger than ImageNet-1K could work!