Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TinyCLIP, Inference with auto inheritance #222

Open
giginho83 opened this issue Jan 30, 2024 · 3 comments
Open

TinyCLIP, Inference with auto inheritance #222

giginho83 opened this issue Jan 30, 2024 · 3 comments

Comments

@giginho83
Copy link

Hi, I'm testing some models from TinyCLIP, great work. I would like to know how can I make inference with models with auto inheritance using open clip format. Thanks in advance.

@wkcn
Copy link
Contributor

wkcn commented Jan 31, 2024

Hi @giginho83 , thanks for your attention to our work!

You can refer to the evaluation script: https://github.com/microsoft/Cream/blob/main/TinyCLIP/docs/EVALUATION.md#for-auto-weight-inference-checkpoint

I may update the inference code for auto inheritance.

@wkcn
Copy link
Contributor

wkcn commented Jan 31, 2024

Hi @giginho83 , I have uploaded the example for the inference with auto inheritance in PR #223 .

Before the code is merged into the main branch, you can try this repo: https://github.com/wkcn/Cream/tree/tinyclip_inference_auto_weight_inheritance/TinyCLIP

cd TinyCLIP
python3 inference.py

The model with auto inheritance TinyCLIP-auto-ViT-45M-32-Text-18M will be executed.

@giginho83
Copy link
Author

Thank you very much for the support, it's working

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants