search

microsoft / Cream

This is a collection of our NAS and Vision Transformer work.
MIT License
1.69k stars 230 forks source link

TinyCLIP, Inference with auto inheritance #222

Open giginho83 opened 10 months ago

giginho83 commented 10 months ago

Hi, I'm testing some models from TinyCLIP, great work. I would like to know how can I make inference with models with auto inheritance using open clip format. Thanks in advance.

wkcn commented 10 months ago

Hi @giginho83 , thanks for your attention to our work!

You can refer to the evaluation script: https://github.com/microsoft/Cream/blob/main/TinyCLIP/docs/EVALUATION.md#for-auto-weight-inference-checkpoint

I may update the inference code for auto inheritance.

wkcn commented 10 months ago

Hi @giginho83 , I have uploaded the example for the inference with auto inheritance in PR #223 .

Before the code is merged into the main branch, you can try this repo: https://github.com/wkcn/Cream/tree/tinyclip_inference_auto_weight_inheritance/TinyCLIP

cd TinyCLIP
python3 inference.py

The model with auto inheritance TinyCLIP-auto-ViT-45M-32-Text-18M will be executed.

giginho83 commented 10 months ago

Thank you very much for the support, it's working