search

vladan-stojnic / ZLaP

Code for Label Propagation for Zero-shot Classification with Vision-Language Models (CVPR2024)
MIT License
32 stars 3 forks source link

Files for feature generation #3

Open santoshkanumuri opened 5 days ago

santoshkanumuri commented 5 days ago

Can you please share code files used to generate the feature files for the project. The files for generating those npy files like text classifiers etc. Thank you.

vladan-stojnic commented 3 days ago

In general these feature files can be generated using any CLIP trained model. I have used OpenCLIP for all models besides BLIP and ALBEF (extracted using LAVIS library) and EVA-CLIP-8B and EVA-CLIP-18B (extracted using HuggingFace transformers as explained in official code). While for generating InMaP classifiers I used the official InMaP code.

After CVPR deadline, I can look into providing the full code I used for extracting those.