search

ContextualAI / lens

This is the official repository for the LENS (Large Language Models Enhanced to See) system.
Apache License 2.0
349 stars 12 forks source link

Generate vocab_tags for my own datasets. #3

Open kai-wen-yang opened 1 year ago

kai-wen-yang commented 1 year ago

Hi, I want to use lens on Birds classification task. But the released vocab_tags obtained from laion does not contain all the bird classnames of my dataset, thus the final accuracy is poor. I want to ask how to build my own vocab_tags for my datasets.

williamberrios commented 1 year ago

Hi @kai-wen-yang , you might need first to extend the vocabulary with these new classes and then generate the CLIP weights associated with the new vocabulary. We will release code for all these steps too!

Keep-lucky commented 1 year ago

Hi @kai-wen-yang , you might need first to extend the vocabulary with these new classes and then generate the CLIP weights associated with the new vocabulary. We will release code for all these steps too! Excuse me, when will these steps be released?