search

rom1504 / clip-retrieval

Easily compute clip embeddings and build a clip retrieval system with them
https://rom1504.github.io/clip-retrieval/
MIT License
2.42k stars 213 forks source link

Integration with hugging face ClipModel #26 #266

Closed Sofianel5 closed 11 months ago

Sofianel5 commented 1 year ago

Allows usage of huggingface ClipModel backends such as https://huggingface.co/patrickjohncyh/fashion-clip or https://huggingface.co/laion/CLIP-ViT-L-14-DataComp.XL-s13B-b90K. Also minor changes such as creating 4 dataloader workers instead of 8 to avoid performance issues.

rom1504 commented 1 year ago

hi, could you please fix the CI ?

rom1504 commented 1 year ago

can you add a test for it at https://github.com/rom1504/clip-retrieval/blob/main/tests/test_clip_inference/test_mapper.py ?

Sofianel5 commented 1 year ago

Hey is anything still blocking merge?

mehdidc commented 1 year ago

Would be great to have this, can we merge @rom1504 ?

rom1504 commented 11 months ago

sorry for the delay, and thank you for the PR!