search

LAION-AI / CLIP_benchmark

CLIP-like model evaluation
MIT License
623 stars 80 forks source link

Add babel imagenet #95

Closed rom1504 closed 1 year ago

rom1504 commented 1 year ago

https://github.com/gregor-ge/Babel-ImageNet

mehdidc commented 1 year ago

Done

rom1504 commented 1 year ago

Adding usage instructions in the readme would be great

On Sat, Jul 8, 2023, 16:27 Mehdi Cherti @.***> wrote:

Closed #95 https://github.com/LAION-AI/CLIP_benchmark/issues/95 as completed.

— Reply to this email directly, view it on GitHub https://github.com/LAION-AI/CLIP_benchmark/issues/95#event-9764374678, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAR437XYTOGINN446ILTUODXPFU5JANCNFSM6AAAAAAZJOWYVA . You are receiving this because you authored the thread.Message ID: @.***>

mehdidc commented 1 year ago

Ah right, will do, here one just needs to specify the language, e.g.

clip_benchmark eval --model xlm-roberta-base-ViT-B-32 --pretrained laion5b_s13b_b90k --dataset babel_imagenet --dataset_root <ROOT> --language <LANG>

mehdidc commented 1 year ago

Added here: https://github.com/LAION-AI/CLIP_benchmark#multilingual-evaluation