search

CoIR-team / coir

A Comprehensive Benchmark for Code Information Retrieval.
https://archersama.github.io/coir/
Apache License 2.0
61 stars 11 forks source link

Integrate with MTEB? #4

Open Muennighoff opened 2 months ago

Muennighoff commented 2 months ago

Amazing work! It'd be great to have the benchmark integrated in MTEB (https://github.com/embeddings-benchmark/mteb) if you're interested :) I think it'd be great for the community & visibility of your project 😊 Should be pretty simple given your format - We'd just need a PR like one of these: LongEmbed ; Law ; FollowIR ; French ; Scandinavian 🙌

archersama commented 2 months ago

Thanks for your attention and support. We will endeavor to integrate COIR into MTEB in the near future.