search

rubra-ai / rubra

Open Weight, tool-calling LLMs
https://docs.rubra.ai/
Apache License 2.0
146 stars 20 forks source link

MTEB score for new embedding models #107

Closed sanjay920 closed 2 months ago

sanjay920 commented 6 months ago

Rubra will soon support embedding models. We need to benchmark the ones that we support by default using the MTEB benchmark: https://github.com/embeddings-benchmark/mteb

sanjay920 commented 6 months ago

Repo to produce and run tests created: https://github.com/rubra-ai/rubra-embed-benchmark

Test started for https://huggingface.co/rubra-ai/rubra-emdeddings/blob/main/nomic-embed-text-v1.5/rubra-nomic-embed-text-v1.5.Q4_K_M.llamafile