defenseunicorns / leapfrogai

Production-ready Generative AI for local, cloud native, airgap, and edge deployments.
https://leapfrog.ai
Apache License 2.0
243 stars 27 forks source link

ADR for Text Embeddings #273

Open gphorvath opened 5 months ago

gphorvath commented 5 months ago

ADR goes here: https://github.com/defenseunicorns/leapfrogai/tree/main/docs/adr

Is Instructor XL the right choice for text embeddings?

Leaderboard: https://huggingface.co/spaces/mteb/leaderboard

Candidates:

gphorvath commented 4 months ago

Also look at reranking performance. Do we need to ADR to have different models based on performance on specific use cases?

gphorvath commented 4 months ago

How do we handle reloading data into RAG when models change?