0hq / tinyvector

A tiny nearest-neighbor embedding database built with SQLite and Pytorch. (In development!)
MIT License
772 stars 24 forks source link

Create embedding functions #3

Open 0hq opened 1 year ago

0hq commented 1 year ago

We want users to be able to generate embeddings on the server and not have to bring their own. We'll need to create a new EmbeddingFunction class than can be extended for custom embedding models on the server, custom endpoints, as well as OpenAI, Cohere, Sentence Transformers, MiniLM, etc.