search

SkywardAI / kirin

Self-hosted and local-first application for inference and RAG on consumer grade hardware.
Apache License 2.0
7 stars 8 forks source link

[feature]: Embeddings operation #43

Closed Aisuko closed 6 months ago

Aisuko commented 6 months ago

image

As we discussed, we should reduce the image size. So, we should remove sentenceTransformer, it's with too much dependencies.

We prefer all-MiniLM-L12-v2 model, small but strong enough.

Screenshot 2024-03-25 at 10 26 34 PM

Here are some examples: https://github.com/Aisuko/notebooks/tree/main/nlp/sentence-similarity/computing-embeddings

Aisuko commented 6 months ago

As we discussed, we will use https://pypi.org/project/kimchima/