search

deatos / HyperVectorDB

Local Vector Database coded in c# supports Cosine Similarity, Jaccard Dissimilarity as well as Euclidean , Manhattan, ChebyShev and Canberra distances
MIT License
7 stars 3 forks source link

ONNX Engine #3

Open deatos opened 1 month ago

deatos commented 1 month ago

I Will be adding in support for loading onnx models on the cpu/gpu such as https://huggingface.co/Qdrant/bge-large-en-v1.5-onnx

@StevenGann, you might be interested in this.

I will link pull request here upon completion for further input.

StevenGann commented 1 month ago

How is this coming along? Can you explain a bit more about it? Will this provide a way to do embeddings without connecting to external software or servers?

deatos commented 1 month ago

reopening

deatos commented 1 month ago

Working with the ONNX engine, one of the major challenges I am facing with this is reliable tokenization in dotnet.

Yes it will provide a way to do embeddings from within dotnet without using an external api.

StevenGann commented 1 month ago

https://learn.microsoft.com/en-us/azure/machine-learning/how-to-use-automl-onnx-model-dotnet?view=azureml-api-2

Looks like ONNX is natively supported by ML.NET. If you push what you have, I could take a look.

deatos commented 1 month ago

@StevenGann, Yes that is what I am using, I have pushed a remake into my other repo, I haven't had much time to work on this as I am finishing up a project for another client however feel free to check it out.