Open rjalexa opened 4 months ago
Hello @rjalexa, thank you for the feedback! We are currently developing several optimizations for KRAGEN, some of which are:
text2vec-transformers
module will allow you to use local models for embedding)These features are currently planned and will be implemented in the near future.
I would love to use Kragen but the data I must handle is sensitive and cannot leave premises (no OpenAI or other external APIs).
I have my own embedder container to build vectors for both the document and the queries and same for the generative function.
Could Kragen provide an interface for such local models?
Cheers from Italy and thank you