Open IbraheemTuffaha opened 8 months ago
This is tough because all embedders are in python. I don't think this would be possible. The best solution is to run your own infinity embedding service (https://github.com/michaelfeil/infinity) and connect to it using the openai gem.
Actually the proposed feature is to support API based embedding generators like OpenAI and Cohere. Not self-hosted embedding models. What do you think?
That's a good idea. It can use the standard interface of the gem.
It would be convenient if you can choose some of the well known embedders through a configuration instead of implementing them in embed function manually. If the desired embedder is not implemented, then you should implement it yourself.