search

redis / redis-vl-python

Redis Vector Library (RedisVL) interfaces with Redis' vector database for realtime semantic search, RAG, and recommendation systems.
https://www.redisvl.com/
MIT License
176 stars 25 forks source link

Improve & Enrich the LLM client implementation for TextVectorizer #160

Closed pierrelambert closed 1 week ago

pierrelambert commented 2 weeks ago
  1. There is no direct way today to use another service than the OpenAI. It would be nice to be able to use any service with an API compatible with the OpenAI one. The target host seems to be hardcoded towards the Open AI service, I may want to use an on-prem/local LLM service, but as for today this is not possible.
  2. Add support for mistral.ai equivalent
justin-cechmanek commented 2 weeks ago

We currently have several TextVectorizer classes to choose from here, but you're correct that mistral is not yet supported. We are in the process of adding support to allow for local vectorizers in this PR. Are there are other specific features you would like to see added to TextVectorizers?

pierrelambert commented 2 weeks ago

I really detected as missing the generic side of connectivity only for now

tylerhutcherson commented 2 weeks ago

Agreed -- @justin-cechmanek we should make a ticket to allow users to overrride the base_url param (and potentially others) for the OpenAI spec. Should be a simple update to the openAI text vectorizer. The support for mistral.ai would be good too given we have some customers using this.

tylerhutcherson commented 1 week ago

@pierrelambert FYI https://github.com/redis/redis-vl-python/pull/171 Can you verify this enables what you need? You just include base_url in the api_config object now.