memgraph / odin

MIT License
580 stars 14 forks source link

Add support for other LLMs #7

Open AlexIchenskiy opened 9 months ago

AlexIchenskiy commented 9 months ago

The main idea is to enhance ODIN's flexibility by adding support for any other models supported by LangChain. These models are listed here.

To achieve this, modifications need to be made in the QueryAgents.py and TextAnalizer.py files in the BOR project to allow users to change the model used. Furthermore, environment variables for Docker, Docker Compose, and Python should be modified to allow users to provide specific keys for other models. For instance, configuration for Azure would look like:

OPENAI_API_TYPE=azure
OPENAI_API_BASE=https://<your-endpoint.openai.azure.com>/
OPENAI_API_KEY=your_AzureOpenAI_key
OPENAI_API_VERSION=2023-05-15

While implementing this feature, thorough testing is crucial, despite the current instability of ODIN. This enhancement will significantly increase ODIN's flexibility and user-friendliness.