search

memgraph / memgraph-platform

Memgraph Platform is a multi-container application containing Memgraph+MAGE and Memgraph Lab.
Apache License 2.0
21 stars 1 forks source link

memgraph-lab: Add feature for users to specify OpenAI base URL #99

Open theobjectivedad opened 4 months ago

theobjectivedad commented 4 months ago

This feature would allow users who are hosting their own LLMs using OpenAI API compatible services such as vllm, aphrodite-engine, and others to use them with the memgraph-lab AI chat.

Broadly, users would just need a way to override the baseURL for the OpenAI connection type, no other changes would be needed.

katarinasupe commented 4 months ago

Hi @theobjectivedad, thank you for filing this feature request. We'll keep you updated 😄