Open nacartwright opened 2 months ago
Below is the closest I have found to be able to do this. I'm aiming for the same outcome. Looks like a new project with almost no active adoption yet.
Chatbot UI -> OpenAPI-compatible REST API -> LangChain/RAG -> Ollama (or vLLM)
Will keep researching other options.
One feature that would be great is Langchain support for agents or chains. Even if it is a LangServe Remote Runnable it would be awesome to be able to leverage Langchain agents / tools...etc.