Deploy `Ask-Anything` as APIs locally/on cloud using `langchain-serve`

OpenGVLab / Ask-Anything

[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.

https://vchat.opengvlab.com/

MIT License

2.99k stars 245 forks source link

Open deepankarm opened 1 year ago

deepankarm commented 1 year ago

Exposes APIs from function definitions locally as well as on the cloud.
Very few lines of code changes and ease of development remain the same as local.
Supports both REST & WebSocket endpoints
Serverless/autoscaling endpoints with automatic tls certs on the cloud.
Real-time streaming, human-in-the-loop support - which is crucial for chatbots.

Disclaimer: I'm the primary author of langchain-serve. Would be happy to collaborate on this!

Andy1621 commented 1 year ago

Thanks for your suggestion! Hopefully for your collaboration!