search

feiyun0112 / Local-LLM-Server

quick way to build a private large language model server and provide OpenAI-compatible interfaces | 快速搭建私有大语言模型（LLM）服务，提供OpenAI兼容接口
Apache License 2.0
29 stars 5 forks source link

Does it support streaming API calls? #2

Closed AI-ASS closed 8 months ago

AI-ASS commented 8 months ago

Does it support streaming API calls?

feiyun0112 commented 8 months ago

yes, it provide OpenAI-compatible interfaces