TigerResearch / TigerBot

TigerBot: A multi-language multi-task LLM
https://www.tigerbot.com
Apache License 2.0
2.24k stars 194 forks source link

Support smoother streaming conversations and provide api services #56

Closed Tlntin closed 1 year ago

Tlntin commented 1 year ago

支持更加流畅的流式对话,并且提供api服务。

之前的流式对话是一段一段,现在是一个字一个字。 提供api服务,并且api支持流式。 新增了一个web_api_demo,这个和之前的基本区别不大,不过它的预测是通过调用api实现的。


Support smoother streaming conversations and provide api services.

The previous streaming conversation was paragraph by paragraph, but now it is word by word. Provide api services, and the api supports streaming. A new web_api_demo has been added, which is not much different from the previous one, but its prediction is realized by calling the api.