search

microsoft / DeepSpeed-MII

MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.
Apache License 2.0
1.91k stars 175 forks source link

support stream #488

Open ZZhangxian opened 5 months ago

ZZhangxian commented 5 months ago

support stream