llama_server.py支持多卡推理吗

ProjectD-AI / llama_inference

llama inference for tencentpretrain

GNU General Public License v3.0

96 stars 11 forks source link

Open yuxuan2015 opened 1 year ago

fengyh3 commented 1 year ago

正在写，关注一下update哈

fengyh3 commented 1 year ago

@yuxuan2015 已支持

yuxuan2015 commented 1 year ago

@fengyh3 好的