search

TigerResearch / TigerBot

TigerBot: A multi-language multi-task LLM
https://www.tigerbot.com
Apache License 2.0
2.24k stars 194 forks source link

180b多机多卡怎么推理？ #39

Open tangjianbing23 opened 1 year ago

tangjianbing23 commented 1 year ago

如题

Vivicai1005 commented 1 year ago
image
tangjianbing23 commented 1 year ago

这是一台机器上面有5张卡吧？假如每台机器有4张卡，单台机器不够呢？