硬件预算咨询 - Githubissues

OpenMOSS / MOSS

An open-source tool-augmented conversational language model from Fudan University

https://txsun1997.github.io/blogs/moss.html

Apache License 2.0

11.92k stars 1.14k forks source link

Open vany75 opened 1 year ago

vany75 commented 1 year ago

如果搭建一台服务器跑MOSS的话，预算大概是多少呢？能否给个配置建议

Crear12 commented 1 year ago

3090台式机的话（24GB显存）3000刀基本拉满了。满载体验的话A100 80GB的话单卡24000刀，H100我记得Dell给我们的报价是约等于两张A100 80GB，或者四张A100 40GB。