Memory configuration requirements for graphics cards

FudanDISC / DISC-LawLLM

[中文法律大模型] DISC-LawLLM: an intelligent legal system powered by large language models (LLMs) to provide a wide range of legal services.

Apache License 2.0

549 stars 61 forks source link

Closed baizangchuan closed 1 year ago

baizangchuan commented 1 year ago

请问这个13B的模型实际运行要多大显存呢？40G的卡够不QAQ

yueshengbin commented 1 year ago

40G的卡够了，实际运行大概35G左右

Charlie-XIAO commented 1 year ago

Closing as completed.