What is the minimum GPU configurations for training?

myshell-ai / JetMoE

Reaching LLaMA2 Performance with 0.1M Dollars

Apache License 2.0

937 stars 72 forks source link

Open ybdesire opened 2 months ago

ybdesire commented 2 months ago

What is the minimum V100 or A800 numbers we need to train this model if not considering the training time ?