请问这个工程能在8卡4090上复现吗？

jiahe7ay / MINI_LLM

This is a repository used by individuals to experiment and reproduce the pre-training process of LLM.

348 stars 53 forks source link

Open LYMDLUT opened 7 months ago

LYMDLUT commented 7 months ago

24g显存有办法复现该项目吗？

jiahe7ay commented 7 months ago

能

ye7love7 commented 7 months ago

8卡a40 48g，希望预训练一个7b模型，这个项目可行吗？需要怎么修改呀？谢谢