Can 4 A6000 GPUs support pretraining?

OFA-Sys / OFA

Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework

Apache License 2.0

2.39k stars 248 forks source link

Can 4 A6000 GPUs support pretraining? #422

Open bad-meets-joke opened 10 months ago