Closed FZU-LW closed 1 year ago
Hello, I would like to know the type and number of GPUs used in your experiment, thanks
All of our experiments were run on single GPUs. We used an 80G A100 for the GPT-NeoX experiments, and 40G A100 for everything else.
Hello, I would like to know the type and number of GPUs used in your experiment, thanks