Open xuezhongcailian opened 8 months ago
Does this repository currently support multi-GPU experiments
Hi, Not at the moment. For reference, there is a PR on that (#223) which requires some cleaning and a more robust / generic way to gather gpu info than using WORLD_SIZE directly.
Feature
Does this repository currently support multi-GPU experiments
Motivation
Additional context