Open datavistics opened 2 weeks ago
It would be great to have multi-node support for tasks like text generation.
Im hoping to do continued pre-training on a multi-node config for a large model.
No response
Feature Request
It would be great to have multi-node support for tasks like text generation.
Motivation
Im hoping to do continued pre-training on a multi-node config for a large model.
Additional Context
No response