search

bigscience-workshop / Megatron-DeepSpeed

Ongoing research training transformer language models at scale, including: BERT & GPT-2
Other
1.32k stars 213 forks source link

[MTF] Add `weighted-split-paths` support #299

Closed thomasw21 closed 2 years ago

thomasw21 commented 2 years ago

This will allow to manually set validation dataset.