search

bigcode-project / Megatron-LM

Ongoing research training transformer models at scale
Other
371 stars 48 forks source link

Fix data preprocessing #76

Closed mayank31398 closed 1 year ago

mayank31398 commented 1 year ago

This PR fixes the issue https://github.com/NVIDIA/Megatron-LM/issues/431.