search

bigcode-project / Megatron-LM

Ongoing research training transformer models at scale
Other
374 stars 49 forks source link

Fix data preprocessing #76

Closed mayank31398 closed 1 year ago

mayank31398 commented 1 year ago

This PR fixes the issue https://github.com/NVIDIA/Megatron-LM/issues/431.