Closed Hongyuan-Tao closed 3 months ago
Hey @Hongyuan-Tao, thanks for spotting this issue! The folder was indeed missing from the repo.
I just upload files to the scripts/data/megatron_conversion
folder - feel free to let us know (or re-open the issue) if you have further questions!
Dear authors! Thank you for your wonderful work! I'd like to pretrain your model but I found the folder [scripts/data/megatron_conversion] was deleted when I was trying to process the data.Is this folder be moved to another place? Looking forward to your early reply!