Yangyi-Chen / SOLO

Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"
Apache License 2.0
111 stars 3 forks source link

Is the folder of [scripts/data/megatron_conversion] be deleted? #6

Closed Hongyuan-Tao closed 3 months ago

Hongyuan-Tao commented 3 months ago

Dear authors! Thank you for your wonderful work! I'd like to pretrain your model but I found the folder [scripts/data/megatron_conversion] was deleted when I was trying to process the data.Is this folder be moved to another place? Looking forward to your early reply!

xingyaoww commented 3 months ago

Hey @Hongyuan-Tao, thanks for spotting this issue! The folder was indeed missing from the repo. I just upload files to the scripts/data/megatron_conversion folder - feel free to let us know (or re-open the issue) if you have further questions!