Open Yut-tuat opened 9 months ago
@Yut-tuat, thanks for your interest! We will try to release the pretraining code. But it will take a while to publish it since I implemented the full pretraining based on our internal infra.
Hi,
Wonderful work!
Could you give me a hint that which codebase or way you use during the pretrain?
Thanks Shawn
@Yut-tuat, thanks for your interest! We will try to release the pretraining code. But it will take a while to publish it since I implemented the full pretraining based on our internal infra.