About the wandb log for Pretrain and SFT

NVlabs / EAGLE

EAGLE: Exploring The Design Space for Multimodal LLMs with Mixture of Encoders

https://arxiv.org/pdf/2408.15998

Apache License 2.0

543 stars 45 forks source link

Open XpracticeYSKM opened 2 months ago

XpracticeYSKM commented 2 months ago

Thanks for your awesome work!

Can you share the wandb log for Pretrain and SFT, it will be very helpful for us to observe whether our training is normal.

In addition, can we share the projector weights after X5 and X4 pretraining?