search

AILab-CVC / SEED

Official implementation of SEED-LLaMA (ICLR 2024).
https://ailab-cvc.github.io/seed
Other
576 stars 31 forks source link

Training code for SEED-LLaMA #12

Open shubhamgarg21 opened 11 months ago

shubhamgarg21 commented 11 months ago

Hi, I am wondering if at any point the training code for SEED-LLaMA will be made available?

geyuying commented 8 months ago

We have released the training code of SEED-LLaMa, including SEED tokenizer, Multimodal LLM pretraining and instruction tuning. Our Multimodal LLM training codebase supports 1. large-scale multi-node training with deepspeed 2. highly-efficient multiple training datapipes.