AILab-CVC / SEED

Official implementation of SEED-LLaMA (ICLR 2024).
https://ailab-cvc.github.io/seed
Other
515 stars 30 forks source link

Instruction Tuning hyperparameters for SEED-LLaMA #39

Open dhdbsrlw opened 2 months ago

dhdbsrlw commented 2 months ago

Hello. Thank you for releasing this amazing work. I am attempting to perform MultiModal Instruction Tuning on the pretrained-8b SEED-LLaMA model. However, I have not found any detailed hyperparameters in your paper or the GitHub README. Could you share a summary of the instruction tuning hyperparameters for SEED-LLaMA similar to those provided for the pretraining step?