how to set differnt batch sizes for different datasets

InternLM / InternLM-XComposer

InternLM-XComposer2 is a groundbreaking vision-language large model (VLLM) excelling in free-form text-image composition and comprehension.

1.91k stars 120 forks source link

how to set differnt batch sizes for different datasets #332

Open wjn922 opened 3 weeks ago

wjn922 commented 3 weeks ago

In the paper InternLM-XComposer2-4KHD, I find there is a description: "we adjust the data loader to enable different batch sizes for them and adjust their weight accordingly."

How to achieve this during trainining? Looking forward to your replay. Thanks!