batch size and gpu settings?

Luodian / Otter

🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

https://otter-ntu.github.io/

MIT License

3.54k stars 242 forks source link

batch size and gpu settings? #275

Open yichaoshen-MS opened 11 months ago

yichaoshen-MS commented 11 months ago

What are the settings of the num_gpus and batchsize_per_gpu? And what is the total gpu number? Is support gradient_accumulation_steps?