Number of nodes required for downstream tasks training

facebookresearch / HierVL

[CVPR 2023] HierVL Learning Hierarchical Video-Language Embeddings

Other

43 stars 3 forks source link

Number of nodes required for downstream tasks training #8

Closed hudaAlamri closed 10 months ago

hudaAlamri commented 10 months ago

Hello,

I have a question regarding the configuration for downstream task training. Specifically, I'm unsure about the number of nodes required to reproduce the results. In the configuration files, such as epic.json, the GPU is set to 8, but in trainer.sh, the srun command is set with N8 and n_gpu:8. Could you please provide clarification on this?

Thank you!

thechargedneutron commented 10 months ago

The GPU is set to 8 regardless of number of nodes. I remember using 4 nodes for all downstream task training.