Closed xxxiaosong closed 1 year ago
How many GPUs are required for this task?
Thank you very much for your attention to our work. In our experimental setup, we harnessed the computational power of 4 Nvidia RTX 3090 GPUs. In theory, a greater number of GPUs can be advantageous, as our approach relies on a symmetric cross-entropy loss, akin to the one used in CLIP. The increased computational resources can potentially enhance the model's performance further.
Thanks for your reply! And how much time does the training process consume for each dataset....
Thanks for your reply! And how much time does the training process consume for each dataset....
Phase 1 (80 epoch) lasts about 24 hours, phase 2 (200 epoch) lasts about 36 hours. Hope this helps.
Thks, this helps a lot!
Can you give information about the model parameter number and inference time?
How many GPUs are required for this task?