Cuda memory error on 5 GPU's

ThalesGroup / ConceptBERT

Implementation of ConceptBert: Concept-Aware Representation for Visual Question Answering

https://github.com/ThalesGroup/ConceptBERT

Other

25 stars 11 forks source link

Cuda memory error on 5 GPU's #12

Open chirag1903 opened 2 years ago

chirag1903 commented 2 years ago

For training on 1024 batch size, it is still showing cuda out of memory error on 5 gpus. Is distributed training is available for this implementation?