Problem about multi processing

mynlp / cst_captioning

PyTorch Implementation of Consensus-based Sequence Training for Video Captioning

59 stars 17 forks source link

Problem about multi processing #5

Open SilencerChen opened 6 years ago

SilencerChen commented 6 years ago

Thanks for your great work at first. I run you code and find out the usage rate of my GPU is always 0% when calculate the scores of the val captions. I train to use multiprocessing and need to add "num_works" in torch.utils.data.DataLoader but I find you write the class all by yourself. So is there a way to use the mutiprocessing?

plsang commented 6 years ago

I think the COCO Caption Evaluation code does not support running on GPU.
You can implement a DataLoader class to support parallel loading; however, I don't think it improves the speed significantly since data loading is quite fast.
You may need to run on multiple GPUs; however, I haven't tried to implement this. Any contribution is welcome.