search

vacancy / NSCL-PyTorch-Release

PyTorch implementation for the Neuro-Symbolic Concept Learner (NS-CL).
http://nscl.csail.mit.edu
MIT License
418 stars 94 forks source link

Does not support MultiGPU training #14

Closed qizhust closed 3 years ago

qizhust commented 3 years ago

Hi, an AssertionError 

assert len(progs) == len(batch_features)

appears when 

args.gpu_parallel=True

did you meet this error?

vacancy commented 3 years ago

Sorry maybe I didn't state clearly in the README file, this code does not support multi GPU training -- actually, using DataParallel won't increase the speed as the bottleneck is the dense CPU operations in program execution.

Using multiprocessing based data parallelism might help, but I haven't tried that.

qizhust commented 3 years ago

Yep, I see. Thanks for your reply :)