neuroailab / tfutils

Utilities for working with tensorflow
MIT License
25 stars 8 forks source link

Allow modules to pass lists of outputs in case of parallelization across several GPUs or gradient accumulation #64

Closed damro closed 6 years ago

damro commented 7 years ago

Optimizer needs to be able to collect losses across multiple batches or GPUs. Therefore the API between modules should allow some form of lists of outputs and losses