toodef / neural-pipeline

Neural networks training pipeline based on PyTorch
https://neural-pipeline.readthedocs.io
MIT License
312 stars 24 forks source link

Add batch gradients accumulating (for increase batch without increasing memory usage) #9

Open toodef opened 5 years ago

toodef commented 5 years ago

For solving this issue these steps needed:

For do this test need to provide same data input to model and same weights in model (last can be done by flushing weights to file).