Do not backpropagate through layers without gradient sources

LLNL / lbann

Livermore Big Artificial Neural Network Toolkit

http://software.llnl.gov/lbann/

Other

223 stars 79 forks source link

Closed tbennun closed 7 months ago

tbennun commented 8 months ago

This PR tracks layers that do not need to be computed on backpropagation and skips those. Disable with LBANN_NO_BACKPROP_DISABLE=1.

tbennun commented 8 months ago

Patch is ready and working

bvanessen commented 7 months ago

@tbennun Does it past CI?

tbennun commented 7 months ago

Yes