search

Bluefog-Lib / bluefog

Distributed and decentralized training framework for PyTorch over graph
https://bluefog-lib.github.io/bluefog/
Apache License 2.0
291 stars 71 forks source link

Timeline Backward Tracking #24

Open hanbinhu opened 4 years ago

hanbinhu commented 4 years ago

The current backward timeline using register_backward_hook() will ignore the gradient computation time for the last layer.