search

pesser / edflow

Reduce boilerplate code for your ML projects. TensorFlow and PyTorch.
https://edflow.readthedocs.io/
MIT License
24 stars 13 forks source link

Profiling #269

Open jhaux opened 4 years ago

jhaux commented 4 years ago

Introducing: The Pytorch Profiling hook! Saves a trace, that can be interactively viewed via the chrome://tracing tool. Take a look at the attached pictures.

Still on the todo list:

Image 1: Some 15 training steps. Note the validation steps every 2^n steps. zoom_0 Image 2: Zoom to about one step. Left: Forward pass, middle: gradient calculation, right: gradient application. zoom_1 Image 3: Some Conv - Batch-Norm - ReLU layers zoom_2

theRealSuperMario commented 4 years ago

This needs to be documented, otherwise it is just another awesome feature which nobody will ever know about and we will kick it out again after some time.

Besides that, I love it!

theRealSuperMario commented 4 years ago

black formatting is missing