facebookresearch / hydra

Hydra is a framework for elegantly configuring complex applications
https://hydra.cc
MIT License
8.39k stars 608 forks source link

Experimentation tracking support #385

Open omry opened 4 years ago

omry commented 4 years ago

By providing a hook that gets notified before and after the application starts, it's possible to support experimentation tracking.

Candidate backends:

reactivetype commented 4 years ago

This is a nice add-on. CometML could also be a good candidate.

omry commented 4 years ago

Once we have a single such plugin it should be easy for others to contribute more.

jieru-hu commented 2 years ago

this should be possible now with Hydra 1.1's callback https://hydra.cc/docs/experimental/callbacks/