UDST / orca

Python library for task orchestration
https://udst.github.io/orca/
BSD 3-Clause "New" or "Revised" License
53 stars 21 forks source link

Brainstorming, report cache statistics. #36

Open Eh2406 opened 6 years ago

Eh2406 commented 6 years ago

I was just thinking whether it made sense for us to be cashing all the things, as we do now. In order to answer that I'd want to know for each thing orca is keeping track of:

  1. How many times did orca generate this thing?
  2. How many times did orca use a cached copy of this thing?
  3. How much time was spent in generating this thing?
  4. How much ram was used to hang on to the cached copy of this thing?

Things I could diagnose with this data from after a full model run include: