Breakend / experiment-impact-tracker

MIT License
266 stars 31 forks source link

child experiment tracker #10

Closed leondz closed 4 years ago

leondz commented 4 years ago

In multi-experiment code it would be constructive to launch one tracker and store child experiments within this. There seems to be some support for this but it's unclear how to use it - is this feature implemented?

Breakend commented 4 years ago

I'm not sure I understand this use case or whether it would even be possible. We use the process ids for the script to attribute energy. We can't attribute energy to threads within python or multiple experiments within one process. I think the recommended approach would be to use multiple scripts each with their own dedicated tracker. Unless you mean to do this sequentially? E.g., something like:

with track('experiment1') as exp1:
      some_exp_here()

with track('experiment2') as exp1:
      some_exp_here()
leondz commented 4 years ago

Ah, OK. This was a reference to this part of the example in the root README.md. My use case is to have an experiment runner that measures impact of multiple experiments.

# The child experiments to group together
  "child_experiments" : 
Breakend commented 4 years ago

Might be addressed by #24 ? We now support contexts and have tests to validate. Please re-open if still an issue.