multi epoch runs do not report per epoch metrics

[sohaibimran7]

The ability to retrieve per-epoch scores for all metrics would be helpful, for eg. to calculate metric variance across epochs. Is there a way to retrieve or easily calculate per-epoch metrics?

[aisi-inspect]

There isn't currently a ready made way to do this (but I agree there should be!). In the meantime you could read the samples directly from the log file (https://ukgovernmentbeis.github.io/inspect_ai/eval-logs.html#evallog). The samples have an epoch field which you could use to compute manually.