search

NVlabs / FPSci

Aim Training Experiments
Other
70 stars 23 forks source link

Log scoring to database #393

Open jspjutNV opened 2 years ago

jspjutNV commented 2 years ago

The scoring models in #381 may be useful metrics for analysis. A useful feature will be to log these results to the sessions table.

bboudaoud-nv commented 2 years ago

This makes sense to me, we can probably add a way to let people optionally log score (however it is configured) to the database.

I'd suggest that score occur per trial (where it is lease ambiguous) but could also be included in session-level results, though we'd need to have an aggregation metric at that level (sum, mean, etc).

jspjutNV commented 2 years ago

Logging per trial is good, especially if the session is a column in that table since you can use queries to aggregate however you want.