jharwell / sierra

Automation framework for the scientific method in AI research
MIT License
18 stars 1 forks source link

feature/227-models-plugin #227

Closed jharwell closed 3 years ago

jharwell commented 4 years ago

Needed for my modeling paper. Should enable specification in the main.yaml file for a project of what models to enable/run (or maybe just run all models it finds; need a cmdline disable then). All models run during graph generation.

A model for a univariate batch criteria should get/needs:

When running graph generation, linegraphs should check for a '.model' file just like they check for a '.stddev' file. Heatmaps should generate TWO new images: one for the model prediction, and one for the error/deviation from experimental results (e.g. for swarm 2D distribution).

I don't think I should try to set this up to work with bivariate batch criteria.