search

ktindiana / sphinxval

SPHINX validation code for solar energetic particle models
MIT License
3 stars 3 forks source link

Feature Request: Keep track of N forecasts submitted, N skipped #42

Open rickyegeland opened 11 months ago

rickyegeland commented 11 months ago

It should be possible from the SPHINX reports to determine how many forecasts of a given short name were submitted to SPHINX, and how many were skipped e.g. in the All Clear quantity. This can help reveal unexpected omissions or errors in the processing.

The N_submitted and N_skipped values should appear in both the *_metrics.csv files and in the md/html reports.

rickyegeland commented 7 months ago

@ktindiana made some progress on this recently, right? Which commit?

ktindiana commented 7 months ago

@rickyegeland No, the code does not report this information yet. As a human, I looked at files and understood a way to check this, but no coding has been done.