search

ktindiana / sphinxval

SPHINX validation code for solar energetic particle models
MIT License
3 stars 3 forks source link

Apply filtering based on issue time to determine first and last forecasts, etc #88

Open ktindiana opened 5 months ago

ktindiana commented 5 months ago

Add: Filtering on issue time may provide information about model performance using the earliest available data and the most available data (data that became available later on and not necessarily in real time). This is particularly relevant for iPATH, which can be rerun after flare information is update, or iPATH and SEPMOD, which may be rerun if CME parameters are updated. This is a type of scientific investigation.

Exists: The current "First" and "Last" forecast features in SPHINX are based on the prediction window and are most relevant for models that give high cadence predictions like UMASEP, MagPy, ASPECS and we are interested in looking at performance as data comes in in real time. This is an assessment of model performance in real time as the time closes in on the occurrence of an SEP event.

rickyegeland commented 5 months ago

If you sort forecasts by (prediction_window.start_time, issue_time) instead of (prediction_window.start_time) alone, do you get this feature for free through "First", "Last"?