cmu-delphi / exploration-tooling

tools for evaluating and exploring forecasters
Other
0 stars 0 forks source link

`clear_lastminute_nas` will erase too much data as written for `chng` #103

Open dsweber2 opened 6 months ago

dsweber2 commented 6 months ago

Currently, clear_lastminute_nas will remove any row which has any NA's in it whatsoever. With multiple signals, this can mean removing rows with real data (as an example, see 11-29-24, for which 10-02-24 is the last day with data). Before using chng, we will need another scheme to handle differently missing data. Ideas:

@brookslogan may have other thoughts I forgot about.