Closed FariborzDaneshvar-NOAA closed 2 months ago
@FariborzDaneshvar-NOAA is the CSV file aggregate of the USGS stations?
Also about about the location of the new file, I agree that it's a "post" script. But in this case it needs to be evaluated in the "prep" environment, like the analyze_ensemble.py
script. The post refers to the env created for deterministic run (before probabilistic run was implemented). Maybe we can just put this under prep/files
as well and at some point think about reorganizing everything.
What do you think?
@
@FariborzDaneshvar-NOAA is the CSV file aggregate of the USGS stations?
This is the aggregate of all observation points I got from the NHC team (including COOPS and USGS) for retrospective storms. It has two attributes for two vdatums (NAVD88, and xGEOID20b). Maybe putting it in the static_data ?!
Also about about the location of the new file, I agree that it's a "post" script. But in this case it needs to be evaluated in the "prep" environment, like the
analyze_ensemble.py
script. The post refers to the env created for deterministic run (before probabilistic run was implemented). Maybe we can just put this underprep/files
as well and at some point think about reorganizing everything.What do you think?
100% agree! I put it here just for the reference. Do you want me to move it to singularity/prep/files
?
I was also thinking of integrating it into analyze_ensemble, but first wanted to add it to EnsemblePerturbation, and call it from there. Any thoughts?
Do you want me to move it to
singularity/prep/files
Yes please.
Any thoughts?
It's a good idea. I agree it's a good idea to integrate. So are you thinking about adding it as a separate example
in ensembleperturbation
like what we have for klpc?
It's a good idea. I agree it's a good idea to integrate. So are you thinking about adding it as a separate
example
inensembleperturbation
like what we have for klpc?
No, I was thinking about adding these two functions:
make_ROC_curve_inputs()
function in ensembleperturbation/uncertainty_quantification/surrogate.py
. Inputs will be 1) probabilities.nc
that will be created earlier with probability_field_from_surrogate()
, and 2) obs_csv (from static_data for now).plot_ROC_curve()
function in ensembleperturbation/plotting/surrogate.py
with one input (netcdf file created in the previous step)@SorooshMani-NOAA I moved it to /prep/files/ as you suggested. You might want to close this PR until I make the next change! thanks for sharing your thoughts.
I missed your earlier comment about CSV ... we can put that in static data, but if we want to put anything related to that in ensemble perturbation we should generalize it so that data can be fetched using your stormevents usgs module
I like your suggestion for adding the functions in the ensemble perturbation, let's just make sure we deal with the USGS aggregate input.
Let's keep it like this, we'll merge it when you're ready
@FariborzDaneshvar-NOAA I forgot about this ... is it OK to merge this?
is it OK to merge this?
Yes please, thanks.
From my side I see the same file added to both prep and post directories. I accept the merge, but then I'll cleanup in #51 where I'm reorganizing stuff
@SorooshMani-NOAA Thanks! Sorry I forgot to remove the duplicate one from post!
Added
ROC_single_run.py
to calculate stats (i.e., hit, miss, ... and POD,FAR), and plot ROC (based on POD and FAR).Command with example args: