firelab / windninja

A diagnostic wind model developed for use in wildland fire modeling.
https://weather.firelab.org/windninja/
Other
117 stars 44 forks source link

NOMADS past cast support #188

Open ksshannon opened 8 years ago

ksshannon commented 8 years ago

Related to #49

ksshannon commented 8 years ago

The history of the models varies, we'll need to add an element to the data in nomads.h

ksshannon commented 8 years ago

ping @jforthofer, when you get a chance to try this...

jforthofer commented 8 years ago

I tried out the nomads-pastcast branch but ran into problems and couldn't get a run to go. I first loaded a DEM in the GUI and turned on the weather model initialization. I selected the RTMA, for the time it seemed limited in the calendar thing to only allow today and yesterday, so I picked one of those times and clicked download. I don't think it ever downloaded a file as the file list in the GUI never refreshed to show it. Just after that, I tried to do a regular wx model run (UCAR-RAP) and the GUI just froze up, had to kill it. Command line output looked like this:

"UCAR-NDFD-CONUS-2.5-KM" 
"UCAR-RAP-CONUS-13-KM" 
Qt has caught an exception thrown from an event handler. Throwing
exceptions from an event handler is not supported in Qt. You must
reimplement QApplication::notify() and catch all exceptions there.

terminate called after throwing an instance of 'std::logic_error'
  what():  basic_string::_S_construct null not valid
The program has unexpectedly finished.

Am I doing something wrong... seems like a GUI bug...?

ksshannon commented 8 years ago

RTMA might be a bad case, which I didn't check. I'll attempt to reproduce.

jforthofer commented 8 years ago

I also tried NAM CONUS and it doesn't seem to actually download the file for me. Is there anything I could be doing wrong, like a cmake setting or something?

ksshannon commented 8 years ago

No cmake changes. If you are up to date (git pull), then you are as far as me. Don't test any more until I look.

ksshannon commented 8 years ago

@jforthofer I just reproduced the throw(), I'll fix it. I was able to download the RTMA, CONUS NAM and HRRR from nomads in the past though. We may have hit an issue with RTMA, it is weird.

ksshannon commented 8 years ago

UCAR issue fixed, that was stupid, and I just didn't test. The RTMA issue above I can't reproduce. I suspect it was a date issue.

jforthofer commented 6 years ago

Kyle, we were just talking about this past cast stuff again. Where are we now? I know you were getting things to somewhat work earlier. Was this just from the running 1 month or so data that NOMADS keeps available on the server? Are there data sets to use that have years of archives? We should talk with Matt again about that RTMA data.

ksshannon commented 6 years ago

NOMADS only goes back a week now:

http://nomads.ncep.noaa.gov/pub/data/nccf/com/nam/prod/

jforthofer commented 6 years ago

OK, that's the only data set you know of right now? We should talk to Matt...

ksshannon commented 6 years ago

I need to look at the old NARR and other climate data again. It's been a while.

On Thu, Jun 7, 2018 at 4:43 PM Jason Forthofer notifications@github.com wrote:

OK, that's the only data set you know of right now? We should talk to Matt...

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/firelab/windninja/issues/188#issuecomment-395588874, or mute the thread https://github.com/notifications/unsubscribe-auth/AAwVDWjfxxors_VlxG8A4qzXuLIcJwyQks5t6ayqgaJpZM4JeURM .

-- Kyle

nwagenbrenner commented 2 months ago

I think we can get RTMA for conus and ak going back to at least 2016 here:

https://registry.opendata.aws/noaa-rtma/

We can use the GDAL /vsis3/ driver to extract subsets of the data over the network.

https://gdal.org/user/virtual_file_systems.html