search

CDAT / cdat

Community Data Analysis Tools
Other
174 stars 68 forks source link

OPeNDAP URL from the GUI Does Not Work #56

Closed williams13 closed 11 years ago

williams13 commented 11 years ago

I can enter an OPeNDAP URL in the file window and it will open it and show the dimensions. However, I cannot "Load and Close" or "Load" the data into memory to show up in the "Variables" window. I used the following OPeNDAP URL for my testing:

http://goldsmr3.sci.gsfc.nasa.gov:80/dods/

doutriaux1 commented 11 years ago

This is not a valid URL! However I tried: http://goldsmr3.sci.gsfc.nasa.gov/dods/MATMCPRAD This works from the command line. In the GUI it seems like it is hanged! Like if it were loading up all the variables in or something (on Mac). Ben can you take a look, it seems related to the cache issue.

I'll look as well.

doutriaux1 commented 11 years ago

Yes, confirmed it eventually loads in the mac... I don't know why itneeds to load the variable completely in before displaying. Ben is it cache? It used to simply need only FILE variable to load the variable information. Again I will double check the code but it seems related to Ben's new cache mechanism.

benbu commented 11 years ago

The only thing the cache system I put in does, is save the cdmsfile objects after they are created. I didn't add any new code to download or open anything that wasn't already there, it's just being stored somewhere now so it can be reused. For these reasons, I doubt it's related to the cache but I could be wrong. I'll look into it after I finish a few other bugs.

doutriaux1 commented 11 years ago

i will look as well thanks Ben.

clynnes commented 11 years ago

MERRA data is available through two different OPeNDAP servers at NASA's GES DISC (my org): http://goldsmr3.sci.gsfc.nasa.gov/dods/ is a GrADS Data Server; data appear to be one big space-time cube, which for a 30-year dataset is moderately large even for monthlies, which may account for it appearing to hang. That service is really intended more for use by a GrADS client, or a client that is paying very close attention to accessing just little slices of it. There is also a Hyrax OPeNDAP server you may want consider in some cases, e.g., http://goldsmr3.sci.gsfc.nasa.gov/opendap/MERRA_MONTHLY/MATMCPRAD.5.2.0, which breaks the files up into individual time slices. Granted, that unaggregated aspect may complicate some of the time navigation in uvcdat; we are experimenting with aggregation via NCML, but not for that product yet. If you want to explore the technical details of the two options, or work with us to tweak some aspects to better support uvcdat, please contact me (chris.lynnes@nasa.gov and/or dana.m.ostrenga@nasa.gov. (P.S. We are also experimenting with TDS, but are not so far along yet.)

doutriaux1 commented 11 years ago

Ok that should be fixed it's the same bug as #55