search

ORAC-CC / orac

Optimal Retrieval of Aerosol and Cloud
GNU General Public License v3.0
30 stars 20 forks source link

Where to find ORAC lookup tables #90

Closed pdebuyl closed 11 months ago

pdebuyl commented 1 year ago

The wiki page https://github.com/ORAC-CC/orac/wiki/Download-LUTs points to the URL http://eodg.atm.ox.ac.uk/user/mcgarragh/orac_luts/ to download LUTs. When following the link, I have an error 403.

Is there another location to download LUTs?

Thanks,

Pierre

andyprata commented 1 year ago

Hi Pierre

Yes that link needs updating. You can find the latest look-up tables here: https://gws-access.jasmin.ac.uk/public/oracluts/

As a general rule, you should use the latest version of the LUT for the sensor you're interested in. However, there are a few tables in there that are experimental. The uncertainty treatment for the solar channels is also currently being developed.

May I ask what you plan to use them for? (i.e. cloud, volcanic ash? which sensor etc?)

I could potentially advise on the best way forward then.

Cheers Andy

pdebuyl commented 1 year ago

Hello @andyprata thanks for the reply :-)

I now have the NetCDF LUT files for SEVIRI. I guess that I have mixed up something though: the orac.py driver program complained about not finding "sad files" which are the the orac_luts subdirectory by default, hence my request for LUT files.

Are the .sad and .nc files providing similar information here?

Regarding the use: our (i.e. colleagues in the remote sensing team at RMIB) first use is for cloud retrieval with SEVIRI, with a focus on ice clouds.

simonrp84 commented 1 year ago

Hi Pierre, good to see you getting started on ORAC!

Just to note that the netCDF lookup tables are experimental right now and, at least in my tests, the uncertainties for SEVIRI are problematic. As such, I'll send you the old (.sad) format LUTs via slack.

Regarding the orac.py program, that's @adamcpovey's script. Am sure he can point you at what option is needed to run with whichever version of the LUTs you choose.

pdebuyl commented 1 year ago

Thanks @simonrp84 :-)

adamcpovey commented 1 year ago

There are two reasons that that script might complain: the files you want aren't in the folder (which is solved by accessing the sources above) or the code doesn't know about the LUT you want to use. This is true of the NCDF tables, as they're experimental so we haven't entirely decided what they look like. The table definitions are here and, if that's what you need, I can copy over the syntax for a new table in the morning when I'm at my desk.

pdebuyl commented 12 months ago

Hello @andyprata @adamcpovey . I could get a copy of SAF files for MSG3 and will try to start from there. I am not really enthusiastic about using experimental definition files so will try to stick with those files.

adamcpovey commented 12 months ago

I'm guessing you aren't able to access JASMIN?

pdebuyl commented 12 months ago

No no, I received a zip file from a friendly ORAC contributor.

adamcpovey commented 12 months ago

We don't have a large enough permanent FTP to leave the LUTs somewhere accessible to all. Give Simon or me a shout when you need something and we'll see what we can do.

pdebuyl commented 12 months ago

How much storage would be needed?

adamcpovey commented 11 months ago

Absolutely every table I have (which will include some repeats, failed experiments, and very old versions) is 51GB. So a 100GB space should cover everything we would ever want and we'd have to have a chat to work out the minimum necessary space.

pdebuyl commented 11 months ago

While I can't commit to long term plans, the RMIB team could host this on our public FTP/HTTP server. I am closing this as I have tables though. Feel free to contact me by email (GitHub user name + AT + meteo.be).