PollyNET / Pollynet_Processing_Chain

NRT lidar data processing program for multiwavelength polarization Raman lidar network (PollyNET)
https://polly.tropos.de/
GNU General Public License v3.0
20 stars 8 forks source link

hardcoded iwv format files? #152

Closed HolgerPollyNet closed 1 month ago

HolgerPollyNet commented 2 years ago

https://github.com/PollyNET/Pollynet_Processing_Chain/blob/0bd0d80450af4cdb781c29c7125c94e304ed5db6/lib/io/readIWV.m#L64

or https://github.com/PollyNET/Pollynet_Processing_Chain/blob/0bd0d80450af4cdb781c29c7125c94e304ed5db6/lib/io/readIWV.m#L93

Need this to be fixed ?

E.g. for Mindelo it is named: sups_oscm_mwr00_l2_prw_v00_20210916000000.....

HolgerPollyNet commented 2 years ago

This should work in line 93, right?:

_sprintf('*_mwr00_l2_prw_v00_%s*.nc', ..._

ZPYin commented 2 years ago

https://github.com/PollyNET/Pollynet_Processing_Chain/blob/0bd0d80450af4cdb781c29c7125c94e304ed5db6/lib/io/readIWV.m#L93

Need this to be fixed ?

E.g. for Mindelo it is named: sups_oscm_mwr00_l2_prw_v00_20210916000000.....

If the data format of the integrated water vapor (IWV) for Mindelo is the same for Punta-Arenas, you can simple re-config the keyword of MWRFolder https://github.com/PollyNET/Pollynet_Processing_Chain/blob/82bc73fea5b2eb5ffad9145b48ef574cfa25b890/lib/config/polly_global_config.json#L19

Below is for Punta-Areas (old server)

"MWRFolder": "/lacroshome/hatpro/data/pta/data/level2",

This can direct Picasso to search IWV data files at a pre-defined folder.

Let me know whether it works. If not, you can send me the error message and a exemplified file of IWV. Then I can probably quickly fix it. 😄


No need to change MWRSite. This information is automatically parsed from the campaign history file.

HolgerPollyNet commented 2 years ago

The folder of course I changed, but the filename structure to search for was too much hardcoded, as shown above, so with the proposed change it workded, an MWR files were found - But the calibration is not yet working, something I have to dive in together with @ulysses78

HolgerPollyNet commented 1 year ago

any progress on this @ulysses78 ?

ulysses78 commented 1 year ago

Not yet.

ulysses78 commented 1 year ago

I added a function called lib/io/readMWR_cloudnet.m with the option to use IWV cloudnet products from HATPRO-MWR devices. This function reads the cloudnet product file, which is already stored on rsd2-server. This function of course is recognized within the file lib/io/readIWV.m as a new option, besides 'AERONET' and 'MWR'. Whereas 'MWR' means MWR_pro products. To use this new function, one has to change the following key/values in the polly_global_config.json file:

"IWV_instrument": "MWR_cloudnet", "MWRFolder": "/data/level1b/cloudnetpy/products",

HolgerPollyNet commented 1 month ago

Is solved and can be closed, can't it? @ulysses78 @martin-rdz