pytroll / pygac

A python package to read and calibrate NOAA and Metop AVHRR GAC and LAC data
https://pygac.readthedocs.org/
GNU General Public License v3.0
20 stars 25 forks source link

Half a pixel shift on the x-axis for Metop GAC data. #88

Open mraspaud opened 3 years ago

mraspaud commented 3 years ago

Disclaimer: this is probably not an issue in pygac, but because it involves pygac and because of a lack of other place, I would like to have the discussion here.

@helgaweb has brought to my attention four passes from metops A and B where there is a consistent shift in x-direction. Since these are considered KLM satellites, there is no correction applied to the navigation by pygac (or satpy for that matter), so we are wondering where this can come from. @sfinkens @carloshorn any ideas? Attaching some images so you can see.

ECC_GAC_avhrr_metopa_99999_20080425T0859344Z_20080425T1040564Z h5_ch2 ECC_GAC_avhrr_metopa_99999_20080603T0853028Z_20080603T1034248Z h5_ch2 ECC_GAC_avhrr_metopb_99999_20130620T0916194Z_20130620T1006314Z h5_ch2 ECC_GAC_avhrr_metopb_99999_20130621T0855104Z_20130621T0945224Z h5_ch2

mraspaud commented 3 years ago

For the record, these were generated using pygac output form clara a2, but I downloaded one of the original gac files from NOAA class, plotted it with satpy and pygac, and could not see any difference.

helgaweb commented 3 years ago

Thanks @mraspaud Here are further impressions - a visual comparison of LAC L1c data by the University of Bern and PyGAC CLARA-A2 data. diff_lac_gac_20080603_0901_metop2 diff_lac_gac_20080425_0907_metop2 diff2_lac_gac_20080425_0907_metop2

sfinkens commented 3 years ago

Oh, that's nasty. I have no idea what the reason might be. But somebody mentioned in a meeting just now that the LAC -> GAC averaging for METOP might not be done onboard but in the ground segment. And maybe the methods differ.

helgaweb commented 3 years ago

@abhaydd Please also have a look.

mraspaud commented 3 years ago

@sfinkens Yes, that was one of my hypothesis, that the navigation doesn't match the aggregation in the same manner as it does on NOAA GAC.

helgaweb commented 3 years ago

@sfinkens Yes, I looked into that. And have notes & plots on this. Even though it was new for me that the onground resampling should take place at NOAA facilities and not EUMETSAT processing facilities.

abhaydd commented 3 years ago

Thanks @helgaweb for informing about this anomaly. I think we need to have credible/reliable information on how the processing of GAC differs between NOAA and EUMETSAT facilities (may be it doesn't). We should probably raise this point in tomorrows FCDR meeting.

helgaweb commented 3 years ago

@abhaydd Yes indeed, sofar its an open issues and only hypothesis. I made a few tests, but didn't had proper access for test data. And as said I went into the documentation...but this is also not reliable.

mraspaud commented 3 years ago

I was just talking to @abhaydd and he was wondering if the gac aggregation scheme wasn't causing the problem. He seems to remember that 4pixels are aggregated and the lon/lat is taken from the 5th pixel. @helgaweb could you check where a given lon/lat in a GAC pass is located in the corresponding LAC pass, columnwise ?

abhaydd commented 3 years ago

Do we have any statistic w.r.t. how frequently such a shift occurs? Is it a systematic feature or have we just checked few scenes? Thanks.

helgaweb commented 3 years ago

@mraspaud It's supposed to be the same lon/lat info columnwise. But that's one of the things, why I was asking for this data earlier. So yes.

@abhaydd Few scenes were checked visually. The analysis of the relative geometric accuracy of LAC/GAC contains a much larger sample. But of course, there could be other error sources involved (even after the extensive testing).

mraspaud commented 3 years ago

@helgaweb did you have time to look further at this?

helgaweb commented 3 years ago

@mraspaud Yes I had. I compiled information from the KlM User's Guide and analysed few scenes (FRAC, LHRR, HRPT, in comparison to GAC from UniBe and NSS. Sorry for the slow response here. I will reach out soon.

mraspaud commented 1 year ago

@helgaweb any news on this? we were talking about this again...

helgaweb commented 1 year ago

@mraspaud I stopped working on that same time ago. I think I shared the latest plots with @abhaydd and you in dec 2020? I did a lot of literature search -> you find this in my CMSAF final report. I can send it to you via email? Let me know how I can support this...

mraspaud commented 1 year ago

getting your report would be great. I can then document here.