pytroll / pytroll-examples

Collection of examples for pytroll satellite data processing
GNU General Public License v3.0
76 stars 34 forks source link

FY4A_agri_introduction(zh-CN).ipynb need agri_l1_4000m_geo, how can i do ? #49

Open wanggang19830806 opened 1 year ago

wanggang19830806 commented 1 year ago

When I run: filenames = glob.glob('F:/FY4A/AGRI/20220701/FY4A-_AGRI--_N_DISK_1047E_L1-_FDI-_MULT_NOM_20220701060000_20220701061459_4000M_V0001.HDF') scn = Scene(filenames, reader='agri_fy4a_l1') composite = 'true_color' scn.load([composite])

there are two problem, what can improve it ? Required file type 'agri_l1_4000m_geo' not found or loaded for 'satellite_zenith_angle' Required file type 'agri_l1_4000m_geo' not found or loaded for 'solar_zenith_angle' Required file type 'agri_l1_4000m_geo' not found or loaded for 'solar_azimuth_angle' Required file type 'agri_l1_4000m_geo' not found or loaded for 'satellite_azimuth_angle'

ProxyError: HTTPSConnectionPool(host='zenodo.org', port=443): Max retries exceeded with url: /record/1288441/files/pyspectral_atm_correction_luts_no_aerosol.tgz (Caused by ProxyError('Your proxy appears to only use HTTP and not HTTPS, try changing your proxy URL to be HTTP. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#https-proxy-error-http-proxy', SSLError(SSLError(1, '[SSL: WRONG_VERSION_NUMBER] wrong version number (_ssl.c:1131)'))))

zxdawn commented 1 year ago

It seems you can't access the zenodo correctly. You need to make sure your internet is available to download the pyspectral data. BTW, the reader should be agri_l1.

wanggang19830806 commented 1 year ago

Dear Zhang Xin: the new satpy readers provide agri_fy4a_l1 and agri_fy4b_l1。if add agri_l1,it will show error. from satpy import available_readers available_readers() scn = Scene(filenames, reader='agri_l1')

I'm sure my internet can visit google and youtube github. but how can I available to download the pyspectral data?

zxdawn commented 1 year ago

Ha, thanks for the report. I tested on my machine and got the same error.

However, if I copy https://zenodo.org/record/1288441/files/pyspectral_atm_correction_luts_no_aerosol.tgz to browser, the data can be downloaded successfully.

zxdawn commented 1 year ago

Well, it should be the internet problem. Here's the test on my Chinese machine:

Without vpn:

wget https://zenodo.org/record/1288441/files/pyspectral_atm_correction_luts_no_aerosol.tgz                                      ✔  arctic   14:44:49
--2022-11-15 14:44:50--  https://zenodo.org/record/1288441/files/pyspectral_atm_correction_luts_no_aerosol.tgz
Resolving zenodo.org (zenodo.org)... 0.0.0.0
Connecting to zenodo.org (zenodo.org)|0.0.0.0|:443... failed: Connection refused.

With vpn:

wget https://zenodo.org/record/1288441/files/pyspectral_atm_correction_luts_no_aerosol.tgz                                  INT ✘  arctic   14:44:34
--2022-11-15 14:44:35--  https://zenodo.org/record/1288441/files/pyspectral_atm_correction_luts_no_aerosol.tgz
Connecting to 127.0.0.1:7890... connected.
Proxy request sent, awaiting response... 200 OK
Length: 54291625 (52M) [application/octet-stream]
Saving to: ‘pyspectral_atm_correction_luts_no_aerosol.tgz’

pyspectral_atm_correction_luts_no_aerosol. 100%[========================================================================================>]  51.78M  10.2MB/s    in 6.0s

2022-11-15 14:44:44 (8.60 MB/s) - ‘pyspectral_atm_correction_luts_no_aerosol.tgz’ saved [54291625/54291625]
wanggang19830806 commented 1 year ago

Thanks:     I have beend download pyspectral_atm_correction_luts_no_aerosol.tgz. The file should be put where the correct directory ? Then the porgram could run right?

Thank you for your prompt reply! ------------------ 原始邮件 ------------------ 发件人: "pytroll/pytroll-examples" @.>; 发送时间: 2022年11月15日(星期二) 下午2:46 @.>; 抄送: "IT'S MY @.**@.>; 主题: Re: [pytroll/pytroll-examples] FY4A_agri_introduction(zh-CN).ipynb need agri_l1_4000m_geo, how can i do ? (Issue #49)

Well, it should be the internet problem. Here's the test on my Chinese machine:

Without vpn: wget https://zenodo.org/record/1288441/files/pyspectral_atm_correction_luts_no_aerosol.tgz  ✔  arctic   14:44:49 --2022-11-15 14:44:50-- https://zenodo.org/record/1288441/files/pyspectral_atm_correction_luts_no_aerosol.tgz Resolving zenodo.org (zenodo.org)... 0.0.0.0 Connecting to zenodo.org (zenodo.org)|0.0.0.0|:443... failed: Connection refused.
With vpn: wget https://zenodo.org/record/1288441/files/pyspectral_atm_correction_luts_no_aerosol.tgz  INT ✘  arctic   14:44:34 --2022-11-15 14:44:35-- https://zenodo.org/record/1288441/files/pyspectral_atm_correction_luts_no_aerosol.tgz Connecting to 127.0.0.1:7890... connected. Proxy request sent, awaiting response... 200 OK Length: 54291625 (52M) [application/octet-stream] Saving to: ‘pyspectral_atm_correction_luts_no_aerosol.tgz’ pyspectral_atm_correction_luts_no_aerosol. 100%[========================================================================================>] 51.78M 10.2MB/s in 6.0s 2022-11-15 14:44:44 (8.60 MB/s) - ‘pyspectral_atm_correction_luts_no_aerosol.tgz’ saved [54291625/54291625]
— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

zxdawn commented 1 year ago

You can turn on the debug like this:

from satpy.utils import debug_on
debug_on()

Then you will see the directory to save data. For my mac laptop, it's /Users/xin/Library/Application Support/pyspectral/rayleigh_only. Downloading and extracting the tgz file should work.

wanggang19830806 commented 1 year ago

Under your guidance,  I  have put to the correct rayleigh_only file dir .  the new question is No rsr file C:\Users\DELL\AppData\Local\pytroll\pyspectral\rsr_agri_FY-4A.h5 on disk I have go to pyspectral but not found it . could tell me where to download it?

Thank you very much for your patient guidance

------------------ 原始邮件 ------------------ 发件人: "pytroll/pytroll-examples" @.>; 发送时间: 2022年11月15日(星期二) 下午3:00 @.>; 抄送: "IT'S MY @.**@.>; 主题: Re: [pytroll/pytroll-examples] FY4A_agri_introduction(zh-CN).ipynb need agri_l1_4000m_geo, how can i do ? (Issue #49)

You can turn on the debug like this: from satpy.utils import debug_on debug_on()
Then you will see the directory to save data. For my mac laptop, it's /Users/xin/Library/Application Support/pyspectral/rayleigh_only. Downloading and extracting the tgz file should work.

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

zxdawn commented 1 year ago

I suppose it's this one: https://github.com/pytroll/pyspectral/blob/aaa55f732790306826f98e68b3cbc865af9a9086/pyspectral/utils.py#L91

wanggang19830806 commented 1 year ago

It's wonderful,now I could get beautiful FY4A true color map by satpy under your patient guidance.      Then  the question is :  by scn.available_dataset_names(),it can get not only  C01-C14 channel, but include 'solar_azimuth_angle','solar_zenith_angle','satellite_zenith_angle','solar_azimuth_angle'. In satpy new version. scn.available_dataset_names() just shows C01-C14 channel。Did I something wrong?

 And now, scn.load([true color]) did not show" Required file type 'agri_l1_4000m_geo' not found or loaded for 'solar_azimuth_angle' "  any more 。 It means  compostion(true_color)  run the correct and has used agri_l1_4000m_geo ?

------------------ 原始邮件 ------------------ 发件人: "pytroll/pytroll-examples" @.>; 发送时间: 2022年11月15日(星期二) 下午3:43 @.>; 抄送: "IT'S MY @.**@.>; 主题: Re: [pytroll/pytroll-examples] FY4A_agri_introduction(zh-CN).ipynb need agri_l1_4000m_geo, how can i do ? (Issue #49)

I suppose it's this one: https://github.com/pytroll/pyspectral/blob/aaa55f732790306826f98e68b3cbc865af9a9086/pyspectral/utils.py#L91

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

jshn9515 commented 9 months ago

I have the same problem. It shows the message: Required file type 'agri_l1_4000m_geo' not found or loaded for 'satellite_zenith_angle' Required file type 'agri_l1_4000m_geo' not found or loaded for 'solar_zenith_angle' Required file type 'agri_l1_4000m_geo' not found or loaded for 'solar_azimuth_angle' Required file type 'agri_l1_4000m_geo' not found or loaded for 'satellite_azimuth_angle' But the true color map can also be shown without error. Is that OK if I ignore this?

mraspaud commented 9 months ago

@jshn9515 I think the angles are computed if not to be found in the data. The result should not be impacted significantly.