search

OpenEarthLab / CasCast

20 stars 2 forks source link

Hello, may I ask which Python file is used to convert vil-2019-SEVIR-VIL_ANDOMEVENTS2019_0501_0831. h5 to vil-2019-SEVIR-VIL_ANDOMEVENTS2019_0501_0831. h5-30-0. npy? #4

Open hiuaaa opened 2 months ago

hiuaaa commented 2 months ago

Hello, may I ask which Python file is used to convert vil-2019-SEVIR-VIL_ANDOMEVENTS2019_0501_0831. h5 to vil-2019-SEVIR-VIL_ANDOMEVENTS2019_0501_0831. h5-30-0. npy?

JimengShi commented 2 months ago

Hi, I would like to ask this question as well. Is it possible to share the codes to convert h5 files to npy files? Thanks!

jasong-ovo commented 2 months ago

Thanks for your attention. We will release the codes for converting .h5 to the npy soon. Additionally, we follow the excel file provided by the official repo of SEVIR https://github.com/MIT-AI-Accelerator/neurips-2020-sevir to name our .npy file, and the processing is similar as EarthFormer https://github.com/amazon-science/earth-forecasting-transformer. You could also check these repos in advance.

CatIIIIIIII commented 2 months ago

Thank you for your very excellent work! We also need the convertion!

JimengShi commented 2 months ago

Thanks for your attention. We will release the codes for converting .h5 to the npy soon. Additionally, we follow the excel file provided by the official repo of SEVIR https://github.com/MIT-AI-Accelerator/neurips-2020-sevir to name our .npy file, and the processing is similar as EarthFormer https://github.com/amazon-science/earth-forecasting-transformer. You could also check these repos in advance.

Thanks so much for the reply. Based on your description, I wrote programs to convert h5 to npy files on my side. I am looking forward to yours still. The other question is from petrel_client.client import Client in https://github.com/OpenEarthLab/CasCast/blob/master/utils/checkpoint_ceph.py. It shows NameError: name 'Client' is not defined. Could you please share some insights to fix it? How to get the petrel_client installed? Thanks!

jasong-ovo commented 2 months ago

We'll update our codes in Oct. Petrel_client is a private package used in sh_ailab to connect the file system like AWS S3 ceph. We recommend you to replace this class with your own codes to save files in your local file system.

jasong-ovo commented 2 months ago

We'll update our codes in Oct. Petrel_client is a private package used in sh_ailab to connect the file system like AWS S3 ceph. We recommend you to replace this class with your own codes to save files in your local file system.

Additionally, set "use_ceph" to be False in .yaml to avoid the using of the ceph file system.