Process L3U SST from Geostationary satellites (GOES-<16,17>) and HIMAWARI-08 (NCEP Data Tanks)

[ShastriPaturi]

The L3U SST from Geostationary satellites (GOES-<16,17>) and HIMAWARI-08 available in NCEP data tanks span from 2020621 (GOES-16) till real_time.

1. Search for previous years.
2. Create a IODA converter 
3. Super-ob to 0.25 deg
4. Push to R2D2.

[ShastriPaturi]

@mjhossen, the data are on hera. Please start with 20210801. /scratch2/NCEPDEV/marine/Shastri.Paturi/DATA_realtime/20210801/sst

Example files (Data are hourly): GOES-<16,17> (ABI is the sensor - Advanced Baseline Imager) 20210801230000-STAR-L3C_GHRSST-SSTsubskin-ABI_G16-ACSPO_V2.70-v02.0-fv01.0.nc 20210801230000-STAR-L3C_GHRSST-SSTsubskin-ABI_G17-ACSPO_V2.71-v02.0-fv01.0.nc Himawari-08 (AHI is the sensor - Advance Himawari Imager) 20210801230000-STAR-L3C_GHRSST-SSTsubskin-AHI_H08-ACSPO_V2.70-v02.0-fv01.0.nc

[mjhossen]

@ShastriPaturi Which script we can use?

[ShastriPaturi]

@mjhossen you can use gds2_sst2ioda.py .Sent from my iPhoneOn Oct 5, 2022, at 5:15 PM, mjhossen @.***> wrote: @ShastriPaturi Which script we can use?

—Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you were mentioned.Message ID: @.***>

[mjhossen]

Converted a 10 min file (see a figure). Should we push sst_goes to PT10M database? Before pushing to r2d2 database, should we do superobing?

Is it 10-min or hourly?

[guillaumevernieres]

Yes @mjhossen , all the sst obs have to be superobed, that's what we discussed this am. We're not keeping the raw or not superobed files.

[ShastriPaturi]

@mjhossen Thanks for the plot. Please plot for all the swaths.

Please super-ob to 0.25 deg grid. Ping me when you complete converting for 20210801. I will provide info on superobbing.

[mjhossen]

Completed. Files are located at /work2/noaa/ng-godas/jhossen/sst_goes/20210801/

[ShastriPaturi]

@mjhossen you only needed to convert GOES (ABH) and Himawari (AHI). Also, you need to convert the hourly files to daily files and super-ob them.

[mjhossen]

@ShastriPaturi I think it is better to superob the hourly data first and then concatenate them for daily. I submitted a job for producing a daily file but stopped without completing because to time limit (8 hrs).

[guillaumevernieres]

@ShastriPaturi I think it is better to superob the hourly data first and then concatenate them for daily. I submitted a job for producing a daily file but stopped without completing because to time limit (8 hrs).

@mjhossen , things got lost in translations ... Yes, superob the hourly file and then concatenate. Sorry this wasn't communicated properly, but this is what we've had to do for all the sst retreivals.

[ShastriPaturi]

@mjhossen, copy the following files from /work/noaa/ng-godas/spaturi/nggodas_realtime_ext/DATA_realtime/cron/ioda-v2/sst_10min

1. create_obs2ioda.sh (submits batch job to ioda-convert, for you the hourly files)

• godas_obs2ioda.sh

2. godas_superob.sbatch (submits superobing batch job, you may have to update directories related to soca-science

• godas_store_obs.py & godas_obs2ioda.utils Let me know if you have issues.

[mjhossen]

@ShastriPaturi Some hours data are missing for G17: 20210811/sst/20210811000000-STAR-L3C_GHRSST-SSTsubskin-ABI_G17-ACSPO_V2.71-v02.0-fv01.0.nc 20210811/sst/20210811010000-STAR-L3C_GHRSST-SSTsubskin-ABI_G17-ACSPO_V2.71-v02.0-fv01.0.nc 20210811/sst/20210811020000-STAR-L3C_GHRSST-SSTsubskin-ABI_G17-ACSPO_V2.71-v02.0-fv01.0.nc 20210811/sst/20210811030000-STAR-L3C_GHRSST-SSTsubskin-ABI_G17-ACSPO_V2.71-v02.0-fv01.0.nc 20210811/sst/20210811040000-STAR-L3C_GHRSST-SSTsubskin-ABI_G17-ACSPO_V2.71-v02.0-fv01.0.nc 20210811/sst/20210811050000-STAR-L3C_GHRSST-SSTsubskin-ABI_G17-ACSPO_V2.71-v02.0-fv01.0.nc 20210811/sst/20210811060000-STAR-L3C_GHRSST-SSTsubskin-ABI_G17-ACSPO_V2.71-v02.0-fv01.0.nc 20210811/sst/20210811070000-STAR-L3C_GHRSST-SSTsubskin-ABI_G17-ACSPO_V2.71-v02.0-fv01.0.nc 20210811/sst/20210811080000-STAR-L3C_GHRSST-SSTsubskin-ABI_G17-ACSPO_V2.71-v02.0-fv01.0.nc 20210811/sst/20210811200000-STAR-L3C_GHRSST-SSTsubskin-ABI_G17-ACSPO_V2.71-v02.0-fv01.0.nc 20210811/sst/20210811210000-STAR-L3C_GHRSST-SSTsubskin-ABI_G17-ACSPO_V2.71-v02.0-fv01.0.nc 20210811/sst/20210811220000-STAR-L3C_GHRSST-SSTsubskin-ABI_G17-ACSPO_V2.71-v02.0-fv01.0.nc 20210811/sst/20210811230000-STAR-L3C_GHRSST-SSTsubskin-ABI_G17-ACSPO_V2.71-v02.0-fv01.0.nc

[ShastriPaturi]

@mjhossen continue with what is there. I will get files from HPSS and fill in the missing files if they are available

[mjhossen]

Ioda-conversion and superobing of SST GOES<G16,G17> & Himawari H08 is completed for the period of 20210801-20210831. Superobs data is located at /work2/noaa/ng-godas/jhossen/sst_goes/superob

[ShastriPaturi]

Thanks @mjhossen. Please do the the plots too.

[mjhossen]

Plot ObsValue for 20210801 (24 hours) ABI_<G16, G17> and AHI_H08 superobs data:

[mjhossen]

ObsError (superobs):

[guillaumevernieres]

@ShastriPaturi @mjhossen , is this done?

[ShastriPaturi]

Yes. Closing this issue