NOAA-EMC / global-workflow

Global Superstructure/Workflow supporting the Global Forecast System (GFS)
https://global-workflow.readthedocs.io/en/latest
GNU Lesser General Public License v3.0
70 stars 163 forks source link

update feature/gfsv16b to use parallel netcdf for I/O #16

Closed yangfanglin closed 3 years ago

yangfanglin commented 4 years ago

Created a new branch feature/gfsv16b_paranetcdf to add the options to workflow scripts to use parallel netcdf for I/O. The application varies with model resolution and computing platform. See

  1. https://github.com/ufs-community/ufs-weather-model/pull/43 for final model changes
  2. https://github.com/NOAA-EMC/fv3atm/issues/23 discussions among the developers
  3. https://docs.google.com/document/d/18vqajgOv3flbS35eNPMnYpFyNiprkJpHkVZpP--dx5o/edit for Jun Wang's tests on Dell.
yangfanglin commented 4 years ago

See https://github.com/NOAA-EMC/global-workflow/pull/17 for the changes and test.

KateFriedman-NOAA commented 4 years ago

@yangfanglin Checking on the status of this issue. Please close if the work is complete. Thanks!

yangfanglin commented 4 years ago

Not entirely resolved yet. We are still using a personal installation of netCDF lib on HERA. The version under NCEP lib does not work.

On Mon, Jun 8, 2020 at 9:46 AM Kate Friedman notifications@github.com wrote:

@yangfanglin https://github.com/yangfanglin Checking on the status of this issue. Please close if the work is complete. Thanks!

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/NOAA-EMC/global-workflow/issues/16#issuecomment-640613392, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKY5N2NERHKUHKPLIUUJ4V3RVTTT3ANCNFSM4KO3NLMQ .

-- Fanglin Yang, Ph.D. Physical Scientist Environmental Modeling Center National Centers for Environmental Prediction 301-6833722; fanglin.yang@noaa.gov http://www.emc.ncep.noaa.gov/gmb/wx24fy/fyang/ http://www.emc.ncep.noaa.gov/gmb/STATS_vsdb/

KateFriedman-NOAA commented 3 years ago

@yangfanglin Check on this issue again. Is this now complete? Thanks!

yangfanglin commented 3 years ago

You can close it now

On Thu, Sep 17, 2020 at 1:51 PM Kate Friedman notifications@github.com wrote:

@yangfanglin https://github.com/yangfanglin Check on this issue again. Is this now complete? Thanks!

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/NOAA-EMC/global-workflow/issues/16#issuecomment-694397570, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKY5N2I5UQR35REHIP65ACTSGJEB7ANCNFSM4KO3NLMQ .

-- Fanglin Yang, Ph.D. Chief, Model Physics Group Modeling and Data Assimilation Branch

NOAA/NWS/NCEP Environmental Modeling Center

https://www.emc.ncep.noaa.gov/gmb/wx24fy/fyang/ https://www.emc.ncep.noaa.gov/gmb/wx24fy/fyang/

KateFriedman-NOAA commented 3 years ago

Thanks!