Clean up long-run pipeline, info statements and duplicate yaml files.

CliMA / ClimaCoupler.jl

ClimaCoupler: bringing atmosphere, land, and ocean together

Apache License 2.0

21 stars 3 forks source link

Clean up long-run pipeline, info statements and duplicate yaml files. #879

Open akshaysridhar opened 5 days ago

akshaysridhar commented 5 days ago

Simplifies 'info' statements to only print on root proc
Unifies amip_target_topo_diagedmf_cpu/gpu yaml files: CPU/GPU is now controlled via environment variables so we do not need 2 yaml files with identical config arguments.

Fixes slabocean, topo+edmf longrun config files following this broken build. These bring these config files in line with Atmos defaults while we investigate potential issues with our SSPKnoth timestepper.

modified:   src/Utilities.jl
modified:   .buildkite/longruns/pipeline.yml
modified:   config/longrun_configs/amip_target_topo.yml
modified:   config/longrun_configs/slabplanet_aqua_coupler_sf_evolve_ocn.yml
modified:    config/longrun_configs/amip_target_topo_diagedmf_cpu.yml
modified:    config/longrun_configs/amip_target_topo_diagedmf_gpu.yml

akshaysridhar commented 5 days ago

There is a pending issue following build 699, in which the same configuration fails on CPU but passes on GPU devices (possibly due to recent bycolumn changes in ClimaAtmos / Coupler)

juliasloan25 commented 4 days ago

We kept the separate GPU and CPU configs for this run only because we want to run it on GPU for 300 days, but running on CPU for 300 days will take a very long time (30 days already takes 7 hours). We kept the CPU config runs at 30 days to avoid wasting compute resources

juliasloan25 commented 4 days ago

There is a pending issue following build 699, in which the same configuration fails on CPU but passes on GPU devices (possibly due to recent bycolumn changes in ClimaAtmos / Coupler)

This configuration has been failing on CPU and passing on GPU for a few weeks (e.g. see this build from two weekends ago), so it predates at least the bycolumn changes that were made in the coupler

akshaysridhar commented 4 days ago

We kept the separate GPU and CPU configs for this run only because we want to run it on GPU for 300 days, but running on CPU for 300 days will take a very long time (30 days already takes 7 hours). We kept the CPU config runs at 30 days to avoid wasting compute resources

Ah noted, the SYPD values are 0.3 or 1.4 for CPU/ GPU respectively, I'll revert this change.