search

EarthWorksOrg / EarthWorks

Other
3 stars 2 forks source link

Post cesm2_3_alpha17a Updates #24

Closed gdicker1 closed 7 months ago

gdicker1 commented 7 months ago

This PR moves CAM up to tag cam6_3_145 while adding a patch for NVHPC compilers, moving CIME up to tag cime6.0.0182, and brings in recent changes to mpas-seaice that fix Intel OneAPI builds.

gdicker1 commented 7 months ago

Related Pull Requests in externals:

[^Edit-1]: Added later, on Jan 30th [^Edit-2]: Added on Feb 1st

gdicker1 commented 7 months ago

Since #22 has been merged, this is now moved out of draft. This PR should be merged quickly, dependent on tests. I skipped most tests in #22 since I expected CAM would break without the patches in EWOrg/CAM #12

gdicker1 commented 7 months ago

@dazlich, could you test this branch for the FullyCoupled compset?

I got an error I really didn't expect when trying to run ./case.build (with any compiler). Essentially the paths don't look right to me and there's a mention of 'Can't locate Switch.pm in @INC ...'

Excerpt of error:

2024-01-29 19:40:32 ice
Create namelist for component mpassi
Calling /glade/work/gdicker/EarthWorks/EWRepo_PullRequests/2024Jan23_TagUpdate_cesm2_3_alpha17a/EW_tst2/components/mpas-seaice//cime_config/buildnml
ERROR: Command: '/glade/work/gdicker/EarthWorks/EWRepo_PullRequests/2024Jan23_TagUpdate_cesm2_3_alpha17a/EW_tst2/components/mpas-seaice/bld/build-namelist -infile /glade/work/gdicker/EarthWorks/EWRepo_PullRequests/2024Jan23_TagUpdate_cesm2_3_alpha17a/cases/2024Jan29_172743_EWTest_postalpha17a_FullyCoupled.mpasa120.derecho.gnu/Buildconf/mpassiconf/cesm_namelist -caseroot /glade/work/gdicker/EarthWorks/EWRepo_PullRequests/2024Jan23_TagUpdate_cesm2_3_alpha17a/cases/2024Jan29_172743_EWTest_postalpha17a_FullyCoupled.mpasa120.derecho.gnu -casebuild /glade/work/gdicker/EarthWorks/EWRepo_PullRequests/2024Jan23_TagUpdate_cesm2_3_alpha17a/cases/2024Jan29_172743_EWTest_postalpha17a_FullyCoupled.mpasa120.derecho.gnu/Buildconf -cimeroot /glade/work/gdicker/EarthWorks/EWRepo_PullRequests/2024Jan23_TagUpdate_cesm2_3_alpha17a/EW_tst2/cime -inst_string '' -decomp_prefix 'mpas-o.graph.info.QU120.' -date_stamp '230524' -ice_grid 'oQU120' -ice_ic_mode 'cold_start' -ice_bgc 'no_ice_bgc' -surface_mode 'free' -iceberg_mode 'none' -prognostic_mode 'full' -ntasks_ice '128' -ninst_ice '1'' failed with error 'Can't locate Switch.pm in @INC (you may need to install the Switch module) (@INC entries checked: /glade/u/apps/derecho/23.09/opt/perl/lib/perl5/x86_64-linux-thread-multi /glade/u/apps/derecho/23.09/opt/perl/lib/perl5 //////////////////////////////////////////////////////////////////////////////////////glade/u/apps/derecho/23.09/spack/opt/spack/perl/5.38.0/gcc/7.5.0/jqrn/lib/perl5 //////////////////////////////////////////////////////////////////////////////////////glade/u/apps/derecho/23.09/spack/opt/spack/perl/5.38.0/gcc/7.5.0/jqrn/lib/site_perl/5.38.0/x86_64-linux-thread-multi //////////////////////////////////////////////////////////////////////////////////////glade/u/apps/derecho/23.09/spack/opt/spack/perl/5.38.0/gcc/7.5.0/jqrn/lib/site_perl/5.38.0 //////////////////////////////////////////////////////////////////////////////////////glade/u/apps/derecho/23.09/spack/opt/spack/perl/5.38.0/gcc/7.5.0/jqrn/lib/5.38.0/x86_64-linux-thread-multi //////////////////////////////////////////////////////////////////////////////////////glade/u/apps/derecho/23.09/spack/opt/spack/perl/5.38.0/gcc/7.5.0/jqrn/lib/5.38.0) at /glade/work/gdicker/EarthWorks/EWRepo_PullRequests/2024Jan23_TagUpdate_cesm2_3_alpha17a/EW_tst2/components/mpas-seaice/bld/build-namelist line 1603.
BEGIN failed--compilation aborted at /glade/work/gdicker/EarthWorks/EWRepo_PullRequests/2024Jan23_TagUpdate_cesm2_3_alpha17a/EW_tst2/components/mpas-seaice/bld/build-namelist line 1603.' from dir '/glade/work/gdicker/EarthWorks/EWRepo_PullRequests/2024Jan23_TagUpdate_cesm2_3_alpha17a/cases/2024Jan29_172743_EWTest_postalpha17a_FullyCoupled.mpasa120.derecho.gnu/Buildconf/mpassiconf'
ERROR: case.build failed
dazlich commented 7 months ago

Will do

On Jan 30, 2024, at 11:29 AM, G. Dylan Dickerson @.***> wrote:

Caution: EXTERNAL Sender

@dazlichhttps://github.com/dazlich, could you test this branch for the FullyCoupled compset?

I got an error I really didn't expect when trying to run ./case.build (with any compiler). Essentially the paths don't look right to me and there's a mention of 'Can't locate Switch.pm in @INC ...'

Excerpt of error:

2024-01-29 19:40:32 ice Create namelist for component mpassi Calling /glade/work/gdicker/EarthWorks/EWRepo_PullRequests/2024Jan23_TagUpdate_cesm2_3_alpha17a/EW_tst2/components/mpas-seaice//cime_config/buildnml ERROR: Command: '/glade/work/gdicker/EarthWorks/EWRepo_PullRequests/2024Jan23_TagUpdate_cesm2_3_alpha17a/EW_tst2/components/mpas-seaice/bld/build-namelist -infile /glade/work/gdicker/EarthWorks/EWRepo_PullRequests/2024Jan23_TagUpdate_cesm2_3_alpha17a/cases/2024Jan29_172743_EWTest_postalpha17a_FullyCoupled.mpasa120.derecho.gnu/Buildconf/mpassiconf/cesm_namelist -caseroot /glade/work/gdicker/EarthWorks/EWRepo_PullRequests/2024Jan23_TagUpdate_cesm2_3_alpha17a/cases/2024Jan29_172743_EWTest_postalpha17a_FullyCoupled.mpasa120.derecho.gnu -casebuild /glade/work/gdicker/EarthWorks/EWRepo_PullRequests/2024Jan23_TagUpdate_cesm2_3_alpha17a/cases/2024Jan29_172743_EWTest_postalpha17a_FullyCoupled.mpasa120.derecho.gnu/Buildconf -cimeroot /glade/work/gdicker/EarthWorks/EWRepo_PullRequests/2024Jan23_TagUpdate_cesm2_3_alpha17a/EW_tst2/cime -inst_string '' -decomp_prefix 'mpas-o.graph.info.QU120.' -date_stamp '230524' -ice_grid 'oQU120' -ice_ic_mode 'cold_start' -ice_bgc 'no_ice_bgc' -surface_mode 'free' -iceberg_mode 'none' -prognostic_mode 'full' -ntasks_ice '128' -ninst_ice '1'' failed with error 'Can't locate Switch.pm in @INC (you may need to install the Switch module) @.*** entries checked: /glade/u/apps/derecho/23.09/opt/perl/lib/perl5/x86_64-linux-thread-multi /glade/u/apps/derecho/23.09/opt/perl/lib/perl5 //////////////////////////////////////////////////////////////////////////////////////glade/u/apps/derecho/23.09/spack/opt/spack/perl/5.38.0/gcc/7.5.0/jqrn/lib/perl5 //////////////////////////////////////////////////////////////////////////////////////glade/u/apps/derecho/23.09/spack/opt/spack/perl/5.38.0/gcc/7.5.0/jqrn/lib/site_perl/5.38.0/x86_64-linux-thread-multi //////////////////////////////////////////////////////////////////////////////////////glade/u/apps/derecho/23.09/spack/opt/spack/perl/5.38.0/gcc/7.5.0/jqrn/lib/site_perl/5.38.0 //////////////////////////////////////////////////////////////////////////////////////glade/u/apps/derecho/23.09/spack/opt/spack/perl/5.38.0/gcc/7.5.0/jqrn/lib/5.38.0/x86_64-linux-thread-multi //////////////////////////////////////////////////////////////////////////////////////glade/u/apps/derecho/23.09/spack/opt/spack/perl/5.38.0/gcc/7.5.0/jqrn/lib/5.38.0) at /glade/work/gdicker/EarthWorks/EWRepo_PullRequests/2024Jan23_TagUpdate_cesm2_3_alpha17a/EW_tst2/components/mpas-seaice/bld/build-namelist line 1603. BEGIN failed--compilation aborted at /glade/work/gdicker/EarthWorks/EWRepo_PullRequests/2024Jan23_TagUpdate_cesm2_3_alpha17a/EW_tst2/components/mpas-seaice/bld/build-namelist line 1603.' from dir '/glade/work/gdicker/EarthWorks/EWRepo_PullRequests/2024Jan23_TagUpdate_cesm2_3_alpha17a/cases/2024Jan29_172743_EWTest_postalpha17a_FullyCoupled.mpasa120.derecho.gnu/Buildconf/mpassiconf' ERROR: case.build failed

— Reply to this email directly, view it on GitHubhttps://github.com/EarthWorksOrg/EarthWorks/pull/24#issuecomment-1917647273, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ADS3XWBSVGG56DVL57YWEFTYRE3XZAVCNFSM6AAAAABCQE6NHWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSMJXGY2DOMRXGM. You are receiving this because you were mentioned.Message ID: @.***>

gdicker1 commented 7 months ago

@dazlich If you've already fetched the code, you might need to re-do it[^1]. I was pointing mpassi-ew2.0.001 to the wrong commit. I've fixed/pushed that tag now.

[^1]: Or at least git fetch origin && git checkout mpassi-ew2.0.001 in the mpas-seaice directory.

dazlich commented 7 months ago

I get the same error.

On Jan 30, 2024, at 11:57 AM, G. Dylan Dickerson @.***> wrote:

Caution: EXTERNAL Sender

@dazlichhttps://github.com/dazlich If you've already fetched the code, you might need to re-do it1<x-msg://25/#user-content-fn-1-d37453d30e50a643372db87ba9328cde>. I was pointing mpassi-ew2.0.001 to the wrong commit. I've fixed/pushed that tag now.

Footnotes

  1. Or at least git fetch origin && git checkout mpassi-ew2.0.001 in the mpas-seaice directory. ↩<x-msg://25/#user-content-fnref-1-d37453d30e50a643372db87ba9328cde>

— Reply to this email directly, view it on GitHubhttps://github.com/EarthWorksOrg/EarthWorks/pull/24#issuecomment-1917692995, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ADS3XWEI6BRN54IUJZGN243YRE673AVCNFSM6AAAAABCQE6NHWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSMJXGY4TEOJZGU. You are receiving this because you were mentioned.Message ID: @.***>

gdicker1 commented 7 months ago

Ah darn, I was hoping I was just setting something up incorrectly. Do you think you can handle this error @dazlich?

dazlich commented 7 months ago

I’ll tackle it.

Sent from my iPhone

On Jan 30, 2024, at 12:38 PM, G. Dylan Dickerson @.***> wrote:



Caution: EXTERNAL Sender

Ah darn, I was hoping I was just setting something up incorrectly. Do you think you can handle this error @dazlichhttps://github.com/dazlich?

— Reply to this email directly, view it on GitHubhttps://github.com/EarthWorksOrg/EarthWorks/pull/24#issuecomment-1917754434, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ADS3XWFPGDUSORFP5QYGHBLYRFD2RAVCNFSM6AAAAABCQE6NHWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSMJXG42TINBTGQ. You are receiving this because you were mentioned.Message ID: @.***>

dazlich commented 7 months ago

First bits of info: I tested my standalone mpas-seaice - same error. I tested my standalong mpas-ocean - same error in the corresponding build-enamelist I reverted to the previous version of config_machines.xml and everything compiles although things fail at the load step (this is due to a divergence for mpas_attlist.F between the framework for mpasa and that for mpaso/mpassi) - a change in modules breaks the compilation.

These are the changes, I wonder which one breaks Switch: < intel,gnu,nvhpc,intel-oneapi,intel-classic

<COMPILERS>intel,gnu,cray,nvhpc,intel-oneapi,intel-classic</COMPILERS>

1301c1301 < ncarenv/23.09

ncarenv/23.06 1306c1306 < intel/2023.2.1

    <command name="load">intel/2023.0.0</command>

1310c1310 < intel-oneapi/2023.2.1

    <command name="load">intel-oneapi/2023.0.0</command>

1314c1314 < intel-classic/2023.2.1

    <command name="load">intel-classic/2023.0.0</command>

1326c1326 < nvhpc/23.7

    <command name="load">nvhpc/23.5</command>

1334c1334 < cray-mpich/8.1.27

cray-mpich/8.1.25 1341c1341 < cuda/12.2.1

    <command name="load">cuda/11.7.1</command>

1355c1355 < esmf/8.6.0b04-debug

esmf/8.6.0b03-debug 1360c1360 < esmf/8.6.0b04

esmf/8.6.0b03

On Jan 30, 2024, at 12:38 PM, G. Dylan Dickerson @.***> wrote:

Caution: EXTERNAL Sender

Ah darn, I was hoping I was just setting something up incorrectly. Do you think you can handle this error @dazlichhttps://github.com/dazlich?

— Reply to this email directly, view it on GitHubhttps://github.com/EarthWorksOrg/EarthWorks/pull/24#issuecomment-1917754434, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ADS3XWFPGDUSORFP5QYGHBLYRFD2RAVCNFSM6AAAAABCQE6NHWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSMJXG42TINBTGQ. You are receiving this because you were mentioned.Message ID: @.***>

gdicker1 commented 7 months ago

I was able to:

Depending on your thoughts or tests, I think I'm good to merge this @dazlich.

This gets us a lot of the way to a EWMv2.1 release. Next we'll need the branch and changes to incorporate MPAS-A OpenACC!

areanddee commented 7 months ago

Sounds good to me!

On Sat, Feb 3, 2024 at 11:44 AM G. Dylan Dickerson @.***> wrote:

I was able to:

Depending on your thoughts or tests, I think I'm good to merge this @dazlich https://github.com/dazlich.

This gets us a lot of the way to a EWMv2.1 release. Next we'll need the branch and changes to incorporate MPAS-A OpenACC!

— Reply to this email directly, view it on GitHub https://github.com/EarthWorksOrg/EarthWorks/pull/24#issuecomment-1925425988, or unsubscribe https://github.com/notifications/unsubscribe-auth/AZ2GWBPET2JUTLMZYTK2FRTYR2APJAVCNFSM6AAAAABCQE6NHWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSMRVGQZDKOJYHA . You are receiving this because your review was requested.Message ID: @.***>

dazlich commented 7 months ago

I’m good with it, thanks

Sent from my iPhone

On Feb 3, 2024, at 12:38 PM, areanddee @.***> wrote:



Caution: EXTERNAL Sender

Sounds good to me!

On Sat, Feb 3, 2024 at 11:44 AM G. Dylan Dickerson @.***> wrote:

I was able to:

Depending on your thoughts or tests, I think I'm good to merge this @dazlich https://github.com/dazlich.

This gets us a lot of the way to a EWMv2.1 release. Next we'll need the branch and changes to incorporate MPAS-A OpenACC!

— Reply to this email directly, view it on GitHub https://github.com/EarthWorksOrg/EarthWorks/pull/24#issuecomment-1925425988, or unsubscribe https://github.com/notifications/unsubscribe-auth/AZ2GWBPET2JUTLMZYTK2FRTYR2APJAVCNFSM6AAAAABCQE6NHWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSMRVGQZDKOJYHA . You are receiving this because your review was requested.Message ID: @.***>

— Reply to this email directly, view it on GitHubhttps://github.com/EarthWorksOrg/EarthWorks/pull/24#issuecomment-1925437965, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ADS3XWDQ5BAUJGEJDDU7BOLYR2G4LAVCNFSM6AAAAABCQE6NHWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSMRVGQZTOOJWGU. You are receiving this because you were mentioned.Message ID: @.***>