Overhaul packages.yaml (@climbfuji's addons) - Githubissues

JCSDA / spack-stack

Creative Commons Zero v1.0 Universal

21 stars 41 forks source link

Overhaul packages.yaml (@climbfuji's addons) #1159

Closed climbfuji closed 2 days ago

climbfuji commented 3 days ago

Summary

This PR should get merged into https://github.com/JCSDA/spack-stack/pull/1138 (or it can replace #1138, since it is based on it), but for the purpose of testing in CI I am creating a PR here.

The changes on top of #1138 are:

Unpin a few Python packages, pin a few others to resolve duplicated packages for the unified environment and the neptune standalone environment on Nautilus (w/ Intel + MKL); also works on @climbfuji's Dell laptop for both templates
Update Nautilus site config (this site is special, since it uses MKL instead of openblas/fftw as provider for blas, lapack, fftw-api)

Testing

Concretized both environments on Nautilus with Intel - no unwanted duplicates
Concretized both environments on @climbfuji's Dell laptop with GCC - no unwanted duplicates
MISSING CI testing
Applications affected

See #1138

Systems affected

See #1138

Dependencies

n/a

Issue(s) addressed

See #1138

Checklist

[x] This PR addresses one issue/problem/enhancement, or has a very good reason for not doing so.
[ ] These changes have been tested on the affected systems and applications.
[ ] ~~All dependency PRs/issues have been resolved and this PR can be merged.~~

climbfuji commented 3 days ago

Not yet ready for prime time. Getting lots of build errors on nautilus, seem to be related to the new setuptools or pip

climbfuji commented 2 days ago

@AlexanderRichert-NOAA When I restrict py-numpy to 1:25 or earlier, everything builds fine on my end and in CI. Do you want to check out these additions here on top of your PR?

AlexanderRichert-NOAA commented 2 days ago

I think we should lobby the Spack devs to see about a concretization option that really unifies everything, including build-only dependencies, which as far as I can tell is the root of all these issues (i.e., Spack doesn't count build-only dependencies as duplicates for unify:true or unify:when_possible).

climbfuji commented 2 days ago

I think we should lobby the Spack devs to see about a concretization option that really unifies everything, including build-only dependencies, which as far as I can tell is the root of all these issues (i.e., Spack doesn't count build-only dependencies as duplicates for unify:true or unify:when_possible).

That's a good point. Why don't you join the (almost) weekly spack user's meeting (Wed 10am MT/12pm ET) - quite often there is a number of spack developers on the call (for example today).

climbfuji commented 2 days ago

Ubuntu CI runner had a full disk again. I fixed it and submitted a PR to a JCSDA repo to avoid this problem in the future. Hopefully the current Intel build will go through smoothly, then I will rerun GNU.

climbfuji commented 2 days ago

@AlexanderRichert-NOAA - https://github.com/AlexanderRichert-NOAA/spack-stack/pull/3

climbfuji commented 2 days ago

Closing, no longer needed.