StanfordLegion / legion

The Legion Parallel Programming System
https://legion.stanford.edu
Apache License 2.0
676 stars 145 forks source link

HTR build failure in CI #1756

Open elliottslaughter opened 3 weeks ago

elliottslaughter commented 3 weeks ago

Reported by @mariodirenzo:

All my CIs based on the CMake build of Legion have been failing with errors like

/home/gitlab-runner/legion-debug-cmake/runtime/realm/gasnet1/gasnetmsg.cc:1665:
 undefined reference to `gasneti_thunk_tm'

The error appeared after https://gitlab.com/StanfordLegion/legion/-/merge_requests/1427 was merged.

Mario, can you provide any additional details on the specific CMake command line, and the system (OS, CUDA, CMake, etc. versions)?

elliottslaughter commented 1 week ago

@mariodirenzo Please retest this on latest master, we've merged various fixes to the CMake build that I think are likely to resolve this.

elliottslaughter commented 6 days ago

I've been told that CI is passing now, so closing. (If this is not true, feel free to reopen.)

mariodirenzo commented 6 days ago

Unfortunately, I haven't been able to get a build of Legion using CMake after https://gitlab.com/StanfordLegion/legion/-/merge_requests/1427 was merged. If the runtime is built properly, I get this error

[0 - 7fd0f5de7c40]    0.000000 {5}{gex}: Failed to load gex wrapper at librealm_gex_wrapper.so

when executing the code. Other configurations fail when compiling either my code or the runtime itself. I do not have any time to debug this until mid-October. I'll get in touch when I have further info

seemamirch commented 6 days ago

@mariodirenzo - if you can provides details to reproduce I can debug further. I don't see any cmake builds in the CI (the link I have been using for it - https://lc.llnl.gov/gitlab/stanford-psaap/ci/-/pipelines)

seemamirch commented 1 day ago

One config that fails with cmake

  1. Build failure with cmake + gasnet1 on lassen (different from what's reported above)
    • the same options work on sapling
    • the same options but without cmake work on lassen
    • the scripts and output from the builds (with/without cmake) are on sapling -> /scratch2/seemah/lassen_cmake_issue/
    • build.sh - build script for both, bad.txt is the build output with cmake, good.txt is without cmake
    • cmake version 3.23.1