Alpine-DAV / ascent

A flyweight in situ visualization and analysis runtime for multi-physics HPC simulations
https://alpine-dav.github.io/ascent/
Other
196 stars 66 forks source link

build error on Ubuntu 18.04 on the develop branch #347

Closed danlipsa closed 3 years ago

danlipsa commented 5 years ago

I got the latest develop branch and now I get the following error. Seems that there is an extra -Wl,/home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/openmpi-3.1.3-t5mxvnwmoq7jyrgqifcn52x454d5ddnt/lib If I remove that, the linking succeeds. Do you have any suggestions? Thanks!

Here is the full log:

[~/projects/ascent (develop %=)]$ python scripts/uberenv/uberenv.py --install --prefix="build"
[uberenv project settings: {u'package_name': u'ascent', u'uberenv_package_name': u'uberenv-ascent', u'spack_clean_packages': [u'vtkm', u'vtkh', u'conduit'], u'spack_url': u'https://github.com/alpine-DAV/spack', u'spack_activate': {u'py-sphinx': [u'+python', u'+doc'], u'conduit': [u'+python'], u'py-mpi4py': [u'+python', u'+mpi'], u'py-numpy': [u'+python']}, u'spack_branch': u'task/2019_01_update_ascent'}]
[uberenv options: {'ignore_ssl_errors': False, 'spack_clean': False, 'spack_pull': False, 'mirror': None, 'run_tests': False, 'macos_sdk_env_setup': False, 'prefix': 'build', 'project_json': '/home/danlipsa/projects/ascent/scripts/uberenv/project.json', 'install': True, 'create_mirror': False, 'spack_config_dir': None, 'spec': None}]
[spack spec: %gcc]
[installing to: /home/danlipsa/projects/ascent/build]
[info: destination '/home/danlipsa/projects/ascent/build' already exists]
[info: destination '/home/danlipsa/projects/ascent/build/spack' already exists]
[disabling config scope (except default) in: /home/danlipsa/projects/ascent/build/spack/lib/spack/spack/config.py]
[exe: cp /home/danlipsa/projects/ascent/scripts/uberenv/spack_configs/config.yaml /home/danlipsa/projects/ascent/build/spack/etc/spack/defaults/]
[exe: spack/bin/spack compiler find]
==> Found no new compilers
==> Compilers are defined in the following files:
    /home/danlipsa/projects/ascent/build/spack/etc/spack/defaults/linux/compilers.yaml
[exe: spack/bin/spack spec ascent%gcc]
Input spec
--------------------------------
ascent%gcc

Concretized
--------------------------------
ascent@develop%gcc@7.4.0~adios~cuda cuda_arch= ~doc+fortran~mfem+mpi+openmp+python+shared+test+vtkh arch=linux-ubuntu18.04-x86_64 
    ^cmake@3.14.5%gcc@7.4.0~doc+ncurses+openssl+ownlibs~qt arch=linux-ubuntu18.04-x86_64 
        ^ncurses@6.1%gcc@7.4.0~symlinks~termlib arch=linux-ubuntu18.04-x86_64 
            ^pkgconf@1.5.4%gcc@7.4.0 arch=linux-ubuntu18.04-x86_64 
        ^openssl@1.1.1%gcc@7.4.0+systemcerts arch=linux-ubuntu18.04-x86_64 
            ^perl@5.26.2%gcc@7.4.0+cpanm patches=0eac10ed90aeb0459ad8851f88081d439a4e41978e586ec743069e8b059370ac +shared+threads arch=linux-ubuntu18.04-x86_64 
                ^gdbm@1.18.1%gcc@7.4.0 arch=linux-ubuntu18.04-x86_64 
                    ^readline@7.0%gcc@7.4.0 arch=linux-ubuntu18.04-x86_64 
            ^zlib@1.2.11%gcc@7.4.0+optimize+pic+shared arch=linux-ubuntu18.04-x86_64 
    ^conduit@master%gcc@7.4.0~adios~doc~doxygen+fortran+hdf5+mpi+python+shared~silo+test arch=linux-ubuntu18.04-x86_64 
        ^hdf5@1.8.21%gcc@7.4.0~cxx~debug~fortran~hl~mpi+pic+shared~szip~threadsafe arch=linux-ubuntu18.04-x86_64 
        ^openmpi@3.1.3%gcc@7.4.0~cuda+cxx_exceptions fabrics= ~java~legacylaunchers~memchecker~pmi schedulers= ~sqlite3~thread_multiple+vt arch=linux-ubuntu18.04-x86_64 
            ^hwloc@1.11.11%gcc@7.4.0~cairo~cuda~gl+libxml2~nvml+pci+shared arch=linux-ubuntu18.04-x86_64 
                ^libpciaccess@0.13.5%gcc@7.4.0 arch=linux-ubuntu18.04-x86_64 
                    ^libtool@2.4.6%gcc@7.4.0 arch=linux-ubuntu18.04-x86_64 
                        ^m4@1.4.18%gcc@7.4.0 patches=3877ab548f88597ab2327a2230ee048d2d07ace1062efe81fc92e91b7f39cd00,c0a408fbffb7255fcc75e26bd8edab116fc81d216bfd18b473668b7739a4158e,fc9b61654a3ba1a8d6cd78ce087e7c96366c290bc8d2c299f09828d793b853c8 +sigsegv arch=linux-ubuntu18.04-x86_64 
                            ^libsigsegv@2.11%gcc@7.4.0 arch=linux-ubuntu18.04-x86_64 
                    ^util-macros@1.19.1%gcc@7.4.0 arch=linux-ubuntu18.04-x86_64 
                ^libxml2@2.9.8%gcc@7.4.0~python arch=linux-ubuntu18.04-x86_64 
                    ^libiconv@1.15%gcc@7.4.0 arch=linux-ubuntu18.04-x86_64 
                    ^xz@5.2.4%gcc@7.4.0 arch=linux-ubuntu18.04-x86_64 
                ^numactl@2.0.12%gcc@7.4.0 arch=linux-ubuntu18.04-x86_64 
                    ^autoconf@2.69%gcc@7.4.0 arch=linux-ubuntu18.04-x86_64 
                    ^automake@1.16.1%gcc@7.4.0 arch=linux-ubuntu18.04-x86_64 
        ^py-numpy@1.15.2%gcc@7.4.0+blas+lapack arch=linux-ubuntu18.04-x86_64 
            ^openblas@0.3.4%gcc@7.4.0 cpu_target= ~ilp64+pic+shared threads=none ~virtual_machine arch=linux-ubuntu18.04-x86_64 
            ^py-setuptools@40.4.3%gcc@7.4.0 arch=linux-ubuntu18.04-x86_64 
                ^python@2.7.15%gcc@7.4.0+dbm~optimizations patches=123082ab3483ded78e86d7c809e98a804b3465b4683c96bd79a2fd799f572244 +pic+pythoncmd+shared~tk~ucs4 arch=linux-ubuntu18.04-x86_64 
                    ^bzip2@1.0.8%gcc@7.4.0+shared arch=linux-ubuntu18.04-x86_64 
                        ^diffutils@3.6%gcc@7.4.0 arch=linux-ubuntu18.04-x86_64 
                    ^sqlite@3.26.0%gcc@7.4.0~functions arch=linux-ubuntu18.04-x86_64 
    ^py-mpi4py@2.0.0%gcc@7.4.0 arch=linux-ubuntu18.04-x86_64 
    ^vtkh@ascent_ver%gcc@7.4.0~cuda cuda_arch= +mpi+openmp+shared~tbb arch=linux-ubuntu18.04-x86_64 
        ^vtkm@ascent_ver%gcc@7.4.0~64bitids build_type=Release ~cuda cuda_arch= +doubleprecision~logging~mpi+openmp+rendering+shared~tbb arch=linux-ubuntu18.04-x86_64 

[exe: spack/bin/spack clean ]
==> Removing all temporary build stages
[exe: spack/bin/spack clean -d]
==> Removing cached downloads
[exe: spack/bin/spack install ascent%gcc]
==> pkgconf is already installed in /home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/pkgconf-1.5.4-3hmuxasffur2f722cg62ne4nhlhygmb6
==> ncurses is already installed in /home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/ncurses-6.1-s4rsiori6blknfxf2jx4nbfxfzvcww2k
==> readline is already installed in /home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/readline-7.0-x7uagobvcwfapcyvhslp5fufco43brj4
==> gdbm is already installed in /home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/gdbm-1.18.1-l7katdr6pmx34twx2hx3hrch6rx2qj74
==> perl is already installed in /home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/perl-5.26.2-cali6lf2zepe7i2g6vh5ujo2qclxa2ik
==> zlib is already installed in /home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/zlib-1.2.11-o2viq7yriiaw6nwqpaa7ltpyzqkaonhb
==> openssl is already installed in /home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/openssl-1.1.1-mypfcdfi7bsu7e7sg2sbr4rjk2yputab
==> cmake is already installed in /home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/cmake-3.14.5-hucxniipgclxb6rxubh54yfq4i4hfzlr
==> hdf5 is already installed in /home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/hdf5-1.8.21-q6ovshl5ftvib6byoajhvfkbprcc7an6
==> libsigsegv is already installed in /home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/libsigsegv-2.11-lfdj4ogrh5sqzicgts4x2orbrcu2adbk
==> m4 is already installed in /home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/m4-1.4.18-d75p7dg2cqidehqznyjr2tf4nxojh5th
==> libtool is already installed in /home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/libtool-2.4.6-4neu5jwwmuo26mjs6363q6bupczjk6hk
==> util-macros is already installed in /home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/util-macros-1.19.1-a226ran4thxadofd7yow3sfng3gy3t3k
==> libpciaccess is already installed in /home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/libpciaccess-0.13.5-vhehc322oo5ipbbk465m6py6zzr4kdam
==> libiconv is already installed in /home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/libiconv-1.15-wwik4mijzqovfjaty5alcurcx6gy5zy2
==> xz is already installed in /home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/xz-5.2.4-ur2jffeua3gzg5otnmqgfnfdexgtjxcl
==> libxml2 is already installed in /home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/libxml2-2.9.8-kpebshc7zndjk22chw76yqkjvz4dgcso
==> autoconf is already installed in /home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/autoconf-2.69-qkvtgw537piwlrrfc6ltowg5nizqdvru
==> automake is already installed in /home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/automake-1.16.1-vcclrc6q5lxetugdlbkq62bduwbciyrm
==> numactl is already installed in /home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/numactl-2.0.12-n6yyt2yxl3ydtze6fhlg6kjyuf33ezel
==> hwloc is already installed in /home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/hwloc-1.11.11-mcsb2x5rchviurjx5ihbtsosurkjm2gf
==> openmpi is already installed in /home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/openmpi-3.1.3-t5mxvnwmoq7jyrgqifcn52x454d5ddnt
==> openblas is already installed in /home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/openblas-0.3.4-sifq7qk3udfkrveqdnh7ja4zhwycri4o
==> diffutils is already installed in /home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/diffutils-3.6-oo4rnzyfobuwyc7gefdge46p7lbumi3q
==> bzip2 is already installed in /home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/bzip2-1.0.8-g2ghsbb6kih2itnkcqc2v6iraimj23r4
==> sqlite is already installed in /home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/sqlite-3.26.0-vfm7zhdzs427rwh3yjokwphxp24pj3ej
==> python is already installed in /home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/python-2.7.15-a6xnpy67eutji6vndg4n2v2nhpn7dosz
==> py-setuptools is already installed in /home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/py-setuptools-40.4.3-isayekmpd5kbzjihd2n37ux3ptsy4onj
==> py-numpy is already installed in /home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/py-numpy-1.15.2-u4czngvyspy6klgwohqzz4d6sybo6p6b
==> Installing conduit
==> Searching for binary cache of conduit
==> Warning: No Spack mirrors are currently configured
==> No binary for conduit found: installing from source
==> Cloning git repository: https://github.com/LLNL/conduit.git on branch master
==> No checksum needed when fetching with git
==> Already staged conduit-master-g556lcuunle2346mszl6v5smerqllnfm in /home/danlipsa/projects/ascent/build/spack/var/spack/stage/conduit-master-g556lcuunle2346mszl6v5smerqllnfm
==> No patches needed for conduit
==> Building conduit [Package]
==> Executing phase: 'install'
==> Error: ProcessError: Command exited with status 2:
    'make' '-j8'

5 errors found in build log:
     508    cd /home/danlipsa/projects/ascent/build/spack/var/spack/stage/conduit-master-g556lcuunle2346mszl6v5smerqllnfm/conduit/spack-build/thirdparty_builtin/libyaml-690a781 && /usr/bin
            /gcc  -I/home/danlipsa/projects/ascent/build/spack/var/spack/stage/conduit-master-g556lcuunle2346mszl6v5smerqllnfm/conduit/spack-build/fortran -I/home/danlipsa/projects/ascent/
            build/spack/var/spack/stage/conduit-master-g556lcuunle2346mszl6v5smerqllnfm/conduit/src/thirdparty_builtin/rapidjson/include -I/home/danlipsa/projects/ascent/build/spack/var/sp
            ack/stage/conduit-master-g556lcuunle2346mszl6v5smerqllnfm/conduit/src/thirdparty_builtin/libb64-1.2.1/include -I/home/danlipsa/projects/ascent/build/spack/var/spack/stage/condu
            it-master-g556lcuunle2346mszl6v5smerqllnfm/conduit/src/thirdparty_builtin/libyaml-690a781/include  -O2 -g -DNDEBUG -fPIC   -o CMakeFiles/conduit_libyaml.dir/src/scanner.c.o   -
            c /home/danlipsa/projects/ascent/build/spack/var/spack/stage/conduit-master-g556lcuunle2346mszl6v5smerqllnfm/conduit/src/thirdparty_builtin/libyaml-690a781/src/scanner.c
     509    [  6%] Building C object thirdparty_builtin/libyaml-690a781/CMakeFiles/conduit_libyaml.dir/src/writer.c.o
     510    cd /home/danlipsa/projects/ascent/build/spack/var/spack/stage/conduit-master-g556lcuunle2346mszl6v5smerqllnfm/conduit/spack-build/thirdparty_builtin/libyaml-690a781 && /usr/bin
            /gcc  -I/home/danlipsa/projects/ascent/build/spack/var/spack/stage/conduit-master-g556lcuunle2346mszl6v5smerqllnfm/conduit/spack-build/fortran -I/home/danlipsa/projects/ascent/
            build/spack/var/spack/stage/conduit-master-g556lcuunle2346mszl6v5smerqllnfm/conduit/src/thirdparty_builtin/rapidjson/include -I/home/danlipsa/projects/ascent/build/spack/var/sp
            ack/stage/conduit-master-g556lcuunle2346mszl6v5smerqllnfm/conduit/src/thirdparty_builtin/libb64-1.2.1/include -I/home/danlipsa/projects/ascent/build/spack/var/spack/stage/condu
            it-master-g556lcuunle2346mszl6v5smerqllnfm/conduit/src/thirdparty_builtin/libyaml-690a781/include  -O2 -g -DNDEBUG -fPIC   -o CMakeFiles/conduit_libyaml.dir/src/writer.c.o   -c
             /home/danlipsa/projects/ascent/build/spack/var/spack/stage/conduit-master-g556lcuunle2346mszl6v5smerqllnfm/conduit/src/thirdparty_builtin/libyaml-690a781/src/writer.c
     511    [  7%] Linking CXX executable ../../../tests/blt_mpi_smoke
     512    cd /home/danlipsa/projects/ascent/build/spack/var/spack/stage/conduit-master-g556lcuunle2346mszl6v5smerqllnfm/conduit/spack-build/blt/tests/smoke && /home/danlipsa/projects/asc
            ent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/cmake-3.14.5-hucxniipgclxb6rxubh54yfq4i4hfzlr/bin/cmake -E cmake_link_script CMakeFiles/blt_mpi_smoke.dir/link.txt 
            --verbose=1
     513    /usr/bin/g++      -O2 -g -DNDEBUG  -rdynamic -Wl,-rpath -Wl,/home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/hwloc-1.11.11-mcsb2x5rchviur
            jx5ihbtsosurkjm2gf/lib -Wl,/home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/openmpi-3.1.3-t5mxvnwmoq7jyrgqifcn52x454d5ddnt/lib -L/home/da
            nlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/hwloc-1.11.11-mcsb2x5rchviurjx5ihbtsosurkjm2gf/lib -pthread CMakeFiles/blt_mpi_smoke.dir/blt_mpi
            _smoke.cpp.o  -o ../../../tests/blt_mpi_smoke -Wl,-rpath,/home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/openmpi-3.1.3-t5mxvnwmoq7jyrgqi
            fcn52x454d5ddnt/lib /home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/openmpi-3.1.3-t5mxvnwmoq7jyrgqifcn52x454d5ddnt/lib/libmpi.so /home/d
            anlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/openmpi-3.1.3-t5mxvnwmoq7jyrgqifcn52x454d5ddnt/lib/libmpi_cxx.so /home/danlipsa/projects/ascent
            /build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/openmpi-3.1.3-t5mxvnwmoq7jyrgqifcn52x454d5ddnt/lib/libmpi_usempif08.so /home/danlipsa/projects/ascent/build/spack/opt/
            spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/openmpi-3.1.3-t5mxvnwmoq7jyrgqifcn52x454d5ddnt/lib/libmpi_usempi_ignore_tkr.so /home/danlipsa/projects/ascent/build/spack/opt/spack/lin
            ux-ubuntu18.04-x86_64/gcc-7.4.0/openmpi-3.1.3-t5mxvnwmoq7jyrgqifcn52x454d5ddnt/lib/libmpi_mpifh.so
  >> 514    ld: cannot find /home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/openmpi-3.1.3-t5mxvnwmoq7jyrgqifcn52x454d5ddnt/lib: File format not reco
            gnized
  >> 515    collect2: error: ld returned 1 exit status
     516    blt/tests/smoke/CMakeFiles/blt_mpi_smoke.dir/build.make:91: recipe for target 'tests/blt_mpi_smoke' failed
  >> 517    make[2]: *** [tests/blt_mpi_smoke] Error 1
     518    make[2]: Leaving directory '/home/danlipsa/projects/ascent/build/spack/var/spack/stage/conduit-master-g556lcuunle2346mszl6v5smerqllnfm/conduit/spack-build'
     519    CMakeFiles/Makefile2:1412: recipe for target 'blt/tests/smoke/CMakeFiles/blt_mpi_smoke.dir/all' failed
  >> 520    make[1]: *** [blt/tests/smoke/CMakeFiles/blt_mpi_smoke.dir/all] Error 2
     521    make[1]: *** Waiting for unfinished jobs....
     522    /home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/cmake-3.14.5-hucxniipgclxb6rxubh54yfq4i4hfzlr/bin/cmake -E cmake_copy_f90_mod lib/fortra
            n/fruit.mod blt/thirdparty_builtin/fruit-3.4.1/CMakeFiles/fruit.dir/fruit.mod.stamp GNU
     523    /home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/cmake-3.14.5-hucxniipgclxb6rxubh54yfq4i4hfzlr/bin/cmake -E cmake_copy_f90_mod lib/fortra
            n/fruit_util.mod blt/thirdparty_builtin/fruit-3.4.1/CMakeFiles/fruit.dir/fruit_util.mod.stamp GNU
     524    [  7%] Linking Fortran shared library ../../../lib/libfruit.so
     525    cd /home/danlipsa/projects/ascent/build/spack/var/spack/stage/conduit-master-g556lcuunle2346mszl6v5smerqllnfm/conduit/spack-build/blt/thirdparty_builtin/fruit-3.4.1 && /home/da
            nlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/cmake-3.14.5-hucxniipgclxb6rxubh54yfq4i4hfzlr/bin/cmake -E cmake_link_script CMakeFiles/fruit.di
            r/link.txt --verbose=1
     526    /home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/cmake-3.14.5-hucxniipgclxb6rxubh54yfq4i4hfzlr/bin/cmake -E touch blt/thirdparty_builtin/
            fruit-3.4.1/CMakeFiles/fruit.dir/fruit.f90.o.provides.build

     ...

     535    cd /home/danlipsa/projects/ascent/build/spack/var/spack/stage/conduit-master-g556lcuunle2346mszl6v5smerqllnfm/conduit/spack-build/blt/thirdparty_builtin/googletest-master-2018-
            02-01/googletest && /home/danlipsa/projects/ascent/build/spack/opt/spack/linux-ubuntu18.04-x86_64/gcc-7.4.0/cmake-3.14.5-hucxniipgclxb6rxubh54yfq4i4hfzlr/bin/cmake -E cmake_lin
            k_script CMakeFiles/gtest.dir/link.txt --verbose=1
     536    /usr/bin/g++ -fPIC     -O2 -g -DNDEBUG  -shared -Wl,-soname,libgtest.so -o ../../../../lib/libgtest.so CMakeFiles/gtest.dir/src/gtest-all.cc.o -pthread
     537    make[2]: Leaving directory '/home/danlipsa/projects/ascent/build/spack/var/spack/stage/conduit-master-g556lcuunle2346mszl6v5smerqllnfm/conduit/spack-build'
     538    [  7%] Built target gtest
     539    make[1]: Leaving directory '/home/danlipsa/projects/ascent/build/spack/var/spack/stage/conduit-master-g556lcuunle2346mszl6v5smerqllnfm/conduit/spack-build'
     540    Makefile:143: recipe for target 'all' failed
  >> 541    make: *** [all] Error 2

See build log for details:
  /home/danlipsa/projects/ascent/build/spack/var/spack/stage/conduit-master-g556lcuunle2346mszl6v5smerqllnfm/conduit/spack-build.out
[~/projects/ascent (develop %=)]$ 
danlipsa commented 5 years ago

@cyrush @mclarsen Any suggestions? Thanks!

cyrush commented 5 years ago

@danlipsa I did update blt in conduit, maybe there is something that needs to be smoothed out there.

B/c of the -wl, It looks like a failed attempt to create an rpath command -- which would be something cmake is crafting. The other rpath command looks fine.

I'll try to replicate in ubuntu 18.

danlipsa commented 5 years ago

I think I did, but maybe I did not remove the build directory. I'll try to do that and rebuild.

danlipsa commented 5 years ago

I removed the build directory, rebuilt and still get the same thing.

danlipsa commented 5 years ago

Seems that openmpi-3.1.3 was the problem. With mpich everything compiles fine.

cyrush commented 5 years ago

thanks for the update.

If we provide a ubuntu 18 spack configs, we can prefer mpich -- or we can recommend mpich via command line.

IAMkecheng commented 4 years ago

Hi, I'm installing the Ascent following the Quick Start and got the same problem:

>> 150    /usr/bin/ld: cannot find /home/luke/ascent/build/spack/opt/spack/li
            nux-ubuntu20.04-nehalem/gcc-9.3.0/openmpi-3.1.4-kvdo3l3labhohn5m6ho
            cmif35kejqak6/lib: file format not recognized
  >> 151    collect2: error: ld returned 1 exit status
  >> 152    make[2]: *** [vtkh/utils/CMakeFiles/vtkh_utils_mpi.dir/build.make:1
            28: lib/libvtkh_utils_mpi.so] Error 1

Do you have any idea to solve this problem? Thanks!

mclarsen commented 4 years ago

I just built Ascent on ubuntu 20LTS. I had to use gcc 8 (which came installed) for some reason.

Here is the spack config I used:

https://github.com/Alpine-DAV/ascent/blob/436ff33d8a32c8095bb21120afc9c113e9509840/scripts/uberenv/spack_configs/drake/openmp/compilers.yaml

Let me know if this needs more explanation.

danlipsa commented 4 years ago

This is my .spack/packages.yaml in case it helps

cat ~/.spack/packages.yaml 
packages:
   opengl:
     paths:
       opengl@4.5.0: /usr
     buildable: False
   cuda:
     paths:
       cuda@10.1.243: /usr/local/cuda
     buildable: False
   all:
     providers:
       mpi: [mpich, openmpi]

The relevant part I think is that I prefer mpich over openmpi.

mclarsen commented 4 years ago

I now remember the issue I ran into with gcc 9.3. Several of our dependencies build gtest (through BLT), and the version of gtest has a known issue gcc 9.3. A newer version of BLT includes a fix, but we would have to make sure that all of our deps that use BLT use the newer version.

cyrush commented 4 years ago

we could test this via spack, if we wired up external blt option to all the tpls

mclarsen commented 4 years ago

I think we could also bypass the testing if all the deps had a ~testing option that disabled building the gtest/unit tests.

IAMkecheng commented 4 years ago

Thanks for your help. I have tried to use gcc-8 instead of gcc-9, but there still have one problem:

luke@luke-Aspire-GX-781:~$ gcc -v
bash: /usr/bin/gcc: No such file or directory
luke@luke-Aspire-GX-781:~$ gcc-8 -v
Using built-in specs.
COLLECT_GCC=gcc-8
COLLECT_LTO_WRAPPER=/usr/lib/gcc/x86_64-linux-gnu/8/lto-wrapper
OFFLOAD_TARGET_NAMES=nvptx-none
OFFLOAD_TARGET_DEFAULT=1
Target: x86_64-linux-gnu
Configured with: ../src/configure -v --with-pkgversion='Ubuntu 8.4.0-1ubuntu1~18.04' --with-bugurl=file:///usr/share/doc/gcc-8/README.Bugs --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --prefix=/usr --with-gcc-major-version-only --program-suffix=-8 --program-prefix=x86_64-linux-gnu- --enable-shared --enable-linker-build-id --libexecdir=/usr/lib --without-included-gettext --enable-threads=posix --libdir=/usr/lib --enable-nls --enable-clocale=gnu --enable-libstdcxx-debug --enable-libstdcxx-time=yes --with-default-libstdcxx-abi=new --enable-gnu-unique-object --disable-vtable-verify --enable-libmpx --enable-plugin --enable-default-pie --with-system-zlib --with-target-system-zlib=auto --enable-objc-gc=auto --enable-multiarch --disable-werror --with-arch-32=i686 --with-abi=m64 --with-multilib-list=m32,m64,mx32 --enable-multilib --with-tune=generic --enable-offload-targets=nvptx-none --without-cuda-driver --enable-checking=release --build=x86_64-linux-gnu --host=x86_64-linux-gnu --target=x86_64-linux-gnu
Thread model: posix
gcc version 8.4.0 (Ubuntu 8.4.0-1ubuntu1~18.04) 
luke@luke-Aspire-GX-781:~$ cd ascent/
luke@luke-Aspire-GX-781:~/ascent$ ls
azure-pipelines.yml  CHANGELOG.md  config-build.sh  COPYRIGHT  hashes.txt  LICENSE  package.py  README.md  scripts  src
luke@luke-Aspire-GX-781:~/ascent$ python3 scripts/uberenv/uberenv.py --install --prefix="build"
[uberenv project settings: {'package_name': 'ascent', 'uberenv_package_name': 'uberenv-ascent', 'spack_url': 'https://github.com/alpine-DAV/spack', 'spack_branch': 'task/2019_11_update_ascent', 'spack_activate': {'py-numpy': ['+python'], 'py-pip': ['+python'], 'py-mpi4py': ['+python', '+mpi'], 'conduit': ['+python'], 'py-sphinx': ['+python', '+doc']}, 'spack_clean_packages': ['vtkm', 'vtkh', 'conduit']}]
[uberenv options: {'install': True, 'prefix': 'build', 'spec': None, 'mirror': None, 'create_mirror': False, 'spack_config_dir': None, 'project_json': '/home/luke/ascent/scripts/uberenv/project.json', 'ignore_ssl_errors': False, 'spack_pull': False, 'spack_clean': False, 'run_tests': False, 'macos_sdk_env_setup': False}]
[spack spec: %gcc]
[installing to: /home/luke/ascent/build]
[info: cloning spack develop branch from github]
[exe: git clone -b task/2019_11_update_ascent https://github.com/alpine-DAV/spack]
Cloning into 'spack'...
remote: Enumerating objects: 2, done.
remote: Counting objects: 100% (2/2), done.
remote: Total 196436 (delta 1), reused 1 (delta 1), pack-reused 196434
Receiving objects: 100% (196436/196436), 76.98 MiB | 1.33 MiB/s, done.
Resolving deltas: 100% (82489/82489), done.
[disabling config scope (except default) in: /home/luke/ascent/build/spack/lib/spack/spack/config.py]
[exe: cp /home/luke/ascent/scripts/uberenv/spack_configs/config.yaml /home/luke/ascent/build/spack/etc/spack/defaults/]
[exe: spack/bin/spack compiler find]
==> Added 2 new compilers to /home/luke/ascent/build/spack/etc/spack/defaults/linux/compilers.yaml
    gcc@9.3.0  gcc@8.4.0
==> Compilers are defined in the following files:
    /home/luke/ascent/build/spack/etc/spack/defaults/linux/compilers.yaml
[exe: spack/bin/spack spec ascent%gcc]
Input spec
--------------------------------
ascent%gcc

Concretized
--------------------------------
ascent@develop%gcc@9.3.0~adios~babelflow~cuda cuda_arch=none ~doc~dray+fortran~mfem+mpi+openmp+python+serial+shared+test+vtkh arch=linux-ubuntu20.04-nehalem
    ^cmake@3.14.5%gcc@9.3.0~doc+ncurses+openssl+ownlibs~qt arch=linux-ubuntu20.04-nehalem
        ^ncurses@6.1%gcc@9.3.0~symlinks~termlib arch=linux-ubuntu20.04-nehalem
            ^pkgconf@1.6.3%gcc@9.3.0 arch=linux-ubuntu20.04-nehalem
        ^openssl@1.1.1d%gcc@9.3.0+systemcerts arch=linux-ubuntu20.04-nehalem
            ^perl@5.30.0%gcc@9.3.0+cpanm+shared+threads arch=linux-ubuntu20.04-nehalem
                ^gdbm@1.18.1%gcc@9.3.0 arch=linux-ubuntu20.04-nehalem

I have removed gcc@9.3.0, but there still used it. Why? Looking forward to your reply. Thanks!

mclarsen commented 4 years ago

I don't know how spack choses the default compiler, but you can tell it which one to use. Use the command:

python3 scripts/uberenv/uberenv.py --install --prefix="build" --spec="%gcc@8.4.0"
IAMkecheng commented 4 years ago

it works, Thanks!

IAMkecheng commented 4 years ago

The version of gcc and gfortran should be consistent, otherwise it will encounter the problems like me. If anyone else uses Ubuntu 20.04 to build Ascent, he should double check the version of gcc and gfortran, because the default version of 20.04 is gcc-9.3.0 and gfortran-9 instead of gcc-8 and gfortran. This is my ~/ascent/build/spack/etc/spack/defaults/linux/compilers.yaml:

compilers:
- compiler:
    spec: gcc@8.4.0
    paths:
      cc: /bin/gcc-8
      cxx: /bin/g++-8
      f77: /usr/bin/gfortran-8
      fc: /usr/bin/gfortran-8
    flags: {}
    operating_system: ubuntu20.04
    target: x86_64
    modules: []
    environment: {}
    extra_rpaths: []
- compiler:
    spec: gcc@9.3.0
    paths:
      cc: /bin/gcc-9
      cxx: /bin/g++-9
      f77:
      fc:
    flags: {}
    operating_system: ubuntu20.04
    target: x86_64
    modules: []
    environment: {}
    extra_rpaths: []

in case it will help someone else.

IAMkecheng commented 4 years ago

using mpich instead of openmpi can solve the problem of the installation of vtk-h

IAMkecheng commented 4 years ago
[exe: spack/bin/spack clean ]
==> Removing all temporary build stages
[exe: spack/bin/spack clean --all]
==> Removing all temporary build stages
==> Removing cached downloads
==> Removing cached information on repositories
==> Removing python cache files
[exe: spack/bin/spack install ascent%gcc@8.4.0]
==> ascent is already installed in /home/luke/ascent/build/spack/opt/spack/linux-ubuntu20.04-nehalem/gcc-8.4.0/ascent-develop-pdep3ds3qg4dx5m66snf74r3hphohzy3
[activating dependent packages]
[exe: spack/bin/spack activate py-numpy]
==> Package py-numpy/ijzirnk is already activated.
[exe: spack/bin/spack activate py-pip]
==> Package py-pip/tsz6khz is already activated.
[exe: spack/bin/spack activate py-mpi4py]
==> Error: py-mpi4py matches multiple packages.
  Matching packages:
    4wvy22u py-mpi4py@3.0.3%gcc@8.4.0 arch=linux-ubuntu20.04-nehalem
    qls5vls py-mpi4py@3.0.3%gcc@8.4.0 arch=linux-ubuntu20.04-nehalem
  Use a more specific spec.
[exe: spack/bin/spack activate conduit]
==> Error: conduit matches multiple packages.
  Matching packages:
    7rbwg5g conduit@master%gcc@8.4.0 arch=linux-ubuntu20.04-nehalem
    qg62r6y conduit@master%gcc@8.4.0 arch=linux-ubuntu20.04-nehalem
  Use a more specific spec.
[exe: spack/bin/spack activate ascent]
==> Package ascent/tvx64pz is already activated.

[symlinking install to /home/luke/ascent/build/ascent-install]
[symlinking host config file to /home/luke/ascent/build/luke-Aspire-GX-781-linux-ubuntu20.04-nehalem-gcc@8.4.0-ascent.cmake]

[install complete!]

the error caused by installing openmpi first and generated two py-mpi4py and conduit, I have removed the previous one, but after run the python3 scripts/uberenv/uberenv.py --install --prefix="build" --spec="%gcc@8.4.0" again, there still occurred this error, is this a big problem?

mclarsen commented 4 years ago

@IAMkecheng re fortran: that is good to know. I used the gcc9 fortran with the gcc8 and I didn't have an issue, so I wonder what is different.

Re the python activation issue: I don't think that is going be a big issue, but @cyrush would know better. If you are not using python, then you should be good to go.

IAMkecheng commented 4 years ago

@mclarsen I don't know why, but when i changed from gcc-9 fortran to gfortran-8, the following problem is fixed:

==> Installing openblas
==> Searching for binary cache of openblas
==> Warning: No Spack mirrors are currently configured
==> No binary for openblas found: installing from source
==> Fetching https://github.com/xianyi/OpenBLAS/archive/v0.3.7.tar.gz
################################################################################################################################################################ 100.0%                                  -=O=-                                                                                                                 #     #    #  #                                   -=O=-                                                                                                                   #    #   # #                                    -=O=-                                                                                                                    #    #  ##                                     -=O=-                                                                                                                     #    # #                                      -=O=-                                                                                                                      #   ##                                       -=O=-                                                                                                                       # ##                                        -=O=-                                                                                                                       # #                                         -=O=-                                                                                                                    #  ##                                          -=O=-                                                                                                                 #   # #                                           -=O=-                                                                                                              #    #  #                                            -=O=-                                                                                                           #    #   ##                                             -=O=-                                                                                                       #     #    # #                                                         -=O=-                                          #           #          #          #                           
==> Staging archive: /home/luke/ascent/build/spack/var/spack/stage/spack-stage-openblas-0.3.7-yjzxe7bsqy6ezezw24oj2kmws376ahds/v0.3.7.tar.gz
==> Created stage in /home/luke/ascent/build/spack/var/spack/stage/spack-stage-openblas-0.3.7-yjzxe7bsqy6ezezw24oj2kmws376ahds
==> No patches needed for openblas
==> Building openblas [MakefilePackage]
==> Executing phase: 'edit'
==> Executing phase: 'build'
==> Error: ProcessError: Command exited with status 2:
    'make' '-j4' 'CC=/home/luke/ascent/build/spack/lib/spack/env/gcc/gcc' 'FC=/home/luke/ascent/build/spack/lib/spack/env/gcc/gfortran' 'MAKE_NB_JOBS=0' 'USE_OPENMP=0' 'USE_THREAD=0' 'NO_AVX512=1' 'libs' 'netlib' 'shared'

2 errors found in build log:
     10388    make[1]: Leaving directory '/home/luke/ascent/build/spack/var/spack/stage/spack-stage-openblas-0.3.7-yjzxe7bsqy6ezezw24oj2kmws376ahds/spack-src/lapack-n
              etlib'
     10389    make[1]: Entering directory '/home/luke/ascent/build/spack/var/spack/stage/spack-stage-openblas-0.3.7-yjzxe7bsqy6ezezw24oj2kmws376ahds/spack-src/exports
              '
     10390    perl ./gensymbol linktest  x86_64 _ 0 0 0 0 0 0 "" "" 1 > linktest.c
     10391    /home/luke/ascent/build/spack/lib/spack/env/gcc/gcc -O2 -DMAX_STACK_ALLOC=2048 -Wall -m64 -DF_INTERFACE_GFORT -fPIC -DNO_AVX512 -DNO_WARMUP -DMAX_CPU_NU
              MBER=4 -DMAX_PARALLEL_NUMBER=1 -DVERSION=\"0.3.7\" -mavx2 -DASMNAME= -DASMFNAME=_ -DNAME=_ -DCNAME= -DCHAR_NAME=\"_\" -DCHAR_CNAME=\"\" -DNO_AFFINITY -I
              ..  -shared -o ../libopenblas_haswell-r0.3.7.so \
     10392    -Wl,--whole-archive ../libopenblas_haswell-r0.3.7.a -Wl,--no-whole-archive \
     10393    -Wl,-soname,libopenblas.so.0 -lm -lgfortran -lm -lgfortran
  >> 10394    /usr/bin/ld: cannot find -lgfortran
  >> 10395    collect2: error: ld returned 1 exit status
     10396    make[1]: *** [Makefile:157: ../libopenblas_haswell-r0.3.7.so] Error 1
     10397    make[1]: Leaving directory '/home/luke/ascent/build/spack/var/spack/stage/spack-stage-openblas-0.3.7-yjzxe7bsqy6ezezw24oj2kmws376ahds/spack-src/exports'
     10398    make: *** [Makefile:101: shared] Error 2

See build log for details:
  /home/luke/ascent/build/spack/var/spack/stage/spack-stage-openblas-0.3.7-yjzxe7bsqy6ezezw24oj2kmws376ahds/spack-build-out.txt

my previous gfortran is :

luke@luke-Aspire-GX-781:~/ascent$ gfortran -v
Using built-in specs.
COLLECT_GCC=gfortran
COLLECT_LTO_WRAPPER=/usr/lib/gcc/x86_64-linux-gnu/9/lto-wrapper
OFFLOAD_TARGET_NAMES=nvptx-none:hsa
OFFLOAD_TARGET_DEFAULT=1
Target: x86_64-linux-gnu
Configured with: ../src/configure -v --with-pkgversion='Ubuntu 9.3.0-10ubuntu2' --with-bugurl=file:///usr/share/doc/gcc-9/README.Bugs --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --prefix=/usr --with-gcc-major-version-only --program-suffix=-9 --program-prefix=x86_64-linux-gnu- --enable-shared --enable-linker-build-id --libexecdir=/usr/lib --without-included-gettext --enable-threads=posix --libdir=/usr/lib --enable-nls --enable-clocale=gnu --enable-libstdcxx-debug --enable-libstdcxx-time=yes --with-default-libstdcxx-abi=new --enable-gnu-unique-object --disable-vtable-verify --enable-plugin --enable-default-pie --with-system-zlib --with-target-system-zlib=auto --enable-objc-gc=auto --enable-multiarch --disable-werror --with-arch-32=i686 --with-abi=m64 --with-multilib-list=m32,m64,mx32 --enable-multilib --with-tune=generic --enable-offload-targets=nvptx-none,hsa --without-cuda-driver --enable-checking=release --build=x86_64-linux-gnu --host=x86_64-linux-gnu --target=x86_64-linux-gnu
Thread model: posix
gcc version 9.3.0 (Ubuntu 9.3.0-10ubuntu2) 

and finally i used:

luke@luke-Aspire-GX-781:~/ascent$ gfortran-8 -v
Using built-in specs.
COLLECT_GCC=gfortran-8
COLLECT_LTO_WRAPPER=/usr/lib/gcc/x86_64-linux-gnu/8/lto-wrapper
OFFLOAD_TARGET_NAMES=nvptx-none
OFFLOAD_TARGET_DEFAULT=1
Target: x86_64-linux-gnu
Configured with: ../src/configure -v --with-pkgversion='Ubuntu 8.4.0-3ubuntu2' --with-bugurl=file:///usr/share/doc/gcc-8/README.Bugs --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --prefix=/usr --with-gcc-major-version-only --program-suffix=-8 --program-prefix=x86_64-linux-gnu- --enable-shared --enable-linker-build-id --libexecdir=/usr/lib --without-included-gettext --enable-threads=posix --libdir=/usr/lib --enable-nls --enable-bootstrap --enable-clocale=gnu --enable-libstdcxx-debug --enable-libstdcxx-time=yes --with-default-libstdcxx-abi=new --enable-gnu-unique-object --disable-vtable-verify --enable-libmpx --enable-plugin --enable-default-pie --with-system-zlib --with-target-system-zlib=auto --enable-objc-gc=auto --enable-multiarch --disable-werror --with-arch-32=i686 --with-abi=m64 --with-multilib-list=m32,m64,mx32 --enable-multilib --with-tune=generic --enable-offload-targets=nvptx-none --without-cuda-driver --enable-checking=release --build=x86_64-linux-gnu --host=x86_64-linux-gnu --target=x86_64-linux-gnu
Thread model: posix
gcc version 8.4.0 (Ubuntu 8.4.0-3ubuntu2) 

Hopefully this will help. To the python activation issue, I have run the cloverleaf3d example successfully and if there will be some issues I will report it. BTW, the path at CloverLeaf3D Ascent Demos might be incorrect: (Also available in install directory: examples/ascent/cloverleaf_demos/pipelines_and_scenes/volume_contour.yaml) missing the tutorial, might a typo.

cyrush commented 4 years ago

@IAMkecheng Thanks for all the details, its great to have context on what type of issues can appear!

for the activation issue, this is the spack logic that selects which python modules should be active. The logic isn't robust if there are multiple builds. Like Matt said, there shouldn't be any issue unless you are using python (but some of the demos do use python)

That said, you should be able to resolve by removing the openmpi chain of deps using:

cd uberenv_libs/spack uninstall --dependents openmpi

Then rerun the uberenv command you used before to complete the python activation.

For the typo in tutorial, the yaml file should exist at:

ascent-install-dir/examples/ascent/tutorial/cloverleaf_demos/pipelines_and_scenes/volume_contour.yaml 

I check one of my installs and it seemed correct, can you let me know what is missing for you?

Again, thanks for the feedback!

IAMkecheng commented 4 years ago

What I'm said is in https://ascent.readthedocs.io/en/latest/Tutorial_CloverLeaf_Demos.html : image image

cyrush commented 4 years ago

Ahh, i see now, missing the the thanks for pointing this out!

IAMkecheng commented 4 years ago

Just for double-check, what I mean is that missing the "/tutorial" in the path?

cyrush commented 4 years ago

And now I see that as well -- seems a few things are wrong -- Thanks for iterating 👍

IAMkecheng commented 4 years ago

@cyrush I have tried the command that you wrote before, which is: cd uberenv_libs/spack uninstall --dependents openmpi unfortunately, it didn.t work. Do you mean run this command under ~ascent and it will go into ~/ascent/uberenv_libs/spack, or there might lose anything?

mclarsen commented 4 years ago

@IAMkecheng I have a simpler solution. rm -rf uberenv_libs then run the build command again. It will take longer, but now that you know the right command to build for your system, it should solve your problem.

cyrush commented 4 years ago

@IAMkecheng Sorry I meant to cd into uberenv_libs/spack, then run -- bin/spack/uninstall --dependents openmpi

IAMkecheng commented 4 years ago

Oops...I have followed @cyrush 's solution, and find there's no openmpi:

luke@luke-Aspire-GX-781:~$ cd ascent/
luke@luke-Aspire-GX-781:~/ascent$ cd uberenv_libs/spack/
luke@luke-Aspire-GX-781:~/ascent/uberenv_libs/spack$ ls
bin  CHANGELOG.md  COPYRIGHT  etc  lib  LICENSE-APACHE  LICENSE-MIT  NOTICE  opt  README.md  share  var
luke@luke-Aspire-GX-781:~/ascent/uberenv_libs/spack$ ./bin/spack uninstall --dependents openmpi
==> Error: openmpi does not match any installed packages.

then I changed to @mclarsen 's solution:

luke@luke-Aspire-GX-781:~/ascent$ ls
azure-pipelines.yml  build  CHANGELOG.md  config-build.sh  COPYRIGHT  hashes.txt  LICENSE  package.py  README.md  scripts  src  uberenv_libs
luke@luke-Aspire-GX-781:~/ascent$ rm -rf uberenv_libs
luke@luke-Aspire-GX-781:~/ascent$ python3 scripts/uberenv/uberenv.py --install --prefix="build" --spec="%gcc@8.4.0"
[uberenv project settings: {'package_name': 'ascent', 'uberenv_package_name': 'uberenv-ascent', 'spack_url': 'https://github.com/alpine-DAV/spack', 'spack_branch': 'task/2019_11_update_ascent', 'spack_activate': {'py-numpy': ['+python'], 'py-pip': ['+python'], 'py-mpi4py': ['+python', '+mpi'], 'conduit': ['+python'], 'py-sphinx': ['+python', '+doc']}, 'spack_clean_packages': ['vtkm', 'vtkh', 'conduit']}]
[uberenv options: {'install': True, 'prefix': 'build', 'spec': '%gcc@8.4.0', 'mirror': None, 'create_mirror': False, 'spack_config_dir': None, 'project_json': '/home/luke/ascent/scripts/uberenv/project.json', 'ignore_ssl_errors': False, 'spack_pull': False, 'spack_clean': False, 'run_tests': False, 'macos_sdk_env_setup': False}]
[spack spec: %gcc@8.4.0]
[installing to: /home/luke/ascent/build]
[info: destination '/home/luke/ascent/build' already exists]
[info: destination '/home/luke/ascent/build/spack' already exists]
[disabling config scope (except default) in: /home/luke/ascent/build/spack/lib/spack/spack/config.py]
[exe: cp /home/luke/ascent/scripts/uberenv/spack_configs/config.yaml /home/luke/ascent/build/spack/etc/spack/defaults/]
[exe: spack/bin/spack compiler find]
==> Found no new compilers
==> Compilers are defined in the following files:
    /home/luke/ascent/build/spack/etc/spack/defaults/linux/compilers.yaml
[exe: spack/bin/spack spec ascent%gcc@8.4.0]
Input spec
--------------------------------
ascent%gcc@8.4.0
...
==> Package py-pip/tsz6khz is already activated.
[exe: spack/bin/spack activate py-mpi4py]
==> Error: py-mpi4py matches multiple packages.
  Matching packages:
    4wvy22u py-mpi4py@3.0.3%gcc@8.4.0 arch=linux-ubuntu20.04-nehalem
    qls5vls py-mpi4py@3.0.3%gcc@8.4.0 arch=linux-ubuntu20.04-nehalem
  Use a more specific spec.
[exe: spack/bin/spack activate conduit]
==> Error: conduit matches multiple packages.
  Matching packages:
    7rbwg5g conduit@master%gcc@8.4.0 arch=linux-ubuntu20.04-nehalem
    qg62r6y conduit@master%gcc@8.4.0 arch=linux-ubuntu20.04-nehalem
  Use a more specific spec.

the problem is still there, and:

luke@luke-Aspire-GX-781:~/ascent$ ls
azure-pipelines.yml  build  CHANGELOG.md  config-build.sh  COPYRIGHT  hashes.txt  LICENSE  package.py  README.md  scripts  src

The uberenv_libs folder is gone! Surprise...

cyrush commented 4 years ago

@IAMkecheng I think I might know what is going on. uberenv_libsis the default value we use for the --prefix option. Since you used --prefix="build", you need to remove the openmpi install from the spack that was built there -- not in the uberenv_libs dir.

Can you try:

cd build/spack
bin/spack/uninstall --dependents openmpi

Then, back up in the ascent dir: scripts/uberenv/uberenv.py --install --prefix="build" --spec="%gcc@8.4.0"

IAMkecheng commented 4 years ago

Great, already fixed it! Thanks! and something need to mention, the command should be:

cd build/spack
bin/spack uninstall --dependents openmpi
python3 scripts/uberenv/uberenv.py --install --prefix="build" --spec="%gcc@8.4.0"

And now the uberenv_libs folder is still gone. Hope this will not have a big influence.