Closed matthewfeickert closed 2 years ago
Okay, so maybe the script needs to be updated as on lxplus8
there is a Python 3
[feickert@lxplus8s06 ~]$ python3 --version --version
Python 3.6.8 (default, Oct 19 2021, 05:14:06)
[GCC 8.5.0 20210514 (Red Hat 8.5.0-3)]
but that's a different Python 3 than the version setup by scl_source enable rh-python36
so the following won't work with trying to use the existing ~recast/public/yadage/venv/
that was created with the rh-python36
Python
[feickert@lxplus8s06 ~]$ export RECAST_DEFAULT_RUN_BACKEND=local
[feickert@lxplus8s06 ~]$ export RECAST_DEFAULT_BUILD_BACKEND=kubernetes
[feickert@lxplus8s06 ~]$ export PACKTIVITY_CONTAINER_RUNTIME=singularity
[feickert@lxplus8s06 ~]$ export SINGULARITY_CACHEDIR="/tmp/$(whoami)/singularity"
[feickert@lxplus8s06 ~]$ mkdir -p $SINGULARITY_CACHEDIR
[feickert@lxplus8s06 ~]$ export LC_ALL=en_US.utf-8
[feickert@lxplus8s06 ~]$ export LANG=en_US.utf-8
[feickert@lxplus8s06 ~]$ . ~recast/public/yadage/venv/bin/activate
(venv) [feickert@lxplus8s06 ~]$ python --version
python: error while loading shared libraries: libpython3.6m.so.rh-python36-1.0: cannot open shared object file: No such file or directory
@lukasheinrich If you agree with my summary then I'll login as recast
and delete the existing virtual environment and create a new one from a requirements.txt
that we can place under ~recast/public/
.
edit: I guess lxplus_reqs.txt
is this requirements.txt
already, but maybe we should turn this into a proper pip-tools
lock file for application deployment. That's another Issue though.
While temporarily giving up on trying to setup a working environment with the graphviz
C library built from source, I tried on lxplus8
to setup an LCG view, but I realized there are very limited LCG views that support CentOS 8 as LCG views are mostly CentOS 7.
However, there are a few LCG views that are CentOS 8 like dev3
with x86_64-centos8-gcc10-opt
. So on lxplus8
$ . /cvmfs/sft.cern.ch/lcg/views/dev3/latest/x86_64-centos8-gcc10-opt/setup.sh
$ python --version --version
Python 3.9.6 (default, Sep 6 2021, 15:33:32)
[GCC 10.3.0]
Though using LCG views is probably not the way to go as trying to setup anything in that virtual environment is a total mess and will give a huge array of pip
warnings given all the other things already crammed in there (when trying to install things like pygraphviz
).
@lukasheinrich If you have any memory of how you setup the original virtual environment that would be helpful, but I guess looking at it you didn't setup a visualization backend (i.e., no recast-atlas[local]==0.0.20
)
[recast@lxplus8s17 yadage]$ readlink -f .
/afs/cern.ch/user/r/recast/public/yadage
[recast@lxplus8s17 yadage]$ ls -lhtra
total 7.0K
drwxr-xr-x. 6 recast zp 2.0K Jul 22 2018 venv
drwxr-xr-x. 3 recast zp 2.0K Feb 4 2019 .
-rw-r--r--. 1 recast zp 93 Nov 13 2019 requirements.txt
drwxr-xr-x. 7 recast def-cg 2.0K Dec 16 07:59 ..
[recast@lxplus8s17 yadage]$ cat requirements.txt
recast-atlas==0.0.20
packtivity==0.14.20
yadage==0.19.9
yadage-schemas==0.10.6
adage==0.9.0
[recast@lxplus8s17 yadage]$ find venv/lib/python3.6/site-packages/ -type d -iname "pygraphviz"
So if this can be skipped this makes things easier. :+1:
However,
lxplus-cloud.cern.ch
doesn't seem to be a valid address. I think(?) this might now belxplus8.cern.ch
Yeah. On the List of LXPLUS Aliases page there's the entry
DNS Alias Name | Notes |
---|---|
lxplus8.cern.ch |
Set of machines configured with CS8. It includes the supported cloud clients thus replacing lxplus-cloud since 31 March 2021. |
In the current README there is the example for using RECAST on LXPLUS
https://github.com/recast-hep/recast-atlas/blob/4264157ad3d92aa145249f37a3a26a8dd257c27d/README.md#L37-L44
However,
lxplus-cloud.cern.ch
doesn't seem to be a valid address. I think(?) this might now belxplus8.cern.ch
given https://clouddocs.web.cern.ch/clients/lxplus.html (@lukasheinrich can you confirm?). However, if one logs ontolxplus8
then the following failsSo the public RECAST setup script shouldn't rely on
scl_source
but still needs Python 3 to get its virtual environment setup.