LXPLUS example in docs not working about recast-atlas HOT 3 CLOSED

Okay, so maybe the script needs to be updated as on lxplus8 there is a Python 3

[feickert@lxplus8s06 ~]$ python3 --version --version
Python 3.6.8 (default, Oct 19 2021, 05:14:06) 
[GCC 8.5.0 20210514 (Red Hat 8.5.0-3)]

but that's a different Python 3 than the version setup by scl_source enable rh-python36 so the following won't work with trying to use the existing ~recast/public/yadage/venv/ that was created with the rh-python36 Python

[feickert@lxplus8s06 ~]$ export RECAST_DEFAULT_RUN_BACKEND=local
[feickert@lxplus8s06 ~]$ export RECAST_DEFAULT_BUILD_BACKEND=kubernetes
[feickert@lxplus8s06 ~]$ export PACKTIVITY_CONTAINER_RUNTIME=singularity
[feickert@lxplus8s06 ~]$ export SINGULARITY_CACHEDIR="/tmp/$(whoami)/singularity"
[feickert@lxplus8s06 ~]$ mkdir -p $SINGULARITY_CACHEDIR
[feickert@lxplus8s06 ~]$ export LC_ALL=en_US.utf-8
[feickert@lxplus8s06 ~]$ export LANG=en_US.utf-8
[feickert@lxplus8s06 ~]$ . ~recast/public/yadage/venv/bin/activate
(venv) [feickert@lxplus8s06 ~]$ python --version
python: error while loading shared libraries: libpython3.6m.so.rh-python36-1.0: cannot open shared object file: No such file or directory

@lukasheinrich If you agree with my summary then I'll login as recast and delete the existing virtual environment and create a new one from a requirements.txt that we can place under ~recast/public/.

edit: I guess lxplus_reqs.txt is this requirements.txt already, but maybe we should turn this into a proper pip-tools lock file for application deployment. That's another Issue though.

from recast-atlas.

While temporarily giving up on trying to setup a working environment with the graphviz C library built from source, I tried on lxplus8 to setup an LCG view, but I realized there are very limited LCG views that support CentOS 8 as LCG views are mostly CentOS 7.

However, there are a few LCG views that are CentOS 8 like dev3 with x86_64-centos8-gcc10-opt. So on lxplus8

$ . /cvmfs/sft.cern.ch/lcg/views/dev3/latest/x86_64-centos8-gcc10-opt/setup.sh
$ python --version --version
Python 3.9.6 (default, Sep  6 2021, 15:33:32) 
[GCC 10.3.0]

Though using LCG views is probably not the way to go as trying to setup anything in that virtual environment is a total mess and will give a huge array of pip warnings given all the other things already crammed in there (when trying to install things like pygraphviz).

@lukasheinrich If you have any memory of how you setup the original virtual environment that would be helpful, but I guess looking at it you didn't setup a visualization backend (i.e., no recast-atlas[local]==0.0.20)

[recast@lxplus8s17 yadage]$ readlink -f .
/afs/cern.ch/user/r/recast/public/yadage
[recast@lxplus8s17 yadage]$ ls -lhtra
total 7.0K
drwxr-xr-x. 6 recast zp     2.0K Jul 22  2018 venv
drwxr-xr-x. 3 recast zp     2.0K Feb  4  2019 .
-rw-r--r--. 1 recast zp       93 Nov 13  2019 requirements.txt
drwxr-xr-x. 7 recast def-cg 2.0K Dec 16 07:59 ..
[recast@lxplus8s17 yadage]$ cat requirements.txt 
recast-atlas==0.0.20
packtivity==0.14.20
yadage==0.19.9
yadage-schemas==0.10.6
adage==0.9.0

[recast@lxplus8s17 yadage]$ find venv/lib/python3.6/site-packages/ -type d -iname "pygraphviz"

So if this can be skipped this makes things easier. 👍

from recast-atlas.

However, lxplus-cloud.cern.ch doesn't seem to be a valid address. I think(?) this might now be lxplus8.cern.ch

Yeah. On the List of LXPLUS Aliases page there's the entry

from recast-atlas.