search

IBM / powerai

This repo contains ancillary information used to assist users of IBM Watson Machine Learning Community Edition. This repo will contain How To's, Readme's, Dockerfiles, etc. that can be consumed by users looking to get started.
BSD 2-Clause "Simplified" License
56 stars 54 forks source link

how to install ray from powerai conda channels? GLIBCXX_3.4.21 not found #272

Open den-run-ai opened 4 years ago

den-run-ai commented 4 years ago

I noticed that this Ray package was released in conda powerai channel: https://anaconda.org/powerai/ray

What are the installation steps for this package? Does it require base powerai 1.6.2 or powerai 1.7.0 or early release?

When I tried to install the following runtime error appears:

conda activate ray
(ray) [j0541825@mesquite-2 ~]$ python
Python 3.6.10 |Anaconda, Inc.| (default, Mar 26 2020, 00:22:27)
[GCC 7.3.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import ray
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/data/gpfs/anaconda3/envs/ray/lib/python3.6/site-packages/ray/__init__.py", line 25, in <module>
    CDLL(so_path, ctypes.RTLD_GLOBAL)
  File "/data/gpfs/anaconda3/envs/ray/lib/python3.6/ctypes/__init__.py", line 348, in __init__
    self._handle = _dlopen(self._name, mode)
OSError: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.21' not found (required by /data/gpfs/anaconda3/envs/ray/lib/python3.6/site-packages/ray/_raylet.so)

Here is the list of installed packages in that environment:

# Name                    Version                   Build  Channel
_libgcc_mutex             0.1                        main
_pytorch_select           2.0             gpu_25737.g2788c56    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
absl-py                   0.8.1                    py36_0
apex                      0.1.0_1.7.1.a0  py36_683.g5ebb56f    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
arrow-cpp                 0.15.1          py36_684.g3ff7364    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
atomicwrites              1.4.0                      py_0
attrs                     20.1.0                   pypi_0    pypi
blas                      1.0                    openblas
boost-cpp                 1.67.0               h14c3975_4
brotli                    1.0.7                he6710b0_0
brotlipy                  0.7.0           py36h7b6447c_1000
bzip2                     1.0.8                h7b6447c_0
c-ares                    1.15.0            h7b6447c_1001
ca-certificates           2020.7.22                     0
cairo                     1.14.12              h8948797_3
certifi                   2020.6.20                py36_0
cffi                      1.12.3           py36h2e261b9_0
chardet                   3.0.4                 py36_1003
click                     7.0                        py_0
cloudpickle               1.6.0                      py_0
colorama                  0.4.3                      py_0
coverage                  4.5.4            py36h7b6447c_0
cryptography              3.1.1            py36h1ba5d50_0
cudatoolkit               10.2.89            698.g82312a1    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
cudnn                     7.6.5_10.2         667.g338a052    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
cxxfilt                   0.2.0           py_646.gbc2955e    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
cycler                    0.10.0                   py36_0
cython                    0.29                     pypi_0    pypi
cytoolz                   0.11.0           py36h7b6447c_0
dask-core                 2.30.0                     py_0
decorator                 4.4.2                      py_0
double-conversion         3.1.5              647.g15aab6a    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
ffmpeg                    4.2.2                h20bf706_0
filelock                  3.0.12                     py_0
fontconfig                2.13.0               h9420a91_0
freeglut                  3.0.0                hf484d3e_5
freetype                  2.10.2               h5ab3b9f_0
funcsigs                  1.0.2                    py36_0
future                    0.17.1                   py36_0
gflags                    2.2.2             1703.g1bcb8ab    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
giflib                    5.1.4                h14c3975_1
glib                      2.63.1               h5a9c865_0
glog                      0.3.5             1692.g110e904    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
gmp                       6.1.2                h7f7056e_2
gnutls                    3.6.5             h71b1129_1002
graphite2                 1.3.14               h23475e2_0
graphsurgeon              0.4.1           py36_721.g6b2a552    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
grpc-cpp                  1.28.1             657.g35c3292    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
grpcio                    1.16.1           py36hf8bcb03_1
harfbuzz                  1.8.8                hffaf4a1_0
hdf5                      1.10.4               hb1b8bf9_0
hypothesis                5.37.1                     py_0
icu                       58.2                 he6710b0_3
idna                      2.8                      py36_0
imageio                   2.9.0                      py_0
importlib-metadata        1.7.0                    py36_0
importlib_metadata        1.7.0                         0
iniconfig                 1.0.1                    pypi_0    pypi
jasper                    2.0.14               h07fcdf6_1
jpeg                      9b                   hcb7ba68_2
jsonschema                3.2.0                    py36_1
kiwisolver                1.2.0            py36hfd86e86_0
lame                      3.100                h7b6447c_0
ld_impl_linux-ppc64le     2.33.1               h0f24833_7
leveldb                   1.20                 hf484d3e_1
libboost                  1.67.0               h46d08c1_4
libedit                   3.1.20191231         h14c3975_1
libevent                  2.1.11             651.gcf7de63    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
libffi                    3.2.1             hf484d3e_1007
libgcc-ng                 8.2.0                h822a55f_1
libgfortran-ng            7.3.0                h822a55f_1
libglu                    9.0.0                hf484d3e_1
libopenblas               0.3.10               h5a2b251_0
libopencv                 3.4.10          py36_812.g27886b9    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
libopus                   1.3.1                h7b6447c_0
libpng                    1.6.37               hbc83047_0
libprotobuf               3.8.0              658.gde7f9ce    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
libstdcxx-ng              8.2.0                h822a55f_1
libtiff                   4.1.0                h2733197_0
libuuid                   1.0.3                h1bed415_2
libvpx                    1.7.0                hf484d3e_0
libwebp                   1.0.1                h8e7db2f_0
libxcb                    1.14                 h7b6447c_0
libxml2                   2.9.10               he19cac6_1
llvmlite                  0.31.0           py36hd408876_0
lmdb                      0.9.24               he6710b0_0
lz4-c                     1.8.1.2              h14c3975_0
markdown                  3.1.1                    py36_0
matplotlib                3.3.1                         0
matplotlib-base           3.3.1            py36h8254106_0
mock                      3.0.5                    py36_0
more-itertools            8.4.0                    pypi_0    pypi
nccl                      2.6.4              664.g54e83f1    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
ncurses                   6.2                  he6710b0_1
nettle                    3.4.1                hbb512f6_0
networkx                  2.3                        py_0
ninja                     1.9.0            py36hfd86e86_0
numactl                   2.0.12             652.gb5e1afd    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
numba                     0.47.0           py36h962f231_0
numpy                     1.17.4           py36hd5be1e1_0
numpy-base                1.17.4           py36h2f8d375_0
olefile                   0.46                       py_0
onnx                      1.6.0           py36_695.g506708a    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
opencv                    3.4.10          py36_812.g27886b9    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
openh264                  2.1.0                hd408876_0
openssl                   1.1.1h               h7b6447c_0
packaging                 20.4                       py_0
pandas                    0.25.3           py36he6710b0_0
parquet-cpp               1.5.1              652.g650bfd0    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
pcre                      8.44                 he6710b0_0
pillow                    7.0.0            py36haac5956_0
pip                       20.2.2                   py36_0
pixman                    0.40.0               h7b6447c_0
pluggy                    0.13.1                   py36_0
powerai-license           1.7.1.a0           808.g7ea5f87    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
powerai-release           1.7.1.a0           651.g1c389a2    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
powerai-tools             1.7.1.a0           647.g843ad38    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
protobuf                  3.8.0            py36he6710b0_0
py                        1.9.0                      py_0
py-opencv                 3.4.10          py36_812.g27886b9    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
pyarrow                   0.15.1          py36_687.gfd1820f    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
pycparser                 2.20                       py_2
pyopenssl                 19.1.0                     py_1
pyparsing                 2.4.7                      py_0
pyrsistent                0.17.3           py36h7b6447c_0
pysocks                   1.7.1                    py36_0
pytest                    6.0.1                    pypi_0    pypi
python                    3.6.10               ha29dc6b_1
python-dateutil           2.8.1                      py_0
python-lmdb               0.98             py36he6710b0_0
pytorch                   1.5.0            25737.g2788c56    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
pytorch-base              1.5.0           gpu_py36_25737.g2788c56    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
pytz                      2020.1                     py_0
pywavelets                1.1.1            py36h7b6447c_2
pyyaml                    5.1.2            py36h7b6447c_0
ray                       0.8.1            py36h1d8a796_1    powerai
re2                       2020.05.01         645.g6afac28    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
readline                  8.0                  h7b6447c_0
redis-py                  3.5.3                      py_0
requests                  2.22.0                   py36_1
scikit-image              0.15.0           py36he6710b0_0
scipy                     1.4.1            py36habc2bb6_0
setuptools                49.6.0                   py36_0
six                       1.15.0                   pypi_0    pypi
snappy                    1.1.7                h1532aa0_3
sortedcontainers          2.2.2                      py_0
spectrum-mpi              10.03              702.ga72dafb    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
sqlite                    3.33.0               hbc83047_0
tabulate                  0.8.2                    py36_0
tensorboard               2.2.2           py_a4bcc6b_4457.g1bb2968    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
tensorboard-plugin-wit    1.6.0           py_638.gc00ec86    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
tensorrt                  7.0.0.11        py36_721.g6b2a552    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
thrift-cpp                0.13.0             667.g56cf104    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
tk                        8.6.10               hbc83047_0
toml                      0.10.1                   pypi_0    pypi
toolz                     0.11.1                     py_0
torchtext                 0.6.0           py36_659.ge17227c    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
torchvision-base          0.6.0           gpu_py36_682.ga63109c    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
tornado                   6.0.4            py36h7b6447c_1
tqdm                      4.36.1                     py_0
typing                    3.6.4                    py36_0
uff                       0.6.5           py36_721.g6b2a552    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
uriparser                 0.9.3              639.g7465fef    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
urllib3                   1.25.10                    py_0
wcwidth                   0.2.5                      py_0
werkzeug                  0.16.0                     py_0
wheel                     0.34.2                   py36_0
x264                      1!157.20191217       h7b6447c_0
xz                        5.2.5                h7b6447c_0
yaml                      0.1.7                h1bed415_2
zipp                      3.1.0                    pypi_0    pypi
zlib                      1.2.11               h7b6447c_3
zstd                      1.3.7                h0b5b093_0