search

tensorflow / agents

TF-Agents: A reliable, scalable and easy to use TensorFlow library for Contextual Bandits and Reinforcement Learning.
Apache License 2.0
2.81k stars 720 forks source link

ImportError: Attempted to load a reverb dynamic library, but it could not find the required symbols inside of TensorFlow. #937

Open ace510 opened 4 months ago

ace510 commented 4 months ago

not sure why this comment exists, I cannot delete it

ace510 commented 4 months ago

expected outcome: script completes

actual output: I get the following error output

error output:

2024-08-01 09:20:23.497544: I tensorflow/core/util/port.cc:153] oneDNN custom operations are on. You may see slightly different numerical results due to floating-point round-off errors from different computation orders. To turn them off, set the environment variableTF_ENABLE_ONEDNN_OPTS=0`. 2024-08-01 09:20:23.497972: I external/local_xla/xla/tsl/cuda/cudart_stub.cc:32] Could not find cuda drivers on your machine, GPU will not be used. 2024-08-01 09:20:23.500704: I external/local_xla/xla/tsl/cuda/cudart_stub.cc:32] Could not find cuda drivers on your machine, GPU will not be used. 2024-08-01 09:20:23.509208: E external/local_xla/xla/stream_executor/cuda/cuda_fft.cc:485] Unable to register cuFFT factory: Attempting to register factory for plugin cuFFT when one has already been registered 2024-08-01 09:20:23.522218: E external/local_xla/xla/stream_executor/cuda/cuda_dnn.cc:8454] Unable to register cuDNN factory: Attempting to register factory for plugin cuDNN when one has already been registered 2024-08-01 09:20:23.526436: E external/local_xla/xla/stream_executor/cuda/cuda_blas.cc:1452] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered 2024-08-01 09:20:23.535967: I tensorflow/core/platform/cpu_feature_guard.cc:210] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations. To enable the following instructions: AVX2 AVX_VNNI FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags. 2024-08-01 09:20:24.183294: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT Traceback (most recent call last): File "/home/ianclark/.pyenv/versions/3.11.9/lib/python3.11/site-packages/reverb/pybind.py", line 4, in from .libpybind import * ImportError: /home/ianclark/.pyenv/versions/3.11.9/lib/python3.11/site-packages/reverb/libpybind.so: undefined symbol: _ZN4absl12lts_2023012513hash_internal15MixingHashState5kSeedE

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/home/ianclark/Github/tf_agent/main.py", line 14, in import reverb File "/home/ianclark/.pyenv/versions/3.11.9/lib/python3.11/site-packages/reverb/init.py", line 27, in from reverb import item_selectors as selectors File "/home/ianclark/.pyenv/versions/3.11.9/lib/python3.11/site-packages/reverb/item_selectors.py", line 19, in from reverb import pybind File "/home/ianclark/.pyenv/versions/3.11.9/lib/python3.11/site-packages/reverb/pybind.py", line 6, in _load_op_library.reraise_wrapped_error(e) File "/home/ianclark/.pyenv/versions/3.11.9/lib/python3.11/site-packages/reverb/platform/default/load_op_library.py", line 43, in reraise_wrapped_error six.reraise(ImportError, File "/home/ianclark/.pyenv/versions/3.11.9/lib/python3.11/site-packages/six.py", line 718, in reraise raise value.with_traceback(tb) File "/home/ianclark/.pyenv/versions/3.11.9/lib/python3.11/site-packages/reverb/pybind.py", line 4, in from .libpybind import * ImportError: Attempted to load a reverb dynamic library, but it could not find the required symbols inside of TensorFlow. This commonly occurs when your version of tensorflow and reverb are mismatched. For example, if you are using the python package 'tf-nightly', make sure you use the python package 'dm-reverb-nightly' built on the same or the next night. If you are using a release version package 'tensorflow', use a release package 'dm-reverb' built to be compatible with that exact version. If all else fails, file a github issue on deepmind/reverb. Current installed version of tensorflow: 2.17.0.

Orignal error: /home/ianclark/.pyenv/versions/3.11.9/lib/python3.11/site-packages/reverb/libpybind.so: undefined symbol: _ZN4absl12lts_2023012513hash_internal15MixingHashState5kSeedE`

package version info: python --version Python 3.11.9

`pip list tf-agents Package Version

absl-py 2.1.0 asttokens 2.4.1 astunparse 1.6.3 cachetools 5.4.0 certifi 2024.7.4 charset-normalizer 3.3.2 cloudpickle 3.0.0 contourpy 1.2.1 cycler 0.12.1 decorator 5.1.1 dm-reverb 0.14.0 dm-tree 0.1.8 executing 2.0.1 flatbuffers 24.3.25 fonttools 4.53.1 gast 0.6.0 gin-config 0.5.0 google-auth 2.32.0 google-auth-oauthlib 1.2.1 google-pasta 0.2.0 grpcio 1.65.2 gym 0.23.0 gym-notices 0.0.8 h5py 3.11.0 idna 3.7 imageio 2.4.0 ipython 8.26.0 jedi 0.19.1 keras 3.4.1 kiwisolver 1.4.5 libclang 18.1.1 Markdown 3.6 markdown-it-py 3.0.0 MarkupSafe 2.1.5 matplotlib 3.9.1 matplotlib-inline 0.1.7 mdurl 0.1.2 ml-dtypes 0.3.2 namex 0.0.8 numpy 1.26.4 oauthlib 3.2.2 opt-einsum 3.3.0 optree 0.12.1 packaging 24.1 parso 0.8.4 pexpect 4.9.0 pillow 10.4.0 pip 24.2 portpicker 1.6.0 prompt_toolkit 3.0.47 protobuf 4.25.4 psutil 6.0.0 ptyprocess 0.7.0 pure_eval 0.2.3 pyasn1 0.6.0 pyasn1_modules 0.4.0 pygame 2.6.0 Pygments 2.18.0 pyparsing 3.1.2 python-dateutil 2.9.0.post0 PyVirtualDisplay 3.0 requests 2.32.3 requests-oauthlib 2.0.0 rich 13.7.1 rlds 0.1.8 rsa 4.9 setuptools 65.5.0 six 1.16.0 stack-data 0.6.3 tensorboard 2.17.0 tensorboard-data-server 0.7.2 tensorflow 2.17.0 tensorflow-estimator 2.15.0 tensorflow-io-gcs-filesystem 0.37.1 tensorflow-probability 0.22.1 termcolor 2.4.0 tf-agents 0.7.1 tf_keras 2.17.0 traitlets 5.14.3 typing_extensions 4.6.0 urllib3 2.2.2 wcwidth 0.2.13 Werkzeug 3.0.3 wheel 0.43.0 wrapt 1.14.1`

NelmerXp commented 1 month ago

I have the same issue, did you find a solution?