bark-simulator / bark-ml

Gym environments and agents for autonomous driving.
https://bark-simulator.github.io/
MIT License
93 stars 18 forks source link

failed to do "bazel run //examples:tfa" #84

Closed tinmodeHuang closed 3 years ago

tinmodeHuang commented 3 years ago

It's too hard for me to figure out what was wrong, @patrickhart @klemense1 help me please!

my operations as follow:

  1. git clone https://github.com/bark-simulator/bark-ml.git
  2. bash utils/install.sh
  3. source utils/dev_into.sh
  4. bazel run //examples:continuous_env
  5. bazel run //examples:tfa

the somethings printed as follow:

tinmode@tinmode-ThinkStation-K:~/bark-ml$ bash utils/install.sh

Running virtualenv with interpreter /usr/bin/python3.7
Using base prefix '/usr'
/home/tinmode/.local/lib/python3.6/site-packages/virtualenv.py:1041: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
  import imp
Overwriting /home/tinmode/bark-ml/bark_ml/python_wrapper/venv/lib/python3.7/orig-prefix.txt with new content
New python executable in /home/tinmode/bark-ml/bark_ml/python_wrapper/venv/bin/python3.7
Not overwriting existing python script /home/tinmode/bark-ml/bark_ml/python_wrapper/venv/bin/python (you must use /home/tinmode/bark-ml/bark_ml/python_wrapper/venv/bin/python3.7)
Installing setuptools, pip, wheel...done.
Requirement already satisfied: aabbtree>=2.5.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from -r ./utils/docker/installers/requirements.txt (line 1)) (2.6.2)
Requirement already satisfied: absl-py>==0.9.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from -r ./utils/docker/installers/requirements.txt (line 2)) (0.11.0)
Requirement already satisfied: lxml>=4.5.1 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from -r ./utils/docker/installers/requirements.txt (line 3)) (4.6.2)
Requirement already satisfied: matplotlib>=3.2.2 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from -r ./utils/docker/installers/requirements.txt (line 4)) (3.3.4)
Requirement already satisfied: numpy>=1.18.5 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from -r ./utils/docker/installers/requirements.txt (line 5)) (1.19.5)
Collecting numpy>=1.18.5
  Downloading numpy-1.20.1-cp37-cp37m-manylinux2010_x86_64.whl (15.3 MB)
     |████████████████████████████████| 15.3 MB 416 kB/s 
Requirement already satisfied: six>=1.15.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from -r ./utils/docker/installers/requirements.txt (line 6)) (1.15.0)
Requirement already satisfied: twine>==3.1.1 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from -r ./utils/docker/installers/requirements.txt (line 7)) (3.3.0)
Requirement already satisfied: panda3d>=1.10.6.post2 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from -r ./utils/docker/installers/requirements.txt (line 8)) (1.10.8)
Requirement already satisfied: pandas>=1.0.5 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from -r ./utils/docker/installers/requirements.txt (line 9)) (1.2.2)
Requirement already satisfied: gym>=0.17.2 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from -r ./utils/docker/installers/requirements.txt (line 10)) (0.18.0)
Requirement already satisfied: pygame>=1.9.6 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from -r ./utils/docker/installers/requirements.txt (line 11)) (2.0.1)
Requirement already satisfied: tensorflow>=2.3.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from -r ./utils/docker/installers/requirements.txt (line 12)) (2.4.1)
Requirement already satisfied: tensorboard>=2.2.2 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from -r ./utils/docker/installers/requirements.txt (line 13)) (2.4.1)
Requirement already satisfied: tf-agents>=0.6.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from -r ./utils/docker/installers/requirements.txt (line 14)) (0.6.0)
Collecting tf-agents>=0.6.0
  Downloading tf_agents-0.7.1-py3-none-any.whl (1.2 MB)
     |████████████████████████████████| 1.2 MB 1.2 MB/s 
Requirement already satisfied: tensorflow-probability==0.11.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from -r ./utils/docker/installers/requirements.txt (line 15)) (0.11.0)
Requirement already satisfied: tf2_gnn>=2.4.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from -r ./utils/docker/installers/requirements.txt (line 16)) (2.9.0)
Requirement already satisfied: spektral>=0.6.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from -r ./utils/docker/installers/requirements.txt (line 17)) (1.0.4)
Requirement already satisfied: notebook in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from -r ./utils/docker/installers/requirements.txt (line 18)) (6.2.0)
Requirement already satisfied: torch>=1.5.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from -r ./utils/docker/installers/requirements.txt (line 19)) (1.7.1)
Requirement already satisfied: graph-nets==1.1.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from -r ./utils/docker/installers/requirements.txt (line 20)) (1.1.0)
Requirement already satisfied: tensorflow-addons==0.11.2 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from -r ./utils/docker/installers/requirements.txt (line 21)) (0.11.2)
Requirement already satisfied: future in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from graph-nets==1.1.0->-r ./utils/docker/installers/requirements.txt (line 20)) (0.18.2)
Requirement already satisfied: dm-sonnet in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from graph-nets==1.1.0->-r ./utils/docker/installers/requirements.txt (line 20)) (2.0.0)
Requirement already satisfied: setuptools in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from graph-nets==1.1.0->-r ./utils/docker/installers/requirements.txt (line 20)) (53.0.0)
Requirement already satisfied: dm-tree in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from graph-nets==1.1.0->-r ./utils/docker/installers/requirements.txt (line 20)) (0.1.5)
Requirement already satisfied: networkx in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from graph-nets==1.1.0->-r ./utils/docker/installers/requirements.txt (line 20)) (2.5)
Requirement already satisfied: typeguard>=2.7 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from tensorflow-addons==0.11.2->-r ./utils/docker/installers/requirements.txt (line 21)) (2.11.1)
Requirement already satisfied: gast>=0.3.2 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from tensorflow-probability==0.11.0->-r ./utils/docker/installers/requirements.txt (line 15)) (0.3.3)
Requirement already satisfied: cloudpickle==1.3 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from tensorflow-probability==0.11.0->-r ./utils/docker/installers/requirements.txt (line 15)) (1.3.0)
Requirement already satisfied: decorator in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from tensorflow-probability==0.11.0->-r ./utils/docker/installers/requirements.txt (line 15)) (4.4.2)
Requirement already satisfied: scipy in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from gym>=0.17.2->-r ./utils/docker/installers/requirements.txt (line 10)) (1.6.1)
Requirement already satisfied: Pillow<=7.2.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from gym>=0.17.2->-r ./utils/docker/installers/requirements.txt (line 10)) (7.2.0)
Requirement already satisfied: pyglet<=1.5.0,>=1.4.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from gym>=0.17.2->-r ./utils/docker/installers/requirements.txt (line 10)) (1.5.0)
Requirement already satisfied: pyparsing!=2.0.4,!=2.1.2,!=2.1.6,>=2.0.3 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from matplotlib>=3.2.2->-r ./utils/docker/installers/requirements.txt (line 4)) (2.4.7)
Requirement already satisfied: python-dateutil>=2.1 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from matplotlib>=3.2.2->-r ./utils/docker/installers/requirements.txt (line 4)) (2.8.1)
Requirement already satisfied: kiwisolver>=1.0.1 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from matplotlib>=3.2.2->-r ./utils/docker/installers/requirements.txt (line 4)) (1.3.1)
Requirement already satisfied: cycler>=0.10 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from matplotlib>=3.2.2->-r ./utils/docker/installers/requirements.txt (line 4)) (0.10.0)
Requirement already satisfied: pytz>=2017.3 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from pandas>=1.0.5->-r ./utils/docker/installers/requirements.txt (line 9)) (2021.1)
Requirement already satisfied: tqdm in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from spektral>=0.6.0->-r ./utils/docker/installers/requirements.txt (line 17)) (4.57.0)
Requirement already satisfied: joblib in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from spektral>=0.6.0->-r ./utils/docker/installers/requirements.txt (line 17)) (1.0.1)
Requirement already satisfied: scikit-learn in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from spektral>=0.6.0->-r ./utils/docker/installers/requirements.txt (line 17)) (0.24.1)
Requirement already satisfied: requests in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from spektral>=0.6.0->-r ./utils/docker/installers/requirements.txt (line 17)) (2.25.1)
Requirement already satisfied: google-auth<2,>=1.6.3 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from tensorboard>=2.2.2->-r ./utils/docker/installers/requirements.txt (line 13)) (1.27.0)
Requirement already satisfied: werkzeug>=0.11.15 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from tensorboard>=2.2.2->-r ./utils/docker/installers/requirements.txt (line 13)) (1.0.1)
Requirement already satisfied: protobuf>=3.6.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from tensorboard>=2.2.2->-r ./utils/docker/installers/requirements.txt (line 13)) (3.14.0)
Requirement already satisfied: tensorboard-plugin-wit>=1.6.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from tensorboard>=2.2.2->-r ./utils/docker/installers/requirements.txt (line 13)) (1.8.0)
Requirement already satisfied: markdown>=2.6.8 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from tensorboard>=2.2.2->-r ./utils/docker/installers/requirements.txt (line 13)) (3.3.3)
Requirement already satisfied: google-auth-oauthlib<0.5,>=0.4.1 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from tensorboard>=2.2.2->-r ./utils/docker/installers/requirements.txt (line 13)) (0.4.2)
Requirement already satisfied: grpcio>=1.24.3 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from tensorboard>=2.2.2->-r ./utils/docker/installers/requirements.txt (line 13)) (1.32.0)
Requirement already satisfied: wheel>=0.26 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from tensorboard>=2.2.2->-r ./utils/docker/installers/requirements.txt (line 13)) (0.36.2)
Requirement already satisfied: opt-einsum~=3.3.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from tensorflow>=2.3.0->-r ./utils/docker/installers/requirements.txt (line 12)) (3.3.0)
Requirement already satisfied: flatbuffers~=1.12.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from tensorflow>=2.3.0->-r ./utils/docker/installers/requirements.txt (line 12)) (1.12)
Requirement already satisfied: keras-preprocessing~=1.1.2 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from tensorflow>=2.3.0->-r ./utils/docker/installers/requirements.txt (line 12)) (1.1.2)
Requirement already satisfied: tensorflow-estimator<2.5.0,>=2.4.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from tensorflow>=2.3.0->-r ./utils/docker/installers/requirements.txt (line 12)) (2.4.0)
Requirement already satisfied: google-pasta~=0.2 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from tensorflow>=2.3.0->-r ./utils/docker/installers/requirements.txt (line 12)) (0.2.0)
Requirement already satisfied: termcolor~=1.1.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from tensorflow>=2.3.0->-r ./utils/docker/installers/requirements.txt (line 12)) (1.1.0)
Requirement already satisfied: wrapt~=1.12.1 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from tensorflow>=2.3.0->-r ./utils/docker/installers/requirements.txt (line 12)) (1.12.1)
Requirement already satisfied: h5py~=2.10.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from tensorflow>=2.3.0->-r ./utils/docker/installers/requirements.txt (line 12)) (2.10.0)
Requirement already satisfied: astunparse~=1.6.3 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from tensorflow>=2.3.0->-r ./utils/docker/installers/requirements.txt (line 12)) (1.6.3)
Requirement already satisfied: typing-extensions~=3.7.4 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from tensorflow>=2.3.0->-r ./utils/docker/installers/requirements.txt (line 12)) (3.7.4.3)
Requirement already satisfied: gin-config>=0.3.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from tf-agents>=0.6.0->-r ./utils/docker/installers/requirements.txt (line 14)) (0.4.0)
Requirement already satisfied: dpu-utils>=0.2.7 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from tf2_gnn>=2.4.0->-r ./utils/docker/installers/requirements.txt (line 16)) (0.3.1)
Requirement already satisfied: requests-toolbelt!=0.9.0,>=0.8.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from twine>==3.1.1->-r ./utils/docker/installers/requirements.txt (line 7)) (0.9.1)
Requirement already satisfied: rfc3986>=1.4.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from twine>==3.1.1->-r ./utils/docker/installers/requirements.txt (line 7)) (1.4.0)
Requirement already satisfied: readme-renderer>=21.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from twine>==3.1.1->-r ./utils/docker/installers/requirements.txt (line 7)) (28.0)
Requirement already satisfied: pkginfo>=1.4.2 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from twine>==3.1.1->-r ./utils/docker/installers/requirements.txt (line 7)) (1.7.0)
Requirement already satisfied: colorama>=0.4.3 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from twine>==3.1.1->-r ./utils/docker/installers/requirements.txt (line 7)) (0.4.4)
Requirement already satisfied: importlib-metadata in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from twine>==3.1.1->-r ./utils/docker/installers/requirements.txt (line 7)) (3.4.0)
Requirement already satisfied: keyring>=15.1 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from twine>==3.1.1->-r ./utils/docker/installers/requirements.txt (line 7)) (22.0.1)
Requirement already satisfied: cffi in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from dpu-utils>=0.2.7->tf2_gnn>=2.4.0->-r ./utils/docker/installers/requirements.txt (line 16)) (1.14.5)
Requirement already satisfied: azure-storage-blob in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from dpu-utils>=0.2.7->tf2_gnn>=2.4.0->-r ./utils/docker/installers/requirements.txt (line 16)) (12.7.1)
Requirement already satisfied: SetSimilaritySearch in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from dpu-utils>=0.2.7->tf2_gnn>=2.4.0->-r ./utils/docker/installers/requirements.txt (line 16)) (0.1.7)
Requirement already satisfied: sentencepiece==0.1.92 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from dpu-utils>=0.2.7->tf2_gnn>=2.4.0->-r ./utils/docker/installers/requirements.txt (line 16)) (0.1.92)
Requirement already satisfied: docopt in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from dpu-utils>=0.2.7->tf2_gnn>=2.4.0->-r ./utils/docker/installers/requirements.txt (line 16)) (0.6.2)
Requirement already satisfied: azure-identity in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from dpu-utils>=0.2.7->tf2_gnn>=2.4.0->-r ./utils/docker/installers/requirements.txt (line 16)) (1.5.0)
Requirement already satisfied: cachetools<5.0,>=2.0.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from google-auth<2,>=1.6.3->tensorboard>=2.2.2->-r ./utils/docker/installers/requirements.txt (line 13)) (4.2.1)
Requirement already satisfied: pyasn1-modules>=0.2.1 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from google-auth<2,>=1.6.3->tensorboard>=2.2.2->-r ./utils/docker/installers/requirements.txt (line 13)) (0.2.8)
Requirement already satisfied: rsa<5,>=3.1.4 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from google-auth<2,>=1.6.3->tensorboard>=2.2.2->-r ./utils/docker/installers/requirements.txt (line 13)) (4.7.1)
Requirement already satisfied: requests-oauthlib>=0.7.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from google-auth-oauthlib<0.5,>=0.4.1->tensorboard>=2.2.2->-r ./utils/docker/installers/requirements.txt (line 13)) (1.3.0)
Requirement already satisfied: SecretStorage>=3.2 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from keyring>=15.1->twine>==3.1.1->-r ./utils/docker/installers/requirements.txt (line 7)) (3.3.1)
Requirement already satisfied: jeepney>=0.4.2 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from keyring>=15.1->twine>==3.1.1->-r ./utils/docker/installers/requirements.txt (line 7)) (0.6.0)
Requirement already satisfied: zipp>=0.5 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from importlib-metadata->twine>==3.1.1->-r ./utils/docker/installers/requirements.txt (line 7)) (3.4.0)
Requirement already satisfied: pyasn1<0.5.0,>=0.4.6 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from pyasn1-modules>=0.2.1->google-auth<2,>=1.6.3->tensorboard>=2.2.2->-r ./utils/docker/installers/requirements.txt (line 13)) (0.4.8)
Requirement already satisfied: docutils>=0.13.1 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from readme-renderer>=21.0->twine>==3.1.1->-r ./utils/docker/installers/requirements.txt (line 7)) (0.16)
Requirement already satisfied: bleach>=2.1.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from readme-renderer>=21.0->twine>==3.1.1->-r ./utils/docker/installers/requirements.txt (line 7)) (3.3.0)
Requirement already satisfied: Pygments>=2.5.1 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from readme-renderer>=21.0->twine>==3.1.1->-r ./utils/docker/installers/requirements.txt (line 7)) (2.8.0)
Requirement already satisfied: packaging in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from bleach>=2.1.0->readme-renderer>=21.0->twine>==3.1.1->-r ./utils/docker/installers/requirements.txt (line 7)) (20.9)
Requirement already satisfied: webencodings in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from bleach>=2.1.0->readme-renderer>=21.0->twine>==3.1.1->-r ./utils/docker/installers/requirements.txt (line 7)) (0.5.1)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from requests->spektral>=0.6.0->-r ./utils/docker/installers/requirements.txt (line 17)) (1.26.3)
Requirement already satisfied: certifi>=2017.4.17 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from requests->spektral>=0.6.0->-r ./utils/docker/installers/requirements.txt (line 17)) (2020.12.5)
Requirement already satisfied: idna<3,>=2.5 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from requests->spektral>=0.6.0->-r ./utils/docker/installers/requirements.txt (line 17)) (2.10)
Requirement already satisfied: chardet<5,>=3.0.2 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from requests->spektral>=0.6.0->-r ./utils/docker/installers/requirements.txt (line 17)) (4.0.0)
Requirement already satisfied: oauthlib>=3.0.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from requests-oauthlib>=0.7.0->google-auth-oauthlib<0.5,>=0.4.1->tensorboard>=2.2.2->-r ./utils/docker/installers/requirements.txt (line 13)) (3.1.0)
Requirement already satisfied: cryptography>=2.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from SecretStorage>=3.2->keyring>=15.1->twine>==3.1.1->-r ./utils/docker/installers/requirements.txt (line 7)) (3.4.6)
Requirement already satisfied: pycparser in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from cffi->dpu-utils>=0.2.7->tf2_gnn>=2.4.0->-r ./utils/docker/installers/requirements.txt (line 16)) (2.20)
Requirement already satisfied: tornado>=6.1 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from notebook->-r ./utils/docker/installers/requirements.txt (line 18)) (6.1)
Requirement already satisfied: ipykernel in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from notebook->-r ./utils/docker/installers/requirements.txt (line 18)) (5.4.3)
Requirement already satisfied: pyzmq>=17 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from notebook->-r ./utils/docker/installers/requirements.txt (line 18)) (22.0.3)
Requirement already satisfied: prometheus-client in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from notebook->-r ./utils/docker/installers/requirements.txt (line 18)) (0.9.0)
Requirement already satisfied: jinja2 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from notebook->-r ./utils/docker/installers/requirements.txt (line 18)) (2.11.3)
Requirement already satisfied: jupyter-core>=4.6.1 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from notebook->-r ./utils/docker/installers/requirements.txt (line 18)) (4.7.1)
Requirement already satisfied: argon2-cffi in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from notebook->-r ./utils/docker/installers/requirements.txt (line 18)) (20.1.0)
Requirement already satisfied: Send2Trash>=1.5.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from notebook->-r ./utils/docker/installers/requirements.txt (line 18)) (1.5.0)
Requirement already satisfied: traitlets>=4.2.1 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from notebook->-r ./utils/docker/installers/requirements.txt (line 18)) (5.0.5)
Requirement already satisfied: terminado>=0.8.3 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from notebook->-r ./utils/docker/installers/requirements.txt (line 18)) (0.9.2)
Requirement already satisfied: nbconvert in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from notebook->-r ./utils/docker/installers/requirements.txt (line 18)) (6.0.7)
Requirement already satisfied: nbformat in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from notebook->-r ./utils/docker/installers/requirements.txt (line 18)) (5.1.2)
Requirement already satisfied: jupyter-client>=5.3.4 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from notebook->-r ./utils/docker/installers/requirements.txt (line 18)) (6.1.11)
Requirement already satisfied: ipython-genutils in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from notebook->-r ./utils/docker/installers/requirements.txt (line 18)) (0.2.0)
Requirement already satisfied: ptyprocess in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from terminado>=0.8.3->notebook->-r ./utils/docker/installers/requirements.txt (line 18)) (0.7.0)
Requirement already satisfied: msal-extensions~=0.3.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from azure-identity->dpu-utils>=0.2.7->tf2_gnn>=2.4.0->-r ./utils/docker/installers/requirements.txt (line 16)) (0.3.0)
Requirement already satisfied: azure-core<2.0.0,>=1.0.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from azure-identity->dpu-utils>=0.2.7->tf2_gnn>=2.4.0->-r ./utils/docker/installers/requirements.txt (line 16)) (1.11.0)
Requirement already satisfied: msal<2.0.0,>=1.6.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from azure-identity->dpu-utils>=0.2.7->tf2_gnn>=2.4.0->-r ./utils/docker/installers/requirements.txt (line 16)) (1.9.0)
Requirement already satisfied: PyJWT[crypto]<3,>=1.0.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from msal<2.0.0,>=1.6.0->azure-identity->dpu-utils>=0.2.7->tf2_gnn>=2.4.0->-r ./utils/docker/installers/requirements.txt (line 16)) (2.0.1)
Requirement already satisfied: portalocker~=1.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from msal-extensions~=0.3.0->azure-identity->dpu-utils>=0.2.7->tf2_gnn>=2.4.0->-r ./utils/docker/installers/requirements.txt (line 16)) (1.7.1)
Requirement already satisfied: msrest>=0.6.18 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from azure-storage-blob->dpu-utils>=0.2.7->tf2_gnn>=2.4.0->-r ./utils/docker/installers/requirements.txt (line 16)) (0.6.21)
Requirement already satisfied: isodate>=0.6.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from msrest>=0.6.18->azure-storage-blob->dpu-utils>=0.2.7->tf2_gnn>=2.4.0->-r ./utils/docker/installers/requirements.txt (line 16)) (0.6.0)
Requirement already satisfied: tabulate>=0.7.5 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from dm-sonnet->graph-nets==1.1.0->-r ./utils/docker/installers/requirements.txt (line 20)) (0.8.8)
Requirement already satisfied: ipython>=5.0.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from ipykernel->notebook->-r ./utils/docker/installers/requirements.txt (line 18)) (7.20.0)
Requirement already satisfied: pickleshare in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from ipython>=5.0.0->ipykernel->notebook->-r ./utils/docker/installers/requirements.txt (line 18)) (0.7.5)
Requirement already satisfied: pexpect>4.3 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from ipython>=5.0.0->ipykernel->notebook->-r ./utils/docker/installers/requirements.txt (line 18)) (4.8.0)
Requirement already satisfied: prompt-toolkit!=3.0.0,!=3.0.1,<3.1.0,>=2.0.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from ipython>=5.0.0->ipykernel->notebook->-r ./utils/docker/installers/requirements.txt (line 18)) (3.0.16)
Requirement already satisfied: backcall in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from ipython>=5.0.0->ipykernel->notebook->-r ./utils/docker/installers/requirements.txt (line 18)) (0.2.0)
Requirement already satisfied: jedi>=0.16 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from ipython>=5.0.0->ipykernel->notebook->-r ./utils/docker/installers/requirements.txt (line 18)) (0.18.0)
Requirement already satisfied: parso<0.9.0,>=0.8.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from jedi>=0.16->ipython>=5.0.0->ipykernel->notebook->-r ./utils/docker/installers/requirements.txt (line 18)) (0.8.1)
Requirement already satisfied: wcwidth in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from prompt-toolkit!=3.0.0,!=3.0.1,<3.1.0,>=2.0.0->ipython>=5.0.0->ipykernel->notebook->-r ./utils/docker/installers/requirements.txt (line 18)) (0.2.5)
Requirement already satisfied: MarkupSafe>=0.23 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from jinja2->notebook->-r ./utils/docker/installers/requirements.txt (line 18)) (1.1.1)
Requirement already satisfied: nbclient<0.6.0,>=0.5.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from nbconvert->notebook->-r ./utils/docker/installers/requirements.txt (line 18)) (0.5.2)
Requirement already satisfied: defusedxml in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from nbconvert->notebook->-r ./utils/docker/installers/requirements.txt (line 18)) (0.6.0)
Requirement already satisfied: mistune<2,>=0.8.1 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from nbconvert->notebook->-r ./utils/docker/installers/requirements.txt (line 18)) (0.8.4)
Requirement already satisfied: pandocfilters>=1.4.1 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from nbconvert->notebook->-r ./utils/docker/installers/requirements.txt (line 18)) (1.4.3)
Requirement already satisfied: testpath in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from nbconvert->notebook->-r ./utils/docker/installers/requirements.txt (line 18)) (0.4.4)
Requirement already satisfied: jupyterlab-pygments in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from nbconvert->notebook->-r ./utils/docker/installers/requirements.txt (line 18)) (0.1.2)
Requirement already satisfied: entrypoints>=0.2.2 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from nbconvert->notebook->-r ./utils/docker/installers/requirements.txt (line 18)) (0.3)
Requirement already satisfied: async-generator in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from nbclient<0.6.0,>=0.5.0->nbconvert->notebook->-r ./utils/docker/installers/requirements.txt (line 18)) (1.10)
Requirement already satisfied: nest-asyncio in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from nbclient<0.6.0,>=0.5.0->nbconvert->notebook->-r ./utils/docker/installers/requirements.txt (line 18)) (1.5.1)
Requirement already satisfied: jsonschema!=2.5.0,>=2.4 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from nbformat->notebook->-r ./utils/docker/installers/requirements.txt (line 18)) (3.2.0)
Requirement already satisfied: attrs>=17.4.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from jsonschema!=2.5.0,>=2.4->nbformat->notebook->-r ./utils/docker/installers/requirements.txt (line 18)) (20.3.0)
Requirement already satisfied: pyrsistent>=0.14.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from jsonschema!=2.5.0,>=2.4->nbformat->notebook->-r ./utils/docker/installers/requirements.txt (line 18)) (0.17.3)
Requirement already satisfied: threadpoolctl>=2.0.0 in ./bark_ml/python_wrapper/venv/lib/python3.7/site-packages (from scikit-learn->spektral>=0.6.0->-r ./utils/docker/installers/requirements.txt (line 17)) (2.1.0)

tinmode@tinmode-ThinkStation-K:~/bark-ml$ source utils/dev_into.sh

(venv) tinmode@tinmode-ThinkStation-K:~/bark-ml$ bazel run //examples:continuous_env

Starting local Bazel server and connecting to it...
INFO: Analyzed target //examples:continuous_env (91 packages loaded, 10904 targets configured).
INFO: Found 1 target...
Target //examples:continuous_env up-to-date:
  bazel-bin/examples/continuous_env
INFO: Elapsed time: 3.186s, Critical Path: 0.11s
INFO: 2 processes: 2 internal.
INFO: Build completed successfully, 2 total actions
INFO: Running command line: external/bazel_tools/tools/test/test-setup.sh examplINFO: Build completed successfully, 2 total actions
exec ${PAGER:-/usr/bin/less} "$0" || exit 1
Executing tests from //examples:continuous_env
-----------------------------------------------------------------------------
2021-02-19 03:40:11.800575: W tensorflow/stream_executor/platform/default/dso_loader.cc:60] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: :/home/tinmode/.mujoco/mujoco200/bin:/home/tinmode/.mujoco/mjpro150/bin
2021-02-19 03:40:11.800589: I tensorflow/stream_executor/cuda/cudart_stub.cc:29] Ignore above cudart dlerror if you do not have a GPU set up on your machine.
WARNING: Logging before InitGoogleLogging() is written to STDERR
W0219 03:40:12.627095 17494 line.hpp:539] AppendLinesNoIntersect yields self intersecting line, will simplify it with 1e-06
W0219 03:40:12.629453 17494 line.hpp:539] AppendLinesNoIntersect yields self intersecting line, will simplify it with 1e-06
pygame 2.0.1 (SDL 2.0.14, Python 3.7.5)
Hello from the pygame community. https://www.pygame.org/contribute.html
Observed state: [0.8733213  0.65225536 0.5008689  0.20910269 0.9533668  0.2843592
 0.48894697 0.17403017 0.7984768  0.72535866 0.48916692 0.17671992
 0.86700416 0.36339933 0.48894697 0.18547125], Action: [-0.0332372  0.0945702], Reward: 0.0, Done: False
Observed state: [0.85659015 0.65526175 0.49329877 0.209785   0.9402888  0.29632837
 0.48894697 0.15403016 0.78510326 0.7373594  0.48916692 0.15671991
 0.8525797  0.37660068 0.48894697 0.17641194], Action: [ 0.17057791 -0.06123417], Reward: 0.0, Done: False
Observed state: [0.8398494  0.6655817  0.49151754 0.20950705 0.9286665  0.30696523
 0.48894697 0.13778941 0.7732572  0.7477589  0.49158832 0.13789496
 0.83892494 0.38909772 0.48894697 0.16611727], Action: [-0.06948784 -0.01440312], Reward: 0.0, Done: False
Observed state: [0.8231294  0.674544   0.4971353  0.20914744 0.9180359  0.31669444
 0.48894697 0.12909642 0.7627233  0.75287354 0.49700108 0.12388435
 0.82602805 0.40090108 0.48894697 0.15739423], Action: [-0.08990398  0.04546412], Reward: 0.0, Done: False
Observed state: [0.80636424 0.6814345  0.49189237 0.21105185 0.90798914 0.32588935
 0.48894697 0.12309869 0.7532045  0.75424516 0.50001705 0.11268246
 0.81374055 0.41214675 0.48894697 0.15084283], Action: [ 0.47610486 -0.04233543], Reward: 0.0, Done: False
Observed state: [0.7894808  0.68814784 0.5010716  0.21185613 0.8983503  0.33471096
 0.48894697 0.11883265 0.74452084 0.7538072  0.5017958  0.10319419
 0.8019071  0.42297682 0.48894697 0.14601257], Action: [0.20106614 0.07350803], Reward: 0.0, Done: False
Observed state: [0.77251244 0.68096334 0.5128576  0.2134339  0.88900065 0.34326786
 0.48894697 0.1158193  0.7365553  0.752475   0.50289166 0.09487686
 0.79106295 0.43290156 0.48894697 0.12601258], Action: [0.39444646 0.09379165], Reward: -1.0, Done: True

(venv) tinmode@tinmode-ThinkStation-K:~/bark-ml$ bazel run //examples:tfa

INFO: Analyzed target //examples:tfa (6 packages loaded, 46 targets configured).
INFO: Found 1 target...
Target //examples:tfa up-to-date:
  bazel-bin/examples/tfa
INFO: Elapsed time: 0.240s, Critical Path: 0.00s
INFO: 1 process: 1 internal.
INFO: Build completed successfully, 1 total action
INFO: Running command line: external/bazel_tools/tools/test/test-setup.sh examplINFO: Build completed successfully, 1 total action
exec ${PAGER:-/usr/bin/less} "$0" || exit 1
Executing tests from //examples:tfa
-----------------------------------------------------------------------------
2021-02-19 03:40:32.589177: W tensorflow/stream_executor/platform/default/dso_loader.cc:60] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: :/home/tinmode/.mujoco/mujoco200/bin:/home/tinmode/.mujoco/mjpro150/bin
2021-02-19 03:40:32.589192: I tensorflow/stream_executor/cuda/cudart_stub.cc:29] Ignore above cudart dlerror if you do not have a GPU set up on your machine.
WARNING:root:Argument blacklist is deprecated. Please use denylist.
WARNING:root:Argument blacklist is deprecated. Please use denylist.
/home/tinmode/bark-ml/bark_ml/python_wrapper/venv/lib/python3.7/site-packages/tensorflow_addons/utils/ensure_tf_install.py:68: UserWarning: Tensorflow Addons supports using Python ops for all Tensorflow versions above or equal to 2.2.0 and strictly below 2.4.0 (nightly versions are not supported). 
 The versions of TensorFlow you are currently using is 2.4.1 and is not supported. 
Some things might work, some things might not.
If you were to encounter a bug, do not file an issue.
If you want to make sure you're using a tested and supported configuration, either change the TensorFlow version or the TensorFlow Addons's version. 
You can find the compatibility matrix in TensorFlow Addon's readme:
https://github.com/tensorflow/addons
  UserWarning,
pygame 2.0.1 (SDL 2.0.14, Python 3.7.5)
Hello from the pygame community. https://www.pygame.org/contribute.html
Traceback (most recent call last):
  File "/home/tinmode/.cache/bazel/_bazel_tinmode/0534ffbce5f0177dc35c2eb30e06c204/execroot/bark_ml/bazel-out/k8-fastbuild/bin/examples/tfa.runfiles/bark_ml/examples/tfa.py", line 29, in <module>
    from bark_ml.library_wrappers.lib_tf_agents.agents import BehaviorSACAgent, BehaviorPPOAgent
  File "/home/tinmode/.cache/bazel/_bazel_tinmode/0534ffbce5f0177dc35c2eb30e06c204/execroot/bark_ml/bazel-out/k8-fastbuild/bin/examples/tfa.runfiles/bark_ml/bark_ml/library_wrappers/lib_tf_agents/agents/__init__.py", line 3, in <module>
    from bark_ml.library_wrappers.lib_tf_agents.agents.graph_sac_agent import BehaviorGraphSACAgent
  File "/home/tinmode/.cache/bazel/_bazel_tinmode/0534ffbce5f0177dc35c2eb30e06c204/execroot/bark_ml/bazel-out/k8-fastbuild/bin/examples/tfa.runfiles/bark_ml/bark_ml/library_wrappers/lib_tf_agents/agents/graph_sac_agent.py", line 19, in <module>
    from bark_ml.library_wrappers.lib_tf_agents.networks import GNNActorNetwork, GNNCriticNetwork
  File "/home/tinmode/.cache/bazel/_bazel_tinmode/0534ffbce5f0177dc35c2eb30e06c204/execroot/bark_ml/bazel-out/k8-fastbuild/bin/examples/tfa.runfiles/bark_ml/bark_ml/library_wrappers/lib_tf_agents/networks/__init__.py", line 1, in <module>
    from bark_ml.library_wrappers.lib_tf_agents.networks.gnn_actor_network import GNNActorNetwork
  File "/home/tinmode/.cache/bazel/_bazel_tinmode/0534ffbce5f0177dc35c2eb30e06c204/execroot/bark_ml/bazel-out/k8-fastbuild/bin/examples/tfa.runfiles/bark_ml/bark_ml/library_wrappers/lib_tf_agents/networks/gnn_actor_network.py", line 15, in <module>
    from bark_ml.library_wrappers.lib_tf_agents.networks.gnns.interaction_wrapper import InteractionWrapper
  File "/home/tinmode/.cache/bazel/_bazel_tinmode/0534ffbce5f0177dc35c2eb30e06c204/execroot/bark_ml/bazel-out/k8-fastbuild/bin/examples/tfa.runfiles/bark_ml/bark_ml/library_wrappers/lib_tf_agents/networks/gnns/__init__.py", line 4, in <module>
    from bark_ml.library_wrappers.lib_tf_agents.networks.gnns.edge_conditioned_wrapper import GEdgeCondWrapper
  File "/home/tinmode/.cache/bazel/_bazel_tinmode/0534ffbce5f0177dc35c2eb30e06c204/execroot/bark_ml/bazel-out/k8-fastbuild/bin/examples/tfa.runfiles/bark_ml/bark_ml/library_wrappers/lib_tf_agents/networks/gnns/edge_conditioned_wrapper.py", line 11, in <module>
    from spektral.layers import EdgeConditionedConv
ImportError: cannot import name 'EdgeConditionedConv' from 'spektral.layers' (/home/tinmode/bark-ml/bark_ml/python_wrapper/venv/lib/python3.7/site-packages/spektral/layers/__init__.py)
patrickhart commented 3 years ago

Hello, this seems to be due to changes in the spektral library. EdgeConditionedConvdoes not seem to be available any longer. I will have a look into it and maybe remove spektral as the graph nets library provides enough capabilities.

patrickhart commented 3 years ago

Should be resolved by PR #85 Let us know if it works for you now!

tinmodeHuang commented 3 years ago

In this case, shall I find an alternative to EdgeConditionedConv in Spektral library for making sure of the model to works?

patrickhart commented 3 years ago

For now, I removed it from the master branch. A wide variety of graph neural networks can be implemented using the graphs-net library. As you do not seem to run the tfa_gnn example, this depends on the intended use-case. If you pull the master branch everything should work now (also the example you are trying to run)

tinmodeHuang commented 3 years ago

yeah, it works now! by the way, are there many behavior models in the bark-ml like those in the bark such as BehaviorMobilRuleBased which can be configured to other traffic participators?

patrickhart commented 3 years ago

Exactly, you can assign these models to other traffic participants in the scene (does not exclude the ego vehicle). For a closer look how these can be defined you can have a look e.g. here: https://github.com/bark-simulator/bark-ml/blob/87a8047abd36f28d5bad12c50e7156e75b6542c4/bark_ml/environments/blueprints/merging/merging.py#L82

Using the ParameterServer from BARK their behavior can be adapted.

patrickhart commented 3 years ago

As the problem seems to be solved, I am closing this issue for now.

tinmodeHuang commented 3 years ago

hey, @patrickhart . I want to run tfa_gnn.py in the training mode, and therefore the following modification has been done.

flags.DEFINE_enum("mode",
                  "train",
                  ["train", "visualize", "evaluate"],
                  "Mode the configuration should be executed in.")

but I got the error as follow:

Current thread 0x00007f76f8c6b740 (most recent call first):
  File "/home/tinmode/bark-ml/bark_ml/python_wrapper/venv/lib/python3.7/site-packages/tensorflow/python/ops/gen_summary_ops.py", line 143 in create_summary_file_writer
  File "/home/tinmode/bark-ml/bark_ml/python_wrapper/venv/lib/python3.7/site-packages/tensorflow/python/ops/summary_ops_v2.py", line 285 in __init__
  File "/home/tinmode/bark-ml/bark_ml/python_wrapper/venv/lib/python3.7/site-packages/tensorflow/python/ops/summary_ops_v2.py", line 516 in create_file_writer_v2
  File "/home/tinmode/.cache/bazel/_bazel_tinmode/0534ffbce5f0177dc35c2eb30e06c204/execroot/bark_ml/bazel-out/k8-fastbuild/bin/examples/tfa_gnn.runfiles/bark_ml/bark_ml/library_wrappers/lib_tf_agents/runners/tfa_runner.py", line 59 in SetupSummaryWriter
  File "/home/tinmode/.cache/bazel/_bazel_tinmode/0534ffbce5f0177dc35c2eb30e06c204/execroot/bark_ml/bazel-out/k8-fastbuild/bin/examples/tfa_gnn.runfiles/bark_ml/examples/tfa_gnn.py", line 77 in run_configuration
  File "/home/tinmode/bark-ml/bark_ml/python_wrapper/venv/lib/python3.7/site-packages/absl/app.py", line 251 in _run_main
  File "/home/tinmode/bark-ml/bark_ml/python_wrapper/venv/lib/python3.7/site-packages/absl/app.py", line 303 in run
  File "/home/tinmode/.cache/bazel/_bazel_tinmode/0534ffbce5f0177dc35c2eb30e06c204/execroot/bark_ml/bazel-out/k8-fastbuild/bin/examples/tfa_gnn.runfiles/bark_ml/examples/tfa_gnn.py", line 88 in <module>

could you point me in the correct direction of cracking it?

patrickhart commented 3 years ago

is that the only error you get? Would be nice if you could provide more verbose logging. The example currently runs in the CI, but nevertheless I will additionally try running it locally.

EDIT: locally it seems to run for me. have you made sure to exactly install the requirements using the install.sh script?

tinmodeHuang commented 3 years ago

all info printed as follow:

INFO: Analyzed target //examples:tfa_gnn (0 packages loaded, 2 targets configured).
INFO: Found 1 target...
Target //examples:tfa_gnn up-to-date:
  bazel-bin/examples/tfa_gnn
INFO: Elapsed time: 0.499s, Critical Path: 0.26s
INFO: 1 process: 1 internal.
INFO: Build completed successfully, 1 total action
INFO: Running command line: external/bazel_tools/tools/test/test-setup.sh examplINFO: Build completed successfully, 1 total action
exec ${PAGER:-/usr/bin/less} "$0" || exit 1
Executing tests from //examples:tfa_gnn
-----------------------------------------------------------------------------
2021-02-22 08:35:47.681869: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
WARNING:root:Argument blacklist is deprecated. Please use denylist.
WARNING:root:Argument blacklist is deprecated. Please use denylist.
I0222 08:35:49.831873 140148956641088 xodr_parser.py:318] Transforming PlanView with given offset
I0222 08:35:49.832876 140148956641088 xodr_parser.py:318] Transforming PlanView with given offset
WARNING: Logging before InitGoogleLogging() is written to STDERR
W0222 08:35:49.833972 12815 line.hpp:539] AppendLinesNoIntersect yields self intersecting line, will simplify it with 1e-06
W0222 08:35:49.836246 12815 line.hpp:539] AppendLinesNoIntersect yields self intersecting line, will simplify it with 1e-06
I0222 08:35:51.102321 140148956641088 graph_observer.py:72] GraphObserver configured with node attributes: ['x', 'y', 'theta', 'vel', 'goal_x', 'goal_y', 'goal_dx', 'goal_dy', 'goal_theta', 'goal_d', 'goal_vel']
I0222 08:35:51.102415 140148956641088 graph_observer.py:87] GraphObserver configured with edge attributes: ['dx', 'dy', 'dvel', 'dtheta']
2021-02-22 08:35:51.191214: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2021-02-22 08:35:51.191677: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2021-02-22 08:35:51.226737: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:941] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2021-02-22 08:35:51.227276: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:01:00.0 name: Quadro P2200 computeCapability: 6.1
coreClock: 1.493GHz coreCount: 10 deviceMemorySize: 4.94GiB deviceMemoryBandwidth: 186.45GiB/s
2021-02-22 08:35:51.227302: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2021-02-22 08:35:51.230018: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2021-02-22 08:35:51.230066: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2021-02-22 08:35:51.231103: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2021-02-22 08:35:51.231331: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2021-02-22 08:35:51.233914: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2021-02-22 08:35:51.234525: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2021-02-22 08:35:51.234656: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2021-02-22 08:35:51.234764: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:941] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2021-02-22 08:35:51.235188: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:941] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2021-02-22 08:35:51.235552: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2021-02-22 08:35:51.235826: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2021-02-22 08:35:51.236409: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2021-02-22 08:35:51.236496: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:941] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2021-02-22 08:35:51.236865: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:01:00.0 name: Quadro P2200 computeCapability: 6.1
coreClock: 1.493GHz coreCount: 10 deviceMemorySize: 4.94GiB deviceMemoryBandwidth: 186.45GiB/s
2021-02-22 08:35:51.236881: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2021-02-22 08:35:51.236898: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2021-02-22 08:35:51.236912: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2021-02-22 08:35:51.236926: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2021-02-22 08:35:51.236939: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2021-02-22 08:35:51.236955: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2021-02-22 08:35:51.236970: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2021-02-22 08:35:51.236985: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2021-02-22 08:35:51.237044: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:941] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2021-02-22 08:35:51.237452: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:941] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2021-02-22 08:35:51.237805: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2021-02-22 08:35:51.237830: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2021-02-22 08:35:51.508730: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2021-02-22 08:35:51.508746: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0 
2021-02-22 08:35:51.508750: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N 
2021-02-22 08:35:51.508938: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:941] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2021-02-22 08:35:51.509289: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:941] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2021-02-22 08:35:51.509696: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:941] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2021-02-22 08:35:51.509970: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4339 MB memory) -> physical GPU (device: 0, name: Quadro P2200, pci bus id: 0000:01:00.0, compute capability: 6.1)
2021-02-22 08:35:52.615242: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:116] None of the MLIR optimization passes are enabled (registered 2)
2021-02-22 08:35:52.737659: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 2799925000 Hz
2021-02-22 08:35:52.939789: W tensorflow/core/grappler/optimizers/loop_optimizer.cc:906] Skipping loop optimization for Merge node with control input: cond/branch_executed/_32
2021-02-22 08:35:53.085557: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2021-02-22 08:35:53.249964: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2021-02-22 08:35:53.368112: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2021-02-22 08:36:13.117102: W tensorflow/core/grappler/optimizers/loop_optimizer.cc:906] Skipping loop optimization for Merge node with control input: cond/branch_executed/_32
2021-02-22 08:36:13.502343: W tensorflow/core/grappler/optimizers/loop_optimizer.cc:906] Skipping loop optimization for Merge node with control input: cond/branch_executed/_32
2021-02-22 08:36:13.886196: W tensorflow/core/grappler/optimizers/loop_optimizer.cc:906] Skipping loop optimization for Merge node with control input: cond/branch_executed/_32
2021-02-22 08:36:14.255450: W tensorflow/core/grappler/optimizers/loop_optimizer.cc:906] Skipping loop optimization for Merge node with control input: cond/branch_executed/_32
/home/tinmode/bark-ml/bark_ml/python_wrapper/venv/lib/python3.7/site-packages/gym/logger.py:30: UserWarning: WARN: Box bound precision lowered by casting to float32
  warnings.warn(colorize('%s: %s'%('WARN', msg % args), 'yellow'))
WARNING:tensorflow:5 out of the last 5 calls to <function GraphNetwork.call at 0x7f75d5fb3440> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has experimental_relax_shapes=True option that relaxes argument shapes that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for  more details.
W0222 08:36:14.279514 140148956641088 def_function.py:126] 5 out of the last 5 calls to <function GraphNetwork.call at 0x7f75d5fb3440> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has experimental_relax_shapes=True option that relaxes argument shapes that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for  more details.
I0222 08:36:14.304891 140148956641088 common.py:980] No checkpoint available at 
WARNING:tensorflow:From /home/tinmode/bark-ml/bark_ml/python_wrapper/venv/lib/python3.7/site-packages/tensorflow/python/autograph/operators/control_flow.py:1218: ReplayBuffer.get_next (from tf_agents.replay_buffers.replay_buffer) is deprecated and will be removed in a future version.
Instructions for updating:
Use `as_dataset(..., single_deterministic_pass=False) instead.
W0222 08:36:14.377789 140148956641088 api.py:479] From /home/tinmode/bark-ml/bark_ml/python_wrapper/venv/lib/python3.7/site-packages/tensorflow/python/autograph/operators/control_flow.py:1218: ReplayBuffer.get_next (from tf_agents.replay_buffers.replay_buffer) is deprecated and will be removed in a future version.
Instructions for updating:
Use `as_dataset(..., single_deterministic_pass=False) instead.
2021-02-22 08:36:14.739276: F tensorflow/core/framework/tensor.cc:673] Check failed: 1 == NumElements() (1 vs. 0)Must have a one element tensor
Fatal Python error: Aborted

Thread 0x00007f736705f700 (most recent call first):
  File "/home/tinmode/anaconda3/envs/bark-ml/lib/python3.7/multiprocessing/pool.py", line 470 in _handle_results
  File "/home/tinmode/anaconda3/envs/bark-ml/lib/python3.7/threading.py", line 870 in run
  File "/home/tinmode/anaconda3/envs/bark-ml/lib/python3.7/threading.py", line 926 in _bootstrap_inner
  File "/home/tinmode/anaconda3/envs/bark-ml/lib/python3.7/threading.py", line 890 in _bootstrap

Thread 0x00007f7367860700 (most recent call first):
  File "/home/tinmode/anaconda3/envs/bark-ml/lib/python3.7/multiprocessing/pool.py", line 422 in _handle_tasks
  File "/home/tinmode/anaconda3/envs/bark-ml/lib/python3.7/threading.py", line 870 in run
  File "/home/tinmode/anaconda3/envs/bark-ml/lib/python3.7/threading.py", line 926 in _bootstrap_inner
  File "/home/tinmode/anaconda3/envs/bark-ml/lib/python3.7/threading.py", line 890 in _bootstrap

Thread 0x00007f7494d1d700 (most recent call first):
  File "/home/tinmode/anaconda3/envs/bark-ml/lib/python3.7/multiprocessing/pool.py", line 413 in _handle_workers
  File "/home/tinmode/anaconda3/envs/bark-ml/lib/python3.7/threading.py", line 870 in run
  File "/home/tinmode/anaconda3/envs/bark-ml/lib/python3.7/threading.py", line 926 in _bootstrap_inner
  File "/home/tinmode/anaconda3/envs/bark-ml/lib/python3.7/threading.py", line 890 in _bootstrap

Thread 0x00007f7496ffd700 (most recent call first):
  File "/home/tinmode/anaconda3/envs/bark-ml/lib/python3.7/multiprocessing/pool.py", line 110 in worker
  File "/home/tinmode/anaconda3/envs/bark-ml/lib/python3.7/threading.py", line 870 in run
  File "/home/tinmode/anaconda3/envs/bark-ml/lib/python3.7/threading.py", line 926 in _bootstrap_inner
  File "/home/tinmode/anaconda3/envs/bark-ml/lib/python3.7/threading.py", line 890 in _bootstrap

Thread 0x00007f75d2f10700 (most recent call first):
  File "/home/tinmode/anaconda3/envs/bark-ml/lib/python3.7/multiprocessing/pool.py", line 470 in _handle_results
  File "/home/tinmode/anaconda3/envs/bark-ml/lib/python3.7/threading.py", line 870 in run
  File "/home/tinmode/anaconda3/envs/bark-ml/lib/python3.7/threading.py", line 926 in _bootstrap_inner
  File "/home/tinmode/anaconda3/envs/bark-ml/lib/python3.7/threading.py", line 890 in _bootstrap

Thread 0x00007f75d3711700 (most recent call first):
  File "/home/tinmode/anaconda3/envs/bark-ml/lib/python3.7/multiprocessing/pool.py", line 422 in _handle_tasks
  File "/home/tinmode/anaconda3/envs/bark-ml/lib/python3.7/threading.py", line 870 in run
  File "/home/tinmode/anaconda3/envs/bark-ml/lib/python3.7/threading.py", line 926 in _bootstrap_inner
  File "/home/tinmode/anaconda3/envs/bark-ml/lib/python3.7/threading.py", line 890 in _bootstrap

Thread 0x00007f75d3f12700 (most recent call first):
  File "/home/tinmode/anaconda3/envs/bark-ml/lib/python3.7/multiprocessing/pool.py", line 413 in _handle_workers
  File "/home/tinmode/anaconda3/envs/bark-ml/lib/python3.7/threading.py", line 870 in run
  File "/home/tinmode/anaconda3/envs/bark-ml/lib/python3.7/threading.py", line 926 in _bootstrap_inner
  File "/home/tinmode/anaconda3/envs/bark-ml/lib/python3.7/threading.py", line 890 in _bootstrap

Thread 0x00007f75d4713700 (most recent call first):
  File "/home/tinmode/anaconda3/envs/bark-ml/lib/python3.7/multiprocessing/pool.py", line 110 in worker
  File "/home/tinmode/anaconda3/envs/bark-ml/lib/python3.7/threading.py", line 870 in run
  File "/home/tinmode/anaconda3/envs/bark-ml/lib/python3.7/threading.py", line 926 in _bootstrap_inner
  File "/home/tinmode/anaconda3/envs/bark-ml/lib/python3.7/threading.py", line 890 in _bootstrap

Current thread 0x00007f76f8c6b740 (most recent call first):
  File "/home/tinmode/bark-ml/bark_ml/python_wrapper/venv/lib/python3.7/site-packages/tensorflow/python/ops/gen_summary_ops.py", line 143 in create_summary_file_writer
  File "/home/tinmode/bark-ml/bark_ml/python_wrapper/venv/lib/python3.7/site-packages/tensorflow/python/ops/summary_ops_v2.py", line 285 in __init__
  File "/home/tinmode/bark-ml/bark_ml/python_wrapper/venv/lib/python3.7/site-packages/tensorflow/python/ops/summary_ops_v2.py", line 516 in create_file_writer_v2
  File "/home/tinmode/.cache/bazel/_bazel_tinmode/0534ffbce5f0177dc35c2eb30e06c204/execroot/bark_ml/bazel-out/k8-fastbuild/bin/examples/tfa_gnn.runfiles/bark_ml/bark_ml/library_wrappers/lib_tf_agents/runners/tfa_runner.py", line 59 in SetupSummaryWriter
  File "/home/tinmode/.cache/bazel/_bazel_tinmode/0534ffbce5f0177dc35c2eb30e06c204/execroot/bark_ml/bazel-out/k8-fastbuild/bin/examples/tfa_gnn.runfiles/bark_ml/examples/tfa_gnn.py", line 77 in run_configuration
  File "/home/tinmode/bark-ml/bark_ml/python_wrapper/venv/lib/python3.7/site-packages/absl/app.py", line 251 in _run_main
  File "/home/tinmode/bark-ml/bark_ml/python_wrapper/venv/lib/python3.7/site-packages/absl/app.py", line 303 in run
  File "/home/tinmode/.cache/bazel/_bazel_tinmode/0534ffbce5f0177dc35c2eb30e06c204/execroot/bark_ml/bazel-out/k8-fastbuild/bin/examples/tfa_gnn.runfiles/bark_ml/examples/tfa_gnn.py", line 88 in <module>

yes, I have. because the script can locally run in visualization mode.

patrickhart commented 3 years ago

This error seems like its platform/version specific. Here are a few things that I suggest:

  1. Disable the tf.functions in the code in the interaction wrapper and the GNN networks in general. This could help to locate the error better.
  2. Do not use tensorflow-gpu
  3. if nothing works, you could pull the docker file and execute the code within it similar to as the CI is set up
tinmodeHuang commented 3 years ago

the tensorflow2.4 being in use, by the way, what is the CI?

patrickhart commented 3 years ago

CI = Continuous Integration

here is a Docker workflow: https://github.com/bark-simulator/bark-ml/blob/master/.github/workflows/main.yml

tinmodeHuang commented 3 years ago

the excessive number of tracings won't to be done after commenting out @tf.function(experimental_relax_shapes=True) in the graph_network.py and @tf.function in the interaction_wrapper.py. To be honest, I don't understood what the first 12th lines in the main.yml be used to do.

patrickhart commented 3 years ago

Contributions in form of improvements are always welcome!

The main.yml file sets up a Github workflow to run BARK-ML in a docker. This should be platform independent.

tinmodeHuang commented 3 years ago

although I tried to learn about the main.yml, it's too hard for a noob like me to know a lot about it in a short time. if convient, could you tell me how to use it for running BARK-ML in a docker.

patrickhart commented 3 years ago

May I ask what your overall goal is using BARK-ML, learning a behavior using graph neural networks?

I think this is not the right place, to give an introduction to Docker and how to execute python and executables within Docker. Once you are familiar with Docker it should become self-explanatory how to execute scripts.

tinmodeHuang commented 3 years ago

yes. I'm sorry for being eager, and thanks for your advice, I will spend more time being familiar with Docker.