tlbtlbtlb
commented
7 years ago It's best to not call env.render() and just use VNC in the browser to
watch the environment run.
On Mon, May 8, 2017 at 11:42 PM, Tensor-Programming < notifications@github.com> wrote:
(First, please check https://github.com/openai/universe/wiki/Solutions-to- common-problems for solutions to many common problems)
Running the agent example in the read me, from what I can tell, something happens when the env.render() function is called. Opening in browser shows the environment for a split second before it just cuts off. I've tried using other envs but no dice.
Ubuntu 16.04 LTS Python 3.5
[2017-05-09 02:36:12,119] Making new env: flashgames.NeonRace-v0 [2017-05-09 02:36:12,126] Writing logs to file: /tmp/universe-20864.log [2017-05-09 02:36:12,145] Ports used: dict_keys([]) [2017-05-09 02:36:12,145] [0] Creating container: image=quay.io/openai/universe. flashgames:0.20.28. Run the same thing by hand as: docker run -p 5900:5900 -p 15900:15900 --ipc host --cap-add SYS_ADMIN --privileged quay.io/openai/universe.flashgames:0.20.28 [2017-05-09 02:36:13,010] Remote closed: address=localhost:5900 universe-4a0x83-0 | Setting VNC and rewarder password: openai [2017-05-09 02:36:13,010] At least one sockets was closed by the remote. Sleeping 1s... universe-4a0x83-0 | [Tue May 9 06:36:13 UTC 2017] Waiting for /tmp/.X11-unix/X0 to be created (try 1/10) universe-4a0x83-0 | [tigervnc] universe-4a0x83-0 | [tigervnc] Xvnc TigerVNC 1.7.0 - built Sep 8 2016 10:39:22 universe-4a0x83-0 | [tigervnc] Copyright (C) 1999-2016 TigerVNC Team and many others (see README.txt) universe-4a0x83-0 | [tigervnc] See http://www.tigervnc.org for information on TigerVNC. universe-4a0x83-0 | [tigervnc] Underlying X server release 11400000, The X.Org Foundation universe-4a0x83-0 | [tigervnc] universe-4a0x83-0 | [tigervnc] Initializing built-in extension VNC-EXTENSION universe-4a0x83-0 | [tigervnc] Initializing built-in extension Generic Event Extension universe-4a0x83-0 | [tigervnc] Initializing built-in extension SHAPE universe-4a0x83-0 | [tigervnc] Initializing built-in extension MIT-SHM universe-4a0x83-0 | [tigervnc] Initializing built-in extension XInputExtension universe-4a0x83-0 | [tigervnc] Initializing built-in extension XTEST universe-4a0x83-0 | [tigervnc] Initializing built-in extension BIG-REQUESTS universe-4a0x83-0 | [tigervnc] Initializing built-in extension SYNC universe-4a0x83-0 | [tigervnc] Initializing built-in extension XKEYBOARD universe-4a0x83-0 | [tigervnc] Initializing built-in extension XC-MISC universe-4a0x83-0 | [tigervnc] Initializing built-in extension XINERAMA universe-4a0x83-0 | [tigervnc] Initializing built-in extension XFIXES universe-4a0x83-0 | [tigervnc] Initializing built-in extension RENDER universe-4a0x83-0 | [tigervnc] Initializing built-in extension RANDR universe-4a0x83-0 | [tigervnc] Initializing built-in extension COMPOSITE universe-4a0x83-0 | [tigervnc] Initializing built-in extension DAMAGE universe-4a0x83-0 | [tigervnc] Initializing built-in extension MIT-SCREEN-SAVER universe-4a0x83-0 | [tigervnc] Initializing built-in extension DOUBLE-BUFFER universe-4a0x83-0 | [tigervnc] Initializing built-in extension RECORD universe-4a0x83-0 | [tigervnc] Initializing built-in extension DPMS universe-4a0x83-0 | [tigervnc] Initializing built-in extension X-Resource universe-4a0x83-0 | [tigervnc] Initializing built-in extension XVideo universe-4a0x83-0 | [tigervnc] Initializing built-in extension XVideo-MotionCompensation universe-4a0x83-0 | [tigervnc] Initializing built-in extension GLX universe-4a0x83-0 | [tigervnc] universe-4a0x83-0 | [tigervnc] Tue May 9 06:36:13 2017 universe-4a0x83-0 | [tigervnc] vncext: VNC extension running! universe-4a0x83-0 | [tigervnc] vncext: Listening for VNC connections on all interface(s), port 5900 universe-4a0x83-0 | [tigervnc] vncext: created VNC server for screen 0 universe-4a0x83-0 | [tigervnc] [dix] Could not init font path element /usr/share/fonts/X11/Type1/, removing from list! universe-4a0x83-0 | [tigervnc] [dix] Could not init font path element /usr/share/fonts/X11/75dpi/, removing from list! universe-4a0x83-0 | [tigervnc] [dix] Could not init font path element /usr/share/fonts/X11/100dpi/, removing from list! universe-4a0x83-0 | [Tue May 9 06:36:13 UTC 2017] [/usr/local/bin/sudoable-env-setup] Disabling outbound network traffic for none universe-4a0x83-0 | [init] [2017-05-09 06:36:13,057] Launching system_diagnostics_logger.py, recorder_logdir=/tmp/demo universe-4a0x83-0 | [init] [2017-05-09 06:36:13,058] Launching reward_recorder.py, recorder_logdir=/tmp/demo universe-4a0x83-0 | [init] [2017-05-09 06:36:13,061] Launching vnc_recorder.py, recorder_logdir=/tmp/demo universe-4a0x83-0 | [init] [2017-05-09 06:36:13,067] PID 56 launched with command ['sudo', '-H', '-u', 'nobody', 'DISPLAY=:0', 'DBUS_SESSION_BUS_ADDRESS=/dev/null', '/app/universe-envs/controlplane/bin/controlplane.py', '--rewarder-port=15901'] universe-4a0x83-0 | [init] [2017-05-09 06:36:13,088] init detected end of child process 59 with exit code 0, not killed by signal universe-4a0x83-0 | WebSocket server settings: universe-4a0x83-0 | - Listen on :5898 universe-4a0x83-0 | - Flash security policy server universe-4a0x83-0 | - No SSL/TLS support (no cert file) universe-4a0x83-0 | - proxying from :5898 to localhost:5900 universe-4a0x83-0 | [reward_recorder] [2017-05-09 06:36:13,602] Listening on 0.0.0.0:15898 universe-4a0x83-0 | [vnc_recorder] [2017-05-09 06:36:13,644] Listening on 0.0.0.0:5899 universe-4a0x83-0 | [2017-05-09 06:36:13,851] [INFO:root] Starting play_controlplane.py with the following: command=['/app/universe-envs/controlplane/bin/controlplane.py', '--rewarder-port=15901'] args=Namespace(bot_demonstration=False, demonstration=False, env_id=None, idle_timeout=None, integrator_mode=False, no_env=False, no_rewarder=False, no_scorer=False, no_vexpect=False, remotes='vnc://127.0.0.1:5900', rewarder_fps=60, rewarder_port=15901, verbosity=0) env=environ({'USERNAME': 'nobody', 'DISPLAY': ':0', 'SUDO_COMMAND': '/app/universe-envs/controlplane/bin/controlplane.py --rewarder-port=15901', 'USER': 'nobody', 'SUDO_GID': '0', 'HOME': '/nonexistent', 'PATH': '/usr/local/sbin:/usr/local/ bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin', 'LOGNAME': 'nobody', 'SUDO_UID': '0', 'MAIL': '/var/mail/nobody', 'DBUS_SESSION_BUS_ADDRESS': '/dev/null', 'TERM': 'xterm', 'SHELL': '/usr/sbin/nologin', 'SUDO_USER': 'root', 'HOSTNAME': '7134b6bf0ca3'}) universe-4a0x83-0 | [2017-05-09 06:36:13,851] [INFO:root] [EnvStatus] Changing env_state: None (env_id=None) -> None (env_id=None) (episode_id: 0->0, fps=60) universe-4a0x83-0 | [2017-05-09 06:36:13,851] [INFO:universe.rewarder.remote] Starting Rewarder on port=15901 universe-4a0x83-0 | [2017-05-09 06:36:13,854] [INFO:universe.extra.universe.wrappers.logger] Running VNC environments with Logger set to print_frequency=5. To change this, pass "print_frequency=k" or "print_frequency=None" to "env.configure". universe-4a0x83-0 | [2017-05-09 06:36:13,854] [INFO:universe.remotes.hardcoded_addresses] No rewarder addresses were provided, so this env cannot connect to the remote's rewarder channel, and cannot send control messages (e.g. reset) universe-4a0x83-0 | [2017-05-09 06:36:13,855] [INFO:universe.envs.vnc_env] Using the golang VNC implementation universe-4a0x83-0 | [2017-05-09 06:36:13,856] [INFO:universe.envs.vnc_env] Using VNCSession arguments: {'compress_level': 9, 'start_timeout': 7, 'encoding': 'zrle', 'subsample_level': 2, 'fine_quality_level': 50}. (Customize by running "env.configure(vnc_kwargs={...})" universe-4a0x83-0 | [2017-05-09 06:36:13,856] [INFO:universe.envs.vnc_env] Printed stats will ignore clock skew. (This usually makes sense only when the environment and agent are on the same machine.) universe-4a0x83-0 | [2017-05-09 06:36:13,859] [INFO:universe.envs.vnc_env] [0] Connecting to environment: vnc:// 127.0.0.1:5900 password=openai. If desired, you can manually connect a VNC viewer, such as TurboVNC. Most environments provide a convenient in-browser VNC client: http://None/viewer/?password=openai universe-4a0x83-0 | [2017-05-09 06:36:13,859] [INFO:universe.extra.universe.envs.vnc_env] [0] Connecting to environment details: vnc_address=127.0.0.1:5900 vnc_password=openai rewarder_address=None rewarder_password=openai universe-4a0x83-0 | 2017/05/09 06:36:13 I0509 06:36:13.860068 61 gymvnc.go:417] [0:127.0.0.1:5900] opening connection to VNC server universe-4a0x83-0 | [2017-05-09 06:36:13,860] [INFO:root] [EnvStatus] Changing env_state: None (env_id=None) -> resetting (env_id=None) (episode_id: 0->1, fps=60) universe-4a0x83-0 | [2017-05-09 06:36:13,860] [INFO:root] [MainThread] Env state: env_id=None episode_id=1 universe-4a0x83-0 | [2017-05-09 06:36:13,860] [INFO:root] [MainThread] Writing None to /tmp/demo/env_id.txt universe-4a0x83-0 | [tigervnc] Connections: accepted: 127.0.0.1::60366 universe-4a0x83-0 | [tigervnc] SConnection: Client needs protocol version 3.8 universe-4a0x83-0 | [tigervnc] SConnection: Client requests security type VncAuth(2) universe-4a0x83-0 | [tigervnc] VNCSConnST: Server default pixel format depth 24 (32bpp) little-endian rgb888 universe-4a0x83-0 | 2017/05/09 06:36:13 I0509 06:36:13.866727 61 gymvnc.go:550] [0:127.0.0.1:5900] connection established universe-4a0x83-0 | [tigervnc] VNCSConnST: Client pixel format depth 24 (32bpp) little-endian bgr888 universe-4a0x83-0 | [Tue May 9 06:36:13 UTC 2017] [/usr/local/bin/sudoable-env-setup] Disabling outbound network traffic for none universe-4a0x83-0 | [2017-05-09 06:36:13,896] [INFO:gym_flashgames.launcher] [MainThread] Launching new Chrome process (attempt 0/10) universe-4a0x83-0 | [2017-05-09 06:36:13,896] [INFO:root] Replacing selenium_wrapper_server since we currently do it at every episode boundary [2017-05-09 02:36:14,012] Remote closed: address=localhost:15900 [2017-05-09 02:36:14,013] Remote closed: address=localhost:5900 [2017-05-09 02:36:14,013] At least one sockets was closed by the remote. Sleeping 1s... universe-4a0x83-0 | [tigervnc] universe-4a0x83-0 | [tigervnc] Tue May 9 06:36:14 2017 universe-4a0x83-0 | [tigervnc] Connections: accepted: 172.17.0.1::45152 universe-4a0x83-0 | [2017-05-09 06:36:14,018] [INFO:universe.rewarder.remote] Client connecting: peer=tcp4:127.0.0.1:55770 observer=True universe-4a0x83-0 | [2017-05-09 06:36:14,019] [INFO:universe.rewarder.remote] WebSocket connection established universe-4a0x83-0 | [2017-05-09 06:36:14,021] [selenium_wrapper_server] Calling webdriver.Chrome() universe-4a0x83-0 | [init] [2017-05-09 06:36:14,023] init detected end of child process 17 with exit code 0, not killed by signal [2017-05-09 02:36:15,015] Using the golang VNC implementation [2017-05-09 02:36:15,015] Using VNCSession arguments: {'start_timeout': 7, 'encoding': 'tight', 'subsample_level': 2, 'fine_quality_level': 50}. (Customize by running "env.configure(vnc_kwargs={...})" universe-4a0x83-0 | [tigervnc] universe-4a0x83-0 | [nginx] 172.17.0.1 - openai [09/May/2017:06:36:15 +0000] "GET / HTTP/1.1" 101 164 "-" "-" universe-4a0x83-0 | [tigervnc] Tue May 9 06:36:15 2017 universe-4a0x83-0 | [tigervnc] Connections: closed: 172.17.0.1::45152 (Clean disconnection) universe-4a0x83-0 | [tigervnc] EncodeManager: Framebuffer updates: 0 universe-4a0x83-0 | [tigervnc] EncodeManager: Total: 0 rects, 0 pixels universe-4a0x83-0 | [tigervnc] EncodeManager: 0 B (1:-nan ratio) universe-4a0x83-0 | [2017-05-09 06:36:15,017] [INFO:universe.rewarder.remote] WebSocket connection closed: connection was closed uncleanly (peer dropped the TCP connection without previous WebSocket closing handshake) universe-4a0x83-0 | [2017-05-09 06:36:15,018] [INFO:universe.rewarder.remote] [Twisted] Non-active client disconnected [2017-05-09 02:36:15,023] [0] Connecting to environment: vnc://localhost:5900 password=openai. If desired, you can manually connect a VNC viewer, such as TurboVNC. Most environments provide a convenient in-browser VNC client: http://localhost:15900/viewer/ ?password=openai 2017/05/09 02:36:15 I0509 02:36:15.023941 20864 gymvnc.go:417] [0:localhost:5900] opening connection to VNC server universe-4a0x83-0 | [tigervnc] Connections: accepted: 172.17.0.1::45168 2017/05/09 02:36:15 I0509 02:36:15.027754 20864 gymvnc.go:550] [0:localhost:5900] connection established universe-4a0x83-0 | [tigervnc] SConnection: Client needs protocol version 3.8 universe-4a0x83-0 | [tigervnc] SConnection: Client requests security type VncAuth(2) universe-4a0x83-0 | [tigervnc] VNCSConnST: Server default pixel format depth 24 (32bpp) little-endian rgb888 universe-4a0x83-0 | [tigervnc] VNCSConnST: Client pixel format depth 24 (32bpp) little-endian bgr888 universe-4a0x83-0 | [2017-05-09 06:36:15,041] [INFO:universe.rewarder.remote] Client connecting: peer=tcp4:127.0.0.1:55796 observer=False universe-4a0x83-0 | [2017-05-09 06:36:15,042] [INFO:universe.rewarder.remote] WebSocket connection established Traceback (most recent call last): File "app.py", line 11, in
env.render() File "/usr/local/lib/python3.5/dist-packages/gym/core.py", line 153, in render return self._render(mode=mode, close=close) File "/usr/local/lib/python3.5/dist-packages/gym/core.py", line 285, in _render return self.env.render(mode, close) File "/usr/local/lib/python3.5/dist-packages/gym/core.py", line 153, in render return self._render(mode=mode, close=close) File "/home/tensor/python/universe/universe/wrappers/render.py", line 52, in _render return self.env.render(mode=mode, *args, **kwargs) File "/usr/local/lib/python3.5/dist-packages/gym/core.py", line 153, in render return self._render(mode=mode, close=close) File "/usr/local/lib/python3.5/dist-packages/gym/core.py", line 285, in _render return self.env.render(mode, close) File "/usr/local/lib/python3.5/dist-packages/gym/core.py", line 153, in render return self._render(mode=mode, close=close) File "/home/tensor/python/universe/universe/envs/vnc_env.py", line 552, in _render self.vnc_session.render(self.connection_names[0]) go_vncdriver.Error: /tmp/pip-build-ej33ia2v/go-vncdriver/.build/src/ github.com/openai/go-vncdriver/main.go:387: go_vncdriver was installed without OpenGL support. See https://github.com/openai/go-vncdriver for details on how debug. [2017-05-09 02:36:15,222] Killing and removing container: id=7134b6bf0ca3f26a456261b35e7cd06d18b46fb6077497017bc3061398dc 4533 Versions Please include the result of running
$ uname -a ; python --version; pip show universe gym tensorflow numpy go-vncdriver Pillow
`Linux tensor-desktop 4.8.0-36-generic #36 https://github.com/openai/universe/issues/36~16.04.1-Ubuntu SMP Sun Feb 5 09:39:57 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux Python 3.5.2 Name: universe Version: 0.21.5 Summary: Universe: a software platform for measuring and training an AI's general intelligence across the world's supply of games, websites and other applications. Home-page: https://github.com/openai/universe Author: OpenAI Author-email: universe@openai.com License: UNKNOWN Location: /home/tensor/python/universe Requires: autobahn, docker-py, docker-pycreds, fastzbarlight, go-vncdriver, gym, Pillow, PyYAML, six, twisted, ujson Name: gym Version: 0.8.2 Summary: The OpenAI Gym: A toolkit for developing and comparing your reinforcement learning agents. Home-page: https://github.com/openai/gym Author: OpenAI Author-email: gym@openai.com License: UNKNOWN Location: /usr/local/lib/python3.5/dist-packages Requires: six, requests, numpy, pyglet Name: numpy Version: 1.12.1 Summary: NumPy: array processing for numbers, strings, records, and objects. Home-page: http://www.numpy.org Author: NumPy Developers Author-email: numpy-discussion@scipy.org License: BSD Location: /usr/local/lib/python3.5/dist-packages Requires: Name: go-vncdriver Version: 0.4.19 Summary: UNKNOWN Home-page: UNKNOWN Author: UNKNOWN Author-email: UNKNOWN License: UNKNOWN Location: /usr/local/lib/python3.5/dist-packages Requires: numpy
Name: Pillow Version: 4.1.1 Summary: Python Imaging Library (Fork) Home-page: https://python-pillow.org Author: Alex Clark (Fork Author) Author-email: aclark@aclark.net License: Standard PIL License Location: /usr/local/lib/python3.5/dist-packages Requires: olefile `
— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/openai/universe/issues/183, or mute the thread https://github.com/notifications/unsubscribe-auth/AANZdBYjc1VygjZKrVJAu6oAl_luT-aqks5r4ArCgaJpZM4NU4mE .
-- Trevor Blackwell tlb@openai.com 650 776 7870
abeltensor
tensor-programming
(First, please check https://github.com/openai/universe/wiki/Solutions-to-common-problems for solutions to many common problems)
Running the agent example in the read me, from what I can tell, something happens when the env.render() function is called. Opening in browser shows the environment for a split second before it just cuts off. I've tried using other envs but no dice.
Ubuntu 16.04 LTS Python 3.5