search

niuzaisheng / ScreenAgent

ScreenAgent: A Computer Control Agent Driven by Visual Language Large Model (IJCAI-24)
https://arxiv.org/abs/2402.07945
Other
217 stars 24 forks source link

Blank Desktop #21

Open chen-yifu opened 2 months ago

chen-yifu commented 2 months ago

I got a blank desktop, is anybody encountering this? I am running on Macbook with M3 chip. Is this an issue with the AMD64? Below are some logs from the Docker logs. Thanks!

ScreenShot 2024-05-04 at 15 13 47

(base) MacBook-Pro-4:agi yifu$ docker run --platform linux/amd64 -d --name ScreenAgent3 -e RESOLUTION=1024x768 -p 5900:5900 -p 8001:8001 -e VNC_PASSWORD="19981001" -e CLIPBOARD_SERVER_SECRET_TOKEN="" -v /dev/shm:/dev/shm niuniushan/screenagent-env:latest 9ad903103b3fb9a6f1e081e52be94af04b3142a441246b1fd647f8badf66a5ee (base) MacBook-Pro-4:agi yifu$ docker ps CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 9ad903103b3f niuniushan/screenagent-env:latest "/startup.sh" 29 seconds ago Up 28 seconds (health: starting) 0.0.0.0:5900->5900/tcp, 80/tcp, 0.0.0.0:8001->8001/tcp ScreenAgent3 (base) MacBook-Pro-4:agi yifu$ docker logs ScreenAgent3 stored passwd in file: /.password2 2024-05-04 22:28:42,195 CRIT Supervisor is running as root. Privileges were not dropped because no user is specified in the config file. If you intend to run as root, you can set user=root in the config file to avoid this message. 2024-05-04 22:28:42,196 INFO Included extra file "/etc/supervisor/conf.d/supervisord.conf" during parsing 2024-05-04 22:28:42,198 INFO RPC interface 'supervisor' initialized 2024-05-04 22:28:42,198 CRIT Server 'unix_http_server' running without any HTTP authentication checking 2024-05-04 22:28:42,199 INFO supervisord started with pid 14 2024-05-04 22:28:43,208 INFO spawned: 'nginx' with pid 16 2024-05-04 22:28:43,215 INFO spawned: 'web' with pid 17 2024-05-04 22:28:43,220 INFO spawned: 'clipboard_app' with pid 18 2024-05-04 22:28:43,225 INFO spawned: 'xvfb' with pid 19 2024-05-04 22:28:43,228 INFO spawned: 'wm' with pid 20 2024-05-04 22:28:43,236 INFO spawned: 'lxpanel' with pid 21 2024-05-04 22:28:43,238 INFO spawned: 'pcmanfm' with pid 22 2024-05-04 22:28:43,240 INFO spawned: 'x11vnc' with pid 23 2024-05-04 22:28:43,241 INFO spawned: 'novnc' with pid 24 2024-05-04 22:28:43,281 INFO exited: xvfb (exit status 1; not expected) 2024-05-04 22:28:43,284 INFO exited: x11vnc (exit status 1; not expected) 2024-05-04 22:28:43,285 INFO exited: wm (exit status 1; not expected) 2024-05-04 22:28:43,290 INFO exited: pcmanfm (exit status 1; not expected) 2024-05-04 22:28:43,291 INFO exited: lxpanel (exit status 1; not expected) 2024-05-04 22:28:43,469 INFO Listening on http://localhost:6079 (run.py:87) 2024-05-04 22:28:44,425 INFO success: nginx entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2024-05-04 22:28:44,425 INFO success: web entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2024-05-04 22:28:44,425 INFO success: clipboard_app entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2024-05-04 22:28:44,426 INFO spawned: 'xvfb' with pid 41 2024-05-04 22:28:44,426 INFO spawned: 'wm' with pid 42 2024-05-04 22:28:44,427 INFO spawned: 'lxpanel' with pid 43 2024-05-04 22:28:44,428 INFO spawned: 'pcmanfm' with pid 44 2024-05-04 22:28:44,430 INFO spawned: 'x11vnc' with pid 45 2024-05-04 22:28:44,430 INFO success: novnc entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2024-05-04 22:28:44,468 INFO exited: wm (exit status 1; not expected) 2024-05-04 22:28:44,744 INFO exited: pcmanfm (terminated by SIGTRAP; not expected) 2024-05-04 22:28:44,837 INFO exited: lxpanel (terminated by SIGTRAP; not expected) 2024-05-04 22:28:45,839 INFO success: xvfb entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2024-05-04 22:28:45,840 INFO success: x11vnc entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2024-05-04 22:28:46,845 INFO spawned: 'wm' with pid 81 2024-05-04 22:28:46,849 INFO spawned: 'lxpanel' with pid 82 2024-05-04 22:28:46,852 INFO spawned: 'pcmanfm' with pid 83 2024-05-04 22:28:47,036 INFO exited: pcmanfm (terminated by SIGTRAP; not expected) 2024-05-04 22:28:47,047 INFO exited: lxpanel (terminated by SIGTRAP; not expected) 2024-05-04 22:28:48,053 INFO success: wm entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2024-05-04 22:28:50,067 INFO spawned: 'lxpanel' with pid 90 2024-05-04 22:28:50,072 INFO spawned: 'pcmanfm' with pid 91 2024-05-04 22:28:50,252 INFO exited: pcmanfm (terminated by SIGTRAP; not expected) 2024-05-04 22:28:50,254 INFO gave up: pcmanfm entered FATAL state, too many start retries too quickly 2024-05-04 22:28:50,254 INFO exited: lxpanel (terminated by SIGTRAP; not expected) 2024-05-04 22:28:51,258 INFO gave up: lxpanel entered FATAL state, too many start retries too quickly 2024-05-04 22:29:12,176 ERROR Exception on /api/health [GET] (app.py:1890) Traceback (most recent call last): File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 2446, in wsgi_app response = self.full_dispatch_request() File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1951, in full_dispatch_request rv = self.handle_user_exception(e) File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in handle_user_exception reraise(exc_type, exc_value, tb) File "/usr/local/lib/python3.8/dist-packages/flask/_compat.py", line 39, in reraise raise value File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1949, in full_dispatch_request rv = self.dispatch_request() File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1935, in dispatch_request return self.view_functionsrule.endpoint File "/usr/local/lib/web/backend/vnc/app.py", line 41, in apihealth if state.health: File "/usr/local/lib/web/backend/vnc/state.py", line 129, in health self._update_health() File "/usr/local/lib/web/backend/vnc/state.py", line 31, in _update_health output = gsp.check_output([ File "/usr/local/lib/python3.8/dist-packages/gevent/subprocess.py", line 348, in check_output raise CalledProcessError(retcode, process.args, output=output) subprocess.CalledProcessError: Command '['supervisorctl', '-c', '/etc/supervisor/supervisord.conf', 'status']' returned non-zero exit status 3. (base) MacBook-Pro-4:agi yifu$ docker rm -f ScreenAgent3 ScreenAgent3 (base) MacBook-Pro-4:agi yifu$ docker rm -f ScreenAgent2 ScreenAgent2 (base) MacBook-Pro-4:agi yifu$ docker rm -f ScreenAgent1 Error response from daemon: No such container: ScreenAgent1 (base) MacBook-Pro-4:agi yifu$ docker rm -f ScreenAgent ScreenAgent (base) MacBook-Pro-4:agi yifu$ sudo rm /tmp/.X-lock /tmp/.X11-unix/X Password: rm: /tmp/.X-lock: No such file or directory rm: /tmp/.X11-unix/X: No such file or directory (base) MacBook-Pro-4:agi yifu$ docker pull niuniushan/screenagent-env:latest latest: Pulling from niuniushan/screenagent-env Digest: sha256:581a6023f096ce28eb95fd42498ea41a05ac9ae9a7c90f283fe8a43204b85ced Status: Image is up to date for niuniushan/screenagent-env:latest docker.io/niuniushan/screenagent-env:latest

What's Next?

  1. Sign in to your Docker account → docker login
  2. View a summary of image vulnerabilities and recommendations → docker scout quickview niuniushan/screenagent-env:latest (base) MacBook-Pro-4:agi yifu$ docker run --platform linux/amd64 -d --name ScreenAgent -e RESOLUTION=1024x768 -p 5900:5900 -p 8001:8001 -e VNC_PASSWORD='19981001' -e CLIPBOARD_SERVER_SECRET_TOKEN='your_clipboard_token' -v /dev/shm:/dev/shm niuniushan/screenagent-env:latest 7840910fae13408c33148bd000d09942ac38102d3e37943044ad226d03828f5c (base) MacBook-Pro-4:agi yifu$ docker ps -a CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 7840910fae13 niuniushan/screenagent-env:latest "/startup.sh" 6 seconds ago Up 5 seconds (health: starting) 0.0.0.0:5900->5900/tcp, 80/tcp, 0.0.0.0:8001->8001/tcp ScreenAgent 531aa96655cd lang-segment-anything:latest "lightning run app a…" 2 weeks ago Exited (0) 2 weeks ago quirky_wing c5632e9c2518 lang-segment-anything:latest "lightning run app a…" 2 weeks ago Exited (0) 2 weeks ago serene_elbakyan b453388338a0 lang-segment-anything:latest "lightning run app a…" 2 weeks ago Created reverent_bose (base) MacBook-Pro-4:agi yifu$ docker logs ScreenAgent/ stored passwd in file: /.password2 2024-05-04 22:38:21,678 CRIT Supervisor is running as root. Privileges were not dropped because no user is specified in the config file. If you intend to run as root, you can set user=root in the config file to avoid this message. 2024-05-04 22:38:21,679 INFO Included extra file "/etc/supervisor/conf.d/supervisord.conf" during parsing 2024-05-04 22:38:21,681 INFO RPC interface 'supervisor' initialized 2024-05-04 22:38:21,681 CRIT Server 'unix_http_server' running without any HTTP authentication checking 2024-05-04 22:38:21,682 INFO supervisord started with pid 14 2024-05-04 22:38:22,689 INFO spawned: 'nginx' with pid 16 2024-05-04 22:38:22,690 INFO spawned: 'web' with pid 17 2024-05-04 22:38:22,692 INFO spawned: 'clipboard_app' with pid 18 2024-05-04 22:38:22,694 INFO spawned: 'xvfb' with pid 19 2024-05-04 22:38:22,695 INFO spawned: 'wm' with pid 20 2024-05-04 22:38:22,699 INFO spawned: 'lxpanel' with pid 21 2024-05-04 22:38:22,701 INFO spawned: 'pcmanfm' with pid 22 2024-05-04 22:38:22,703 INFO spawned: 'x11vnc' with pid 23 2024-05-04 22:38:22,705 INFO spawned: 'novnc' with pid 24 2024-05-04 22:38:22,749 INFO exited: xvfb (exit status 1; not expected) 2024-05-04 22:38:22,755 INFO exited: wm (exit status 1; not expected) 2024-05-04 22:38:22,755 INFO exited: x11vnc (exit status 1; not expected) 2024-05-04 22:38:22,761 INFO exited: pcmanfm (exit status 1; not expected) 2024-05-04 22:38:22,762 INFO exited: lxpanel (exit status 1; not expected) 2024-05-04 22:38:22,940 INFO Listening on http://localhost:6079 (run.py:87) 2024-05-04 22:38:23,888 INFO success: nginx entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2024-05-04 22:38:23,888 INFO success: web entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2024-05-04 22:38:23,888 INFO success: clipboard_app entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2024-05-04 22:38:23,890 INFO spawned: 'xvfb' with pid 41 2024-05-04 22:38:23,891 INFO spawned: 'wm' with pid 42 2024-05-04 22:38:23,892 INFO spawned: 'lxpanel' with pid 43 2024-05-04 22:38:23,894 INFO spawned: 'pcmanfm' with pid 44 2024-05-04 22:38:23,895 INFO spawned: 'x11vnc' with pid 45 2024-05-04 22:38:23,895 INFO success: novnc entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2024-05-04 22:38:24,209 INFO exited: lxpanel (terminated by SIGTRAP; not expected) 2024-05-04 22:38:24,209 INFO exited: pcmanfm (terminated by SIGTRAP; not expected) 2024-05-04 22:38:25,212 INFO success: xvfb entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2024-05-04 22:38:25,213 INFO success: wm entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2024-05-04 22:38:25,213 INFO success: x11vnc entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2024-05-04 22:38:26,226 INFO spawned: 'lxpanel' with pid 82 2024-05-04 22:38:26,232 INFO spawned: 'pcmanfm' with pid 83 2024-05-04 22:38:26,415 INFO exited: pcmanfm (terminated by SIGTRAP; not expected) 2024-05-04 22:38:26,425 INFO exited: lxpanel (terminated by SIGTRAP; not expected) 2024-05-04 22:38:29,436 INFO spawned: 'lxpanel' with pid 90 2024-05-04 22:38:29,438 INFO spawned: 'pcmanfm' with pid 91 2024-05-04 22:38:29,611 INFO exited: pcmanfm (terminated by SIGTRAP; not expected) 2024-05-04 22:38:29,613 INFO gave up: pcmanfm entered FATAL state, too many start retries too quickly 2024-05-04 22:38:29,614 INFO exited: lxpanel (terminated by SIGTRAP; not expected) 2024-05-04 22:38:30,621 INFO gave up: lxpanel entered FATAL state, too many start retries too quickly (base) MacBook-Pro-4:agi yifu$