search

web-arena-x / webarena

Code repo for "WebArena: A Realistic Web Environment for Building Autonomous Agents"
https://webarena.dev
Apache License 2.0
767 stars 122 forks source link

Unstable website #186

Closed njucckevin closed 1 week ago

njucckevin commented 3 weeks ago

Hi, thanks for the great work.

I follow the instructions in https://github.com/web-arena-x/webarena/blob/main/environment_docker/README.md and set and config my own standalone websites using AWS docker. The websites are accessible and can be interacted with. However, I frequently encounter two problems:

  1. Timeout issue: sometimes with timeout 30000ms and sometimes timeout 500ms. When clicking on the same element, sometimes it works and sometimes it timeouts. Is this caused by my network connection? 
    packages/playwright/_impl/_connection.py", line 96, in inner_send
result = next(iter(done)).result()
playwright._impl._api_types.TimeoutError: Timeout 30000ms exceeded.
=========================== logs ===========================
navigating to "http://ec2-18-220-173-105.us-east-2.compute.amazonaws.com:7770/customer/account/login/", waiting until "load"
============================================================
  2. AWS EC2 breakdown. Although I chose the recommended config with t3a.xlarge and 1000GB EBS, the instance in EC2 seems to crash once every few hours. And after rebooting the instance and restarting the docker, the website is ok again. I checked the monitoring of the instance, but it doesn't look like there are any obvious problems with cpu or storage.

The above two issues seriously hindered my evaluation process. Can you provide some suggestions? Thank you very much.

@frankxu2004 @shuyanzhou @oootttyyy

njucckevin commented 1 week ago

Unexpectedly selected t3a.xlarge as t3a.large, the problem solved after correctly selecting t3a.xlarge.