web-arena-x / webarena

Code repo for "WebArena: A Realistic Web Environment for Building Autonomous Agents"
https://webarena.dev
Apache License 2.0
700 stars 108 forks source link

how to efficiently reset changes to the environment? #88

Closed lyneyandlynette closed 8 months ago

lyneyandlynette commented 8 months ago

It seems that for actions like posting a new submission on reddit will make the submission stay on the page and won't automatically delete itself. This is not very convenient for testing... Is there any way to efficiently undo all changed to the environment? Thank you!

shuyanzhou commented 8 months ago

Hi @lyneyandlynette, thanks, this is a good question. The recommended way is resetting the environment after each round of evaluation.

# stop the dockers
docker stop shopping_admin forum gitlab shopping
# remove the docker images
docker remove shopping_admin forum gitlab shopping;

Depending on whether you are using the AMI or individual dockers, restart the dockers with the instructions in the README file. Let me know if you encounter any issues