search

web-arena-x / webarena

Code repo for "WebArena: A Realistic Web Environment for Building Autonomous Agents"
https://webarena.dev
Apache License 2.0
676 stars 103 forks source link

Docker loading forever on Mac #15

Closed lyneyandlynette closed 9 months ago

lyneyandlynette commented 1 year ago

Hi, Did anyone successfully building the codebase on Mac? I'm trying to docker load the webpages on Mac, however for my MacBook with intel, docker load command takes forever; for my MacBook with M1X chip, it can load the 9G website, but for larger ones, it keeps getting "unexpected EOF" error. Does anyone know how to deal with this? Thank you!

kohjingyu commented 1 year ago

I managed to build the shopping environment on an M1 MacBook, and didn't experience this issue. Maybe you need to increase your Docker virtual disk limit? I've set mine to 160GB.

lyneyandlynette commented 1 year ago

@kohjingyu Hi, thank you for the reply! May I know if you set 160GB to load all the webpages at once? As the file sizes add to up to more than 160GB, how do you get the number then? Thank you!

shuyanzhou commented 1 year ago

160GB for the shopping site only.

We haven't tested the dockers on Mac yet. @frankxu2004 do you thoughts on an estimation on the Docker virtual disk limit?

RogerChern commented 10 months ago

I wonder if it is possible to optimize the image size for each enviroment.

We have shop 72G, shop admin 9G, reddit 50G, gitlab 72G, wikipedia 89G here.

shuyanzhou commented 9 months ago

@RogerChern Unfortunately it is not very likely because they are mostly the data content of the site. We designed to have more data to keep the sites realistic