web-arena-x / webarena

Code repo for "WebArena: A Realistic Web Environment for Building Autonomous Agents"
https://webarena.dev
Apache License 2.0
647 stars 94 forks source link

Is it possible to seperate data and env dependencies in docker images? The images are too big now. #69

Closed Junpliu closed 7 months ago

Junpliu commented 7 months ago

Is it possible to release data and env/dependencies separately, where only env/dependencies are included in the images?

shuyanzhou commented 7 months ago

Thanks for the question. I understand that the size of the images is quite large. Unfortunately, separating the data from the environment is non-trivial as it requires (1) setting up fresh websites and (2) importing data. There can be a lot of issues happening during both steps.