search

web-arena-x / visualwebarena

VisualWebArena is a benchmark for multimodal agents.
https://jykoh.com/vwa
MIT License
232 stars 44 forks source link

What are the multi-site tasks mentioned in the paper? #14

Closed XinrunXu closed 7 months ago

XinrunXu commented 7 months ago
image

Where can I find them directly?

kohjingyu commented 7 months ago

You can filter by all the tasks in config_files/test_classifieds.raw.json, config_files/test_shopping.raw.json and config_files/test_reddit.raw.json in that have multiple sites in "sites", e.g., task 43 of test_reddit.raw.json:

https://github.com/web-arena-x/visualwebarena/blob/0675e395c78f7491071c08681153950f3931abce/config_files/test_reddit.raw.json#L1477-L1480

XinrunXu commented 7 months ago

Thank you!