web-arena-x visualwebarena issues

web-arena-x / visualwebarena

VisualWebArena is a benchmark for multimodal agents.

https://jykoh.com/vwa

MIT License

211 stars 36 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Document update and evaluation update [WIP]

#62 shuyanzhou opened 3 days ago
0
How to set up multiple docker for the same website to conduct the parallel evalution.

#61 leoozy opened 2 weeks ago
1
Need for resetting in run som scripts

#60 sanjari-orb opened 3 weeks ago
2
The very important element: "sort" can not be found in accessibility_tree_with_captioner.

#59 leoozy closed 2 weeks ago
3
Release log of success/failures for GPT4+SOM trajectories

#58 sanjari-orb closed 1 month ago
2
local image hosting, new action stuff

#57 ljang0 opened 1 month ago
2
Pytest code is not working

#56 pokerme7777 opened 1 month ago
1
Issue with URL links in classifieds tasks

#55 Saraabdali closed 1 month ago
1
action space of som can not solve the select element

#54 leoozy closed 2 weeks ago
3
How to open trace files without display server?

#53 piperwolters opened 2 months ago
1
[Question] How to view the generated .trace files for a trace?

#52 ReeceResearch closed 2 months ago
1
May I know any solution for using apptainer instead of docker for starting up website?

#51 pokerme7777 opened 2 months ago
0
Multiple unreachable image ulrs

#50 Saraabdali closed 1 month ago
1
AssertionError: Cookie ./.auth/reddit_state.json expired.

#49 leoozy closed 3 months ago
2
Fully merge WebArena

#48 shuyanzhou closed 3 months ago
1
It seems that the search text for city does not work for the classifieds?

#47 leoozy closed 2 months ago
1
Why you have to remove the dupulicated content.

#46 leoozy closed 2 months ago
1
create clear functionality

#45 ljang0 closed 3 months ago
1
Update to remove unused sites for VWA.

#44 kohjingyu closed 3 months ago
0
ImportError: cannot import name 'GITLAB' from 'browser_env.env_config'

#43 leoozy closed 3 months ago
3
Archive.org Download Links Not Working

#42 jdy18 closed 1 month ago
1
Errors in annotation

#41 leoozy closed 3 months ago
12
Assertion error in LLM based fuzzy match

#40 vardaan123 closed 3 months ago
1
Evaluation always skips last task for any website

#39 vardaan123 closed 3 months ago
1
AttributeError("'Page' object has no attribute 'client'")

#38 vardaan123 closed 4 months ago
3
Elasticsearch / Opensearch issues on Shopping Website

#37 mlin12321 closed 3 months ago
6
How do you evaluate CogVLM when there are multiple images as input.

#36 leoozy closed 4 months ago
1
Shopping Website Issues with setup:store-config:set

#35 mlin12321 closed 3 months ago
1
How to navigate to www.homepage.com?

#34 leoozy closed 3 months ago
3
Could you please release the code about how to run the CogVLM?

#33 leoozy closed 4 months ago
1
How to manually reset the shopping/reddit website?

#32 leoozy closed 4 months ago
1
MySQL error with Classifieds website

#31 vardaan123 closed 4 months ago
5
Configurations Setup for all Model Types

#30 anithselva closed 2 months ago
12
Website Files Missing

#29 mlin12321 closed 4 months ago
5
PyTest fail on test_click_open_new_tab

#28 anithselva opened 4 months ago
0
Reproducing open-source model results

#27 anithselva opened 4 months ago
1
Osclass Error

#26 DEM1TASSE closed 4 months ago
3
Update README.md

#25 danielkornev closed 4 months ago
2
support the switch bewteen webarena, visualwebarena

#24 shuyanzhou closed 3 months ago
0
fix new tab from click bug

#23 shuyanzhou closed 4 months ago
1
add new som elements

#22 ljang0 closed 4 months ago
0
Remove beartype from action functions to allow webstudent to use them

#21 jayoohwang1 closed 4 months ago
0
Possibility of altering evaluation sites

#20 devinat1 closed 4 months ago
1
Blank screenshot when running GPT-4V + SOM

#19 ltzheng closed 4 months ago
1
Trouble with Checkboxes

#18 gurugecl closed 1 month ago
4
Some examples will report an error when running run.py

#17 XinrunXu closed 4 months ago
4
Questions about pytest -x

#16 XinrunXu closed 5 months ago
3
Update LICENSE

#15 kohjingyu closed 5 months ago
0
What are the multi-site tasks mentioned in the paper?

#14 XinrunXu closed 5 months ago
2
Update prompt_constructor.py

#13 tonystark262 closed 5 months ago
1