search

web-arena-x / webarena

Code repo for "WebArena: A Realistic Web Environment for Building Autonomous Agents"
https://webarena.dev
Apache License 2.0
696 stars 108 forks source link

Feature/fix pop menu #112

Open lwaekfjlk opened 6 months ago

lwaekfjlk commented 6 months ago

solve #89

dragon18456 commented 6 months ago

We have noticed this issue as well, is this caused by newer version of playwright?

lwaekfjlk commented 6 months ago

I am not sure. I think that is because playwright just cannot capture those popmenus? Maybe @shuyanzhou can provide more reasons on why this happens.

Basically I try to provide a dirty solution to hard-code this part. Do you have any other suggestions?

shuyanzhou commented 6 months ago

I can confirm this is an issue from Playwright. There is a solution in the issue I posted. I will test it and follow up soon

dragon18456 commented 6 months ago

Thanks @shuyanzhou

@lwaekfjlk As far as I can tell, this bug affects the shopping website and the maps website. Are there any other tasks that have this issue?

shuyanzhou commented 6 months ago

Yes. @dragon18456 This bug affects sorting products and selecting transportation modes. We tested other dropdown menus such as ones on the admin store portal, and found no problem. Feel free to follow up if you discover new problems. Thanks!

dragon18456 commented 6 months ago

One issue I found is that on the bestsellers report page in the shopping_admin website, the dropdowns for the period does not render when the dropdown is open. The agent is unable to select the proper period i.e. year, month, or day for the range, which make some of the first couple of tasks nearly impossible. @shuyanzhou @lwaekfjlk

lwaekfjlk commented 6 months ago

good point :-)

dragon18456 commented 6 months ago

I have also tried changing device_scale_factor=2 as posted in the issue above that @shuyanzhou mentioned, but this does not solve the problem. is this a new problem with playwright? Is there perhaps a version that I can downgrade to to make this issue go away? @lwaekfjlk

shuyanzhou commented 6 months ago

Hi @dragon18456 Thanks for reporting this one. I plan to follow @lwaekfjlk's fix and fix all these known issues. I have tested two or three versions of playwright before, but all have the same issue.