web-arena-x / webarena

Code repo for "WebArena: A Realistic Web Environment for Building Autonomous Agents"
https://webarena.dev
Apache License 2.0
632 stars 90 forks source link

Task 425 reference answer is incorrect #137

Open peterychang opened 1 month ago

peterychang commented 1 month ago

The intent is: "Find the page of the longest bridge in the Western hemisphere on the map."

The reference answer is Mackinac Bridge, which is incorrect. The answer (based on the way the question is worded) would be Lake Pontchartrain Causeway. The question that would need to be asked would be "Find the page for the longest suspension bridge between anchorages in the Western hemisphere" (the Golden Gate Bridge is longer if measured in a different way)