search

web-arena-x / webarena

Code repo for "WebArena: A Realistic Web Environment for Building Autonomous Agents"
https://webarena.dev
Apache License 2.0
647 stars 94 forks source link

No way to aggregate customers by order count when limited to status #101

Closed moladeyal closed 4 months ago

moladeyal commented 5 months ago

Several tasks (ids 288,292, 62, 64, 65) require to get the top k customers by the order count with status=x (e.g. status=completed, status=cancelled). I could not find such an option in the UI. Nor did I find a successful user trajectory from those which were published.

What is the expected way to complete those tasks?

Thanks, Eyal

moladeyal commented 5 months ago

(Probably also relevant to task ids 289-291)

shuyanzhou commented 5 months ago

You are right; there is no option to gather customers by the number of orders. These tasks require the agent to understand the tables. The humans also perform literal counting of orders per user, so there is no recording of the counting.