ServiceNow / WorkArena

WorkArena: How Capable are Web Agents at Solving Common Knowledge Work Tasks?
https://servicenow.github.io/WorkArena/
Other
122 stars 11 forks source link

Timeout error in env.step() #26

Closed dgjun32 closed 1 month ago

dgjun32 commented 1 month ago

in 1st and 2nd task in "workarena.servicenow.order-developer-laptop", admissible action (e.g., click checkbox) results in Timeout Error. Is there any solution?

gasse commented 1 month ago

I don't think this is a bug. The way the UI is implemented, in these tasks the checkboxes can not be interacted with. The task is still feasible by clicking the checkboxes' label instead. Our GPT4 agent usually figures this out and clicks the label after clicking the checkbox unsuccessfully.

dgjun32 commented 1 month ago

Oh, I see, I thought it was a bug but It seems checkboxes are not clickable..! Thank you very much.

gasse commented 1 month ago

Yes it's something we noticed also a while ago, we decided not do do anything about it. It's a weird UI behavior but representative of entreprise software. You're welcome!