search

normal-computing / fuji-web

Fuji is an AI agent that lives in your browser's sidepanel. You can now get tasks done online with a single command!
Apache License 2.0
195 stars 13 forks source link

Support dropdown #50

Open mondaychen opened 3 months ago

mondaychen commented 3 months ago

We currently don’t support any kind of dropdown menu well

mondaychen commented 3 months ago

One possible solution is to scan all select (with option as children) and [role="listbox"] (with [role="option"] as children) , and introduce a new type of annotation + new action type

Example annotation item:

label = "10" name = "Choose a city" tagName = "SELECT" options = ["New York", "Boston", "Paris", "London"]

Example action:

select(10, 'New York')