hdresearch / nolita

Work with web-enabled agents quickly — whether running a quick task or bootstrapping a full-stack product.
https://nolita.ai
MIT License
87 stars 6 forks source link

Some links are getting lost in the dom -> aria tree conversion #25

Closed AlephNotation closed 6 months ago

AlephNotation commented 6 months ago

Example:

State: {"kind":"ObjectiveState","url":"https://hdr.is/people","ariaTree":"[0,\"RootWebArea\",\"About - High Dimensional Research\",[[1,\"link\",\"HIGH DIMENSIONAL RESEARCH\"],\"⚲\",[2,\"link\",\"PRODUCT\"],[3,\"link\",\"BLOG\"],[4,\"link\",\"DOCUMENTATION\"],[5,\"link\",\"COMPANY\"],"progress":["Navigated to the `Company` page to find the email address of Tynan Daly.","Navigated to the `Company` page to find the email address of Tynan Daly"],"objective":"please find the email address link for tynan daly on the company page"}Response: {"progressAssessment":"Cannot find Tynan Daly's email address in the current ariaTree. The page might not contain the required information or it may need additional navigation to reach the desired information.","command":[{"kind":"Click","index":4}],"description":"Attempting to navigate to the `About` page to find Tynan Daly's email address. Clicked on `About`."}
Step response: [object Object]Performing action:[{"kind":"Click","index":4}]

The base tree should contain email links so i think they're getting filtered out during tree simplification.

Working on a fix.

AlephNotation commented 6 months ago

Strangely enough, this seems to have been closed by #32