lavague-ai / LaVague

Large Action Model framework to develop AI Web Agents
https://docs.lavague.ai/en/latest/
Apache License 2.0
4.94k stars 420 forks source link

Navigation Engine switch from arbitrary code exec to outputting XPath, type of action and other arguments #352

Open dhuynh95 opened 2 weeks ago

dhuynh95 commented 2 weeks ago

The NavigationEngine currently does arbitrary code execution, which is a bad practice and is no longer needed (we did it at the beginning because we wanted to provide the ability to invoke tools if needed, but things are well separated now in the PythonEngine who is specialized in calling tools).

We therefore should revamp the current Navigation Engine to output things like:

[
    {"Action": "Click",
     "XPath": "..."
     },
]

Then we provide specific code for each different driver, Selenium, Playwright or Chrome Extension.