lavague-ai / LaVague

Large Action Model framework to develop AI Web Agents
https://docs.lavague.ai/en/latest/
Apache License 2.0
5.39k stars 489 forks source link

Provide option to record static pages for later debugging #489

Open dhuynh95 opened 2 months ago

dhuynh95 commented 2 months ago

Problem

The current Logger does not save the HTML of the page being interacted with.

If the issue is due to the Navigation Engine it could be great to be able to replay this specific step and debug the page without having to recreate the whole process.

For instance, I have some issue in the 4th step of an onboarding form of a bank, and navigation failed. I don't want to redo the whole thing.

image

Proposed solution

I think we could have something like agent.run(objective, record_html=True) to add to the logger the ability to save the both the real DOM and the frozen in the logs.

@mbrunel

dhuynh95 commented 2 months ago

FYI @mbrunel it's important to have the real DOM to test some things on it, but also the frozen one to highlight elements to debug