search

lavague-ai / LaVague

Large Action Model framework to develop AI Web Agents
https://docs.lavague.ai/en/latest/
Apache License 2.0
4.93k stars 418 forks source link

Perform automatic tests on websites #378

Open adeprez opened 4 days ago

adeprez commented 4 days ago

Automating tests for websites

To be run on CI or locally

Goal

Develop a system to perform automated tests on different websites, whether they are hosted online, static, or run locally. The system should:

It will enable us to monitor performance and coverage improvements over time. Contributors can submit use cases to ensure they remain supported, allowing for continuous enhancement.

Proposal

The testing framework can be organized within a tests directory inside the repository. Each website or web application to be tested will have its own subdirectory containing a configuration file and any necessary assets.

tests
   |___ google.com
        |___ config.json
   |___ iframe
        |___ config.json
        |___ iframe.html

/tests/google.com/test.json

{
  "url": "https://google.com",
  "tasks": [{
    "prompt": "Go to LaVague AI",
    "expect": {
      "end_url": "https://www.lavague.ai/"
    }
  }]
}

/tests/iframe/test.json

{
  "start": "python -m http.server 8080"
  "url": "http://localhost:8080",
  "tasks": [  ]
}
adeprez commented 4 days ago

Top websites we can start testing on: