Chrome extension driver

[dhuynh95]

We are doing an MVP of Chrome extension where end users can consume web agents defined by devs.

The interface should

from lavague.core import  WorldModel, ActionEngine
from lavague.core.agents import WebAgent
from lavague.core.server import AgentServer
from lavague.core.extractors import JsonFromMarkdownExtractor
from lavague.drivers.selenium.base import SeleniumDriver
from lavague.drivers.remote import RemoteDriver

driver = DriverServer()
world_model = WorldModel()
action_engine = ActionEngine(driver, extractor=JsonFromMarkdownExtractor())
agent = WebAgent(world_model, action_engine)
server = AgentServer(agent)
server.serve()

In that scenario, the workflow is:

• The dev launches a server
• The client with Chrome Extension connects to it
• The client provides an objective and run it
• The Chrome is piloted by the Agent Server

To do:

• [ ] Interface Chrome
• [ ] Publish on Marketplace
• [ ] Extensive testing on our different use cases
• [ ] Integrate the server class

[adeprez]

The agent server uses a builder to manage multiple simultaneous connections, and thus multiple agents

from lavague.core import WorldModel, ActionEngine
from lavague.core.agents import WebAgent
from lavague.drivers.driverserver import DriverServer
from lavague.server import AgentServer, AgentSession

def create_agent(session: AgentSession):
    world_model = WorldModel()
    driver = DriverServer(session)
    action_engine = ActionEngine(driver)
    return WebAgent(world_model, action_engine)

server = AgentServer(create_agent)
server.serve()