OpenAdaptAI / OpenAdapt

AI-First Process Automation with Large ([Language (LLMs) / Action (LAMs) / Multimodal (LMMs)] / Visual Language (VLMs)) Models
https://www.OpenAdapt.AI
MIT License
739 stars 98 forks source link

Recreate calculator demo with `VanillaReplayStrategy` + segment_descriptions #747

Open abrichr opened 2 weeks ago

abrichr commented 2 weeks ago

Feature request

We would like to build on VanillaReplayStrategy to prompt with segment_descriptions like in VisualReplayStrategy.

Motivation

Replay accuracy