OpenAdaptAI / OpenAdapt

Open Source Generative Process Automation (i.e. Generative RPA). AI-First Process Automation with Large ([Language (LLMs) / Action (LAMs) / Multimodal (LMMs)] / Visual Language (VLMs)) Models
https://www.OpenAdapt.AI
MIT License
881 stars 115 forks source link

Multi-shot prompting #750

Open abrichr opened 3 months ago

abrichr commented 3 months ago

Feature request

We would like to implement multi shot prompting. This involves running openadapt.replay on multiple actions simultaneously.

This also involves selecting relevant recordings, using user specified natural language descriptions. These can be prompted along with model generated natural language descriptions of recordings (ie RAG).

Motivation

https://arxiv.org/abs/2406.03679