search

alan-turing-institute / prompto

An open source library for asynchronous querying of LLM endpoints
https://alan-turing-institute.github.io/prompto/
MIT License
18 stars 1 forks source link

Prompt expansion feature #92

Open rchan26 opened 1 month ago

rchan26 commented 1 month ago

Add functionality to obtain variants of prompts in order to better explore the input space.

Can potentially be linked to #82 for "chaining" prompto runs but for this idea rather than creating a new experiment after an initial run, we are maybe doing an initial "expansion" run to obtain a larger number of prompts to send.

fedenanni commented 1 month ago

Starting point, reading this recent NAACL student workshop paper: https://aclanthology.org/2024.naacl-srw.2.pdf

fedenanni commented 1 month ago

Also: https://arxiv.org/pdf/2402.07927