microsoft / graphrag

A modular graph-based Retrieval-Augmented Generation (RAG) system
https://microsoft.github.io/graphrag/
MIT License
17.75k stars 1.7k forks source link

Prompt Gym #151

Open darthtrevino opened 5 months ago

darthtrevino commented 5 months ago

It could be useful to create a "prompt gym" where prompts + models + parameters can be tuned and compared against our best-performing runs. We'll need some good labeled data and the ability to measure LLM output quality.

chiragshah285 commented 3 months ago

DSPy could be interesting for that