microsoft / promptbase

All things prompt engineering
MIT License
5.44k stars 302 forks source link

MMLU pipeline with random fewshot examples #32

Closed riedgar-ms closed 10 months ago

riedgar-ms commented 10 months ago

AzureML pipeline which selects random fewshot examples for each question in the input dataset. Some naming conventions may be beginning to break down a bit.