irthomasthomas / llm

Access large language models from the command-line
https://llm.datasette.io
Apache License 2.0
0 stars 0 forks source link

Experiments Plugin #5

Open irthomasthomas opened 1 year ago

irthomasthomas commented 1 year ago

I would like some way to record simple experiments.

A python CLI tool. Then a plugin for llm.

irthomasthomas commented 1 year ago

For a given input, create multiple requests varying the parameters and rank the responses