dglazkov / polymath

MIT License
133 stars 9 forks source link

Optimize the question query #51

Open jkomoros opened 1 year ago

jkomoros commented 1 year ago

We currently use Answer the question as truthfully as possible using the provided context, and if the answer is not contained within the text below, say \"I don't know.\" but almost certainly that can be optimized.

We should freeze a context for debugging purposes and try tweaking the query text to maximize quality.

Should we allow the caller of ask() to provide their own query? (Need to be careful of prompt extraction()