Stuff more context into prompt by summarizing context

[jkomoros]

There's a limited window to stuff context into.

One idea is to fetch a lot of context, and then 'compress' it with a query like:

Distill the following  into a summary of 8 sentences emphasizing the distinctive ideas.

Context:
{CONTEXT}

Summary:

You could then fetch a larger context, compress it down, and then smoosh in more context.