dglazkov / polymath

MIT License
132 stars 9 forks source link

Allow configuring a shorter context to allow a shorter completion. #49

Open jkomoros opened 1 year ago

jkomoros commented 1 year ago

The completion API sets a limit on the length of (input + output). The longer the context, the shorter the completion must be.

There's a balance between passing a lot of context to summarize and getting a long result.

It should be possible to configure that split in ask.

Originally noticed while thinking about #14

jkomoros commented 1 year ago
dalmaer commented 1 year ago

Consider tiktoken to measure token length.