search

jpallen / biggles

Biggles is a VS Code extension providing a coding assistant you can talk to
https://marketplace.visualstudio.com/items?itemName=Biggles.biggles
MIT License
3 stars 0 forks source link

Only send max number of before/after tokens #9

Open jpallen opened 11 months ago

jpallen commented 11 months ago

(and make configurable)

JC53489 commented 11 months ago

The model has configurable context now in #11 but each model has different context lengths.

Do we want to fill the context every time we send or be more cost effective/selective?

jpallen commented 11 months ago

I was thinking just limiting to something like 1000 tokens before and after, but make this user-configurable (including infinite), so there is some user control over cost vs effectiveness