Summarizer picking stronger models if needed [feature idea]

paul-gauthier / aider

aider is AI pair programming in your terminal

https://aider.chat/

Apache License 2.0

17.95k stars 1.68k forks source link

Closed gwpl closed 7 months ago

gwpl commented 10 months ago

"Summarizer suddenly failed for gpt-3.5-turbo"

I am using gpt-4-preview model (and this time was loaded with a lot of context... and it can take up to 128k)

What I was thinking, was:

maybe summarizer can be intelligent and :
- if context is bigger use gpt-3.5-turbo-16k
- otherwise if it's still too big, use gpt-4-preview (which is "gpt-4 turbo")

Sorry for not being more helpful, but I pressed "enter" and message disappeared so I tried to reconstruct from memory.

paul-gauthier commented 7 months ago

The summarizer now uses the 3.5 model with 16k.