search

brave / brave-browser

Brave browser for Android, iOS, Linux, macOS, Windows.
https://brave.com
Mozilla Public License 2.0
17.84k stars 2.33k forks source link

Premium users should have a larger context limit #33880

Open mattmcalister opened 1 year ago

mattmcalister commented 1 year ago

consider increasing limit from 2k to 4k

petemill commented 1 year ago

The context limit is determined by the model. If a user is premium, then they can use a model with a higher limit, like Claude Instant

mattmcalister commented 1 year ago

Claude should be able to support articles like this (7k words), but i'm getting the This conversation is too long error

Image

petemill commented 1 year ago

If you're seeing that error then that means that the actual claude API is giving the error. We could truncate this article by lowering our page length character estimate. It must be set too high.