search

logancyang / obsidian-copilot

THE Copilot in Obsidian
https://www.obsidiancopilot.com/
GNU Affero General Public License v3.0
3.05k stars 213 forks source link

The global token limit may result in the set value exceeding the token limit of certain models, making it unavailable. #832

Open spenseri opened 2 days ago

spenseri commented 2 days ago

The global token limit may result in the set value exceeding the token limit of certain models, making it unavailable.

One solution is: set a separate token limit for each model.

logancyang commented 1 day ago

Context length could be added to the CustomModel interface. A lot of other things as well, e.g. price. They can be optional fields at "add model" time.