Token input limit - Githubissues

lifan0127 / ai-research-assistant

Aria is Your AI Research Assistant Powered by GPT Large Language Models

GNU Affero General Public License v3.0

1.06k stars 57 forks source link

Token input limit #129

Open phlsphr opened 2 months ago

phlsphr commented 2 months ago

Are the token input limits driven by OpenAI or are they hard-coded into the plugin? I am seeing a "0/4000" in the lower right hand corner of the ARIA window, which seems like a limit of 4000. When I input more tokens than the limit, are the rest cut off and not sent? Thanks!

lifan0127 commented 2 months ago

It's limited by the OpenAI model of your choice. The 0/4000 in the UI is merely a suggestion and has no effect.

phlsphr commented 2 months ago

Great plugin, by the way - thank you for creating it! The integration with Zotero is such a time-saver and I really like that I can craft my own prompts.