Token limits per message?

load1n9 / openai

Unofficial Deno wrapper for the Open Ai api

MIT License

73 stars 23 forks source link

Token limits per message? #26

Closed bdodroid closed 1 year ago

bdodroid commented 1 year ago

Just a question on token limits:

If I use, for example, the 8k token model, can I send a list of messages, each with content equal to 8k tokens, or would the entirety of my messages array have to be under 8k?

lino-levan commented 1 year ago

OpenAI automatically strips all tokens outside of the 8k limit. You do not need to do this manually yourself.