search

knuddelsgmbh / jtokkit

JTokkit is a Java tokenizer library designed for use with OpenAI models.
https://jtokkit.knuddels.de/
MIT License
516 stars 38 forks source link

increase gpt-3.5-turbo maxContextLength to 16k #92

Open dafriz opened 3 months ago

dafriz commented 3 months ago

OpenAI has increased context window of gpt-3.5-turbo model to 16k matching gpt-3.5-turbo-16k model

See https://platform.openai.com/docs/models/gpt-3-5-turbo