dimays / chunkgpt

A lightweight library for summarizing text that surpasses the token limit of specific OpenAI GPT-based models.
MIT License
5 stars 3 forks source link

Add gpt-4-128k support #12

Open kylemclaren opened 11 months ago

kylemclaren commented 11 months ago

Per OAI's announcement, GPT-4 128k is here. This adds token support, else you'll hit token_limit errors when trying to use the model.