openai.error maximum context length is 4097 token

talkingwallace / ChatGPT-Paper-Reader

This repo offers a simple interface that helps you to read&summerize research papers in pdf format. You can ask some questions after reading. This interface is developed based on openai API and using GPT-3.5-turbo model.

739 stars 110 forks source link

openai.error maximum context length is 4097 token #4

Open VeeDou opened 1 year ago

VeeDou commented 1 year ago

openai.error.InvalidRequestError: This model's maximum context length is 4097 tokens. However, your messages resulted in 4425 tokens. Please reduce the length of the messages.

talkingwallace commented 1 year ago

Hi, currently this repo does not support long articles due to the 4096 token limits of GPT-3.5-turbo

austinmw commented 1 year ago

Can you add chunking by section?

Chapoly1305 commented 1 year ago

Ref https://github.com/talkingwallace/ChatGPT-Paper-Reader/issues/21