Getting 500 with Gemini-pro with longer request body

tmc / langchaingo

LangChain for Go, the easiest way to write LLM-based programs in Go

https://tmc.github.io/langchaingo/

MIT License

3.76k stars 523 forks source link

Getting 500 with Gemini-pro with longer request body #803

Open arkadyb opened 2 months ago

arkadyb commented 2 months ago

Hi, i am trying to ask the model to summarize a random the document, however the response comes back with 500 from google api. With the context window limit of 1million token, is there any limitation on an individual request or the part length?

The request body is attached. gemini-request-body.json

Thanks,

eliben commented 1 month ago

Thanks for your report. There are several layers of software involved here; are you able to reproduce this issue when using the Google AI Go SDK directly? And if yes, are you able to reproduce it by using curl?