Vercel Timeout Error with Large Text Generation in Production

bracesproul / gen-ui

🧬 Generative UI web application built with LangChain.js, AI SDK & Next.js

197 stars 46 forks source link

Vercel Timeout Error with Large Text Generation in Production #13

Open rossanodr opened 2 months ago

rossanodr commented 2 months ago

I noticed that in production, this project may give a Vercel timeout error if the chat is generating a large text. This shouldn't happen since it's streaming, and it doesn't happen in other projects where I use Langchain. Is there any configuration in Langgraph or StreamRunnableUI to overcome this?

rossanodr commented 1 month ago

How is it possible to not crash the entire application when it runs some error like the timeout error?