search

langchain-ai / langserve

LangServe 🦜️🏓
Other
1.93k stars 214 forks source link

LangServe playground crashes on browser due to out of memory #699

Open explocion opened 4 months ago

explocion commented 4 months ago

Description: I was trying to build a RAG application where the retrieved context is HUGE. When I run it from the langserve playground, my browser crashes due to out of memory. I suspect it was because saving the stream log in the frontend was using to much memory (64 chunks with 2000 characters per chunk).

Steps to Reproduce:

  1. Build a RAG application
  2. Retrieve with a large context

Attempted Solution: Reducing the number of chunks works, but I really need a huge number of chunks for my application.

juliushuck commented 3 months ago

Same problem here stream_logs seems to get a lot of events and then the browser tab crashes. I also retrieve with a huge retriever that is using a lot of llm calls and so on.