search

getredash / redash

Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.
http://redash.io/
BSD 2-Clause "Simplified" License
26.36k stars 4.37k forks source link

Large query results causing Redis to lose connection #3669

Open danielfaulknor opened 5 years ago

danielfaulknor commented 5 years ago

Issue Summary

A very large number of results (960,000) causes Redis to give up during saving_results

Steps to Reproduce

  1. Run a query that generates 960,000 rows
  2. Watch it fail in the logs (https://gist.github.com/danielfaulknor/b6f6a99246cfcaa23e5020201d5c7fb8)

Why is this a bug in my view - This is constantly reproducible, and doesn't produce an error in the GUI, it just gets stuck on saving_results state. I have to run redis-cli flushall to clear the query.

The docker host has 12GB RAM and doesn't get past about 7.5GB in use.

Technical details:

zachliu commented 5 years ago

@danielfaulknor Have you tried to play with the CELERYD_MAX_TASKS_PER_CHILD(celery 3) or worker_max_memory_per_child(celery 4) parameter?