plotly / dash

Data Apps & Dashboards for Python. No JavaScript Required.
https://plotly.com/dash
MIT License
21.56k stars 2.08k forks source link

polars seems incompatible with long callbacks #2609

Open liammcknight95 opened 1 year ago

liammcknight95 commented 1 year ago

Describe your context dash app with python 3.11.4 deployed on AWS EC2 instance

dash[diskcache]  2.11.1
polars 0.18.11

Describe the bug

When running long callbacks in dash with polars, they run infinitely & don't get collected - I imagine it's something to do with polars parallelism & multithreading? don't run into these issues with pandas

Expected behavior

Callback to run

acrixl commented 1 year ago

check celery & redis as background_callback_manager

liammcknight95 commented 1 year ago

hey, seems to work fine for celery - guess diskcache is the issue

liammcknight95 commented 1 year ago

my testing wasn't very thorough it would seem.

on further investigation - the initial callbacks collect correctly, unlike with diskcache. however when running with celery & redis, the callback doesn't get updated after the first call to it