panel-extensions / panel-graphic-walker

A project providing a Graphic Walker Pane for use with HoloViz Panel.
https://github.com/panel-extensions/panel-graphic-walker
MIT License
32 stars 3 forks source link

Add Dask kernel_computation support #39

Open MarcSkovMadsen opened 2 weeks ago

MarcSkovMadsen commented 2 weeks ago

Builds on #38. So review that one first.

MarcSkovMadsen commented 2 weeks ago

Currently it does not work. By studying pygwalker I can see their dataframe support comes registrating the dataframe in duckdb. For example for modin they first convert to pandas and the register :-). I don't think that is what we want to do with dask. We want to use its compute engine.

My hypothesis is that dask should be supported via dask-sql and a custom parser. Might require a little bit more work.

As dask is not what I need for my use cases, I will park it here for now. Hoping that others will take it up if they need it.