BlazingDB / blazingsql

BlazingSQL is a lightweight, GPU accelerated, SQL engine for Python. Built on RAPIDS cuDF.
https://blazingsql.com
Apache License 2.0
1.93k stars 183 forks source link

Streamz - Live data plotting #656

Open jsang-scala opened 4 years ago

jsang-scala commented 4 years ago

I noticed BlazingSQL does not have a feature to plot live data (like streamz from holoviews). It would be great to add this feature, mainly for large data sets generated from simulations.

kingmesal commented 4 years ago

Providing SQL over the custreamz api would be very valuable. This is a top use case for comparing to technologies like KSQL (Kafka SQL).

felipeblazing commented 4 years ago

Something we want to be able to do but at the moment we have no plans to implement this for the next release. That being said we add things all the time. Can you give some more information, @jsang-scala about the kinds of workloads you would want to setup?

satishvarmadandu commented 4 years ago

@felipeblazing .. most of the workloads includes ( but not limited) (a) groupBy, joins and computing aggregations , (b) filtering with regex queries. AnsiSql support would be great

jsang-scala commented 4 years ago

@felipeblazing A package similar to streamz to manage continuous streams of data when working with Pandas Dataframes or cuDF Dataframes that is compatible with a dashboard and jupyter lab. Thanks for the help!