python-streamz / streamz

Real-time stream processing for python
https://streamz.readthedocs.io/en/latest/
BSD 3-Clause "New" or "Revised" License
1.24k stars 149 forks source link

Add River nodes and examples #434

Closed martindurant closed 2 years ago

martindurant commented 2 years ago

Fixes #432 (eventually)

@philippjfr - the notebook version of this works ok, but is limited by the jupyter comm to about 20Hz. Running the script version fails quickly with:

RuntimeError: _pending_writes should be non-None when we have a document lock, and we should have the lock when the document changes

It would be cool to figure a viz pipeline that only updates every so often, perhaps with datashading.

NB: but the cluster centres are not actually reasonable. When the pipeline and viz works OK, I'd like to get in touch with someone at River to explain the correct way to prime the model.

martindurant commented 2 years ago

https://user-images.githubusercontent.com/6042212/136070852-8128d479-d696-4a12-b93d-6c93791fbd96.mp4