ContextLab / hypertools

A Python toolbox for gaining geometric insights into high-dimensional data
http://hypertools.readthedocs.io/en/latest/
MIT License
1.81k stars 161 forks source link

support streaming data #101

Open andrewheusser opened 7 years ago

andrewheusser commented 7 years ago

e.g.

hyp.plot(streaming_data, streaming=True)

or could be inferred from the structure of streaming_data

jeremymanning commented 7 years ago

Ideally data streams would be just another type of supported data types, in addition to pandas dataframes and numpy arrays.

So we'd use some initial samples to compute the dimensionality reduction transform, and then all future samples would be added to the plot dynamically using that transform.

jeremymanning commented 7 years ago

(so I'd vote for no streaming flag)

jeremymanning commented 6 years ago

Potentially useful library (thanks for the twitter tip, @andrewheusser!): http://streamz.readthedocs.io/en/latest/

A tutorial-style description may be found here: https://matthewrocklin.com/blog//work/2017/10/16/streaming-dataframes-1

jeremymanning commented 6 years ago

This might be useful for adding support for streaming data: https://ipywidgets.readthedocs.io/en/latest/