search

vaexio / vaex

Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀
https://vaex.io
MIT License
8.23k stars 590 forks source link

[FEATURE-REQUEST] Best compatible tools for MLOPS? #1555

Closed enthusiastics closed 2 years ago

enthusiastics commented 2 years ago

Hi,

I just found Vaex and I think this is an extremely valuable technology, especially for my use case where we require very fast and scalable computation. I actually want to put Vaex into production. But I would like to ask what is the most compatible streaming data tools and database to use (basically, I would need to stream data, apply realtime transformation, output real time prediction, and also store results into database for future reference (or future restarts.))? I really want to apply Vaex to tick data where there is massive volume and per second and high speed analysis is needed.

JovanVeljanoski commented 2 years ago

Closing as duplicate of #1554. This is not a bug-report or a feature request, but a question so it belongs in the discussions where it was first opened.