vaexio / vaex

Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀
https://vaex.io
MIT License
8.22k stars 590 forks source link

Fix: list aggregator when doing N-d groupby (dense) #2273

Open JovanVeljanoski opened 1 year ago

JovanVeljanoski commented 1 year ago

Discovered by and partially addresses https://github.com/vaexio/vaex/issues/2272

maartenbreddels commented 1 year ago

ok, maybe we should always assume sparse when having arrow like aggregators, that would be 1 solution. The other is that I find a way to flatten the arrays before... which is hard :)