search

vaexio / vaex

Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀
https://vaex.io
MIT License
8.23k stars 590 forks source link

[FEATURE-REQUEST] The join "how" doesn't support "cross" option #2234

Closed hewittzgh closed 1 year ago

hewittzgh commented 1 year ago

Hi sir, I use the vaex recently. Vaex is a awesome package. But I find that the vaex doesn't support the "cross" option of the join API. I want to cross-join two dataframes like pandas. Can you help me? I really need the feature to build my cryptography system.

hewittzgh commented 1 year ago

@maartenbreddels @JovanVeljanoski

JovanVeljanoski commented 1 year ago

Hi,

There is indeed no support for a cross join currently. I think it would be great if we could support it. However it is a rather big undertaking (especially to make it memory efficient and performant), and if we take up that task it would block any other development and support for a rather long time.

We would be happy to take this on if some one is willing to fund or otherwise support this work. Otherwise we want to spend time developing features that we think will impact more people and we put as a higher priority.