search

wdm0006 / DummyRDD

A pure python mock of pyspark's RDD
http://wdm0006.github.io/DummyRDD/
BSD 3-Clause "New" or "Revised" License
27 stars 13 forks source link

DataFrames support #29

Open Irio opened 6 years ago

Irio commented 6 years ago

Do you know about anyone working on the support for Spark DataFrames? Are there any public plans on doing so?

I may be interested in collaborating with it.

wdm0006 commented 6 years ago

No one is that I know of, but I'd be happy to help out/support anyone who was interested in working on that.

Irio commented 6 years ago

Me and @jtemporal are working on it, using it in a real project as experimentation before deciding to open a pull request.

Hope to do so in the following weeks, after testing it better (in our project and with unit tests).