Remove all references to rdd in this project

MrPowers / quinn

pyspark methods to enhance developer productivity 📣 👯 🎉

https://mrpowers.github.io/quinn/

Apache License 2.0

597 stars 93 forks source link

Closed MrPowers closed 4 months ago

MrPowers commented 5 months ago

rdd doesn't work with Spark Connect.

We want this entire project to work well for both Spark Connect and "legacy Spark".

Let's just remove all the rdd references.

jeffbrennan commented 5 months ago

looks like #188 addresses all usages of rdd in the repo (besides the column_to_list benchmarking doc) - we can close