MrPowers / quinn

pyspark methods to enhance developer productivity 📣 👯 🎉
https://mrpowers.github.io/quinn/
Apache License 2.0
597 stars 93 forks source link

Fix: Failure in tests/extensions/test_dataframe_ext.py for Spark 2.4 #217

Closed kunaljubce closed 4 months ago

kunaljubce commented 4 months ago

Proposed changes

Added skipif marker to few tests containing df.transform() as this method was only introduced in Spark 3.0, fixes test failure for pyspark < 3.0. Fixes #216.

Types of changes

What types of changes does your code introduce to quinn? Put an x in the boxes that apply

Further comments

Minor, non-breaking change introduced with a pytest skipif marker so that nothing breaks on the tests even after we decommission support for PySpark < 3.0.