Added skipif marker to few tests containing df.transform() as this method was only introduced in Spark 3.0, fixes test failure for pyspark < 3.0. Fixes #216.
Types of changes
What types of changes does your code introduce to quinn?
Put an x in the boxes that apply
[x] Bugfix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] Documentation Update (if none of the other choices apply)
Further comments
Minor, non-breaking change introduced with a pytest skipif marker so that nothing breaks on the tests even after we decommission support for PySpark < 3.0.
Proposed changes
Added skipif marker to few tests containing df.transform() as this method was only introduced in Spark 3.0, fixes test failure for pyspark < 3.0. Fixes #216.
Types of changes
What types of changes does your code introduce to quinn? Put an
x
in the boxes that applyFurther comments
Minor, non-breaking change introduced with a pytest skipif marker so that nothing breaks on the tests even after we decommission support for PySpark < 3.0.