Update Spark/Scala Version, Feature enhancement

mrpowers-io / spark-fast-tests

Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit)

https://mrpowers-io.github.io/spark-fast-tests/

MIT License

429 stars 77 forks source link

Update Spark/Scala Version, Feature enhancement #122

Closed zeotuan closed 1 month ago

zeotuan commented 4 months ago

Support Spark 3.3 and 3.4
Support tolerance for big decimal
Support tolerance for nested row
row compare performance improvement
add benchmarking

SemyonSinchenko commented 1 month ago

@zeotuan Hello! Sorry for the long answer and thank you for the contribution. Any chance you can finish it / mark as "ready for review"?

zeotuan commented 1 month ago

@SemyonSinchenko No worries! Let me refine the branch before marking it as ready

alfonsorr commented 1 month ago

The contribution is great but I see too many things in one single pr. Could it be split to see better the focus of each new one of the functionalities?

zeotuan commented 1 month ago

The contribution is great but I see too many things in one single pr. Could it be split to see better the focus of each new one of the functionalities?

Sure. I'll break it down into multiple PR