search

univalence / spark-tools

https://univalence.github.io/spark-tools/
Apache License 2.0
44 stars 8 forks source link

[spark-test] bug ! those two dataset should be equal. #19

Closed ahoy-jon closed 5 years ago

ahoy-jon commented 5 years ago

in https://github.com/univalence/spark-tools/blob/52814a283ec346b2093af2ae9a4476c0125cde9d/spark-test/src/test/scala/io/univalence/sparktest/bug/DataFrameEqualityBugSparkTraining.scala

two datasets that are the same, should be equal!

HarrisonCheng commented 5 years ago

Fixed in https://github.com/univalence/spark-tools/commit/9ca72af77831d636a3306e31bc9ee8489d853695 and https://github.com/univalence/spark-tools/commit/6bb24921404d5723ce6f357842b7a60716dd54ea