FRosner / drunken-data-quality

Spark package for checking data quality
Apache License 2.0
222 stars 69 forks source link

Tests fail with Spark 1.3.0 #90

Open FRosner opened 8 years ago

FRosner commented 8 years ago
[info] A NumberOfRowsConstraint
Checking [column: int]
It has a total number of 1 columns and 3 rows.
- The number of rows satisfies (count = 3).

[info] - should succeed if the actual number of rows is equal to the expected *** FAILED ***
[info]   Map(NumberOfRowsConstraint((count = 3)) -> NumberOfRowsConstraintResult(NumberOfRowsConstraint((count = 3)),3,de.frosner.ddq.constraints.ConstraintSuccess$@1e02dfb7)) was not equal to Map(NumberOfRowsConstraint((count = 3)) -> NumberOfRowsConstraintResult(NumberOfRowsConstraint((count = 3)),3,de.frosner.ddq.constraints.ConstraintSuccess$@1e02dfb7)) (NumberOfRowsConstraintTest.scala:18)
Checking [column: int]
It has a total number of 1 columns and 3 rows.
- The actual number of rows 3 does not satisfy ((count < 3) || (count > 3)).

[info] - should fail if the number of rows is not in the expected range *** FAILED ***
[info]   Map(NumberOfRowsConstraint(((count < 3) || (count > 3))) -> NumberOfRowsConstraintResult(NumberOfRowsConstraint(((count < 3) || (count > 3))),3,de.frosner.ddq.constraints.ConstraintFailure$@336d0940)) was not equal to Map(NumberOfRowsConstraint(((count < 3) || (count > 3))) -> NumberOfRowsConstraintResult(NumberOfRowsConstraint(((count < 3) || (count > 3))),3,de.frosner.ddq.constraints.ConstraintFailure$@336d0940)) (NumberOfRowsConstraintTest.scala:32)