FINRAOS / MegaSparkDiff

A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations of possible data sources. Multiple execution modes in multiple environments enable the user to generate a diff report as a Java/Scala-friendly DataFrame or as a file for future use. Comes with out of the box SparkFactory and SparkCompare tools.
https://finraos.github.io/MegaSparkDiff/
Apache License 2.0
49 stars 26 forks source link

Adding method to DiffResults to return amount of discrepancies found per column for a table with key columns #54

Closed Cofagrigus closed 5 years ago

Cofagrigus commented 5 years ago

Additionally of note: moving a method from SparkCompare to DiffResults

BlackDuckCoPilot commented 5 years ago

Black Duck Security Report

Merging #54 into develop will not change security risk.

Click here to see full report


3 component(s) did not change but have updated security data. This may affect your calculated score.