FINRAOS / MegaSparkDiff

A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations of possible data sources. Multiple execution modes in multiple environments enable the user to generate a diff report as a Java/Scala-friendly DataFrame or as a file for future use. Comes with out of the box SparkFactory and SparkCompare tools.
https://finraos.github.io/MegaSparkDiff/
Apache License 2.0
49 stars 26 forks source link

Implemented the exclude column and order by feature in the DiffResult #53

Closed Yuming-Wei closed 5 years ago

Yuming-Wei commented 5 years ago

Implemented the exclude column and order by feature in the DiffResult Add a test for the new function in DiffResult.

BlackDuckCoPilot commented 5 years ago

Black Duck Security Report

Merging #53 into develop will not change security risk.

Added Components

Clean: 2

Click here to see full report


3 component(s) did not change but have updated security data. This may affect your calculated score.

aosama commented 5 years ago

I looked at the files change and I'm comfortable with the changes, perhaps @mmlinford and @matthewgillett can take a quick look too.