search

FINRAOS / MegaSparkDiff

A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations of possible data sources. Multiple execution modes in multiple environments enable the user to generate a diff report as a Java/Scala-friendly DataFrame or as a file for future use. Comes with out of the box SparkFactory and SparkCompare tools.
https://finraos.github.io/MegaSparkDiff/
Apache License 2.0
48 stars 26 forks source link

Added sample transformation test code. #16

Closed matthewgillett closed 6 years ago

matthewgillett commented 6 years ago

This commit contains the following sample tests: 1) Database to database transformation test. 2) File to database transformation test.

Code contains updates from @aosama. Thank you @aosama for your review of the code.

BlackDuckCoPilot commented 6 years ago

Black Duck Security Report

Merging #16 into master will not change security risk.

Click here to see full report

matthewgillett commented 6 years ago

@aosama Sample code moved to separate module. Please review.