FINRAOS / MegaSparkDiff

A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations of possible data sources. Multiple execution modes in multiple environments enable the user to generate a diff report as a Java/Scala-friendly DataFrame or as a file for future use. Comes with out of the box SparkFactory and SparkCompare tools.
https://finraos.github.io/MegaSparkDiff/
Apache License 2.0
49 stars 26 forks source link

Allow specifying delimiter in JDBC connection #30

Closed nrthyrk closed 6 years ago

nrthyrk commented 6 years ago

Sometimes when comparing JDBC dataset with plain text files, other delimiters than commas are used in those text files.

This PR allows specifying a different delimiter for JDBC connection so that such use cases can be covered.

BlackDuckCoPilot commented 6 years ago

Black Duck Security Report

Merging #30 into develop will not change security risk.

Added Components

Clean: 1

Removed Components

Clean: 1

Click here to see full report