search

FINRAOS / MegaSparkDiff

A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations of possible data sources. Multiple execution modes in multiple environments enable the user to generate a diff report as a Java/Scala-friendly DataFrame or as a file for future use. Comes with out of the box SparkFactory and SparkCompare tools.
https://finraos.github.io/MegaSparkDiff/
Apache License 2.0
48 stars 26 forks source link

Bump spark.version from 2.3.1 to 2.4.4 #60

Closed dependabot[bot] closed 4 years ago

dependabot[bot] commented 4 years ago

Bumps spark.version from 2.3.1 to 2.4.4.

Updates spark-core_2.11 from 2.3.1 to 2.4.4

Updates spark-sql_2.11 from 2.3.1 to 2.4.4

Updates spark-hive_2.11 from 2.3.1 to 2.4.4

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot ignore this [patch|minor|major] version` will close this PR and stop Dependabot creating any more for this minor/major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) - `@dependabot use these labels` will set the current labels as the default for future PRs for this repo and language - `@dependabot use these reviewers` will set the current reviewers as the default for future PRs for this repo and language - `@dependabot use these assignees` will set the current assignees as the default for future PRs for this repo and language - `@dependabot use this milestone` will set the current milestone as the default for future PRs for this repo and language You can disable automated security fix PRs for this repo from the [Security Alerts page](https://github.com/FINRAOS/MegaSparkDiff/network/alerts).
blackduck-copilot[bot] commented 4 years ago

Black Duck Security Report

Branch master has no Black Duck results, and could not be compared to #60. Analyze branch master to get a change comparison.

Removed Components

High Risk: 8 Medium Risk: 5 Low Risk: 1 Clean: 173

Click here to see full report

matthewgillett commented 4 years ago

Spark version was bumped to 2.4.4 in pull request #57 to develop branch. This will go to the master branch when develop branch is ready.

dependabot[bot] commented 4 years ago

OK, I won't notify you again about this release, but will get in touch when a new version is available.

If you change your mind, just re-open this PR and I'll resolve any conflicts on it.