target / data-validator

A tool to validate data, built around Apache Spark.
Other
101 stars 34 forks source link

Adds docs on creating Ivy settings for repo resolution #119

Closed colindean closed 2 years ago

colindean commented 2 years ago

GitHub Packages currently— and for the foreseeable future— requires credentials to access even public GitHub Packages repositories. Specifying this to spark-submit isn't straightforward. It requires creating and passing an ivysettings XML file. This patch documents that process.

This also bumps all of the DV versions up to 0.14.1, latest as of this patch.

colindean commented 2 years ago

The POM declares the deps and it seems to resolve correctly all of the time for me.