CoxAutomotiveDataSolutions / waimak

Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.

Apache License 2.0

75 stars 16 forks source link

Exposed uri used on the flow in the Spark context #56

Closed alexjbush closed 5 years ago

alexjbush commented 5 years ago

Description

Expose the actual URI used to create the FileSystem object in the Spark Flow Context.

Fixes #47

Type of change

[ ] Bug fix (non-breaking change which fixes an issue)
[X] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update

How Has This Been Tested?

Unit test

coveralls commented 5 years ago

Pull Request Test Coverage Report for Build 399

2 of 2 (100.0%) changed or added relevant lines in 1 file are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 78.551%

Totals
Change from base Build 384:	0.0%
Covered Lines:	1117
Relevant Lines:	1422

💛 - Coveralls