CoxAutomotiveDataSolutions / waimak

Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
Apache License 2.0
75 stars 16 forks source link

Feature/issue 74 execute action #79

Closed alexjbush closed 5 years ago

alexjbush commented 5 years ago

Description

This adds withExecutor and execute functions onto DataFlows allowing DataFlows to be executed inline without needing to create an Executor explicitly and call execute.

Fixes #74

Type of change

Please delete options that are not relevant.

How Has This Been Tested?

Unit tests

codecov-io commented 5 years ago

Codecov Report

Merging #79 into develop will increase coverage by 0.03%. The diff coverage is 100%.

Impacted file tree graph

@@             Coverage Diff             @@
##           develop      #79      +/-   ##
===========================================
+ Coverage    81.95%   81.98%   +0.03%     
===========================================
  Files           56       56              
  Lines         1585     1588       +3     
  Branches        66       67       +1     
===========================================
+ Hits          1299     1302       +3     
  Misses         286      286
Impacted Files Coverage Δ
...autodata/waimak/dataflow/spark/SparkDataFlow.scala 87.32% <100%> (+0.36%) :arrow_up:
...ala/com/coxautodata/waimak/dataflow/DataFlow.scala 95.62% <100%> (+0.03%) :arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update 3e80947...2cf7bdf. Read the comment docs.