CoxAutomotiveDataSolutions / waimak

Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
Apache License 2.0
75 stars 16 forks source link

Feature/hadoop db connectors for complex types #83

Closed vavison closed 5 years ago

vavison commented 5 years ago

Description

HiveDBConnector now works for complex types (e.g MapType, StructType)

Type of change

Please delete options that are not relevant.

How Has This Been Tested?

Additional test for complex types

codecov-io commented 5 years ago

Codecov Report

Merging #83 into develop will not change coverage. The diff coverage is 100%.

Impacted file tree graph

@@           Coverage Diff            @@
##           develop      #83   +/-   ##
========================================
  Coverage    82.12%   82.12%           
========================================
  Files           56       56           
  Lines         1600     1600           
  Branches        63       63           
========================================
  Hits          1314     1314           
  Misses         286      286
Impacted Files Coverage Δ
...coxautodata/waimak/metastore/HiveDBConnector.scala 100% <ø> (ø) :arrow_up:
...n/scala/com/coxautodata/waimak/spark/app/Env.scala 90.9% <100%> (ø) :arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update fc0f297...7dbd58e. Read the comment docs.