cloudera-labs / envelope

Build configuration-driven ETL pipelines on Apache Spark
Apache License 2.0
158 stars 89 forks source link

Support DECIMAL data type across all modules #9

Open jeremybeard opened 8 years ago

umesh9794 commented 8 years ago

@jeremybeard : do you mean in KuduStorageTable and DelimitedTranslator ? "java.math.BigDecimal" ?

jeremybeard commented 8 years ago

@umesh9794 The whole way through the pipeline, including translators, storage tables, how it is represented in a GenericRecord (the in-memory record format of Envelope), and with Spark SQL. To resolve this issue Kudu would need to support DECIMAL first.

umesh9794 commented 8 years ago

Sure, @jeremybeard , got it, Thanks!