cloudera-labs / envelope

Build configuration-driven ETL pipelines on Apache Spark
Apache License 2.0
157 stars 89 forks source link

Need an update to the example files #20

Closed ShawnHouCHN closed 6 years ago

ShawnHouCHN commented 7 years ago

Hi Author It is wonderful that the new version 4 is compatible with spark 2 and kafka 0.10 I once downloaded the package and tried out the examples you include, seems the foutput (https://github.com/cloudera-labs/envelope/blob/master/src/main/java/com/cloudera/labs/envelope/output/FileSystemOutput.java) only support parquet and csv rather than, as the example conf shown, avro. Might need a review on this part. Thx

jeremybeard commented 6 years ago

This is now fixed.