search

pranab / chombo

Big Data ETL and Utilities for Hadoop Map Reduce, Spark and Storm
http://pkghosh.wordpress.com/
105 stars 73 forks source link

DataTransformer.scala does not work for "Generators" attributes #7

Open abhisheksreesaila opened 5 years ago

abhisheksreesaila commented 5 years ago

In DataTransformer.scala

getTranformedAttributes method

  1. It imports " transformer attributes" for creating transformers - works well
  2. it imports "transformer attributes" for creating generators - but runs generator code number of transformer attributes times and overwrites the entire line.

Fix : Have a separate "generatedAttributes" in the "Main Java" class. That how I fixed. Jut raising here to see if there is a better way or anyone is facing similar issue