search

Shopify / camus

Kafka->HDFS pipeline from LInkedIn. It is a mapreduce job that does distributed data loads out of Kafka.
7 stars 4 forks source link

Remove spam logging. #102

Closed olessia closed 6 years ago

olessia commented 6 years ago

Remove outputing a log line for individual message that has evet_timestamp that's malformed or missing.

This will significantly reduce our map tasks' log size.