Add ShopifyHourlyPartitioner to drop using an hourly folder structure

Shopify / camus

Kafka->HDFS pipeline from LInkedIn. It is a mapreduce job that does distributed data loads out of Kafka.

7 stars 4 forks source link

Add ShopifyHourlyPartitioner to drop using an hourly folder structure #45

Closed drdee closed 9 years ago

drdee commented 9 years ago

This is a scrappy solution and basically a 99% copy of ShopifyPartitioner with the exception that it appends an hourly component. I've tested this and it works well.

@yagnik

yagnik commented 9 years ago

:ship: