search

gerritjvv / bigstreams

bigstreams big data kafka hadoop and file based imports
Eclipse Public License 1.0
3 stars 3 forks source link

Kafka Collector #68

Closed GoogleCodeExporter closed 8 years ago

GoogleCodeExporter commented 8 years ago 
Write a kafka collector that reads from a kafka, based on TopicConfig(s).
The data written is sent to a LogFileWriter usint the streams-log project.

This project should run as a rpm and is meant to consume from kafka for files 
that will end up in hdfs or other batch storage and that need files to be 
partitioned by date-hour, and topic.

Original issue reported on code.google.com by gerritjvv@gmail.com on 8 Jan 2013 at 11:49

GoogleCodeExporter commented 8 years ago

Original comment by gerritjvv@gmail.com on 27 Mar 2013 at 12:52