search

confluentinc / camus

Mirror of Linkedin's Camus
Apache License 2.0
0 stars 62 forks source link

CamusSweeper documentation #22

Closed matthayes closed 8 years ago

matthayes commented 9 years ago

Is there any documentation on CamusSweeper and recommendations on how to run it? The Camus docs at http://docs.confluent.io/1.0.1/camus/docs/index.html don't mention anything about the sweeper as far as I can see. Can CamusSweeper be used?

ewencp commented 8 years ago

Note that Camus is now deprecated in favor of the Kafka Connect HDFS connector.

You can use CamusSweeper to aggregate from hourly to daily files. But this job needs to be triggered manually -- see the camus-run script fora sort of template for how to submit a Camus class as a job.