Run indefinintely, unless the -exitafter flag is specified.
Sync multiple Kafka topics. Topics and their target pools are read
from the inputs section of ETL YAMl files specified on the command
line. (One topic/pool pair may also be specified via -topic and
-pool.)
Limit the interval between receiving and committing a record with
the -interval flag.
Limit the number of records per commit with the -thresh flag.
The test in ztests/from-kafka.yaml doesn't run in CI (it requires Kafka and I don't want to do the work here to add Kafka to CI) but it does pass locally for me.
Run indefinintely, unless the -exitafter flag is specified.
Sync multiple Kafka topics. Topics and their target pools are read from the inputs section of ETL YAMl files specified on the command line. (One topic/pool pair may also be specified via -topic and -pool.)
Limit the interval between receiving and committing a record with the -interval flag.
Limit the number of records per commit with the -thresh flag.
The test in ztests/from-kafka.yaml doesn't run in CI (it requires Kafka and I don't want to do the work here to add Kafka to CI) but it does pass locally for me.
For #83. Closes #92.