search

salesforce / storm-dynamic-spout

A framework for building spouts for Apache Storm and a Kafka based spout for dynamically skipping messages to be processed later.
BSD 3-Clause "New" or "Revised" License
40 stars 13 forks source link

Break DynamicSpout, KafkaConsumer, and SidelineSpout into separate modules #19

Open Crim opened 6 years ago

Crim commented 6 years ago

To provide clear separation of concerns between the DynamicSpout framework, the 'Sideline Spout' implementation, and the 'Kafka' consumer implementation, we should separate these out into maven modules.

stanlemon commented 6 years ago

@Crim I feel like the 0.9 milestone is a bit ambition, can we focus on production-readiness in 0.9 and concentrate more splitting in 0.10?

Crim commented 6 years ago

I think after #65 the only remaining blocker for this is SpoutConfig contains a reference to Kafka Consumer to set the default consumer class. That would need to be removed.