Add real-time processing as an option to our consumer.

snowplow-archive / kinesis-example-scala-consumer

Example Scala/SBT event consumer for Amazon Kinesis

http://snowplowanalytics.com

22 stars 14 forks source link

Add real-time processing as an option to our consumer. #5

Closed alexanderdean closed 10 years ago

alexanderdean commented 10 years ago

As per @bamos' explanation in #1:

Scalazon and this example uses TRIM_HORIZON, which starts the iterator at the beginning of the stream, but using LATEST also seems helpful, especially since we're interested in real-time processing. The documentation reads like a real-time consumer application should continuously poll for new data, but I haven't tried anything myself.

bamos commented 10 years ago

Hi @alexanderdean, I've merged everything into the feature/bamos-updates branch and everything's working smoothly for these issues. Please open (or reopen) if you want me to change anything on the Kinesis consumer.