A Ruby interface for the Amazon Kinesis Client Library. Allows developers to easily create robust application to process Amazon Kinesis streams in Ruby.
Apache License 2.0
146
stars
55
forks
source link
Release 2.0.0 of the Amazon Kinesis Client for Ruby #35
Added support for Enhanced Fan-Out: https://aws.amazon.com/blogs/aws/kds-enhanced-fanout/.
Enhanced Fan-Out provides dedicated throughput per stream consumer, and uses an HTTP/2 push API (SubscribeToShard) to deliver records with lower latency.
Updated the Amazon Kinesis Client Library for Java to version 2.1.2.
Version 2.1.2 uses 4 additional Kinesis API's
WARNING: These additional API's may require updating any explicit IAM policies
The shutdown method from version 1 has been replaced by lease_lost and shard_ended.
Added the lease_lost method which is invoked when a lease is lost.
lease_lost replaces shutdown(checkpointer, 'ZOMBIE').
Added the shard_ended method which is invoked when all records from a split or merge have been processed.
shard_ended replaces shutdown(checkpointer, 'TERMINATE').
Added an optional method, shutdown_requested, which provides the record processor a last chance to checkpoint during the Amazon Kinesis Client Library shutdown process before the lease is canceled.
To control how long the Amazon Kinesis Client Library waits for the record processors to complete shutdown, add timeoutInSeconds=<seconds to wait> to your properties file.
Updated the AWS Java SDK version to 2.4.0
MultiLangDaemon now provides logging using Logback.
MultiLangDaemon supports custom configurations for logging via a Logback XML configuration file.
RegisterStreamConsumer
: https://docs.aws.amazon.com/kinesis/latest/APIReference/API_RegisterStreamConsumer.htmlSubscribeToShard
: https://docs.aws.amazon.com/kinesis/latest/APIReference/API_SubscribeToShard.htmlDescribeStreamConsumer
: https://docs.aws.amazon.com/kinesis/latest/APIReference/API_DescribeStreamConsumer.htmlDescribeStreamSummary
: https://docs.aws.amazon.com/kinesis/latest/APIReference/API_DescribeStreamSummary.htmlRecordProcessorBase
: https://github.com/awslabs/amazon-kinesis-client-ruby/blob/d5c2bbafb232b5e1ab947980a0bd8505c87978f9/lib/aws/kclrb/record_processor.rb#L102 which supports the newShardRecordProcessor
interfaceshutdown
method from version 1 has been replaced bylease_lost
andshard_ended
.lease_lost
method which is invoked when a lease is lost.lease_lost
replacesshutdown(checkpointer, 'ZOMBIE')
.shard_ended
method which is invoked when all records from a split or merge have been processed.shard_ended
replacesshutdown(checkpointer, 'TERMINATE')
.shutdown_requested
, which provides the record processor a last chance to checkpoint during the Amazon Kinesis Client Library shutdown process before the lease is canceled.timeoutInSeconds=<seconds to wait>
to your properties file.log_configuration=<log configuration file>
to the Rake command line.Issue #, if available:
Description of changes:
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.