awslabs / amazon-kinesis-connector-flink

This is a fork of the Apache Flink Kinesis connector adding Enhanced Fanout support for Flink 1.8/1.11 on KDA.
Apache License 2.0
21 stars 11 forks source link

FLINK-24431 Copy Flink connector changes to master #48

Closed rudikershaw closed 3 years ago

rudikershaw commented 3 years ago

Issue #: FLINK-24431

Description of changes: The EFO Kinesis connector will register and de-register stream consumers based on the configured registration strategy. When EAGER is used, the client (usually job manager) will register the consumer and then the task managers will de-register the consumer when job stops/fails. If the job is configured to restart on fail, then the consumer will not exist and the job will continuously fail over.

I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.