Receiving 'a' Partition record in Kinesis even when aggregation is disabled.

awslabs / streaming-endpoint-for-apache-hbase

This is a custom Apache HBase replication endpoint, to stream records into Apache Kafka, Amazon Kinesis, etc.

MIT No Attribution

12 stars 10 forks source link

Receiving 'a' Partition record in Kinesis even when aggregation is disabled. #5

Open 13586402 opened 1 year ago

13586402 commented 1 year ago

Hi,

We are facing issue with Hbase Kinesis endpoint. We are receiving 'a' partition key record into Kinesis stream even though 'hbase.replication.kinesis.aggregation-enabled' is set to false.

We are using hbase replication feature to capture the WAL and stream it into kinesis. We don't expect 'a' records and it's failing our process in production.

Could you please help us resolve.

Thanks, Anil

shenavaa commented 1 year ago

Thanks for reaching out. Could you please confirm hbase.replication.kinesis.aggregation-enabled is set to false on all region servers ? please share configuration attributes set in the environment. Replication happens by producer instances on region servers so we are expecting same attribute values across all region servers.