snowplow / enrich

Snowplow Enrichment jobs and library
https://snowplowanalytics.com
Other
21 stars 39 forks source link

Stream Enrich: bump amazon-kinesis-client to 2.2.12 #260

Open szareiangm opened 4 years ago

szareiangm commented 4 years ago

Project: Stream Enrich Version: 1.1.0 Expected behavior: Use enhanced fan out Actual behavior: KCL v1 missing it.

We had this requirement to use the enhance fan out feature from Kinesis to make sure our throughput is consistent. However, KCL v1 is not supporting this feature and we have to upgrade the KCL to version 2. This could be similar topic to https://github.com/snowplow/snowplow-elasticsearch-loader/issues/151.

benjben commented 2 years ago

Enrich 3.0.0 will come with new asset enrich-kinesis that aims at fully replacing Stream Enrich and comes with KCL 2.x