Dynamodb Streams Kinesis Adapter for Python

awslabs / dynamodb-streams-kinesis-adapter

The Amazon DynamoDB Streams Adapter implements the Amazon Kinesis interface so that your application can use KCL to consume and process data from a DynamoDB stream.

Apache License 2.0

99 stars 37 forks source link

Dynamodb Streams Kinesis Adapter for Python #46

Open DilLip-Chowdary-Codes opened 3 years ago

DilLip-Chowdary-Codes commented 3 years ago

Is there any Existing things for processing dynamodb streams with KCL in python ?
I came to know as of now, only java Adapter is Available, if it's true how can we do process dynamodb streams in python

TIA

dacevedo12 commented 2 years ago

Here's a somewhat hackish approach that worked for me:

Use amazon_kclpy 1.5.1 (latest compatible with KCL 1x)
Patch the setup.py to force it to accept amazon-kinesis-client-1.13.3 and aws-java-sdk-*-1.12.311 and httpclient-4.5.13

Run:

java \
    com.amazonaws.services.dynamodbv2.streamsadapter.StreamsMultiLangDaemon \
    path/to/your/consumer.properties