search

beam-pyio / sns_pyio

Apache Beam Python I/O connector for Amazon SNS
Other
1 stars 0 forks source link

SNS Connector Requirements #1

Open kevvo83 opened 1 month ago

kevvo83 commented 1 month ago
  1. Implement put_record_batch functionality of the sink connector
  2. Implement integration tests using localstack
    • 1 integration test to push a JSON record into a topic
    • 1 integration test to push a batch close to quota number of records limit
    • 1 integration test to push a batch with messages close to size limits
    • 1 integration test to recover from quota breach errors
kevvo83 commented 1 month ago

Implementing tests using pytest at the moment - stuck on parameterizing tests using command line options - will move past quickly.

Need to investigate how to use moto - it hasn't worked for me - need to investigate if I can pull this into the unit tests.