Each sink provided by common-streams library defines maximum accepted record size:
for kinesis - 1MB
for pubsub - 10MB
for kafka - 1MB
This PR implements badrow serializer, which makes sure those limits are not exceeded. If limit of bytes is reached, SizeViolation badrow is created with trimmed original payload
Each sink provided by
common-streams
library defines maximum accepted record size:This PR implements badrow serializer, which makes sure those limits are not exceeded. If limit of bytes is reached,
SizeViolation
badrow is created with trimmed original payload