Hey,
I was trying to upload to s3 each message that I get from my input without doing any aggregation.
Maybe I got it wrong but according to the docs upload_queue_size sounds fit for this issue - Number of items we can keep in the local queue before uploading them.
By default the rotation_strategy is configured to time or size thresholds. So I dont see how it behaves together with the upload_queue_size when it is configured.
Hey, I was trying to upload to s3 each message that I get from my input without doing any aggregation. Maybe I got it wrong but according to the docs upload_queue_size sounds fit for this issue - Number of items we can keep in the local queue before uploading them.
The output pipeline I configured :
By default the rotation_strategy is configured to time or size thresholds. So I dont see how it behaves together with the upload_queue_size when it is configured.