CumulusDS / dlq

CLI tool to manipulate AWS Dead Letter Queues
MIT License
1 stars 2 forks source link

Large number of messages in queue chokes the utility on both drain/redrive #88

Open jeffsays opened 2 months ago

jeffsays commented 2 months ago

Draining and/or re-driving messages chokes the utility when there are large number of messages.

This happens in the following circumstances:

I'll grab some screenshots of my console output as I run into these...I'll dig through my screenshot archives as well to find any that I might already have saved

jeffsays commented 2 months ago

@joshuanapoli an update for you with more details

When attempting to drain 1935 messages from a queue, the utility crashes

initial queue size: Screenshot 2024-06-18 at 12 15 57 PM

utility crash (note incomplete number of how many messages are in the queue - it's still increasing at this point): Screenshot 2024-06-18 at 12 15 04 PM

queue reports some of the messages as in-flight now: Screenshot 2024-06-18 at 12 17 14 PM

17 messages were successfully drained before the crash 17 messages drained + 203 in queue + 1717 in flight == 1937 messages 🤔 i guess it has increased since i pulled up the page minutes ago🤮

1920 messages now in the queue Screenshot 2024-06-18 at 12 19 35 PM