🤖 Implement DLQ Size Limit Handling

[sentry-autofix-experimental[bot]]

👋 Hi there! This PR was automatically generated 🤖

Triggered by matthew.cannizzaro@sentry.io

Fixes SENTRY-346J

The issue is caused by the Dead Letter Queue (DLQ) limit being exceeded. This indicates that the system is encountering a significant number of invalid messages, which are being sent to the DLQ. To resolve this issue, we will implement a mechanism to handle situations when the DLQ size limit is reached. This will involve modifying the DLQ policy to either drop messages when the limit is reached or to implement a backpressure mechanism that slows down message consumption to allow for manual intervention or automated processing to reduce the DLQ size.

The steps that were performed:

1. Add DLQ Size Check Before Producing to DLQ
2. Implement Backpressure Mechanism
3. Log Warning and Drop Messages if DLQ Size Exceeded

📣 Instructions for the reviewer which is you, yes you:

• If these changes were incorrect, please close this PR and comment explaining why.
• If these changes were incomplete, please continue working on this PR then merge it.
• If you are feeling confident in my changes, please merge this PR.

This will greatly help us improve the autofix system. Thank you! 🙏

If there are any questions, please reach out to the AI/ML Team on #proj-autofix

🤓 Stats for the nerds:

Prompt tokens: 147456 Completion tokens: 4550 Total tokens: 152006

[getsantry[bot]]

This pull request has gone three weeks without activity. In another week, I will close it.

But! If you comment or otherwise update it, I will reset the clock, and if you add the label WIP, I will leave it alone unless WIP is removed ... forever!

---

"A weed is but an unloved flower." ― Ella Wheeler Wilcox 🥀