P3-Core-Dev-Team / P3-Q-A

This repo is for tracking features
Other
1 stars 0 forks source link

ADS - COC - Rate exceeded Error for Some tables - Neste #149

Closed suseela22 closed 6 days ago

suseela22 commented 1 month ago

Describe the bug Schema level COC report is generated for 1864 tables. Among those, 64 tables failed with the error "Error Occurred: Rate exceeded (Service: Athena, Status Code: 400, Request ID: f087bf06-5b04-4b14-8353-4c81c57f6816)"

To check the failure, 5 failed tables were triggered again. 4/5 tables got succeeded. One table which got failed was triggered and it is In_Progress for more than 3 hours and not completed yet.

Screenshots

One of the failed tables at the first run:

image

Same table got succeed at the next run:

image

COC Job In-progress for a long time: image

No logs were captured: image

Additional context Build no : 2024.09.45542_P2 Region : https://neste-dev.platform3solutions.com/ Client : Neste

maheswarareddyi commented 1 month ago

development for this fix is planned to start by today by @abirami1994

kilam005 commented 2 weeks ago

@abirami1994 update RCA and plan to fix

suseela22 commented 1 week ago

We face similar issue while executing the search as well

image

ClementJosh21 commented 1 week ago

@kilam005 The fix was merged yesterday. @Udhayanila8 Need to verify this.

abirami1994 commented 1 week ago

@kilam005 The fix was merged yesterday. @Udhayanila8 Need to verify this.

Udhayanila8 commented 1 week ago

_Server: https://uat-ads.platform3solutions.com/ Version: 2024.09.45542P4

While retesting COC job failed. so issue got reopened. Trigger application level COC with regex selection, image image COC job failed. image

kilam005 commented 1 week ago

@suseela22 is verifing and will update

suseela22 commented 1 week ago

COC report is generated successfully. Working as expected

kilam005 commented 1 week ago

Thanks for the confirmation @suseela22 . As discussed once you get the report for the all table all coc case generated confim us back.

Udhayanila8 commented 1 week ago

_Server: https://uat-ads.platform3solutions.com/ Version: 2024.09.45542P4

The COC job was completed for around 1100 tables and didn't get a rate-exceeding error. image image Tables for COC image Didn't get the rate exceeded error image Attached the report COC_REPORT_c8b793fe-8d53-4aec-89a2-7866b5de448f (1).pdf

kilam005 commented 6 days ago

@suseela22 Awaiting you comment to close the issue

suseela22 commented 6 days ago

Working as expected.COC is successfully completed for 1900 tables with all the cases enabled.