snowflakedb / SnowAlert

Security Analytics Using The Snowflake Data Warehouse
Apache License 2.0
180 stars 57 forks source link

GSE-3635: Fix AWSIC logging and status=408 errors #664

Closed sfc-gh-afedorov closed 2 months ago

sfc-gh-afedorov commented 2 months ago

Cleans up vestigial logging (known recoverable errors are written to error column in the ingestion tables) and fixes the crash that originates from a 408 response and logs —

botocore.parsers.ResponseParserError: Unable to parse response (no element found: line 1, column 0), invalid XML received. Further retries may succeed:
b''

This was reproduced locally and the retry logic appears to have fixed it, verified via local run.