CloudSnorkel / CloudWatch2S3

Logging infrastructure for exporting all CloudWatch logs from multiple accounts to a single S3 bucket
MIT License
48 stars 26 forks source link

Processing Failed #9

Closed moisesrodriguez closed 2 years ago

moisesrodriguez commented 2 years ago

Hello,

I'm seeing this on the S3 bucket Screen Shot 2022-01-14 at 16 20 42

And opening one of the files contains

{
"attemptsMade":1,
"arrivalTimestamp":1642118621432,
"errorCode":"Lambda.ProcessingFailedStatus",
"errorMessage":"ProcessingFailed status set for record","attemptEndingTimestamp":1642118631572,
"rawData":"H4sIAAAAAAAAALy9Ta82y3Fd+VcaHMvQqe8qz2RY7VGP5Fmj0SDFK4OwJRIkZcMw+r93PTZ60udU4i7sVVuQIOi9V2/wiZ0ZGRG5Mup//Oaff/nLX377n375j//9T7/85t/+5t//3X/8u//7//j7f/iHv/sPf/+bv/nNH//bv/zy5/uPj32brq/jOvev5f7j//LH//Qf/vzHf/3T/U/+9pd//Mvf/v6P//iXf/OXX/78X3/587/505//+Pv/9a/8w1///Mtv//n+d/5//8rfXr//3e//6fjdNW+//d26/NPyu+nr91+/3Y75XObf/9Pvr/v//S//+ru//OOf//Cnv/7hj//yv//hv/z1lz//5Tf/9v/8zb/713/8z7/89d/99h//87/+6X/98W/+r/9p6+//6y//8tfPv/I/fvOH398ml32fv9b9vLZ53b/W42tfr3W95mk9z69j3bZpW7/uP923+fq6lnX6mud9Ovbb9F//cLvkr7/95/vXTfs6T9N5/1XX9fU3/5+r7r/+f7v/67r+5jf/z99k9g5gb59zeyex95Xbu7r+PL+AvSX35zkBe9O05gZnIuCU21uIQ4XftwJ7x5nb24C9Tfh9JMBsS26PBBhDPxJgjA1IAsw07bHBi0QYYQNeJMIIAl4kwEzTlhskEUZRkIQYI2ZfJMYYEpIYIyQVF0pi8qTiIjHm/ge5QRJkcofOXyTGnLFD5y8SY/Z4y89fJMYccQydv0iIMX4fiTB7vD7nLxJgjN+HAoywPkmAWY/cXjnA3H9vN8BMKInJBZxIgBEEnEiAycvOeUIBRtAPBRhBPxJgDH+SAJNXEfNEAoyQEs4T6sPkJ+BEAkyegs4zCTBHvmBmEmDyMn6eSYDJy/h57rZh5pkEGGEDziTACEXg/d/dDTh3+zDzzFKYPCecy42YeSEhxojZS7cTMy+o1ZvvwQUlMXlSsbA+TJ5lL6hMEhyKYkye9S4kxhzCDkRJjPD7UBKT67eiJCY/I1YSYK7cn2u51Tuv5VbvvLIQI0jI8hjBpeVWzFpuxaztVsxabsVs5VbMVm7Fb.......... (HERE THERE IS A BUNCH MORE OF THIS LINES",
"lambdaArn":"arn:aws:lambda:us-west-2:XXXXXXXXXXXX:function:serverlessrepo-CW2S3-docs-ser-LogProcessorFunction-JVclr0k2mvt8"
}

Any ideas what is the actual error and how to debug it? Or what if any parameters need to be updated on the stack?

Thanks!

kichik commented 2 years ago

The Lambda function that does the processing should have a log. Try looking for errors there for more information on the failure. You can also try processing the raw data yourself from the S3 file. Maybe the issue will be obvious there.

moisesrodriguez commented 2 years ago

@kichik thank you for the help, my output is larger than 6mb but that was not obvious from where I was looking at.

Screen Shot 2022-01-16 at 22 41 31