aws-samples / lambda-refarch-streamprocessing

Serverless Reference Architecture for Real-time Stream Processing
Apache License 2.0
349 stars 128 forks source link

Buffer should convert to UTF8 not ASCII #2

Open cameck opened 7 years ago

cameck commented 7 years ago

I think line 37 should be rewritten as payload = new Buffer(record.kinesis.data, 'base64').toString('utf8');

I recently ran into a situation where I could not for the life of me figure out why I kept getting this mysterious unexpected token error in Lambda's Cloudwatch console. After a few hours of testing and debugging, I finally figured out that I was passing invalid JSON Control Characters. BUT, what was really happening was I was converting chinese characters to ASCII.
The standard should be UTF8 to support our global connectivity 😉 .