search

amazon-archives / logstash-input-dynamodb

This input plugin for Logstash scans a specified DynamoDB table and then reads changes to a DynamoDB table from the associated DynamoDB Stream.This gem is a Logstash plugin required to be installed on top of the Logstash core pipeline. This gem is not a stand-alone program.
Apache License 2.0
105 stars 27 forks source link

Data maps over to ES as string #19

Open quocble opened 8 years ago

quocble commented 8 years ago

logstash wasn't easy to install.... I spent quite some time with it and played with the logging format. All of them converts into string type on elastic search. This just doesn't work well for in practice for searching.

I ended up using lambda functions. Worked in 15 minutes.

https://noise.getoto.net/2016/04/05/indexing-amazon-dynamodb-content-with-amazon-elasticsearch-service-using-aws-lambda/

marcosnils commented 8 years ago

@quocble have you checked this plugin that we made?. https://github.com/mantika/logstash-filter-dynamodb it indexes all youre dynamodb into the correct ES type.

I believe it's unnecessary to make a Lambda to process this.