search

amazon-archives / logstash-input-dynamodb

This input plugin for Logstash scans a specified DynamoDB table and then reads changes to a DynamoDB table from the associated DynamoDB Stream.This gem is a Logstash plugin required to be installed on top of the Logstash core pipeline. This gem is not a stand-alone program.
Apache License 2.0
105 stars 27 forks source link

Logstash >= 2.0 #9

Open ahmedammar opened 8 years ago

ahmedammar commented 8 years ago

Basic support for 2.0

Reference #8

raymolin commented 8 years ago

hey @ahmedammar , I was trying to install this version of the logstash plugin. I ran into issues both with trying to install it with the gem installed locally as well as with the full path to the plugin (it seems to always read the gem from rubygems.org). Can I ask how you set it up?

ahmedammar commented 8 years ago

@raymolin: These are the commands I use: to build:

jruby -S gem install bundler
bundle install
jruby -S gem build logstash-input-dynamodb.gemspec

install in log stash:

bin/plugin install ../logstash-input-dynamodb/logstash-input-dynamodb-1.0.0-java.gem
raymolin commented 8 years ago

Hmm, I've tried that, but I usually hit an issue with this line 's.files = git ls-files.split($)' So I replaced it with 'Dir["Gemfile", "Rakefile", "LICENSE.txt", "README.md", "lib//", "spec/"'

The plugin successfully installs, but doesn't show up in bin/plugin list.

ahmedammar commented 8 years ago

@raymolin Can you even install the original plugin? It seems it was always written to install from a git clone (not a downloaded zip from github) ...

Can you try building and install from a cloned git tree?

raymolin commented 8 years ago

I'm going to test that out right now. To confirm, I am building from the cloned git tree, so I can build the plugin. Where I am seeing issues is, bin/plugin install. I either get 'not a git repository' or the plugin doesn't show up on my list.

ahmedammar commented 8 years ago

Just pushed a fix in the scan path as I had broken it.

marcosnils commented 8 years ago

Hey there, just wanted to let you know that the docker container is available now:

https://hub.docker.com/r/mantika/logstash-dynamodb-streams/