This is a plugin for Logstash.
Currently this is BETA software. It contains some known limitations (see below)
You'll need to use this with the Logstash 1.5 or higher, which you can download here.
Install the plugin from the Logstash home directory
$ bin/plugin install logstash-input-rethinkdb
Now you can test the plugin using the stdout output:
$ bin/logstash -e '
input {rethinkdb
{host => "localhost"
port => 28015
auth_key => ""
watch_dbs => ["db1", "db2"]
watch_tables => ["test.foo", "db2.baz"]
backfill => true
}}
output {stdout {codec => json_lines}}'
This will immediately watch the tables test.foo
and db2.baz
, and it will also watch the databases db1
and db2
for new or dropped tables and watch or unwatch those tables appropriately. Since backfill
is true
, it will automatically send events for the documents that already exist in those tables during initialization.
The events are encoded with the "json_lines" codec, which puts compressed json documents one event per line
Fields:
There are two limitations that should be known by anyone using this in production systems:
backfill
is enabled. This limitation is a consequence of LogStash operating on a document-by-document basis.Apache 2.0