search

CleverCloud / logstash-output-pulsar

MIT License
6 stars 5 forks source link

How to use it? #3

Open oeegee opened 4 years ago

oeegee commented 4 years ago

Hello.

I'm build done.

but how to use it?

is include logstash's classpath?

KannarFr commented 4 years ago

Hi @oeegee,

Once it's built you just have to install plugin to logstash like:

bin/logstash-plugin install /path/to/logstash-output-kafka-1.0.0.gem

Then you can use it like (JWT auth here):

output {
  pulsar {
    bootstrap_servers => "pulsar://<HOST>:<PORT>"
    auth_plugin_class_name => "org.apache.pulsar.client.impl.auth.AuthenticationToken"
    auth_params_string => "token:<TOKEN>"
    batch_max_publish_delay => 300
    batch_max_size => 300
    topic_id => "persistent://..."
  }
}
oeegee commented 4 years ago

OK, your good voice! I'm gonna use this command.

bin/logstash-plugin install /path/to/logstash-output-pulsar-1.1.0-SNAPSHOT.gem

Have a nice day.

KannarFr commented 4 years ago

I forgot to mention a critical issue: https://github.com/apache/pulsar/issues/6195. Let me know if you have this issue too..

KannarFr commented 4 years ago

We should just remove pulsar batching yet.