search

logstash-plugins / logstash-input-kinesis

Logstash Plugin for AWS Kinesis Input
Apache License 2.0
45 stars 57 forks source link

Kinesis-input-plugin problem #56

Closed nvamshik closed 5 years ago

nvamshik commented 5 years ago

I was trying to send my logs from AWS Kinesis Firehose to my self managed Elasticsearch cluster through logstash and logstash's kinesis input plugin.

My conf file looks like the following:

input { kinesis { kinesis_stream_name => "Findings-monitor" region => "us-west-2" profile => "~/.aws/credentials" codec => "json" } } output { elasticsearch { hosts => "XX.XX.XX.XX:9200" index => "sample-index" } } I've added my aws credentials to the "~/.aws/credentials" file and also installed kinesis input plugin. But, when I ran the bin/logstash -f /etc/logstash/conf.d/test.conf --path.settings /etc/logstash command, I'm getting the following error:

SEVERE: Unable to initialize after 20 attempts. Shutting down. java.lang.RuntimeException: java.lang.IllegalArgumentException: profile file cannot be null at com.amazonaws.services.kinesis.clientlibrary.lib.worker.Worker.initialize(Worker.java:664) at com.amazonaws.services.kinesis.clientlibrary.lib.worker.Worker.run(Worker.java:564) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.jruby.javasupport.JavaMethod.invokeDirectWithExceptionHandling(JavaMethod.java:438) at org.jruby.javasupport.JavaMethod.invokeDirect(JavaMethod.java:302) at org.jruby.java.invokers.InstanceMethodInvoker.call(InstanceMethodInvoker.java:36) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:318) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:131) at org.jruby.ir.interpreter.InterpreterEngine.processCall(InterpreterEngine.java:339) at org.jruby.ir.interpreter.StartupInterpreterEngine.interpret(StartupInterpreterEngine.java:73) at org.jruby.ir.interpreter.InterpreterEngine.interpret(InterpreterEngine.java:83) at org.jruby.internal.runtime.methods.MixedModeIRMethod.INTERPRET_METHOD(MixedModeIRMethod.java:179) at org.jruby.internal.runtime.methods.MixedModeIRMethod.call(MixedModeIRMethod.java:165) at org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:200) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:338) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:163) at org.jruby.ir.interpreter.InterpreterEngine.processCall(InterpreterEngine.java:314) at org.jruby.ir.interpreter.StartupInterpreterEngine.interpret(StartupInterpreterEngine.java:73) at org.jruby.ir.interpreter.InterpreterEngine.interpret(InterpreterEngine.java:83) at org.jruby.internal.runtime.methods.MixedModeIRMethod.INTERPRET_METHOD(MixedModeIRMethod.java:179) at org.jruby.internal.runtime.methods.MixedModeIRMethod.call(MixedModeIRMethod.java:165) at org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:200) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:338) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:163) at org.jruby.ir.interpreter.InterpreterEngine.processCall(InterpreterEngine.java:314) at org.jruby.ir.interpreter.StartupInterpreterEngine.interpret(StartupInterpreterEngine.java:73) at org.jruby.ir.interpreter.Interpreter.INTERPRET_BLOCK(Interpreter.java:132) at org.jruby.runtime.MixedModeIRBlockBody.commonYieldPath(MixedModeIRBlockBody.java:148) at org.jruby.runtime.IRBlockBody.call(IRBlockBody.java:73) at org.jruby.runtime.Block.call(Block.java:124) at org.jruby.RubyProc.call(RubyProc.java:289) at org.jruby.RubyProc.call(RubyProc.java:246) at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:104) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.IllegalArgumentException: profile file cannot be null Can you please help me with this?