search

elastic / logstash

Logstash - transport and process your logs, events, or other data
https://www.elastic.co/products/logstash
Other
63 stars 3.5k forks source link

NameError when installing plugins #2674

Closed joekiller closed 9 years ago

joekiller commented 9 years ago

I'm trying to install any plugin and getting the following error

$ /opt/logstash/bin/plugin install /tmp/logstash-output-elasticsearch/logstash-output-elasticsearch-0.1.16-java.gem --debug
Validating /tmp/logstash-output-elasticsearch/logstash-output-elasticsearch-0.1.16-java.gem
Error reading plugin file /tmp/logstash-output-elasticsearch/logstash-output-elasticsearch-0.1.16-java.gem, caused by NameError
Installation aborted

I get the Error reading plugin file ... caused by NameError for any plugin I try to install. Tips?

joekiller commented 9 years ago

ran with debug:

sudo DEBUG=true /opt/logstash/bin/plugin install /tmp/logstash-output-elasticsearch/logstash-output-elasticsearch-0.1.16-java.gem
Validating /tmp/logstash-output-elasticsearch/logstash-output-elasticsearch-0.1.16-java.gem
Error reading plugin file /tmp/logstash-output-elasticsearch/logstash-output-elasticsearch-0.1.16-java.gem, caused by NameError
uninitialized constant Gem::Package
joekiller commented 9 years ago

Might have to do with https://github.com/elasticsearch/logstash/commit/9e7d6204a56b2f6f42c57445a35688d8569b988e

joekiller commented 9 years ago

Actually it might have to do with the lack of that commit. Seems like that isn't in 1.5 yet. Trying master...

joekiller commented 9 years ago

Same problem on master.

purbon commented 9 years ago

Facing this same problem with master, Gem::Package goes away if you require 'rubygems\package' but then the plugin is not found somehow. (debugging as we speak)

joekiller commented 9 years ago

Cool. I finally just tried the beta from http://www.elasticsearch.org/overview/logstash/download/ and that is working so I'm going to continue my plugin development from there for now.

purbon commented 9 years ago

/cc @ph @colinsurprenant @jsvd

ph commented 9 years ago

@joekiller What you can do is to add this line to your Gemfile:

gem 'mynewplugin', :path => '~/path/to/the-plugin'
ph commented 9 years ago

Oups too fast on the enter key.

After adding the line you will need to do run this command

bin/plugin install --no-verify

ph commented 9 years ago

@joekiller note that you only need to run the command once to make logstash add your plugin to his loading paths.

colinsurprenant commented 9 years ago

@joekiller, what @ph said. The support for local .gem files in the pluginmanager is not completed, we decided to postpone it a bit but in development mode you can manually add it in the Gemfile as explained by @ph.

I also encourage you to use current master instead of beta1 in http://www.elasticsearch.org/overview/logstash/download/ - we are approaching RC1 and, frankly, any issue you can report will help us iron it out!

joekiller commented 9 years ago

I'll try the .gem file update next.

Just to confirm as y'all suspect, if I install the latest beta from the download page, I get The error reported is: \n kafka must set a milestone. which has to do with all the commits that remove milestones in the plugins, ie https://github.com/logstash-plugins/logstash-input-kafka/commit/aa8098c25ead1a6817551db4e6ac8dabd8f9397b

If I run bin/plugin install --no-verify with 1.5 or master (which is 2.0) I get the error about local gems not being there:

$ DEBUG=true bin/plugin install --no-verify /tmp/logstash-input-kafka-0.1.9.gem
Installing /tmp/logstash-input-kafka-0.1.9.gem
Plugin not found, aborting
HTTP GET https://bundler.rubygems.org/api/v1/dependencies
HTTP 200 OK
Fetching gem metadata from https://rubygems.org/
Query List: ["rspec", "logstash-devutils", "ci_reporter", "simplecov", "coveralls", "logstash-output-zeromq", "logstash-codec-collectd", "logstash-output-xmpp", "logstash-codec-dots", "logstash-codec-edn", "logstash-codec-edn_lines", "logstash-codec-fluent", "logstash-codec-es_bulk", "logstash-codec-graphite", "logstash-codec-json", "logstash-codec-json_lines", "logstash-codec-line", "logstash-codec-msgpack", "logstash-codec-multiline", "logstash-codec-netflow", "logstash-codec-oldlogstashjson", "logstash-codec-plain", "logstash-codec-rubydebug", "logstash-filter-anonymize", "logstash-filter-checksum", "logstash-filter-clone", "logstash-filter-csv", "logstash-filter-date", "logstash-filter-dns", "logstash-filter-drop", "logstash-filter-fingerprint", "logstash-filter-geoip", "logstash-filter-grok", "logstash-filter-json", "logstash-filter-kv", "logstash-filter-metrics", "logstash-filter-multiline", "logstash-filter-mutate", "logstash-filter-ruby", "logstash-filter-sleep", "logstash-filter-split", "logstash-filter-syslog_pri", "logstash-filter-throttle", "logstash-filter-urldecode", "logstash-filter-useragent", "logstash-filter-uuid", "logstash-filter-xml", "logstash-input-couchdb_changes", "logstash-input-elasticsearch", "logstash-input-eventlog", "logstash-input-exec", "logstash-input-file", "logstash-input-ganglia", "logstash-input-gelf", "logstash-input-generator", "logstash-input-graphite", "logstash-input-imap", "logstash-input-irc", "logstash-input-kafka", "logstash-input-log4j", "logstash-input-lumberjack", "logstash-input-pipe", "logstash-input-rabbitmq", "logstash-input-redis", "logstash-input-s3", "logstash-input-snmptrap", "logstash-input-sqs", "logstash-input-stdin", "logstash-input-syslog", "logstash-input-tcp", "logstash-input-twitter", "logstash-input-udp", "logstash-input-unix", "logstash-input-xmpp", "logstash-input-zeromq", "logstash-output-cloudwatch", "logstash-output-csv", "logstash-output-elasticsearch", "logstash-output-email", "logstash-output-exec", "logstash-output-file", "logstash-output-ganglia", "logstash-output-gelf", "logstash-output-graphite", "logstash-output-hipchat", "logstash-output-http", "logstash-output-irc", "logstash-output-juggernaut", "logstash-output-kafka", "logstash-output-lumberjack", "logstash-output-nagios", "logstash-output-nagios_nsca", "logstash-output-null", "logstash-output-opentsdb", "logstash-output-pagerduty", "logstash-output-pipe", "logstash-output-rabbitmq", "logstash-output-redis", "logstash-output-s3", "logstash-output-sns", "logstash-output-sqs", "logstash-output-statsd", "logstash-output-stdout", "logstash-output-tcp", "logstash-output-udp", "/tmp/logstash-input-kafka-0.1.9.gem", "cabin", "pry", "stud", "clamp", "filesize", "treetop", "i18n", "ftw", "mime-types", "rack", "sinatra", "jar-dependencies", "ruby-maven", "maven-tools", "minitar", "file-dependencies", "jruby-httpclient", "jrjackson"]
Query Gemcutter Dependency Endpoint API: rspec,logstash-devutils,ci_reporter,simplecov,coveralls,logstash-output-zeromq,logstash-codec-collectd,logstash-output-xmpp,logstash-codec-dots,logstash-codec-edn,logstash-codec-edn_lines,logstash-codec-fluent,logstash-codec-es_bulk,logstash-codec-graphite,logstash-codec-json,logstash-codec-json_lines,logstash-codec-line,logstash-codec-msgpack,logstash-codec-multiline,logstash-codec-netflow,logstash-codec-oldlogstashjson,logstash-codec-plain,logstash-codec-rubydebug,logstash-filter-anonymize,logstash-filter-checksum,logstash-filter-clone,logstash-filter-csv,logstash-filter-date,logstash-filter-dns,logstash-filter-drop,logstash-filter-fingerprint,logstash-filter-geoip,logstash-filter-grok,logstash-filter-json,logstash-filter-kv,logstash-filter-metrics,logstash-filter-multiline,logstash-filter-mutate,logstash-filter-ruby,logstash-filter-sleep,logstash-filter-split,logstash-filter-syslog_pri,logstash-filter-throttle,logstash-filter-urldecode,logstash-filter-useragent,logstash-filter-uuid,logstash-filter-xml,logstash-input-couchdb_changes,logstash-input-elasticsearch,logstash-input-eventlog,logstash-input-exec,logstash-input-file,logstash-input-ganglia,logstash-input-gelf,logstash-input-generator,logstash-input-graphite,logstash-input-imap,logstash-input-irc,logstash-input-kafka,logstash-input-log4j,logstash-input-lumberjack,logstash-input-pipe,logstash-input-rabbitmq,logstash-input-redis,logstash-input-s3,logstash-input-snmptrap,logstash-input-sqs,logstash-input-stdin,logstash-input-syslog,logstash-input-tcp,logstash-input-twitter,logstash-input-udp,logstash-input-unix,logstash-input-xmpp,logstash-input-zeromq,logstash-output-cloudwatch,logstash-output-csv,logstash-output-elasticsearch,logstash-output-email,logstash-output-exec,logstash-output-file,logstash-output-ganglia,logstash-output-gelf,logstash-output-graphite,logstash-output-hipchat,logstash-output-http,logstash-output-irc,logstash-output-juggernaut,logstash-output-kafka,logstash-output-lumberjack,logstash-output-nagios,logstash-output-nagios_nsca,logstash-output-null,logstash-output-opentsdb,logstash-output-pagerduty,logstash-output-pipe,logstash-output-rabbitmq,logstash-output-redis,logstash-output-s3,logstash-output-sns,logstash-output-sqs,logstash-output-statsd,logstash-output-stdout,logstash-output-tcp,logstash-output-udp,/tmp/logstash-input-kafka-0.1.9.gem,cabin,pry,stud,clamp,filesize,treetop,i18n,ftw,mime-types,rack,sinatra,jar-dependencies,ruby-maven,maven-tools,minitar,file-dependencies,jruby-httpclient,jrjackson
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=rspec,logstash-devutils,ci_reporter,simplecov,coveralls,logstash-output-zeromq,logstash-codec-collectd,logstash-output-xmpp,logstash-codec-dots,logstash-codec-edn,logstash-codec-edn_lines,logstash-codec-fluent,logstash-codec-es_bulk,logstash-codec-graphite,logstash-codec-json,logstash-codec-json_lines,logstash-codec-line,logstash-codec-msgpack,logstash-codec-multiline,logstash-codec-netflow,logstash-codec-oldlogstashjson,logstash-codec-plain,logstash-codec-rubydebug,logstash-filter-anonymize,logstash-filter-checksum,logstash-filter-clone,logstash-filter-csv,logstash-filter-date,logstash-filter-dns,logstash-filter-drop,logstash-filter-fingerprint,logstash-filter-geoip,logstash-filter-grok,logstash-filter-json,logstash-filter-kv,logstash-filter-metrics,logstash-filter-multiline,logstash-filter-mutate,logstash-filter-ruby,logstash-filter-sleep,logstash-filter-split,logstash-filter-syslog_pri,logstash-filter-throttle,logstash-filter-urldecode,logstash-filter-useragent,logstash-filter-uuid,logstash-filter-xml,logstash-input-couchdb_changes,logstash-input-elasticsearch,logstash-input-eventlog
HTTP 200 OK
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=logstash-input-exec,logstash-input-file,logstash-input-ganglia,logstash-input-gelf,logstash-input-generator,logstash-input-graphite,logstash-input-imap,logstash-input-irc,logstash-input-kafka,logstash-input-log4j,logstash-input-lumberjack,logstash-input-pipe,logstash-input-rabbitmq,logstash-input-redis,logstash-input-s3,logstash-input-snmptrap,logstash-input-sqs,logstash-input-stdin,logstash-input-syslog,logstash-input-tcp,logstash-input-twitter,logstash-input-udp,logstash-input-unix,logstash-input-xmpp,logstash-input-zeromq,logstash-output-cloudwatch,logstash-output-csv,logstash-output-elasticsearch,logstash-output-email,logstash-output-exec,logstash-output-file,logstash-output-ganglia,logstash-output-gelf,logstash-output-graphite,logstash-output-hipchat,logstash-output-http,logstash-output-irc,logstash-output-juggernaut,logstash-output-kafka,logstash-output-lumberjack,logstash-output-nagios,logstash-output-nagios_nsca,logstash-output-null,logstash-output-opentsdb,logstash-output-pagerduty,logstash-output-pipe,logstash-output-rabbitmq,logstash-output-redis,logstash-output-s3,logstash-output-sns
HTTP 200 OK
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=logstash-output-sqs,logstash-output-statsd,logstash-output-stdout,logstash-output-tcp,logstash-output-udp,/tmp/logstash-input-kafka-0.1.9.gem,cabin,pry,stud,clamp,filesize,treetop,i18n,ftw,mime-types,rack,sinatra,jar-dependencies,ruby-maven,maven-tools,minitar,file-dependencies,jruby-httpclient,jrjackson
HTTP 200 OK
Query List: ["docile", "simplecov-html", "multi_json", "lockfile", "builder", "rspec-mocks", "rspec-expectations", "rspec-core", "cucumber", "hoe", "diff-lcs", "syntax", "spicycode-rcov", "thor", "term-ansicolor", "rest-client", "colorize", "json", "xml-simple", "nokogiri", "logstash", "logstash-patterns-core", "edn", "murmurhash3", "jruby-openssl", "geoip", "metriks", "user_agent_parser", "elasticsearch", "awesome_print", "jls-grok", "bindata", "jruby-win32ole", "xmpp4r", "ffi-rzmq", "msgpack-jruby", "msgpack", "insist", "gem_publisher", "rake", "filewatch", "addressable", "manticore", "concurrent-ruby", "redis", "mail", "cinch", "march_hare", "bunny", "jls-lumberjack", "aws-sdk", "snmp", "logstash-mixin-aws", "gelf", "gelfd", "jruby-kafka", "thread_safe", "gmetric", "rufus-scheduler", "twitter", "ruby-maven-libs", "archive-tar-minitar", "rcov", "win32console", "method_source", "slop", "coderay", "spoon", "ruby_parser", "yard", "tilt", "mongrel", "shotgun", "rack-test", "rack-protection", "backports", "test-spec", "camping", "fcgi", "memcache-client", "ruby-openid", "thin", "http_parser.rb", "minitest", "facets", "polyglot", "virtus", "ffi", "statsd-ruby"]
Query Gemcutter Dependency Endpoint API: docile,simplecov-html,multi_json,lockfile,builder,rspec-mocks,rspec-expectations,rspec-core,cucumber,hoe,diff-lcs,syntax,spicycode-rcov,thor,term-ansicolor,rest-client,colorize,json,xml-simple,nokogiri,logstash,logstash-patterns-core,edn,murmurhash3,jruby-openssl,geoip,metriks,user_agent_parser,elasticsearch,awesome_print,jls-grok,bindata,jruby-win32ole,xmpp4r,ffi-rzmq,msgpack-jruby,msgpack,insist,gem_publisher,rake,filewatch,addressable,manticore,concurrent-ruby,redis,mail,cinch,march_hare,bunny,jls-lumberjack,aws-sdk,snmp,logstash-mixin-aws,gelf,gelfd,jruby-kafka,thread_safe,gmetric,rufus-scheduler,twitter,ruby-maven-libs,archive-tar-minitar,rcov,win32console,method_source,slop,coderay,spoon,ruby_parser,yard,tilt,mongrel,shotgun,rack-test,rack-protection,backports,test-spec,camping,fcgi,memcache-client,ruby-openid,thin,http_parser.rb,minitest,facets,polyglot,virtus,ffi,statsd-ruby
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=docile,simplecov-html,multi_json,lockfile,builder,rspec-mocks,rspec-expectations,rspec-core,cucumber,hoe,diff-lcs,syntax,spicycode-rcov,thor,term-ansicolor,rest-client,colorize,json,xml-simple,nokogiri,logstash,logstash-patterns-core,edn,murmurhash3,jruby-openssl,geoip,metriks,user_agent_parser,elasticsearch,awesome_print,jls-grok,bindata,jruby-win32ole,xmpp4r,ffi-rzmq,msgpack-jruby,msgpack,insist,gem_publisher,rake,filewatch,addressable,manticore,concurrent-ruby,redis,mail,cinch,march_hare,bunny,jls-lumberjack
HTTP 200 OK
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=aws-sdk,snmp,logstash-mixin-aws,gelf,gelfd,jruby-kafka,thread_safe,gmetric,rufus-scheduler,twitter,ruby-maven-libs,archive-tar-minitar,rcov,win32console,method_source,slop,coderay,spoon,ruby_parser,yard,tilt,mongrel,shotgun,rack-test,rack-protection,backports,test-spec,camping,fcgi,memcache-client,ruby-openid,thin,http_parser.rb,minitest,facets,polyglot,virtus,ffi,statsd-ruby
HTTP 200 OK
Query List: ["elasticsearch-api", "elasticsearch-transport", "ffi-rzmq-core", "rspec-support", "activesupport", "tlsmail", "eventmachine", "multi_test", "gherkin", "cucumber-core", "json_pure", "launchy", "tins", "RubyInline", "rubyforge", "gemcutter", "amq-protocol", "netrc", "rdoc", "mini_portile", "racc", "tenderlove-frex", "rake-compiler", "rexical", "weakling", "bouncy-castle-java", "avl_tree", "hitimes", "atomic", "rbtree", "faraday", "faraday_middleware", "yajl-ruby", "parslet", "ref", "functional-ruby", "logstash", "aws-sdk-resources", "aws-sdk-v1", "uuidtools", "httparty", "daemons", "fastthread", "gem_plugin", "cgi_multipart_eof_fix", "axiom-types", "coercible", "equalizer", "descendants_tracker", "ruby-yadis", "ZenTest", "flexmock", "mocha", "erubis", "activerecord", "markaby", "metaid", "mab", "sexp_processor", "ParseTree", "escape_utils", "eventmachine-le", "preforker", "bones", "tzinfo", "simple_oauth", "naught", "memoizable", "http", "buftok", "jbundler"]
Query Gemcutter Dependency Endpoint API: elasticsearch-api,elasticsearch-transport,ffi-rzmq-core,rspec-support,activesupport,tlsmail,eventmachine,multi_test,gherkin,cucumber-core,json_pure,launchy,tins,RubyInline,rubyforge,gemcutter,amq-protocol,netrc,rdoc,mini_portile,racc,tenderlove-frex,rake-compiler,rexical,weakling,bouncy-castle-java,avl_tree,hitimes,atomic,rbtree,faraday,faraday_middleware,yajl-ruby,parslet,ref,functional-ruby,logstash,aws-sdk-resources,aws-sdk-v1,uuidtools,httparty,daemons,fastthread,gem_plugin,cgi_multipart_eof_fix,axiom-types,coercible,equalizer,descendants_tracker,ruby-yadis,ZenTest,flexmock,mocha,erubis,activerecord,markaby,metaid,mab,sexp_processor,ParseTree,escape_utils,eventmachine-le,preforker,bones,tzinfo,simple_oauth,naught,memoizable,http,buftok,jbundler
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=elasticsearch-api,elasticsearch-transport,ffi-rzmq-core,rspec-support,activesupport,tlsmail,eventmachine,multi_test,gherkin,cucumber-core,json_pure,launchy,tins,RubyInline,rubyforge,gemcutter,amq-protocol,netrc,rdoc,mini_portile,racc,tenderlove-frex,rake-compiler,rexical,weakling,bouncy-castle-java,avl_tree,hitimes,atomic,rbtree,faraday,faraday_middleware,yajl-ruby,parslet,ref,functional-ruby,logstash,aws-sdk-resources,aws-sdk-v1,uuidtools,httparty,daemons,fastthread,gem_plugin,cgi_multipart_eof_fix,axiom-types,coercible,equalizer,descendants_tracker,ruby-yadis
HTTP 200 OK
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=ZenTest,flexmock,mocha,erubis,activerecord,markaby,metaid,mab,sexp_processor,ParseTree,escape_utils,eventmachine-le,preforker,bones,tzinfo,simple_oauth,naught,memoizable,http,buftok,jbundler
HTTP 200 OK
Query List: ["blankslate", "multi_xml", "crack", "echoe", "jnunemaker-crack", "hashie", "oauth2", "roauth", "multipart-post", "configuration", "spruz", "net-scp", "trollop", "mkrf", "adamantium", "ice_nine", "aws-sdk-core", "SexpProcessor", "metaclass", "form_data", "certified", "abstract", "little-plugger", "loquacious", "bones-git", "bones-extras", "bundler", "arel", "activemodel", "activerecord-deprecated_finders"]
Query Gemcutter Dependency Endpoint API: blankslate,multi_xml,crack,echoe,jnunemaker-crack,hashie,oauth2,roauth,multipart-post,configuration,spruz,net-scp,trollop,mkrf,adamantium,ice_nine,aws-sdk-core,SexpProcessor,metaclass,form_data,certified,abstract,little-plugger,loquacious,bones-git,bones-extras,bundler,arel,activemodel,activerecord-deprecated_finders
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=blankslate,multi_xml,crack,echoe,jnunemaker-crack,hashie,oauth2,roauth,multipart-post,configuration,spruz,net-scp,trollop,mkrf,adamantium,ice_nine,aws-sdk-core,SexpProcessor,metaclass,form_data,certified,abstract,little-plugger,loquacious,bones-git,bones-extras,bundler,arel,activemodel,activerecord-deprecated_finders
HTTP 200 OK
Query List: ["net-ssh", "git", "safe_yaml", "highline", "allison", "bones-rcov", "bones-rubyforge", "bones-rspec", "bones-zentest", "curses", "bcrypt-ruby", "httpauth", "jwt", "faraday-middleware", "jmespath", "jamespath"]
Query Gemcutter Dependency Endpoint API: net-ssh,git,safe_yaml,highline,allison,bones-rcov,bones-rubyforge,bones-rspec,bones-zentest,curses,bcrypt-ruby,httpauth,jwt,faraday-middleware,jmespath,jamespath
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=net-ssh,git,safe_yaml,highline,allison,bones-rcov,bones-rubyforge,bones-rspec,bones-zentest,curses,bcrypt-ruby,httpauth,jwt,faraday-middleware,jmespath,jamespath
HTTP 200 OK
Query List: ["termios", "bcrypt", "needle", "jruby-pageant", "psych"]
Query Gemcutter Dependency Endpoint API: termios,bcrypt,needle,jruby-pageant,psych
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=termios,bcrypt,needle,jruby-pageant,psych
HTTP 200 OK
Query List: []
Fetching version metadata from https://rubygems.org/
Query List: ["bones", "rubyforge", "ZenTest", "termios", "rspec", "rcov", "json", "multi_json", "bcrypt", "needle", "jruby-pageant", "echoe", "psych", "net-ssh", "sexp_processor", "git", "safe_yaml", "activesupport", "rake", "highline", "gemcutter", "allison", "rdoc", "hoe", "bones-rcov", "bones-rubyforge", "bones-rspec", "bones-zentest", "curses", "builder", "i18n", "bcrypt-ruby", "faraday", "httpauth", "rack", "jwt", "faraday-middleware", "multi_xml", "backports", "ice_nine", "thread_safe", "memoizable", "jmespath", "jamespath", "blankslate", "crack", "jnunemaker-crack", "hashie", "oauth2", "roauth", "multipart-post", "addressable", "spoon", "configuration", "ffi", "minitest", "spruz", "launchy", "json_pure", "net-scp", "trollop", "term-ansicolor", "mkrf", "rake-compiler", "tzinfo", "memcache-client", "atomic", "adamantium", "descendants_tracker", "gherkin", "nokogiri", "aws-sdk-core", "RubyInline", "SexpProcessor", "metaclass", "form_data", "http_parser.rb", "certified", "abstract", "little-plugger", "loquacious", "bones-git", "bones-extras", "jar-dependencies", "bundler", "ruby-maven", "maven-tools", "thor", "arel", "activemodel", "activerecord-deprecated_finders", "elasticsearch-api", "elasticsearch-transport", "ffi-rzmq-core", "diff-lcs", "rspec-support", "rspec-core", "rspec-expectations", "mime-types", "tlsmail", "treetop", "cabin", "eventmachine", "multi_test", "cucumber-core", "polyglot", "tins", "simplecov", "amq-protocol", "netrc", "mini_portile", "racc", "tenderlove-frex", "rexical", "weakling", "bouncy-castle-java", "avl_tree", "hitimes", "rbtree", "faraday_middleware", "yajl-ruby", "parslet", "ref", "functional-ruby", "logstash", "aws-sdk-resources", "aws-sdk-v1", "uuidtools", "httparty", "ruby_parser", "daemons", "fastthread", "gem_plugin", "cgi_multipart_eof_fix", "axiom-types", "coercible", "equalizer", "ruby-yadis", "flexmock", "mocha", "erubis", "activerecord", "markaby", "metaid", "mab", "ParseTree", "escape_utils", "eventmachine-le", "preforker", "simple_oauth", "naught", "http", "buftok", "jbundler", "aws-sdk", "logstash-codec-plain", "docile", "simplecov-html", "lockfile", "rspec-mocks", "cucumber", "syntax", "spicycode-rcov", "rest-client", "colorize", "xml-simple", "logstash-filter-grok", "logstash-patterns-core", "logstash-codec-line", "edn", "murmurhash3", "jruby-openssl", "geoip", "metriks", "user_agent_parser", "logstash-codec-json", "elasticsearch", "ftw", "awesome_print", "jls-grok", "bindata", "jruby-win32ole", "logstash-output-null", "logstash-input-generator", "xmpp4r", "ffi-rzmq", "msgpack-jruby", "msgpack", "logstash-filter-date", "logstash-filter-mutate", "insist", "minitar", "gem_publisher", "filewatch", "manticore", "stud", "concurrent-ruby", "logstash-codec-json_lines", "redis", "mail", "cinch", "logstash-input-tcp", "march_hare", "bunny", "jls-lumberjack", "snmp", "logstash-mixin-aws", "gelf", "gelfd", "jruby-kafka", "gmetric", "rufus-scheduler", "twitter", "logstash-filter-json", "logstash-output-file", "ruby-maven-libs", "archive-tar-minitar", "win32console", "method_source", "slop", "coderay", "yard", "tilt", "mongrel", "shotgun", "rack-test", "rack-protection", "test-spec", "camping", "fcgi", "ruby-openid", "thin", "facets", "virtus", "statsd-ruby"]
Query Gemcutter Dependency Endpoint API: bones,rubyforge,ZenTest,termios,rspec,rcov,json,multi_json,bcrypt,needle,jruby-pageant,echoe,psych,net-ssh,sexp_processor,git,safe_yaml,activesupport,rake,highline,gemcutter,allison,rdoc,hoe,bones-rcov,bones-rubyforge,bones-rspec,bones-zentest,curses,builder,i18n,bcrypt-ruby,faraday,httpauth,rack,jwt,faraday-middleware,multi_xml,backports,ice_nine,thread_safe,memoizable,jmespath,jamespath,blankslate,crack,jnunemaker-crack,hashie,oauth2,roauth,multipart-post,addressable,spoon,configuration,ffi,minitest,spruz,launchy,json_pure,net-scp,trollop,term-ansicolor,mkrf,rake-compiler,tzinfo,memcache-client,atomic,adamantium,descendants_tracker,gherkin,nokogiri,aws-sdk-core,RubyInline,SexpProcessor,metaclass,form_data,http_parser.rb,certified,abstract,little-plugger,loquacious,bones-git,bones-extras,jar-dependencies,bundler,ruby-maven,maven-tools,thor,arel,activemodel,activerecord-deprecated_finders,elasticsearch-api,elasticsearch-transport,ffi-rzmq-core,diff-lcs,rspec-support,rspec-core,rspec-expectations,mime-types,tlsmail,treetop,cabin,eventmachine,multi_test,cucumber-core,polyglot,tins,simplecov,amq-protocol,netrc,mini_portile,racc,tenderlove-frex,rexical,weakling,bouncy-castle-java,avl_tree,hitimes,rbtree,faraday_middleware,yajl-ruby,parslet,ref,functional-ruby,logstash,aws-sdk-resources,aws-sdk-v1,uuidtools,httparty,ruby_parser,daemons,fastthread,gem_plugin,cgi_multipart_eof_fix,axiom-types,coercible,equalizer,ruby-yadis,flexmock,mocha,erubis,activerecord,markaby,metaid,mab,ParseTree,escape_utils,eventmachine-le,preforker,simple_oauth,naught,http,buftok,jbundler,aws-sdk,logstash-codec-plain,docile,simplecov-html,lockfile,rspec-mocks,cucumber,syntax,spicycode-rcov,rest-client,colorize,xml-simple,logstash-filter-grok,logstash-patterns-core,logstash-codec-line,edn,murmurhash3,jruby-openssl,geoip,metriks,user_agent_parser,logstash-codec-json,elasticsearch,ftw,awesome_print,jls-grok,bindata,jruby-win32ole,logstash-output-null,logstash-input-generator,xmpp4r,ffi-rzmq,msgpack-jruby,msgpack,logstash-filter-date,logstash-filter-mutate,insist,minitar,gem_publisher,filewatch,manticore,stud,concurrent-ruby,logstash-codec-json_lines,redis,mail,cinch,logstash-input-tcp,march_hare,bunny,jls-lumberjack,snmp,logstash-mixin-aws,gelf,gelfd,jruby-kafka,gmetric,rufus-scheduler,twitter,logstash-filter-json,logstash-output-file,ruby-maven-libs,archive-tar-minitar,win32console,method_source,slop,coderay,yard,tilt,mongrel,shotgun,rack-test,rack-protection,test-spec,camping,fcgi,ruby-openid,thin,facets,virtus,statsd-ruby
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=bones,rubyforge,ZenTest,termios,rspec,rcov,json,multi_json,bcrypt,needle,jruby-pageant,echoe,psych,net-ssh,sexp_processor,git,safe_yaml,activesupport,rake,highline,gemcutter,allison,rdoc,hoe,bones-rcov,bones-rubyforge,bones-rspec,bones-zentest,curses,builder,i18n,bcrypt-ruby,faraday,httpauth,rack,jwt,faraday-middleware,multi_xml,backports,ice_nine,thread_safe,memoizable,jmespath,jamespath,blankslate,crack,jnunemaker-crack,hashie,oauth2,roauth
HTTP 200 OK
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=multipart-post,addressable,spoon,configuration,ffi,minitest,spruz,launchy,json_pure,net-scp,trollop,term-ansicolor,mkrf,rake-compiler,tzinfo,memcache-client,atomic,adamantium,descendants_tracker,gherkin,nokogiri,aws-sdk-core,RubyInline,SexpProcessor,metaclass,form_data,http_parser.rb,certified,abstract,little-plugger,loquacious,bones-git,bones-extras,jar-dependencies,bundler,ruby-maven,maven-tools,thor,arel,activemodel,activerecord-deprecated_finders,elasticsearch-api,elasticsearch-transport,ffi-rzmq-core,diff-lcs,rspec-support,rspec-core,rspec-expectations,mime-types,tlsmail
HTTP 200 OK
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=treetop,cabin,eventmachine,multi_test,cucumber-core,polyglot,tins,simplecov,amq-protocol,netrc,mini_portile,racc,tenderlove-frex,rexical,weakling,bouncy-castle-java,avl_tree,hitimes,rbtree,faraday_middleware,yajl-ruby,parslet,ref,functional-ruby,logstash,aws-sdk-resources,aws-sdk-v1,uuidtools,httparty,ruby_parser,daemons,fastthread,gem_plugin,cgi_multipart_eof_fix,axiom-types,coercible,equalizer,ruby-yadis,flexmock,mocha,erubis,activerecord,markaby,metaid,mab,ParseTree,escape_utils,eventmachine-le,preforker,simple_oauth
HTTP 200 OK
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=naught,http,buftok,jbundler,aws-sdk,logstash-codec-plain,docile,simplecov-html,lockfile,rspec-mocks,cucumber,syntax,spicycode-rcov,rest-client,colorize,xml-simple,logstash-filter-grok,logstash-patterns-core,logstash-codec-line,edn,murmurhash3,jruby-openssl,geoip,metriks,user_agent_parser,logstash-codec-json,elasticsearch,ftw,awesome_print,jls-grok,bindata,jruby-win32ole,logstash-output-null,logstash-input-generator,xmpp4r,ffi-rzmq,msgpack-jruby,msgpack,logstash-filter-date,logstash-filter-mutate,insist,minitar,gem_publisher,filewatch,manticore,stud,concurrent-ruby,logstash-codec-json_lines,redis,mail
HTTP 200 OK
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=cinch,logstash-input-tcp,march_hare,bunny,jls-lumberjack,snmp,logstash-mixin-aws,gelf,gelfd,jruby-kafka,gmetric,rufus-scheduler,twitter,logstash-filter-json,logstash-output-file,ruby-maven-libs,archive-tar-minitar,win32console,method_source,slop,coderay,yard,tilt,mongrel,shotgun,rack-test,rack-protection,test-spec,camping,fcgi,ruby-openid,thin,facets,virtus,statsd-ruby
HTTP 200 OK
Query List: ["faraday-middleware", "logstash"]
Query Gemcutter Dependency Endpoint API: faraday-middleware,logstash
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=faraday-middleware,logstash
HTTP 200 OK
Query List: []
Fetching dependency metadata from https://rubygems.org/
Query List: ["faraday-middleware", "logstash"]
Query Gemcutter Dependency Endpoint API: faraday-middleware,logstash
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=faraday-middleware,logstash
HTTP 200 OK
Query List: []
Resolving dependencies...
Error: Bundler::GemNotFound, Could not find gem '/tmp/logstash-input-kafka-0.1.9.gem (>= 0) java' in the gems available on this machine.
Installation aborted
colinsurprenant commented 9 years ago

@joekiller you cannot install a local .gem file with in the current master/1.5 branch using bin/plugin install --no-verify ~/path/to/the-plugin/mynewplugin.gem

you have to add it manually in the Gemfile :

gem 'mynewplugin', :path => '~/path/to/the-plugin'

and execute:

bin/plugin install --no-verify
colinsurprenant commented 9 years ago

@joekiller arggghh sorry, you cannot specify a path to a .gem file in Gemfile, only a path to a local gem DIRECTORY.

so, do not build your gem, simply point :path to the directory containing your gem development and this will work.

joekiller commented 9 years ago

@colinsurprenant yup I got it to install with the non-built gem directory as you said. I then hit 

Bundler::GemfileNotFound: Could not locate Gemfile or .bundle/ directory
                         root at /opt/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.8.2/lib/bundler.rb:198
                  bundle_path at /opt/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.8.2/lib/bundler.rb:101
  configure_gem_home_and_path at /opt/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.8.2/lib/bundler.rb:420
                    configure at /opt/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.8.2/lib/bundler.rb:92
                   definition at /opt/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.8.2/lib/bundler.rb:153
                        setup at /opt/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.8.2/lib/bundler.rb:118
               bundler_setup! at /opt/logstash/lib/logstash/environment.rb:100
                       (root) at /opt/logstash/lib/logstash/runner.rb:8

Interestingly enough, if I run the process via the logstash user, it works so it might be a startup script issue at this point. Still digging...

colinsurprenant commented 9 years ago

@joekiller are you running directly from master or are you generating a .rpm/.deb ? we are actually at the point of testing the .rpm/.deb artifacts. we know the .tar.gz is good but there is likely some issues with the OS packages.

joekiller commented 9 years ago

Running out of /opt/logstash after installing the rpm

joekiller commented 9 years ago

So I get the GemfileNotFound error if I'm not in /opt/logstash when I run the bin/logstash -f /path/to/configs runs fine when I launch within the directory. Diffing the debug output of the scripts yields no difference. Diggin more :)

joekiller commented 9 years ago

lol, just saw #2671 come through on master and that might fix this second part. Testing...

joekiller commented 9 years ago

Nope. Opening another issue for the GemfileNotFound. I have narrowed it down.

ph commented 9 years ago

@joekiller Can you check if you have a .bundle/config in your logstash directory? Can you try to delete it and retry?

joekiller commented 9 years ago

Yeah everything works if I delete .bundle/config #2681 gives the details of the bug otherwise.

suyograo commented 9 years ago

Closing this in lieu of #2681