search

elastic / logstash

Logstash - transport and process your logs, events, or other data
https://www.elastic.co/products/logstash
Other
14.18k stars 3.49k forks source link

HTTP_PROXY and HTTPS_PROXY environment variables are not correctly respected when jar-dependency fetch the pom. #6044

Closed tronicum closed 7 years ago

tronicum commented 7 years ago

Trying to build docker image, changed from logstash:latest to logstash:5

Building logstash
Step 1 : FROM logstash:5
 ---> b8378ec492c6
Step 2 : ENV http_proxy http://<my-corporate-proxy>:80
 ---> Using cache
 ---> 9920b7ec7ddb
Step 3 : ENV https_proxy http://<my-corporate-proxy>:80
 ---> Using cache
 ---> 5b3303a3253c
Step 4 : RUN logstash-plugin update logstash-input-beats
 ---> Running in 9388ecc74a70
Updating logstash-input-beats
Error Bundler::InstallError, retrying 1/10
An error occurred while installing logstash-core-event-java (5.0.0.pre.rc1), and Bundler cannot continue.
Make sure that `gem install logstash-core-event-java -v '5.0.0.pre.rc1'` succeeds before bundling.
WARNING: SSLSocket#session= is not supported
Error Bundler::InstallError, retrying 2/10
An error occurred while installing logstash-core-event-java (5.0.0.pre.rc1), and Bundler cannot continue.
Make sure that `gem install logstash-core-event-java -v '5.0.0.pre.rc1'` succeeds before bundling.
WARNING: SSLSocket#session= is not supported

I changed logstash-plugin install logstash-input-beats to logstash-plugin update logstash-input-beats

as suggested in #5777 but it did not improve.

ph commented 7 years ago

@tronicum Would you add the output of the following command to this issue, this will give us a bit more idea of what is actually going on.

DEBUG=1 bin/logstash-plugin install logstash-input-beats

Also the rc1 contains the latest beats so the update isn't needed.

ph commented 7 years ago

Not this case look really similar to https://github.com/elastic/logstash/issues/5966 and https://github.com/elastic/logstash/issues/5777

ph commented 7 years ago

From the docket build log I see you are using a proxy, I am pretty sure the ENV is case sensitive and should be HTTP_PROXY, but there is some know issues concerning offline installation and the plugin manager.

Reference https://github.com/elastic/logstash/issues/5906

tronicum commented 7 years ago

yeah i noticed some Java programs require upper case HTTP_PROXY so I made the ENV to have both now and added the DEBUG=1:

Building logstash
Step 1 : FROM logstash:5
 ---> b8378ec492c6
Step 2 : ENV http_proxy http://<our-corporate-proxy>:80
 ---> Using cache
 ---> 9920b7ec7ddb
Step 3 : ENV https_proxy http://<our-corporate-proxy>:80
 ---> Using cache
 ---> 5b3303a3253c
Step 4 : ENV HTTP_PROXY http://<our-corporate-proxy>:80
 ---> Running in 8f0ca69c41e6
 ---> b8f26138ef12
Removing intermediate container 8f0ca69c41e6
Step 5 : ENV HTTPS_PROXY http://<our-corporate-proxy>:80
 ---> Running in f2b63a649a83
 ---> 8c078bf6b997
Removing intermediate container f2b63a649a83
Step 6 : RUN DEBUG=1 logstash-plugin update logstash-input-beats
 ---> Running in 54f85feae327
DEBUG: exec /usr/share/logstash/vendor/jruby/bin/jruby --1.9 /usr/share/logstash/lib/pluginmanager/main.rb update logstash-input-beats
Updating logstash-input-beats
HTTP GET https://bundler.rubygems.org/api/v1/dependencies
HTTP 200 OK
Fetching gem metadata from https://rubygems.org/
Query List: ["file-dependencies", "ci_reporter_rspec", "simplecov", "tins", "rspec", "logstash-devutils", "benchmark-ips", "octokit", "stud", "fpm", "rubyzip", "gems", "rack-test", "flores", "term-ansicolor", "docker-api", "pleaserun", "logstash-input-heartbeat", "logstash-codec-collectd", "logstash-output-xmpp", "logstash-codec-dots", "logstash-codec-edn", "logstash-codec-edn_lines", "logstash-codec-fluent", "logstash-codec-es_bulk", "logstash-codec-graphite", "logstash-codec-json", "logstash-codec-json_lines", "logstash-codec-line", "logstash-codec-msgpack", "logstash-codec-multiline", "logstash-codec-netflow", "logstash-codec-plain", "logstash-codec-rubydebug", "logstash-filter-clone", "logstash-filter-csv", "logstash-filter-date", "logstash-filter-dns", "logstash-filter-drop", "logstash-filter-fingerprint", "logstash-filter-geoip", "logstash-filter-grok", "logstash-filter-json", "logstash-filter-kv", "logstash-filter-metrics", "logstash-filter-mutate", "logstash-filter-ruby", "logstash-filter-sleep", "logstash-filter-split", "logstash-filter-syslog_pri", "logstash-filter-throttle", "logstash-filter-urldecode", "logstash-filter-useragent", "logstash-filter-uuid", "logstash-filter-xml", "logstash-input-couchdb_changes", "logstash-input-elasticsearch", "logstash-input-exec", "logstash-input-file", "logstash-input-ganglia", "logstash-input-gelf", "logstash-input-generator", "logstash-input-graphite", "logstash-input-http", "logstash-input-http_poller", "logstash-input-imap", "logstash-input-irc", "logstash-input-jdbc", "logstash-input-log4j", "logstash-input-lumberjack", "logstash-input-pipe", "logstash-input-rabbitmq", "logstash-input-redis", "logstash-input-s3", "logstash-input-snmptrap", "logstash-input-sqs", "logstash-input-stdin", "logstash-input-syslog", "logstash-input-tcp", "logstash-input-twitter", "logstash-input-udp", "logstash-input-unix", "logstash-input-xmpp", "logstash-input-kafka", "logstash-input-beats", "logstash-output-cloudwatch", "logstash-output-csv", "logstash-output-elasticsearch", "logstash-output-file", "logstash-output-graphite", "logstash-output-http", "logstash-output-irc", "logstash-output-kafka", "logstash-output-nagios", "logstash-output-null", "logstash-output-pagerduty", "logstash-output-pipe", "logstash-output-rabbitmq", "logstash-output-redis", "logstash-output-s3", "logstash-output-sns", "logstash-output-sqs", "logstash-output-statsd", "logstash-output-stdout", "logstash-output-tcp", "logstash-output-udp", "logstash-output-webhdfs", "jar-dependencies", "ruby-maven", "logstash-core-event-java", "pry", "clamp", "filesize", "concurrent-ruby", "sinatra", "puma", "jruby-openssl", "chronic_duration", "jrmonitor", "treetop", "i18n", "minitar", "thread_safe", "jrjackson"]
Query Gemcutter Dependency Endpoint API: file-dependencies,ci_reporter_rspec,simplecov,tins,rspec,logstash-devutils,benchmark-ips,octokit,stud,fpm,rubyzip,gems,rack-test,flores,term-ansicolor,docker-api,pleaserun,logstash-input-heartbeat,logstash-codec-collectd,logstash-output-xmpp,logstash-codec-dots,logstash-codec-edn,logstash-codec-edn_lines,logstash-codec-fluent,logstash-codec-es_bulk,logstash-codec-graphite,logstash-codec-json,logstash-codec-json_lines,logstash-codec-line,logstash-codec-msgpack,logstash-codec-multiline,logstash-codec-netflow,logstash-codec-plain,logstash-codec-rubydebug,logstash-filter-clone,logstash-filter-csv,logstash-filter-date,logstash-filter-dns,logstash-filter-drop,logstash-filter-fingerprint,logstash-filter-geoip,logstash-filter-grok,logstash-filter-json,logstash-filter-kv,logstash-filter-metrics,logstash-filter-mutate,logstash-filter-ruby,logstash-filter-sleep,logstash-filter-split,logstash-filter-syslog_pri,logstash-filter-throttle,logstash-filter-urldecode,logstash-filter-useragent,logstash-filter-uuid,logstash-filter-xml,logstash-input-couchdb_changes,logstash-input-elasticsearch,logstash-input-exec,logstash-input-file,logstash-input-ganglia,logstash-input-gelf,logstash-input-generator,logstash-input-graphite,logstash-input-http,logstash-input-http_poller,logstash-input-imap,logstash-input-irc,logstash-input-jdbc,logstash-input-log4j,logstash-input-lumberjack,logstash-input-pipe,logstash-input-rabbitmq,logstash-input-redis,logstash-input-s3,logstash-input-snmptrap,logstash-input-sqs,logstash-input-stdin,logstash-input-syslog,logstash-input-tcp,logstash-input-twitter,logstash-input-udp,logstash-input-unix,logstash-input-xmpp,logstash-input-kafka,logstash-input-beats,logstash-output-cloudwatch,logstash-output-csv,logstash-output-elasticsearch,logstash-output-file,logstash-output-graphite,logstash-output-http,logstash-output-irc,logstash-output-kafka,logstash-output-nagios,logstash-output-null,logstash-output-pagerduty,logstash-output-pipe,logstash-output-rabbitmq,logstash-output-redis,logstash-output-s3,logstash-output-sns,logstash-output-sqs,logstash-output-statsd,logstash-output-stdout,logstash-output-tcp,logstash-output-udp,logstash-output-webhdfs,jar-dependencies,ruby-maven,logstash-core-event-java,pry,clamp,filesize,concurrent-ruby,sinatra,puma,jruby-openssl,chronic_duration,jrmonitor,treetop,i18n,minitar,thread_safe,jrjackson
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=file-dependencies,ci_reporter_rspec,simplecov,tins,rspec,logstash-devutils,benchmark-ips,octokit,stud,fpm,rubyzip,gems,rack-test,flores,term-ansicolor,docker-api,pleaserun,logstash-input-heartbeat,logstash-codec-collectd,logstash-output-xmpp,logstash-codec-dots,logstash-codec-edn,logstash-codec-edn_lines,logstash-codec-fluent,logstash-codec-es_bulk,logstash-codec-graphite,logstash-codec-json,logstash-codec-json_lines,logstash-codec-line,logstash-codec-msgpack,logstash-codec-multiline,logstash-codec-netflow,logstash-codec-plain,logstash-codec-rubydebug,logstash-filter-clone,logstash-filter-csv,logstash-filter-date,logstash-filter-dns,logstash-filter-drop,logstash-filter-fingerprint,logstash-filter-geoip,logstash-filter-grok,logstash-filter-json,logstash-filter-kv,logstash-filter-metrics,logstash-filter-mutate,logstash-filter-ruby,logstash-filter-sleep,logstash-filter-split,logstash-filter-syslog_pri
HTTP 200 OK
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=logstash-filter-throttle,logstash-filter-urldecode,logstash-filter-useragent,logstash-filter-uuid,logstash-filter-xml,logstash-input-couchdb_changes,logstash-input-elasticsearch,logstash-input-exec,logstash-input-file,logstash-input-ganglia,logstash-input-gelf,logstash-input-generator,logstash-input-graphite,logstash-input-http,logstash-input-http_poller,logstash-input-imap,logstash-input-irc,logstash-input-jdbc,logstash-input-log4j,logstash-input-lumberjack,logstash-input-pipe,logstash-input-rabbitmq,logstash-input-redis,logstash-input-s3,logstash-input-snmptrap,logstash-input-sqs,logstash-input-stdin,logstash-input-syslog,logstash-input-tcp,logstash-input-twitter,logstash-input-udp,logstash-input-unix,logstash-input-xmpp,logstash-input-kafka,logstash-input-beats,logstash-output-cloudwatch,logstash-output-csv,logstash-output-elasticsearch,logstash-output-file,logstash-output-graphite,logstash-output-http,logstash-output-irc,logstash-output-kafka,logstash-output-nagios,logstash-output-null,logstash-output-pagerduty,logstash-output-pipe,logstash-output-rabbitmq,logstash-output-redis,logstash-output-s3
HTTP 200 OK
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=logstash-output-sns,logstash-output-sqs,logstash-output-statsd,logstash-output-stdout,logstash-output-tcp,logstash-output-udp,logstash-output-webhdfs,jar-dependencies,ruby-maven,logstash-core-event-java,pry,clamp,filesize,concurrent-ruby,sinatra,puma,jruby-openssl,chronic_duration,jrmonitor,treetop,i18n,minitar,thread_safe,jrjackson
HTTP 200 OK
Query List: ["ci_reporter", "multi_json", "simplecov-html", "lockfile", "docile", "json", "cucumber", "hoe", "rspec-core", "rspec-expectations", "rspec-mocks", "diff-lcs", "syntax", "spicycode-rcov", "gem_publisher", "rake", "fivemat", "kramdown", "insist", "logstash-core-plugin-api", "rspec-wait", "sawyer", "addressable", "faraday", "faraday_middleware", "hashie", "multi_xml", "netrc", "rash", "metriks", "ffi", "cabin", "backports", "arr-pm", "open4", "childprocess", "ftw", "ruby-xz", "archive-tar-minitar", "corefines", "rack", "excon", "multipart-post", "mustache", "ohai", "logstash-core", "logstash", "xmpp4r", "edn", "msgpack-jruby", "msgpack", "jls-grok", "logstash-patterns-core", "bindata", "awesome_print", "lru_redux", "murmurhash3", "geoip", "atomic", "user_agent_parser", "xml-simple", "nokogiri", "elasticsearch", "filewatch", "gelfd", "gelf", "logstash-mixin-http_client", "manticore", "rufus-scheduler", "mail", "mime-types", "cinch", "sequel", "tzinfo-data", "tzinfo", "maven-tools", "jls-lumberjack", "logstash-mixin-rabbitmq_connection", "march_hare", "bunny", "redis", "aws-sdk", "logstash-mixin-aws", "snmp", "jruby-stdin-channel", "twitter", "jruby-kafka", "statsd-ruby", "snappy", "webhdfs", "ruby-maven-libs", "thor", "ruby_parser", "coderay", "method_source", "slop", "spoon", "win32console", "yard", "functional-ruby", "ref", "tilt", "mongrel", "rack-protection", "mustermann", "shotgun", "bouncy-castle-java", "numerizer", "polyglot", "facets"]
Query Gemcutter Dependency Endpoint API: ci_reporter,multi_json,simplecov-html,lockfile,docile,json,cucumber,hoe,rspec-core,rspec-expectations,rspec-mocks,diff-lcs,syntax,spicycode-rcov,gem_publisher,rake,fivemat,kramdown,insist,logstash-core-plugin-api,rspec-wait,sawyer,addressable,faraday,faraday_middleware,hashie,multi_xml,netrc,rash,metriks,ffi,cabin,backports,arr-pm,open4,childprocess,ftw,ruby-xz,archive-tar-minitar,corefines,rack,excon,multipart-post,mustache,ohai,logstash-core,logstash,xmpp4r,edn,msgpack-jruby,msgpack,jls-grok,logstash-patterns-core,bindata,awesome_print,lru_redux,murmurhash3,geoip,atomic,user_agent_parser,xml-simple,nokogiri,elasticsearch,filewatch,gelfd,gelf,logstash-mixin-http_client,manticore,rufus-scheduler,mail,mime-types,cinch,sequel,tzinfo-data,tzinfo,maven-tools,jls-lumberjack,logstash-mixin-rabbitmq_connection,march_hare,bunny,redis,aws-sdk,logstash-mixin-aws,snmp,jruby-stdin-channel,twitter,jruby-kafka,statsd-ruby,snappy,webhdfs,ruby-maven-libs,thor,ruby_parser,coderay,method_source,slop,spoon,win32console,yard,functional-ruby,ref,tilt,mongrel,rack-protection,mustermann,shotgun,bouncy-castle-java,numerizer,polyglot,facets
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=ci_reporter,multi_json,simplecov-html,lockfile,docile,json,cucumber,hoe,rspec-core,rspec-expectations,rspec-mocks,diff-lcs,syntax,spicycode-rcov,gem_publisher,rake,fivemat,kramdown,insist,logstash-core-plugin-api,rspec-wait,sawyer,addressable,faraday,faraday_middleware,hashie,multi_xml,netrc,rash,metriks,ffi,cabin,backports,arr-pm,open4,childprocess,ftw,ruby-xz,archive-tar-minitar,corefines,rack,excon,multipart-post,mustache,ohai,logstash-core,logstash,xmpp4r,edn,msgpack-jruby
HTTP 200 OK
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=msgpack,jls-grok,logstash-patterns-core,bindata,awesome_print,lru_redux,murmurhash3,geoip,atomic,user_agent_parser,xml-simple,nokogiri,elasticsearch,filewatch,gelfd,gelf,logstash-mixin-http_client,manticore,rufus-scheduler,mail,mime-types,cinch,sequel,tzinfo-data,tzinfo,maven-tools,jls-lumberjack,logstash-mixin-rabbitmq_connection,march_hare,bunny,redis,aws-sdk,logstash-mixin-aws,snmp,jruby-stdin-channel,twitter,jruby-kafka,statsd-ruby,snappy,webhdfs,ruby-maven-libs,thor,ruby_parser,coderay,method_source,slop,spoon,win32console,yard,functional-ruby
HTTP 200 OK
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=ref,tilt,mongrel,rack-protection,mustermann,shotgun,bouncy-castle-java,numerizer,polyglot,facets
HTTP 200 OK
Query List: ["builder", "gherkin", "json_pure", "multi_test", "cucumber-core", "event-bus", "cucumber-wire", "gherkin3", "RubyInline", "rubyforge", "gemcutter", "rspec-support", "uri_template", "yajl-ruby", "launchy", "oauth2", "roauth", "hitimes", "avl_tree", "rbtree", "bones", "http_parser.rb", "minitest", "io-like", "test-spec", "camping", "fcgi", "memcache-client", "ruby-openid", "thin", "chef-config", "wmi-lite", "ipaddress", "plist", "mixlib-shellout", "mixlib-log", "mixlib-config", "mixlib-cli", "ffi-yajl", "systemu", "net-dhcp", "extlib", "logstash-core-event", "jruby-monitoring", "jruby-httpclient", "oj", "parslet", "eventmachine", "logstash", "racc", "rexical", "rake-compiler", "mini_portile2", "mini_portile", "tenderlove-frex", "weakling", "pkg-config", "elasticsearch-transport", "elasticsearch-api", "activesupport", "tlsmail", "rcov", "mime-types-data", "metaid", "ParseTree", "ruby2ruby", "sequel_core", "sequel_model", "assistance", "virtus", "amq-protocol", "uuidtools", "httparty", "aws-sdk-resources", "aws-sdk-v1", "buftok", "http", "simple_oauth", "descendants_tracker", "equalizer", "memoizable", "naught", "jbundler", "snappy-jars", "rest-client", "sexp_processor", "erubis", "daemons", "gem_plugin", "cgi_multipart_eof_fix", "fastthread", "escape_utils", "tool"]
Query Gemcutter Dependency Endpoint API: builder,gherkin,json_pure,multi_test,cucumber-core,event-bus,cucumber-wire,gherkin3,RubyInline,rubyforge,gemcutter,rspec-support,uri_template,yajl-ruby,launchy,oauth2,roauth,hitimes,avl_tree,rbtree,bones,http_parser.rb,minitest,io-like,test-spec,camping,fcgi,memcache-client,ruby-openid,thin,chef-config,wmi-lite,ipaddress,plist,mixlib-shellout,mixlib-log,mixlib-config,mixlib-cli,ffi-yajl,systemu,net-dhcp,extlib,logstash-core-event,jruby-monitoring,jruby-httpclient,oj,parslet,eventmachine,logstash,racc,rexical,rake-compiler,mini_portile2,mini_portile,tenderlove-frex,weakling,pkg-config,elasticsearch-transport,elasticsearch-api,activesupport,tlsmail,rcov,mime-types-data,metaid,ParseTree,ruby2ruby,sequel_core,sequel_model,assistance,virtus,amq-protocol,uuidtools,httparty,aws-sdk-resources,aws-sdk-v1,buftok,http,simple_oauth,descendants_tracker,equalizer,memoizable,naught,jbundler,snappy-jars,rest-client,sexp_processor,erubis,daemons,gem_plugin,cgi_multipart_eof_fix,fastthread,escape_utils,tool
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=builder,gherkin,json_pure,multi_test,cucumber-core,event-bus,cucumber-wire,gherkin3,RubyInline,rubyforge,gemcutter,rspec-support,uri_template,yajl-ruby,launchy,oauth2,roauth,hitimes,avl_tree,rbtree,bones,http_parser.rb,minitest,io-like,test-spec,camping,fcgi,memcache-client,ruby-openid,thin,chef-config,wmi-lite,ipaddress,plist,mixlib-shellout,mixlib-log,mixlib-config,mixlib-cli,ffi-yajl,systemu,net-dhcp,extlib,logstash-core-event,jruby-monitoring,jruby-httpclient,oj,parslet,eventmachine,logstash,racc
HTTP 200 OK
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=rexical,rake-compiler,mini_portile2,mini_portile,tenderlove-frex,weakling,pkg-config,elasticsearch-transport,elasticsearch-api,activesupport,tlsmail,rcov,mime-types-data,metaid,ParseTree,ruby2ruby,sequel_core,sequel_model,assistance,virtus,amq-protocol,uuidtools,httparty,aws-sdk-resources,aws-sdk-v1,buftok,http,simple_oauth,descendants_tracker,equalizer,memoizable,naught,jbundler,snappy-jars,rest-client,sexp_processor,erubis,daemons,gem_plugin,cgi_multipart_eof_fix,fastthread,escape_utils,tool
HTTP 200 OK
Query List: ["trollop", "spruz", "ZenTest", "net-scp", "configuration", "jwt", "httpauth", "faraday-middleware", "mkrf", "little-plugger", "loquacious", "rdoc", "bones-git", "bones-extras", "flexmock", "mocha", "activerecord", "markaby", "mab", "ruby-yadis", "eventmachine-le", "preforker", "fuzzyurl", "win32-process", "windows-pr", "windows-api", "win32-api", "libyajl2", "pcap", "english", "blankslate", "system_timer", "SexpProcessor", "validatable", "coercible", "axiom-types", "echoe", "crack", "jnunemaker-crack", "aws-sdk-core", "http-form_data", "http-cookie", "certified", "form_data", "adamantium", "bundler", "abstract"]
Query Gemcutter Dependency Endpoint API: trollop,spruz,ZenTest,net-scp,configuration,jwt,httpauth,faraday-middleware,mkrf,little-plugger,loquacious,rdoc,bones-git,bones-extras,flexmock,mocha,activerecord,markaby,mab,ruby-yadis,eventmachine-le,preforker,fuzzyurl,win32-process,windows-pr,windows-api,win32-api,libyajl2,pcap,english,blankslate,system_timer,SexpProcessor,validatable,coercible,axiom-types,echoe,crack,jnunemaker-crack,aws-sdk-core,http-form_data,http-cookie,certified,form_data,adamantium,bundler,abstract
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=trollop,spruz,ZenTest,net-scp,configuration,jwt,httpauth,faraday-middleware,mkrf,little-plugger,loquacious,rdoc,bones-git,bones-extras,flexmock,mocha,activerecord,markaby,mab,ruby-yadis,eventmachine-le,preforker,fuzzyurl,win32-process,windows-pr,windows-api,win32-api,libyajl2,pcap,english,blankslate,system_timer,SexpProcessor,validatable,coercible,axiom-types,echoe,crack,jnunemaker-crack,aws-sdk-core,http-form_data,http-cookie,certified,form_data,adamantium,bundler,abstract
HTTP 200 OK
Query List: ["curses", "net-ssh", "git", "bones-rcov", "bones-rubyforge", "bones-rspec", "bones-zentest", "metaclass", "activemodel", "arel", "activerecord-deprecated_finders", "test-unit", "language", "ice_nine", "highline", "allison", "safe_yaml", "jamespath", "jmespath", "domain_name", "sqlite3"]
Query Gemcutter Dependency Endpoint API: curses,net-ssh,git,bones-rcov,bones-rubyforge,bones-rspec,bones-zentest,metaclass,activemodel,arel,activerecord-deprecated_finders,test-unit,language,ice_nine,highline,allison,safe_yaml,jamespath,jmespath,domain_name,sqlite3
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=curses,net-ssh,git,bones-rcov,bones-rubyforge,bones-rspec,bones-zentest,metaclass,activemodel,arel,activerecord-deprecated_finders,test-unit,language,ice_nine,highline,allison,safe_yaml,jamespath,jmespath,domain_name,sqlite3
HTTP 200 OK
Query List: ["needle", "bcrypt_pbkdf", "rbnacl", "rbnacl-libsodium", "jruby-pageant", "bcrypt-ruby", "power_assert", "termios", "psych", "unf"]
Query Gemcutter Dependency Endpoint API: needle,bcrypt_pbkdf,rbnacl,rbnacl-libsodium,jruby-pageant,bcrypt-ruby,power_assert,termios,psych,unf
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=needle,bcrypt_pbkdf,rbnacl,rbnacl-libsodium,jruby-pageant,bcrypt-ruby,power_assert,termios,psych,unf
HTTP 200 OK
Query List: ["bcrypt", "pattern-match", "unf_ext"]
Query Gemcutter Dependency Endpoint API: bcrypt,pattern-match,unf_ext
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=bcrypt,pattern-match,unf_ext
HTTP 200 OK
Query List: []
Fetching version metadata from https://rubygems.org/
Query List: ["ffi", "rbnacl", "bcrypt", "pattern-match", "jar-dependencies", "unf_ext", "echoe", "needle", "bcrypt_pbkdf", "rbnacl-libsodium", "jruby-pageant", "bones", "rcov", "rubyforge", "rspec", "ZenTest", "activesupport", "builder", "i18n", "bcrypt-ruby", "hoe", "power_assert", "termios", "psych", "json", "multi_json", "json_pure", "unf", "curses", "net-ssh", "minitest", "git", "bones-rcov", "bones-rubyforge", "bones-rspec", "bones-zentest", "rake", "metaclass", "activemodel", "arel", "tzinfo", "activerecord-deprecated_finders", "windows-pr", "windows-api", "win32-api", "test-unit", "facets", "language", "sexp_processor", "backports", "descendants_tracker", "ice_nine", "thread_safe", "highline", "gemcutter", "allison", "rdoc", "safe_yaml", "jamespath", "multi_xml", "jmespath", "domain_name", "sqlite3", "memoizable", "trollop", "term-ansicolor", "spruz", "gherkin", "gherkin3", "net-scp", "addressable", "spoon", "configuration", "rack", "jwt", "faraday", "httpauth", "faraday-middleware", "mkrf", "rake-compiler", "atomic", "little-plugger", "loquacious", "bones-git", "bones-extras", "flexmock", "mocha", "activerecord", "markaby", "metaid", "mab", "RubyInline", "ruby-yadis", "daemons", "eventmachine", "eventmachine-le", "http_parser.rb", "preforker", "mixlib-config", "mixlib-shellout", "fuzzyurl", "wmi-lite", "win32-process", "libyajl2", "pcap", "english", "blankslate", "system_timer", "memcache-client", "concurrent-ruby", "method_source", "SexpProcessor", "ruby_parser", "ParseTree", "assistance", "ruby2ruby", "sequel", "sequel_core", "validatable", "equalizer", "coercible", "axiom-types", "launchy", "crack", "jnunemaker-crack", "aws-sdk-core", "nokogiri", "http-form_data", "http-cookie", "certified", "form_data", "adamantium", "ruby-maven", "maven-tools", "thor", "bundler", "mime-types", "netrc", "abstract", "simplecov", "treetop", "diff-lcs", "multi_test", "polyglot", "cucumber-core", "event-bus", "cucumber-wire", "rspec-support", "rspec-core", "rspec-expectations", "cabin", "logstash-core", "uri_template", "yajl-ruby", "multipart-post", "hashie", "oauth2", "roauth", "hitimes", "avl_tree", "rbtree", "faraday_middleware", "io-like", "test-spec", "camping", "fcgi", "mongrel", "ruby-openid", "thin", "chef-config", "ipaddress", "plist", "mixlib-log", "mixlib-cli", "ffi-yajl", "systemu", "net-dhcp", "extlib", "jrjackson", "rubyzip", "minitar", "jruby-openssl", "gems", "filesize", "clamp", "stud", "pry", "logstash-core-event", "jruby-monitoring", "chronic_duration", "puma", "sinatra", "logstash-core-event-java", "jrmonitor", "jruby-httpclient", "file-dependencies", "ftw", "oj", "parslet", "logstash-core-plugin-api", "logstash", "racc", "rexical", "mini_portile2", "mini_portile", "tenderlove-frex", "weakling", "pkg-config", "elasticsearch-transport", "elasticsearch-api", "manticore", "logstash-codec-plain", "tlsmail", "archive-tar-minitar", "mime-types-data", "sequel_model", "virtus", "march_hare", "amq-protocol", "uuidtools", "httparty", "aws-sdk-resources", "aws-sdk-v1", "aws-sdk", "buftok", "http", "simple_oauth", "naught", "jbundler", "snappy-jars", "rest-client", "erubis", "gem_plugin", "cgi_multipart_eof_fix", "fastthread", "escape_utils", "tool", "ci_reporter", "simplecov-html", "lockfile", "docile", "cucumber", "rspec-mocks", "syntax", "spicycode-rcov", "gem_publisher", "fivemat", "kramdown", "insist", "rspec-wait", "sawyer", "rash", "metriks", "arr-pm", "open4", "childprocess", "pleaserun", "ruby-xz", "corefines", "tins", "excon", "mustache", "ohai", "xmpp4r", "edn", "logstash-codec-line", "msgpack-jruby", "msgpack", "jls-grok", "logstash-patterns-core", "bindata", "awesome_print", "logstash-output-null", "logstash-codec-json", "logstash-input-generator", "lru_redux", "murmurhash3", "geoip", "logstash-filter-grok", "logstash-filter-date", "user_agent_parser", "xml-simple", "elasticsearch", "logstash-codec-multiline", "filewatch", "gelfd", "gelf", "logstash-input-tcp", "logstash-mixin-http_client", "rufus-scheduler", "mail", "cinch", "tzinfo-data", "jls-lumberjack", "logstash-mixin-rabbitmq_connection", "bunny", "redis", "logstash-mixin-aws", "snmp", "logstash-codec-json_lines", "jruby-stdin-channel", "twitter", "jruby-kafka", "logstash-filter-json", "logstash-output-file", "statsd-ruby", "snappy", "webhdfs", "ruby-maven-libs", "coderay", "slop", "win32console", "yard", "functional-ruby", "ref", "tilt", "rack-protection", "mustermann", "shotgun", "rack-test", "bouncy-castle-java", "numerizer"]
Query Gemcutter Dependency Endpoint API: ffi,rbnacl,bcrypt,pattern-match,jar-dependencies,unf_ext,echoe,needle,bcrypt_pbkdf,rbnacl-libsodium,jruby-pageant,bones,rcov,rubyforge,rspec,ZenTest,activesupport,builder,i18n,bcrypt-ruby,hoe,power_assert,termios,psych,json,multi_json,json_pure,unf,curses,net-ssh,minitest,git,bones-rcov,bones-rubyforge,bones-rspec,bones-zentest,rake,metaclass,activemodel,arel,tzinfo,activerecord-deprecated_finders,windows-pr,windows-api,win32-api,test-unit,facets,language,sexp_processor,backports,descendants_tracker,ice_nine,thread_safe,highline,gemcutter,allison,rdoc,safe_yaml,jamespath,multi_xml,jmespath,domain_name,sqlite3,memoizable,trollop,term-ansicolor,spruz,gherkin,gherkin3,net-scp,addressable,spoon,configuration,rack,jwt,faraday,httpauth,faraday-middleware,mkrf,rake-compiler,atomic,little-plugger,loquacious,bones-git,bones-extras,flexmock,mocha,activerecord,markaby,metaid,mab,RubyInline,ruby-yadis,daemons,eventmachine,eventmachine-le,http_parser.rb,preforker,mixlib-config,mixlib-shellout,fuzzyurl,wmi-lite,win32-process,libyajl2,pcap,english,blankslate,system_timer,memcache-client,concurrent-ruby,method_source,SexpProcessor,ruby_parser,ParseTree,assistance,ruby2ruby,sequel,sequel_core,validatable,equalizer,coercible,axiom-types,launchy,crack,jnunemaker-crack,aws-sdk-core,nokogiri,http-form_data,http-cookie,certified,form_data,adamantium,ruby-maven,maven-tools,thor,bundler,mime-types,netrc,abstract,simplecov,treetop,diff-lcs,multi_test,polyglot,cucumber-core,event-bus,cucumber-wire,rspec-support,rspec-core,rspec-expectations,cabin,logstash-core,uri_template,yajl-ruby,multipart-post,hashie,oauth2,roauth,hitimes,avl_tree,rbtree,faraday_middleware,io-like,test-spec,camping,fcgi,mongrel,ruby-openid,thin,chef-config,ipaddress,plist,mixlib-log,mixlib-cli,ffi-yajl,systemu,net-dhcp,extlib,jrjackson,rubyzip,minitar,jruby-openssl,gems,filesize,clamp,stud,pry,logstash-core-event,jruby-monitoring,chronic_duration,puma,sinatra,logstash-core-event-java,jrmonitor,jruby-httpclient,file-dependencies,ftw,oj,parslet,logstash-core-plugin-api,logstash,racc,rexical,mini_portile2,mini_portile,tenderlove-frex,weakling,pkg-config,elasticsearch-transport,elasticsearch-api,manticore,logstash-codec-plain,tlsmail,archive-tar-minitar,mime-types-data,sequel_model,virtus,march_hare,amq-protocol,uuidtools,httparty,aws-sdk-resources,aws-sdk-v1,aws-sdk,buftok,http,simple_oauth,naught,jbundler,snappy-jars,rest-client,erubis,gem_plugin,cgi_multipart_eof_fix,fastthread,escape_utils,tool,ci_reporter,simplecov-html,lockfile,docile,cucumber,rspec-mocks,syntax,spicycode-rcov,gem_publisher,fivemat,kramdown,insist,rspec-wait,sawyer,rash,metriks,arr-pm,open4,childprocess,pleaserun,ruby-xz,corefines,tins,excon,mustache,ohai,xmpp4r,edn,logstash-codec-line,msgpack-jruby,msgpack,jls-grok,logstash-patterns-core,bindata,awesome_print,logstash-output-null,logstash-codec-json,logstash-input-generator,lru_redux,murmurhash3,geoip,logstash-filter-grok,logstash-filter-date,user_agent_parser,xml-simple,elasticsearch,logstash-codec-multiline,filewatch,gelfd,gelf,logstash-input-tcp,logstash-mixin-http_client,rufus-scheduler,mail,cinch,tzinfo-data,jls-lumberjack,logstash-mixin-rabbitmq_connection,bunny,redis,logstash-mixin-aws,snmp,logstash-codec-json_lines,jruby-stdin-channel,twitter,jruby-kafka,logstash-filter-json,logstash-output-file,statsd-ruby,snappy,webhdfs,ruby-maven-libs,coderay,slop,win32console,yard,functional-ruby,ref,tilt,rack-protection,mustermann,shotgun,rack-test,bouncy-castle-java,numerizer
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=ffi,rbnacl,bcrypt,pattern-match,jar-dependencies,unf_ext,echoe,needle,bcrypt_pbkdf,rbnacl-libsodium,jruby-pageant,bones,rcov,rubyforge,rspec,ZenTest,activesupport,builder,i18n,bcrypt-ruby,hoe,power_assert,termios,psych,json,multi_json,json_pure,unf,curses,net-ssh,minitest,git,bones-rcov,bones-rubyforge,bones-rspec,bones-zentest,rake,metaclass,activemodel,arel,tzinfo,activerecord-deprecated_finders,windows-pr,windows-api,win32-api,test-unit,facets,language,sexp_processor,backports
HTTP 200 OK
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=descendants_tracker,ice_nine,thread_safe,highline,gemcutter,allison,rdoc,safe_yaml,jamespath,multi_xml,jmespath,domain_name,sqlite3,memoizable,trollop,term-ansicolor,spruz,gherkin,gherkin3,net-scp,addressable,spoon,configuration,rack,jwt,faraday,httpauth,faraday-middleware,mkrf,rake-compiler,atomic,little-plugger,loquacious,bones-git,bones-extras,flexmock,mocha,activerecord,markaby,metaid,mab,RubyInline,ruby-yadis,daemons,eventmachine,eventmachine-le,http_parser.rb,preforker,mixlib-config,mixlib-shellout
HTTP 200 OK
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=fuzzyurl,wmi-lite,win32-process,libyajl2,pcap,english,blankslate,system_timer,memcache-client,concurrent-ruby,method_source,SexpProcessor,ruby_parser,ParseTree,assistance,ruby2ruby,sequel,sequel_core,validatable,equalizer,coercible,axiom-types,launchy,crack,jnunemaker-crack,aws-sdk-core,nokogiri,http-form_data,http-cookie,certified,form_data,adamantium,ruby-maven,maven-tools,thor,bundler,mime-types,netrc,abstract,simplecov,treetop,diff-lcs,multi_test,polyglot,cucumber-core,event-bus,cucumber-wire,rspec-support,rspec-core,rspec-expectations
HTTP 200 OK
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=cabin,logstash-core,uri_template,yajl-ruby,multipart-post,hashie,oauth2,roauth,hitimes,avl_tree,rbtree,faraday_middleware,io-like,test-spec,camping,fcgi,mongrel,ruby-openid,thin,chef-config,ipaddress,plist,mixlib-log,mixlib-cli,ffi-yajl,systemu,net-dhcp,extlib,jrjackson,rubyzip,minitar,jruby-openssl,gems,filesize,clamp,stud,pry,logstash-core-event,jruby-monitoring,chronic_duration,puma,sinatra,logstash-core-event-java,jrmonitor,jruby-httpclient,file-dependencies,ftw,oj,parslet,logstash-core-plugin-api
HTTP 200 OK
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=logstash,racc,rexical,mini_portile2,mini_portile,tenderlove-frex,weakling,pkg-config,elasticsearch-transport,elasticsearch-api,manticore,logstash-codec-plain,tlsmail,archive-tar-minitar,mime-types-data,sequel_model,virtus,march_hare,amq-protocol,uuidtools,httparty,aws-sdk-resources,aws-sdk-v1,aws-sdk,buftok,http,simple_oauth,naught,jbundler,snappy-jars,rest-client,erubis,gem_plugin,cgi_multipart_eof_fix,fastthread,escape_utils,tool,ci_reporter,simplecov-html,lockfile,docile,cucumber,rspec-mocks,syntax,spicycode-rcov,gem_publisher,fivemat,kramdown,insist,rspec-wait
HTTP 200 OK
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=sawyer,rash,metriks,arr-pm,open4,childprocess,pleaserun,ruby-xz,corefines,tins,excon,mustache,ohai,xmpp4r,edn,logstash-codec-line,msgpack-jruby,msgpack,jls-grok,logstash-patterns-core,bindata,awesome_print,logstash-output-null,logstash-codec-json,logstash-input-generator,lru_redux,murmurhash3,geoip,logstash-filter-grok,logstash-filter-date,user_agent_parser,xml-simple,elasticsearch,logstash-codec-multiline,filewatch,gelfd,gelf,logstash-input-tcp,logstash-mixin-http_client,rufus-scheduler,mail,cinch,tzinfo-data,jls-lumberjack,logstash-mixin-rabbitmq_connection,bunny,redis,logstash-mixin-aws,snmp,logstash-codec-json_lines
HTTP 200 OK
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=jruby-stdin-channel,twitter,jruby-kafka,logstash-filter-json,logstash-output-file,statsd-ruby,snappy,webhdfs,ruby-maven-libs,coderay,slop,win32console,yard,functional-ruby,ref,tilt,rack-protection,mustermann,shotgun,rack-test,bouncy-castle-java,numerizer
HTTP 200 OK
Query List: ["faraday-middleware", "logstash", "form_data"]
Query Gemcutter Dependency Endpoint API: faraday-middleware,logstash,form_data
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=faraday-middleware,logstash,form_data
HTTP 200 OK
Query List: []
Fetching dependency metadata from https://rubygems.org/
Query List: ["faraday-middleware", "form_data", "logstash"]
Query Gemcutter Dependency Endpoint API: faraday-middleware,form_data,logstash
HTTP GET https://bundler.rubygems.org/api/v1/dependencies?gems=faraday-middleware,form_data,logstash
HTTP 200 OK
Query List: []
Resolving dependencies......................
Using addressable 2.3.8
0:  addressable (2.3.8) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/addressable-2.3.8.gemspec
Using cabin 0.9.0
0:  cabin (0.9.0) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/cabin-0.9.0.gemspec
Using arr-pm 0.0.10
0:  arr-pm (0.0.10) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/arr-pm-0.0.10.gemspec
Using atomic 1.1.99
0:  atomic (1.1.99) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/atomic-1.1.99-java.gemspec
Using avl_tree 1.2.1
0:  avl_tree (1.2.1) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/avl_tree-1.2.1.gemspec
Using awesome_print 1.7.0
0:  awesome_print (1.7.0) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/awesome_print-1.7.0.gemspec
Using jmespath 1.3.1
0:  jmespath (1.3.1) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/jmespath-1.3.1.gemspec
Using aws-sdk-core 2.3.22
0:  aws-sdk-core (2.3.22) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/aws-sdk-core-2.3.22.gemspec
Using aws-sdk-resources 2.3.22
0:  aws-sdk-resources (2.3.22) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/aws-sdk-resources-2.3.22.gemspec
Using aws-sdk 2.3.22
0:  aws-sdk (2.3.22) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/aws-sdk-2.3.22.gemspec
Using json 1.8.3
0:  json (1.8.3) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/json-1.8.3-java.gemspec
Using nokogiri 1.6.8.1
0:  nokogiri (1.6.8.1) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/nokogiri-1.6.8.1-java.gemspec
Using aws-sdk-v1 1.66.0
0:  aws-sdk-v1 (1.66.0) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/aws-sdk-v1-1.66.0.gemspec
Using backports 3.6.8
0:  backports (3.6.8) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/backports-3.6.8.gemspec
Using bindata 2.3.3
0:  bindata (2.3.3) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/bindata-2.3.3.gemspec
Using buftok 0.2.0
0:  buftok (0.2.0) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/buftok-0.2.0.gemspec
Using ffi 1.9.14
0:  ffi (1.9.14) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/ffi-1.9.14-java.gemspec
Using childprocess 0.5.9
0:  childprocess (0.5.9) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/childprocess-0.5.9.gemspec
Using numerizer 0.1.1
0:  numerizer (0.1.1) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/numerizer-0.1.1.gemspec
Using chronic_duration 0.10.6
0:  chronic_duration (0.10.6) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/chronic_duration-0.10.6.gemspec
Using cinch 2.3.2
0:  cinch (2.3.2) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/cinch-2.3.2.gemspec
Using clamp 0.6.5
0:  clamp (0.6.5) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/clamp-0.6.5.gemspec
Using coderay 1.1.1
0:  coderay (1.1.1) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/coderay-1.1.1.gemspec
Using concurrent-ruby 1.0.0
0:  concurrent-ruby (1.0.0) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/concurrent-ruby-1.0.0-java.gemspec
Using unf 0.1.4
0:  unf (0.1.4) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/unf-0.1.4-java.gemspec
Using domain_name 0.5.20160826
0:  domain_name (0.5.20160826) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/domain_name-0.5.20160826.gemspec
Using edn 1.1.1
0:  edn (1.1.1) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/edn-1.1.1.gemspec
Using multi_json 1.12.1
0:  multi_json (1.12.1) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/multi_json-1.12.1.gemspec
Using elasticsearch-api 1.1.0
0:  elasticsearch-api (1.1.0) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/elasticsearch-api-1.1.0.gemspec
Using multipart-post 2.0.0
0:  multipart-post (2.0.0) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/multipart-post-2.0.0.gemspec
Using faraday 0.9.2
0:  faraday (0.9.2) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/faraday-0.9.2.gemspec
Using elasticsearch-transport 1.1.0
0:  elasticsearch-transport (1.1.0) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/elasticsearch-transport-1.1.0.gemspec
Using elasticsearch 1.1.0
0:  elasticsearch (1.1.0) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/elasticsearch-1.1.0.gemspec
Using equalizer 0.0.10
0:  equalizer (0.0.10) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/equalizer-0.0.10.gemspec
Using minitar 0.5.4
0:  minitar (0.5.4) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/minitar-0.5.4.gemspec
Using file-dependencies 0.1.6
0:  file-dependencies (0.1.6) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/file-dependencies-0.1.6.gemspec
Using filesize 0.0.4
0:  filesize (0.0.4) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/filesize-0.0.4.gemspec
Using filewatch 0.9.0
0:  filewatch (0.9.0) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/filewatch-0.9.0.gemspec
Using fpm 1.3.3
0:  fpm (1.3.3) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/fpm-1.3.3.gemspec
Using gelfd 0.2.0
0:  gelfd (0.2.0) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/gelfd-0.2.0.gemspec
Using gems 0.8.3
0:  gems (0.8.3) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/gems-0.8.3.gemspec
Using hitimes 1.2.4
0:  hitimes (1.2.4) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/hitimes-1.2.4-java.gemspec
Using http-cookie 1.0.3
0:  http-cookie (1.0.3) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/http-cookie-1.0.3.gemspec
Using http-form_data 1.0.1
0:  http-form_data (1.0.1) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/http-form_data-1.0.1.gemspec
Using http_parser.rb 0.6.0
0:  http_parser.rb (0.6.0) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/http_parser.rb-0.6.0-java.gemspec
Using http 0.9.9
0:  http (0.9.9) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/http-0.9.9.gemspec
Using i18n 0.6.9
0:  i18n (0.6.9) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/i18n-0.6.9.gemspec
Using insist 1.0.0
0:  insist (1.0.0) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/insist-1.0.0.gemspec
Using jar-dependencies 0.3.5
0:  jar-dependencies (0.3.5) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/jar-dependencies-0.3.5.gemspec
Using jls-grok 0.11.4
0:  jls-grok (0.11.4) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/jls-grok-0.11.4.gemspec
Using jls-lumberjack 0.0.26
0:  jls-lumberjack (0.0.26) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/jls-lumberjack-0.0.26.gemspec
Using jrjackson 0.4.0
0:  jrjackson (0.4.0) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/jrjackson-0.4.0-java.gemspec
Using jrmonitor 0.4.2
0:  jrmonitor (0.4.2) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/jrmonitor-0.4.2.gemspec
Using jruby-openssl 0.9.16
0:  jruby-openssl (0.9.16) from /usr/share/logstash/vendor/jruby/lib/ruby/gems/shared/specifications/default/jruby-openssl-0.9.16-java.gemspec
Using jruby-stdin-channel 0.2.0
0:  jruby-stdin-channel (0.2.0) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/jruby-stdin-channel-0.2.0-java.gemspec
Using ruby-maven-libs 3.3.9
0:  ruby-maven-libs (3.3.9) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/ruby-maven-libs-3.3.9.gemspec
Using ruby-maven 3.3.12
0:  ruby-maven (3.3.12) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/ruby-maven-3.3.12.gemspec
  jar dependencies for logstash-core-event-java-5.0.0.pre.rc1-java.gemspec . . .
[ERROR] [ERROR] Some problems were encountered while processing the POMs:
[FATAL] Non-parseable POM /usr/share/logstash/vendor/bundle/jruby/1.9/gems/jar-dependencies-0.3.5/lib/jars/gemspec_pom.rb: only whitespace content allowed before start tag and not # (position: START_DOCUMENT seen #... @1:1)  @ line 1, column 1
 @
[ERROR] The build could not read 1 project -> [Help 1]
[ERROR]
[ERROR]   The project  (/usr/share/logstash/vendor/bundle/jruby/1.9/gems/jar-dependencies-0.3.5/lib/jars/gemspec_pom.rb) has 1 error
[ERROR]     Non-parseable POM /usr/share/logstash/vendor/bundle/jruby/1.9/gems/jar-dependencies-0.3.5/lib/jars/gemspec_pom.rb: only whitespace content allowed before start tag and not # (position: START_DOCUMENT seen #... @1:1)  @ line 1, column 1 -> [Help 2]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException
[ERROR] [Help 2] http://cwiki.apache.org/confluence/display/MAVEN/ModelParseException

Errno::ENOENT: No such file or directory - /usr/share/logstash/logstash-core-event-java/deps.lst
org/jruby/RubyIO.java:3804:in `read'
org/jruby/RubyIO.java:3987:in `read'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/jar-dependencies-0.3.5/lib/jars/installer.rb:71:in `load_from_maven'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/jar-dependencies-0.3.5/lib/jars/installer.rb:237:in `install_dependencies'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/jar-dependencies-0.3.5/lib/jars/installer.rb:224:in `do_install'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/jar-dependencies-0.3.5/lib/jars/installer.rb:170:in `vendor_jars'
/usr/share/logstash/vendor/jruby/lib/ruby/shared/jars/post_install_hook.rb:28:in `(root)'
org/jruby/RubyProc.java:281:in `call'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/source/path.rb:215:in `run_hooks'
org/jruby/RubyArray.java:1613:in `each'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/source/path.rb:214:in `run_hooks'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/source/path.rb:195:in `generate_bin'
org/jruby/RubyDir.java:341:in `chdir'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/shared_helpers.rb:53:in `chdir'
/usr/share/logstash/vendor/jruby/lib/ruby/1.9/monitor.rb:211:in `mon_synchronize'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/shared_helpers.rb:52:in `chdir'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/source/path.rb:189:in `generate_bin'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/source/path.rb:73:in `install'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/installer.rb:107:in `install_gem_from_spec'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/installer.rb:269:in `install_sequentially'
org/jruby/RubyArray.java:1613:in `each'
/usr/share/logstash/vendor/jruby/lib/ruby/1.9/forwardable.rb:201:in `each'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/installer.rb:268:in `install_sequentially'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/installer.rb:90:in `run'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/installer.rb:18:in `install'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/cli/update.rb:51:in `run'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/cli.rb:178:in `update'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/vendor/thor/lib/thor/command.rb:27:in `run'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/vendor/thor/lib/thor/invocation.rb:126:in `invoke_command'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/vendor/thor/lib/thor.rb:359:in `dispatch'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/vendor/thor/lib/thor/base.rb:440:in `start'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/cli.rb:10:in `start'
/usr/share/logstash/lib/bootstrap/bundler.rb:151:in `execute_bundler'
/usr/share/logstash/lib/bootstrap/bundler.rb:112:in `invoke!'
/usr/share/logstash/lib/pluginmanager/update.rb:64:in `update_gems!'
/usr/share/logstash/lib/pluginmanager/update.rb:29:in `execute'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/clamp-0.6.5/lib/clamp/command.rb:67:in `run'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/clamp-0.6.5/lib/clamp/subcommand/execution.rb:11:in `execute'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/clamp-0.6.5/lib/clamp/command.rb:67:in `run'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/clamp-0.6.5/lib/clamp/command.rb:132:in `run'
/usr/share/logstash/lib/pluginmanager/main.rb:43:in `(root)'
Bundler::InstallError: An error occurred while installing logstash-core-event-java (5.0.0.pre.rc1), and Bundler cannot continue.
Make sure that `gem install logstash-core-event-java -v '5.0.0.pre.rc1'` succeeds before bundling.
  install_gem_from_spec at /usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/installer.rb:145
   install_sequentially at /usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/installer.rb:269
                   each at org/jruby/RubyArray.java:1613
                   each at /usr/share/logstash/vendor/jruby/lib/ruby/1.9/forwardable.rb:201
   install_sequentially at /usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/installer.rb:268
                    run at /usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/installer.rb:90
                install at /usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/installer.rb:18
                    run at /usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/cli/update.rb:51
                 update at /usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/cli.rb:178
                    run at /usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/vendor/thor/lib/thor/command.rb:27
         invoke_command at /usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/vendor/thor/lib/thor/invocation.rb:126
               dispatch at /usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/vendor/thor/lib/thor.rb:359
                  start at /usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/vendor/thor/lib/thor/base.rb:440
                  start at /usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/cli.rb:10
        execute_bundler at /usr/share/logstash/lib/bootstrap/bundler.rb:151
                invoke! at /usr/share/logstash/lib/bootstrap/bundler.rb:112
           update_gems! at /usr/share/logstash/lib/pluginmanager/update.rb:64
                execute at /usr/share/logstash/lib/pluginmanager/update.rb:29
                    run at /usr/share/logstash/vendor/bundle/jruby/1.9/gems/clamp-0.6.5/lib/clamp/command.rb:67
                execute at /usr/share/logstash/vendor/bundle/jruby/1.9/gems/clamp-0.6.5/lib/clamp/subcommand/execution.rb:11
                    run at /usr/share/logstash/vendor/bundle/jruby/1.9/gems/clamp-0.6.5/lib/clamp/command.rb:67
                    run at /usr/share/logstash/vendor/bundle/jruby/1.9/gems/clamp-0.6.5/lib/clamp/command.rb:132
                 (root) at /usr/share/logstash/lib/pluginmanager/main.rb:43
ERROR: Service 'logstash' failed to build: The command '/bin/sh -c DEBUG=1 logstash-plugin update logstash-input-beats' returned a non-zero code: 1
tronicum commented 7 years ago

i hoped for the Pioneer Program label ;-)

ph commented 7 years ago

This is the interesting part that we want :)

  jar dependencies for logstash-core-event-java-5.0.0.pre.rc1-java.gemspec . . .
[ERROR] [ERROR] Some problems were encountered while processing the POMs:
[FATAL] Non-parseable POM /usr/share/logstash/vendor/bundle/jruby/1.9/gems/jar-dependencies-0.3.5/lib/jars/gemspec_pom.rb: only whitespace content allowed before start tag and not # (position: START_DOCUMENT seen #... @1:1)  @ line 1, column 1
 @
[ERROR] The build could not read 1 project -> [Help 1]
[ERROR]
[ERROR]   The project  (/usr/share/logstash/vendor/bundle/jruby/1.9/gems/jar-dependencies-0.3.5/lib/jars/gemspec_pom.rb) has 1 error
[ERROR]     Non-parseable POM /usr/share/logstash/vendor/bundle/jruby/1.9/gems/jar-dependencies-0.3.5/lib/jars/gemspec_pom.rb: only whitespace content allowed before start tag and not # (position: START_DOCUMENT seen #... @1:1)  @ line 1, column 1 -> [Help 2]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException
[ERROR] [Help 2] http://cwiki.apache.org/confluence/display/MAVEN/ModelParseException

Can you rerun the same command with theses options and attach a gist to this issue, I have omited them at first because of the verbosity.

JARS_DEBUG=true JARS_VERBOSE=true DEBUG=1 bin/logstash-plugin install logstash-input-beats

Also what distribution you are running?

ph commented 7 years ago

Lets link this issue to https://github.com/elastic/logstash/issues/5583, to make sure we found the root cause.

tronicum commented 7 years ago

I am using logstash:5 which uses openjdk:8-jre which uses buildpack-deps:jessie-curl which uses debian:jessie from official docker hub (yeah, they said use docker, it makes deployment small and easy ;) thats what (S)HE said)

tronicum commented 7 years ago

here you go: https://gist.github.com/tronicum/2f314bb07e33d7ad20097dd0cc8d2e50

ph commented 7 years ago

@tronicum what is the content of /root/.m2/repository/org/torquebox/mojo/mavengem-wagon/0.2.1/mavengem-wagon-0.2.1.pom.lastUpdated ?

ph commented 7 years ago

I think maven which we use internally to resolve java dependency isn't able to use your http_proxy OR something with the certificates, the content of the lastUpdated will tell us exactly what is going on.

I've tested the install and update on a clean debian jessie vm with rc1, and I did not encounter any errors. I will check with a proxy.

root@jessie:/usr/share/logstash# /usr/share/logstash/bin/logstash-plugin install logstash-filter-dissect
Validating logstash-filter-dissect
Installing logstash-filter-dissect
Installation successful
root@jessie:/usr/share/logstash# /usr/share/logstash/bin/logstash-plugin update logstash-input-beats
Updating logstash-input-beats
No plugin updated
root@jessie:/usr/share/logstash#
ph commented 7 years ago

Good news, after configuring a few vagrant VMs, messing with squid and configuring the http_proxy and https_proxy I can now reproduce this error reliably.

Looking at the mavengem-wagon-0.2.1.pom.lastUpdated 

root@jessie:/usr/share/logstash# cat /root/.m2/repository/org/torquebox/mojo/mavengem-wagon/0.2.1/mavengem-wagon-0.2.1.pom.lastUpdated
#NOTE: This is an Aether internal implementation file, its format can be changed without prior notice.
#Fri Oct 14 15:57:05 GMT+00:00 2016
@default-central-https\://repo.maven.apache.org/maven2/.lastUpdated=1476460625149
https\://repo.maven.apache.org/maven2/.error=Could not transfer artifact org.torquebox.mojo\:mavengem-wagon\:pom\:0.2.1 from/to central (https\://repo.maven.apache.org/maven2)\: Connect to repo.maven.apache.org\:443 [repo.maven.apache.org/151.101.20.215] failed\: Connection timed out
root@jessie:/usr/share/logstash#

If use wget with the link for this pom file it works when the proxy are configured. So I confirm that something is broken with the offline installation related to maven/jar-dependency.

ph commented 7 years ago

I have a workaround create a settings.xml file in ~/root/.m2/

<settings>
  <proxies>
   <proxy>
      <id>example-proxy</id>
      <active>true</active>
      <protocol>http</protocol>
      <host>192.168.33.11</host>
      <port>3128</port>
    </proxy>
  </proxies>
</settings>

This seems the same issue I've created a few months ago https://github.com/mkristian/jar-dependencies/issues/16

gmoskovicz commented 7 years ago

@ph any possibilities to fix this for 5.0.1?

ph commented 7 years ago

@gmoskovicz It wont be for 5.0.1 since it was released yesterday an upstream fix should be merged soon see https://github.com/mkristian/jar-dependencies/issues/16

alexvranceanu commented 7 years ago

As a temporary workaround for those that need to use a proxy, you could set the proxy as part of JRUBY_OPTS: export JRUBY_OPTS="-J-Dhttp.proxyHost=your.proxy.host -J-Dhttp.proxyPort=8080"

For Docker images (in Dockerfile): ENV JRUBY_OPTS "-J-Dhttp.proxyHost=your.proxy.host -J-Dhttp.proxyPort=8080"

Update 2: Apparently you also need to specify the proxy settings on /root/.m2/settings.xml, as an example:

<settings>
  <proxies>
   <proxy>
      <id>proxy</id>
      <active>true</active>
      <protocol>http</protocol>
      <host>your.proxy.host</host>
      <port>8080</port>
    </proxy>
  </proxies>
</settings>
suyograo commented 7 years ago

Fixed in 5.2.0

aleakhtar commented 7 years ago

Faced same issue in Logstash version: 5.2.0 and resolved.

On top of @alexvranceanu suggestions, I had to update proxy settings for Ruby-Mavan plugin at this location:

/usr/share/logstash/vendor/bundle/jruby/1.9/gems/ruby-maven-libs-3.3.9/maven-home/conf/settings.xml

wonkyto commented 7 years ago

I have also tested this on Logstash 5.2.0, the issue does not appear to be resolved.

I had to set the JRUBY_OPTS variable: export JRUBY_OPTS="-J-Dhttp.proxyHost=X.X.X.X -J-Dhttp.proxyPort=YY"

add the /root/.m2/settings.xml 

<settings>
  <proxies>
   <proxy>
      <id>proxy</id>
      <active>true</active>
      <protocol>http</protocol>
      <host>X.X.X.X</host>
      <port>YY</port>
    </proxy>
  </proxies>
</settings>

modify /usr/share/logstash/vendor/bundle/jruby/1.9/gems/ruby-maven-libs-3.3.9/maven-home/conf/settings.xml

   <proxy>
      <id>optional</id>
      <active>true</active>
      <protocol>http</protocol>
      <host>X.X.X.X</host>
      <port>YY</port>
      <nonProxyHosts>local.net|some.host.com</nonProxyHosts>
    </proxy>

After doing these steps I was able to remove and install alternative versions of the Kafka plugins

# bin/logstash-plugin list --verbose | grep kafka
logstash-input-kafka (5.1.4)
logstash-output-kafka (5.1.3)

# bin/logstash-plugin remove logstash-input-kafka
Successfully removed logstash-input-kafka
# bin/logstash-plugin remove logstash-output-kafka
Successfully removed logstash-output-kafka

# bin/logstash-plugin install --version 4.1.1 logstash-input-kafka
Validating logstash-input-kafka-4.1.1
Installing logstash-input-kafka
which: no javac in (/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/root/bin)
which: no javac in (/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/root/bin)
Installation successful

# bin/logstash-plugin install --version 4.0.4 logstash-output-kafka
Validating logstash-output-kafka-4.0.4
Installing logstash-output-kafka
which: no javac in (/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/root/bin)
which: no javac in (/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/root/bin)
Installation successful

# bin/logstash-plugin list --verbose | grep kafka
logstash-input-kafka (4.1.1)
logstash-output-kafka (4.0.4)
msvechla commented 7 years ago

Also not working on logstash 5.2.1 behind proxy with HTTP_PROXY, HTTPS_PROXY, http_proxy and https_proxy environment variables set

wkruse commented 7 years ago

@suyograo It is still broken in 5.2.2, @aleakhtar and @wonkyto workaround works.

csobchuk commented 7 years ago

I can confirm the workarounds from @aleakhtar and @wonkyto on 5.2 with Ubuntu 14.04.4. I have modifed to following for the proxy information: /root/.m2/settings.xml /usr/share/logstash/vendor/bundle/jruby/1.9/gems/ruby-maven-libs-3.3.9/maven-home/conf/settings.xml and modified the following for the JRUBY options: /usr/share/logstash/bin/logstash-plugin and added in proxy settings as root for http, https, HTTP, HTTPS, and no_proxy.

Jensvandecasteele commented 7 years ago

I've managed to get it to work on Windows by changing this file (on top of the workarounds above):

logstash-5.3.0\lib\pluginmanager\utils\http_client.rb

Changing this line: Net::HTTP.start(uri.host, uri.port, :use_ssl => uri.scheme == HTTPS_SCHEME) { |http| yield http }

To:

Net::HTTP.start(uri.host, uri.port, "proxy.COMPANY.XXX", 83, "USER", "PASSWORD", :use_ssl => uri.scheme == HTTPS_SCHEME) { |http| yield http }

However, I see that this file has been changed in the latest commits, so the issue should be fixed when 5.4 gets released.

rabbitmz commented 7 years ago

Guys! I don't know if I have to open a new issue or not. But I have a similar problem as this one, I hope you guys can help me.

OS: Fedora 25 ELK stack version : 5.2 (only with kibanaa+logstash+elasticsearch+filebeat)

Note: I don't have a proxy configured in my network.

Trying to install the logstash-filter-translate as following: DEBUG=1 bin/logstash-plugin install logstash-filter-translate

I'm getting the following error : 


0:  ruby-maven (3.3.12) from /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/ruby-maven-3.3.12.gemspec
  jar dependencies for logstash-core-event-java-5.2.2-java.gemspec . . .

Errno::EPERM: Operation not permitted - Operation not permitted
org/jruby/RubyFile.java:1102:in `utime'
/usr/share/logstash/vendor/jruby/lib/ruby/1.9/fileutils.rb:1389:in `copy_metadata'
/usr/share/logstash/vendor/jruby/lib/ruby/1.9/fileutils.rb:466:in `copy_entry'
/usr/share/logstash/vendor/jruby/lib/ruby/1.9/fileutils.rb:1443:in `preorder_traverse'
/usr/share/logstash/vendor/jruby/lib/ruby/1.9/fileutils.rb:462:in `copy_entry'
/usr/share/logstash/vendor/jruby/lib/ruby/1.9/fileutils.rb:521:in `mv'
/usr/share/logstash/vendor/jruby/lib/ruby/1.9/fileutils.rb:1525:in `fu_each_src_dest'
/usr/share/logstash/vendor/jruby/lib/ruby/1.9/fileutils.rb:1541:in `fu_each_src_dest0'
/usr/share/logstash/vendor/jruby/lib/ruby/1.9/fileutils.rb:1523:in `fu_each_src_dest'
/usr/share/logstash/vendor/jruby/lib/ruby/1.9/fileutils.rb:508:in `mv'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/ruby-maven-3.3.12/lib/ruby_maven.rb:84:in `launch'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/ruby-maven-3.3.12/lib/ruby_maven.rb:39:in `exec'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler.rb:245:in `with_clean_env'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler.rb:232:in `with_original_env'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler.rb:238:in `with_clean_env'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/ruby-maven-3.3.12/lib/ruby_maven.rb:38:in `exec'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/ruby-maven-3.3.12/lib/maven/ruby/maven.rb:112:in `exec'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/jar-dependencies-0.3.10/lib/jars/maven_exec.rb:79:in `resolve_dependencies_list'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/jar-dependencies-0.3.10/lib/jars/installer.rb:237:in `install_dependencies'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/jar-dependencies-0.3.10/lib/jars/installer.rb:226:in `do_install'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/jar-dependencies-0.3.10/lib/jars/installer.rb:172:in `vendor_jars'
/usr/share/logstash/vendor/jruby/lib/ruby/shared/jars/post_install_hook.rb:28:in `(root)'
org/jruby/RubyProc.java:281:in `call'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/source/path.rb:215:in `run_hooks'
org/jruby/RubyArray.java:1613:in `each'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/source/path.rb:214:in `run_hooks'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/source/path.rb:195:in `generate_bin'
org/jruby/RubyDir.java:341:in `chdir'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/shared_helpers.rb:53:in `chdir'
/usr/share/logstash/vendor/jruby/lib/ruby/1.9/monitor.rb:211:in `mon_synchronize'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/shared_helpers.rb:52:in `chdir'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/source/path.rb:189:in `generate_bin'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/source/path.rb:73:in `install'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/installer.rb:107:in `install_gem_from_spec'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/installer.rb:269:in `install_sequentially'
org/jruby/RubyArray.java:1613:in `each'
/usr/share/logstash/vendor/jruby/lib/ruby/1.9/forwardable.rb:201:in `each'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/installer.rb:268:in `install_sequentially'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/installer.rb:90:in `run'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/installer.rb:18:in `install'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/cli/install.rb:80:in `run'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/cli.rb:155:in `install'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/vendor/thor/lib/thor/command.rb:27:in `run'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/vendor/thor/lib/thor/invocation.rb:126:in `invoke_command'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/vendor/thor/lib/thor.rb:359:in `dispatch'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/vendor/thor/lib/thor/base.rb:440:in `start'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/cli.rb:10:in `start'
/usr/share/logstash/lib/bootstrap/bundler.rb:152:in `execute_bundler'
/usr/share/logstash/lib/bootstrap/bundler.rb:113:in `invoke!'
/usr/share/logstash/lib/pluginmanager/install.rb:142:in `install_gems_list!'
/usr/share/logstash/lib/pluginmanager/install.rb:61:in `execute'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/clamp-0.6.5/lib/clamp/command.rb:67:in `run'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/clamp-0.6.5/lib/clamp/subcommand/execution.rb:11:in `execute'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/clamp-0.6.5/lib/clamp/command.rb:67:in `run'
/usr/share/logstash/vendor/bundle/jruby/1.9/gems/clamp-0.6.5/lib/clamp/command.rb:132:in `run'
/usr/share/logstash/lib/pluginmanager/main.rb:46:in `(root)'
Bundler::InstallError: An error occurred while installing logstash-core-event-java (5.2.2), and Bundler cannot continue.
Make sure that `gem install logstash-core-event-java -v '5.2.2'` succeeds before bundling.
  install_gem_from_spec at /usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/installer.rb:145
   install_sequentially at /usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/installer.rb:269
                   each at org/jruby/RubyArray.java:1613
                   each at /usr/share/logstash/vendor/jruby/lib/ruby/1.9/forwardable.rb:201
   install_sequentially at /usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/installer.rb:268
                    run at /usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/installer.rb:90
                install at /usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/installer.rb:18
                    run at /usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/cli/install.rb:80
                install at /usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/cli.rb:155
                    run at /usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/vendor/thor/lib/thor/command.rb:27
         invoke_command at /usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/vendor/thor/lib/thor/invocation.rb:126
               dispatch at /usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/vendor/thor/lib/thor.rb:359
                  start at /usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/vendor/thor/lib/thor/base.rb:440
                  start at /usr/share/logstash/vendor/bundle/jruby/1.9/gems/bundler-1.9.10/lib/bundler/cli.rb:10
        execute_bundler at /usr/share/logstash/lib/bootstrap/bundler.rb:152
                invoke! at /usr/share/logstash/lib/bootstrap/bundler.rb:113
     install_gems_list! at /usr/share/logstash/lib/pluginmanager/install.rb:142
                execute at /usr/share/logstash/lib/pluginmanager/install.rb:61
                    run at /usr/share/logstash/vendor/bundle/jruby/1.9/gems/clamp-0.6.5/lib/clamp/command.rb:67
                execute at /usr/share/logstash/vendor/bundle/jruby/1.9/gems/clamp-0.6.5/lib/clamp/subcommand/execution.rb:11
                    run at /usr/share/logstash/vendor/bundle/jruby/1.9/gems/clamp-0.6.5/lib/clamp/command.rb:67
                    run at /usr/share/logstash/vendor/bundle/jruby/1.9/gems/clamp-0.6.5/lib/clamp/command.rb:132
                 (root) at /usr/share/logstash/lib/pluginmanager/main.rb:46

Thanks in advance.

tronicum commented 7 years ago

@rabbitmz yes your problem is unlreated to the proxy case in this issue. but it seems to be a file permission problem (Errno::EPERM: Operation not permitted - Operation not permitted) in your case. please open a new issue if you need further assistance.

KIVagant commented 7 years ago

I got this problem when accidentally executed logstash-plugin under logstash user. Under sudo all is ok.

TaurusD commented 7 years ago

Here I'm using v5.5.1 behind a proxy and still get the problem. I have set HTTP_PROXY and HTTPS_PROXY in windows environment variables.

error message below:

E:\ELK\logstash-5.5.1>bin\logstash-plugin install logstash-input-mongodb Validating logstash-input-mongodb Installing logstash-input-mongodb Error Bundler::InstallError, retrying 1/10 An error occurred while installing logstash-core (5.5.1), and Bundler cannot continue. Make sure that gem install logstash-core -v '5.5.1' succeeds before bundling. Error Bundler::InstallError, retrying 2/10 An error occurred while installing logstash-core (5.5.1), and Bundler cannot continue. Make sure that gem install logstash-core -v '5.5.1' succeeds before bundling. Error Bundler::InstallError, retrying 3/10 An error occurred while installing logstash-core (5.5.1), and Bundler cannot continue. Make sure that gem install logstash-core -v '5.5.1' succeeds before bundling. Error Bundler::InstallError, retrying 4/10 An error occurred while installing logstash-core (5.5.1), and Bundler cannot continue. Make sure that gem install logstash-core -v '5.5.1' succeeds before bundling. Error Bundler::InstallError, retrying 5/10 An error occurred while installing logstash-core (5.5.1), and Bundler cannot continue. Make sure that gem install logstash-core -v '5.5.1' succeeds before bundling. Error Bundler::InstallError, retrying 6/10 An error occurred while installing logstash-core (5.5.1), and Bundler cannot continue. Make sure that gem install logstash-core -v '5.5.1' succeeds before bundling. Error Bundler::InstallError, retrying 7/10 An error occurred while installing logstash-core (5.5.1), and Bundler cannot continue. Make sure that gem install logstash-core -v '5.5.1' succeeds before bundling. Error Bundler::InstallError, retrying 8/10 An error occurred while installing logstash-core (5.5.1), and Bundler cannot continue. Make sure that gem install logstash-core -v '5.5.1' succeeds before bundling. Error Bundler::InstallError, retrying 9/10 An error occurred while installing logstash-core (5.5.1), and Bundler cannot continue. Make sure that gem install logstash-core -v '5.5.1' succeeds before bundling. Error Bundler::InstallError, retrying 10/10 An error occurred while installing logstash-core (5.5.1), and Bundler cannot continue. Make sure that gem install logstash-core -v '5.5.1' succeeds before bundling. Too many retries, aborting, caused by Bundler::InstallError ERROR: Installation Aborted, message: An error occurred while installing logstash-core (5.5.1), and Bundler cannot continue. Make sure that gem install logstash-core -v '5.5.1' succeeds before bundling.

RogerGMartins commented 6 years ago

same issue as @TaurusD for me. If I remove the proxy settings and use a private gem source i just get a connection error.

gaving commented 6 years ago

FWIW (and after googling about for half an hour), I added --no-verify to my Dockerfile:-

RUN DEBUG=1 logstash-plugin install --no-verify logstash-output-elasticsearch
RUN DEBUG=1 logstash-plugin install --no-verify logstash-input-jdbc
RUN DEBUG=1 logstash-plugin install --no-verify logstash-filter-translate

This managed to get me past logstash-plugin hanging (despite my proxy settings being correct).