search

tagomoris / fluent-plugin-secure-forward

Other
140 stars 30 forks source link

supervise: process finished code=6 #19

Closed cbh34680 closed 9 years ago

cbh34680 commented 9 years ago

日本語で失礼します。

Scientific Linux 6.6 の rpm パッケージ td-agent-1.1.21-0.x86_64 に fluent-plugin-secure-forward (0.3.2) をインストールして利用しています。

PHP のプログラムから 1,000,000 件のデータを送信したところ途中で

2015-06-14 04:15:39 +0900 [info]: fluent/supervisor.rb:296:supervise: process finished code=6

のようなメッセージが出力され fluentd が再起動されています。

直接関係があるかわかりませんが、以前のバージョンである 0.2.5 までは 同じ送信プログラムを実行しても同様の現象は発生せず、0.2.6 と 0.3.2 では 発生が確認されました。

プラグインのバージョンを変更して発生したのでこちらに質問させていただきましたが この現象は fluentd 自体の不具合であるか切り分けは可能ですか？

念のため、これを実行したときの送信側の td-agent.log を以下に転記します。

2015-06-14 04:15:19 +0900 [info]: fluent/supervisor.rb:403:read_config: reading config file path="/etc/td-agent/td-agent.conf"
2015-06-14 04:15:19 +0900 [info]: fluent/supervisor.rb:279:supervise: starting fluentd-0.12.12
2015-06-14 04:15:19 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered buffer plugin 'file'
2015-06-14 04:15:19 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered buffer plugin 'memory'
2015-06-14 04:15:19 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered filter plugin 'grep'
2015-06-14 04:15:19 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered filter plugin 'record_transformer'
2015-06-14 04:15:19 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered filter plugin 'stdout'
2015-06-14 04:15:19 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered input plugin 'debug_agent'
2015-06-14 04:15:19 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered input plugin 'dummy'
2015-06-14 04:15:19 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered input plugin 'exec'
2015-06-14 04:15:19 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered input plugin 'forward'
2015-06-14 04:15:19 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered input plugin 'gc_stat'
2015-06-14 04:15:19 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered input plugin 'http'
2015-06-14 04:15:19 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered input plugin 'monitor_agent'
2015-06-14 04:15:19 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered input plugin 'object_space'
2015-06-14 04:15:19 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered input plugin 'status'
2015-06-14 04:15:19 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered input plugin 'unix'
2015-06-14 04:15:19 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered input plugin 'syslog'
2015-06-14 04:15:19 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered input plugin 'tail'
2015-06-14 04:15:19 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered input plugin 'tcp'
2015-06-14 04:15:19 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered input plugin 'udp'
2015-06-14 04:15:19 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered output plugin 'copy'
2015-06-14 04:15:19 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered output plugin 'exec'
2015-06-14 04:15:19 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered output plugin 'exec_filter'
2015-06-14 04:15:19 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered output plugin 'file'
2015-06-14 04:15:19 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered output plugin 'forward'
2015-06-14 04:15:19 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered output plugin 'null'
2015-06-14 04:15:19 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered output plugin 'relabel'
2015-06-14 04:15:19 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered output plugin 'roundrobin'
2015-06-14 04:15:19 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered output plugin 'stdout'
2015-06-14 04:15:19 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered output plugin 'tcp'
2015-06-14 04:15:19 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered output plugin 'unix'
2015-06-14 04:15:19 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-mixin-config-placeholders' version '0.3.0'
2015-06-14 04:15:19 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-mixin-config-placeholders' version '0.2.4'
2015-06-14 04:15:19 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-mixin-plaintextformatter' version '0.2.6'
2015-06-14 04:15:19 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-plugin-flume' version '0.1.1'
2015-06-14 04:15:19 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-plugin-mongo' version '0.7.10'
2015-06-14 04:15:19 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-plugin-mongo' version '0.7.3'
2015-06-14 04:15:19 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-plugin-rewrite-tag-filter' version '1.5.1'
2015-06-14 04:15:19 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-plugin-rewrite-tag-filter' version '1.4.1'
2015-06-14 04:15:19 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-plugin-s3' version '0.5.9'
2015-06-14 04:15:19 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-plugin-s3' version '0.4.1'
2015-06-14 04:15:19 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-plugin-scribe' version '0.10.14'
2015-06-14 04:15:19 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-plugin-scribe' version '0.10.12'
2015-06-14 04:15:19 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-plugin-secure-forward' version '0.3.2'
2015-06-14 04:15:19 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-plugin-secure-forward' version '0.2.5'
2015-06-14 04:15:19 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-plugin-td' version '0.10.27'
2015-06-14 04:15:19 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-plugin-td' version '0.10.22'
2015-06-14 04:15:19 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-plugin-td-monitoring' version '0.2.0'
2015-06-14 04:15:19 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-plugin-td-monitoring' version '0.1.3'
2015-06-14 04:15:19 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-plugin-webhdfs' version '0.4.1'
2015-06-14 04:15:19 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-plugin-webhdfs' version '0.3.1'
2015-06-14 04:15:19 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluentd' version '0.12.12'
2015-06-14 04:15:19 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluentd' version '0.10.55'
2015-06-14 04:15:19 +0900 [info]: fluent/agent.rb:123:add_match: adding match pattern="tmp.write" type="secure_forward"
2015-06-14 04:15:19 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered output plugin 'secure_forward'
2015-06-14 04:15:19 +0900 [warn]: plugin/out_secure_forward.rb:89:configure: 'insecure' mode has vulnerability for man-in-the-middle attacks.
2015-06-14 04:15:19 +0900 [info]: fluent/root_agent.rb:142:add_source: adding source type="unix"
2015-06-14 04:15:19 +0900 [info]: fluent/root_agent.rb:142:add_source: adding source type="forward"
2015-06-14 04:15:19 +0900 [info]: fluent/engine.rb:97:configure: using configuration file: <ROOT>
  <source>
    type unix
    path /var/run/td-agent/td-agent.sock
  </source>
  <source>
    type forward
  </source>
  <match tmp.write>
    type secure_forward
    shared_key abcde
    self_hostname ***********************
    keepalive 10s
    flush_interval 10s
    retry_wait 60s
    buffer_type file
    buffer_path /data/fluent/test
    buffer_queue_limit 1280
    secure no
    ssl_version SSLv23
    <server>
      host 10.96.152.142
    </server>
  </match>
</ROOT>
2015-06-14 04:15:19 +0900 [debug]: plugin/out_secure_forward.rb:138:start: starting secure-forward
2015-06-14 04:15:19 +0900 [debug]: plugin/out_secure_forward.rb:140:start: start to connect target nodes
2015-06-14 04:15:19 +0900 [debug]: plugin/out_secure_forward.rb:142:block in start: connecting node host="10.96.152.142" port=24284
2015-06-14 04:15:19 +0900 [debug]: plugin/in_stream.rb:180:listen: listening fluent socket on /var/run/td-agent/td-agent.sock
2015-06-14 04:15:19 +0900 [info]: plugin/in_forward.rb:74:listen: listening fluent socket on 0.0.0.0:24224
2015-06-14 04:15:19 +0900 [debug]: plugin/output_node.rb:216:connect: starting client
2015-06-14 04:15:19 +0900 [debug]: plugin/output_node.rb:219:connect: create tcp socket to node host="10.96.152.142" address="10.96.152.142" port=24284
2015-06-14 04:15:19 +0900 [trace]: plugin/output_node.rb:228:connect: changing socket options
2015-06-14 04:15:19 +0900 [trace]: plugin/output_node.rb:235:connect: initializing SSL contexts
2015-06-14 04:15:19 +0900 [trace]: plugin/output_node.rb:239:connect: setting SSL verification options
2015-06-14 04:15:19 +0900 [debug]: plugin/output_node.rb:270:connect: trying to connect ssl session host="10.96.152.142" address="10.96.152.142" port=24284
2015-06-14 04:15:19 +0900 [trace]: plugin/output_node.rb:273:connect: connecting... host="10.96.152.142" address="10.96.152.142" port=24284
2015-06-14 04:15:19 +0900 [debug]: plugin/output_node.rb:281:connect: ssl session connected host="10.96.152.142" port=24284
2015-06-14 04:15:19 +0900 [debug]: plugin/output_node.rb:301:connect: ssl session connected host="10.96.152.142" port=24284
2015-06-14 04:15:19 +0900 [debug]: plugin/output_node.rb:184:on_read: on_read
2015-06-14 04:15:19 +0900 [debug]: plugin/output_node.rb:127:check_helo: checking helo
2015-06-14 04:15:19 +0900 [debug]: plugin/output_node.rb:140:generate_ping: generating ping
2015-06-14 04:15:20 +0900 [debug]: plugin/output_node.rb:184:on_read: on_read
2015-06-14 04:15:20 +0900 [debug]: plugin/output_node.rb:155:check_pong: checking pong
2015-06-14 04:15:20 +0900 [info]: plugin/output_node.rb:207:on_read: connection established to 10.96.152.142
2015-06-14 04:15:20 +0900 [debug]: plugin/output_node.rb:210:on_read: connection established host="10.96.152.142" port=24284 expire=2015-06-14 04:15:30 +0900
2015-06-14 04:15:24 +0900 [trace]: plugin/out_secure_forward.rb:156:block in node_watcher: in node health watcher
2015-06-14 04:15:24 +0900 [trace]: plugin/out_secure_forward.rb:159:block (2 levels) in node_watcher: node health watcher for 10.96.152.142
2015-06-14 04:15:29 +0900 [trace]: plugin/out_secure_forward.rb:156:block in node_watcher: in node health watcher
2015-06-14 04:15:29 +0900 [trace]: plugin/out_secure_forward.rb:159:block (2 levels) in node_watcher: node health watcher for 10.96.152.142
2015-06-14 04:15:32 +0900 [trace]: plugin/in_stream.rb:116:initialize: accepted fluent socket from ':': object_id=70261118875400
2015-06-14 04:15:33 +0900 [trace]: plugin/out_secure_forward.rb:235:write_objects: selected node host="10.96.152.142" port=24284 standby=false
2015-06-14 04:15:34 +0900 [trace]: plugin/out_secure_forward.rb:235:write_objects: selected node host="10.96.152.142" port=24284 standby=false
2015-06-14 04:15:34 +0900 [trace]: plugin/out_secure_forward.rb:156:block in node_watcher: in node health watcher
2015-06-14 04:15:34 +0900 [trace]: plugin/out_secure_forward.rb:159:block (2 levels) in node_watcher: node health watcher for 10.96.152.142
2015-06-14 04:15:34 +0900 [debug]: plugin/out_secure_forward.rb:173:block (2 levels) in node_watcher: reconnecting to node host="10.96.152.142" port=24284 expire=2015-06-14 04:15:30 +0900 expired=true detached=false
2015-06-14 04:15:34 +0900 [trace]: plugin/out_secure_forward.rb:185:block (2 levels) in node_watcher: checking reconnecting node 10.96.152.142
2015-06-14 04:15:34 +0900 [debug]: plugin/output_node.rb:216:connect: starting client
2015-06-14 04:15:34 +0900 [debug]: plugin/output_node.rb:219:connect: create tcp socket to node host="10.96.152.142" address="10.96.152.142" port=24284
2015-06-14 04:15:34 +0900 [trace]: plugin/output_node.rb:228:connect: changing socket options
2015-06-14 04:15:34 +0900 [trace]: plugin/output_node.rb:235:connect: initializing SSL contexts
2015-06-14 04:15:34 +0900 [trace]: plugin/output_node.rb:239:connect: setting SSL verification options
2015-06-14 04:15:34 +0900 [debug]: plugin/output_node.rb:270:connect: trying to connect ssl session host="10.96.152.142" address="10.96.152.142" port=24284
2015-06-14 04:15:34 +0900 [trace]: plugin/output_node.rb:273:connect: connecting... host="10.96.152.142" address="10.96.152.142" port=24284
2015-06-14 04:15:34 +0900 [debug]: plugin/output_node.rb:281:connect: ssl session connected host="10.96.152.142" port=24284
2015-06-14 04:15:34 +0900 [debug]: plugin/output_node.rb:301:connect: ssl session connected host="10.96.152.142" port=24284
2015-06-14 04:15:34 +0900 [debug]: plugin/output_node.rb:184:on_read: on_read
2015-06-14 04:15:34 +0900 [debug]: plugin/output_node.rb:127:check_helo: checking helo
2015-06-14 04:15:34 +0900 [debug]: plugin/output_node.rb:140:generate_ping: generating ping
2015-06-14 04:15:35 +0900 [debug]: plugin/output_node.rb:184:on_read: on_read
2015-06-14 04:15:35 +0900 [debug]: plugin/output_node.rb:155:check_pong: checking pong
2015-06-14 04:15:35 +0900 [debug]: plugin/output_node.rb:210:on_read: connection established host="10.96.152.142" port=24284 expire=2015-06-14 04:15:45 +0900
2015-06-14 04:15:37 +0900 [trace]: plugin/out_secure_forward.rb:235:write_objects: selected node host="10.96.152.142" port=24284 standby=false
2015-06-14 04:15:38 +0900 [trace]: plugin/out_secure_forward.rb:235:write_objects: selected node host="10.96.152.142" port=24284 standby=false
2015-06-14 04:15:39 +0900 [trace]: plugin/out_secure_forward.rb:156:block in node_watcher: in node health watcher
2015-06-14 04:15:39 +0900 [trace]: plugin/out_secure_forward.rb:159:block (2 levels) in node_watcher: node health watcher for 10.96.152.142
2015-06-14 04:15:39 +0900 [trace]: plugin/out_secure_forward.rb:185:block (2 levels) in node_watcher: checking reconnecting node 10.96.152.142
2015-06-14 04:15:39 +0900 [debug]: plugin/out_secure_forward.rb:188:block (2 levels) in node_watcher: connection established for reconnecting node
2015-06-14 04:15:39 +0900 [trace]: plugin/out_secure_forward.rb:197:block (2 levels) in node_watcher: old connection shutting down
2015-06-14 04:15:39 +0900 [trace]: plugin/out_secure_forward.rb:199:block (2 levels) in node_watcher: old connection shutted down
2015-06-14 04:15:39 +0900 [debug]: plugin/output_node.rb:87:shutdown: shutting down node 10.96.152.142
2015-06-14 04:15:39 +0900 [info]: fluent/supervisor.rb:296:supervise: process finished code=6
2015-06-14 04:15:39 +0900 [error]: fluent/supervisor.rb:146:start: fluentd main process died unexpectedly. restarting.
2015-06-14 04:15:39 +0900 [info]: fluent/supervisor.rb:279:supervise: starting fluentd-0.12.12
2015-06-14 04:15:39 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered buffer plugin 'file'
2015-06-14 04:15:39 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered buffer plugin 'memory'
2015-06-14 04:15:39 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered filter plugin 'grep'
2015-06-14 04:15:39 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered filter plugin 'record_transformer'
2015-06-14 04:15:39 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered filter plugin 'stdout'
2015-06-14 04:15:39 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered input plugin 'debug_agent'
2015-06-14 04:15:39 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered input plugin 'dummy'
2015-06-14 04:15:39 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered input plugin 'exec'
2015-06-14 04:15:39 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered input plugin 'forward'
2015-06-14 04:15:39 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered input plugin 'gc_stat'
2015-06-14 04:15:39 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered input plugin 'http'
2015-06-14 04:15:39 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered input plugin 'monitor_agent'
2015-06-14 04:15:39 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered input plugin 'object_space'
2015-06-14 04:15:39 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered input plugin 'status'
2015-06-14 04:15:39 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered input plugin 'unix'
2015-06-14 04:15:39 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered input plugin 'syslog'
2015-06-14 04:15:39 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered input plugin 'tail'
2015-06-14 04:15:39 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered input plugin 'tcp'
2015-06-14 04:15:39 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered input plugin 'udp'
2015-06-14 04:15:39 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered output plugin 'copy'
2015-06-14 04:15:39 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered output plugin 'exec'
2015-06-14 04:15:39 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered output plugin 'exec_filter'
2015-06-14 04:15:39 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered output plugin 'file'
2015-06-14 04:15:39 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered output plugin 'forward'
2015-06-14 04:15:39 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered output plugin 'null'
2015-06-14 04:15:39 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered output plugin 'relabel'
2015-06-14 04:15:39 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered output plugin 'roundrobin'
2015-06-14 04:15:39 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered output plugin 'stdout'
2015-06-14 04:15:39 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered output plugin 'tcp'
2015-06-14 04:15:39 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered output plugin 'unix'
2015-06-14 04:15:39 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-mixin-config-placeholders' version '0.3.0'
2015-06-14 04:15:39 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-mixin-config-placeholders' version '0.2.4'
2015-06-14 04:15:39 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-mixin-plaintextformatter' version '0.2.6'
2015-06-14 04:15:39 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-plugin-flume' version '0.1.1'
2015-06-14 04:15:39 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-plugin-mongo' version '0.7.10'
2015-06-14 04:15:39 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-plugin-mongo' version '0.7.3'
2015-06-14 04:15:39 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-plugin-rewrite-tag-filter' version '1.5.1'
2015-06-14 04:15:39 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-plugin-rewrite-tag-filter' version '1.4.1'
2015-06-14 04:15:39 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-plugin-s3' version '0.5.9'
2015-06-14 04:15:39 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-plugin-s3' version '0.4.1'
2015-06-14 04:15:39 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-plugin-scribe' version '0.10.14'
2015-06-14 04:15:39 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-plugin-scribe' version '0.10.12'
2015-06-14 04:15:39 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-plugin-secure-forward' version '0.3.2'
2015-06-14 04:15:39 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-plugin-secure-forward' version '0.2.5'
2015-06-14 04:15:39 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-plugin-td' version '0.10.27'
2015-06-14 04:15:39 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-plugin-td' version '0.10.22'
2015-06-14 04:15:39 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-plugin-td-monitoring' version '0.2.0'
2015-06-14 04:15:39 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-plugin-td-monitoring' version '0.1.3'
2015-06-14 04:15:39 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-plugin-webhdfs' version '0.4.1'
2015-06-14 04:15:39 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluent-plugin-webhdfs' version '0.3.1'
2015-06-14 04:15:39 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluentd' version '0.12.12'
2015-06-14 04:15:39 +0900 [info]: fluent/engine.rb:90:block in configure: gem 'fluentd' version '0.10.55'
2015-06-14 04:15:39 +0900 [info]: fluent/agent.rb:123:add_match: adding match pattern="tmp.write" type="secure_forward"
2015-06-14 04:15:39 +0900 [trace]: fluent/plugin.rb:98:register_impl: registered output plugin 'secure_forward'
2015-06-14 04:15:39 +0900 [warn]: plugin/out_secure_forward.rb:89:configure: 'insecure' mode has vulnerability for man-in-the-middle attacks.
2015-06-14 04:15:39 +0900 [info]: fluent/root_agent.rb:142:add_source: adding source type="unix"
2015-06-14 04:15:39 +0900 [info]: fluent/root_agent.rb:142:add_source: adding source type="forward"
2015-06-14 04:15:39 +0900 [info]: fluent/engine.rb:97:configure: using configuration file: <ROOT>
  <source>
    type unix
    path /var/run/td-agent/td-agent.sock
  </source>
  <source>
    type forward
  </source>
  <match tmp.write>
    type secure_forward
    shared_key abcde
    self_hostname *************************
    keepalive 10s
    flush_interval 10s
    retry_wait 60s
    buffer_type file
    buffer_path /data/fluent/test
    buffer_queue_limit 1280
    secure no
    ssl_version SSLv23
    <server>
      host 10.96.152.142
    </server>
  </match>
</ROOT>
2015-06-14 04:15:39 +0900 [debug]: plugin/out_secure_forward.rb:138:start: starting secure-forward
2015-06-14 04:15:39 +0900 [debug]: plugin/out_secure_forward.rb:140:start: start to connect target nodes
2015-06-14 04:15:39 +0900 [debug]: plugin/out_secure_forward.rb:142:block in start: connecting node host="10.96.152.142" port=24284
2015-06-14 04:15:39 +0900 [debug]: plugin/in_stream.rb:180:listen: listening fluent socket on /var/run/td-agent/td-agent.sock
2015-06-14 04:15:39 +0900 [info]: plugin/in_forward.rb:74:listen: listening fluent socket on 0.0.0.0:24224
2015-06-14 04:15:39 +0900 [debug]: plugin/output_node.rb:216:connect: starting client
2015-06-14 04:15:39 +0900 [debug]: plugin/output_node.rb:219:connect: create tcp socket to node host="10.96.152.142" address="10.96.152.142" port=24284
2015-06-14 04:15:39 +0900 [trace]: plugin/output_node.rb:228:connect: changing socket options
2015-06-14 04:15:39 +0900 [trace]: plugin/output_node.rb:235:connect: initializing SSL contexts
2015-06-14 04:15:39 +0900 [trace]: plugin/output_node.rb:239:connect: setting SSL verification options
2015-06-14 04:15:39 +0900 [debug]: plugin/output_node.rb:270:connect: trying to connect ssl session host="10.96.152.142" address="10.96.152.142" port=24284
2015-06-14 04:15:39 +0900 [trace]: plugin/output_node.rb:273:connect: connecting... host="10.96.152.142" address="10.96.152.142" port=24284
2015-06-14 04:15:39 +0900 [debug]: plugin/output_node.rb:281:connect: ssl session connected host="10.96.152.142" port=24284
2015-06-14 04:15:39 +0900 [debug]: plugin/output_node.rb:301:connect: ssl session connected host="10.96.152.142" port=24284
2015-06-14 04:15:40 +0900 [debug]: plugin/output_node.rb:184:on_read: on_read
2015-06-14 04:15:40 +0900 [debug]: plugin/output_node.rb:127:check_helo: checking helo
2015-06-14 04:15:40 +0900 [debug]: plugin/output_node.rb:140:generate_ping: generating ping
2015-06-14 04:15:40 +0900 [debug]: plugin/output_node.rb:184:on_read: on_read
2015-06-14 04:15:40 +0900 [debug]: plugin/output_node.rb:155:check_pong: checking pong
2015-06-14 04:15:40 +0900 [info]: plugin/output_node.rb:207:on_read: connection established to 10.96.152.142
2015-06-14 04:15:40 +0900 [debug]: plugin/output_node.rb:210:on_read: connection established host="10.96.152.142" port=24284 expire=2015-06-14 04:15:50 +0900
2015-06-14 04:15:40 +0900 [trace]: plugin/out_secure_forward.rb:235:write_objects: selected node host="10.96.152.142" port=24284 standby=false
2015-06-14 04:15:42 +0900 [trace]: plugin/out_secure_forward.rb:235:write_objects: selected node host="10.96.152.142" port=24284 standby=false
2015-06-14 04:15:44 +0900 [trace]: plugin/out_secure_forward.rb:235:write_objects: selected node host="10.96.152.142" port=24284 standby=false
2015-06-14 04:15:44 +0900 [trace]: plugin/out_secure_forward.rb:156:block in node_watcher: in node health watcher
2015-06-14 04:15:44 +0900 [trace]: plugin/out_secure_forward.rb:159:block (2 levels) in node_watcher: node health watcher for 10.96.152.142
2015-06-14 04:15:48 +0900 [debug]: fluent/supervisor.rb:337:block in install_supervisor_signal_handlers: fluentd supervisor process get SIGTERM
2015-06-14 04:15:48 +0900 [debug]: fluent/supervisor.rb:507:block in install_main_process_signal_handlers: fluentd main process get SIGTERM
2015-06-14 04:15:48 +0900 [debug]: fluent/supervisor.rb:510:block in install_main_process_signal_handlers: getting start to shutdown main process
2015-06-14 04:15:48 +0900 [info]: fluent/engine.rb:175:run: shutting down fluentd
2015-06-14 04:15:48 +0900 [debug]: plugin/output_node.rb:87:shutdown: shutting down node 10.96.152.142
2015-06-14 04:15:48 +0900 [info]: fluent/supervisor.rb:296:supervise: process finished code=0

＊ "ssl_version SSLv23" を指定しているのは、td-agent-1.1.21-0.x86_64 に同胞されている ruby のバージョンが 1.9.3 であり、デフォルト値の TLSv1_2 を認識できなかったためです。

tagomoris commented 9 years ago

out_secure_forward は connection established を報告している一方、以下のようなログが fluent/supervisor から出ています。

2015-06-14 04:15:48 +0900 [debug]: fluent/supervisor.rb:337:block in install_supervisor_signal_handlers: fluentd supervisor process get SIGTERM
2015-06-14 04:15:48 +0900 [debug]: fluent/supervisor.rb:507:block in install_main_process_signal_handlers: fluentd main process get SIGTERM

何が原因かはわかりませんが外部からSIGTERMを受け取っているようなので、少なくとも secure-forward plugin の問題ではないようです。

cbh34680 commented 9 years ago

回答ありがとうございます。 Closed にされた後にすみません。

ご指摘のあったのは最後に td-agent を停止したときの記録 (2015-06-14 04:15:48) で、 そちらは [process finished code=0] と、正常に終了しています。

今回 伺っているのは 2015-06-14 04:15:39 に記録されている [process finished code=6] のほうになります。

tagomoris commented 9 years ago

見間違えていました、すみません。 が、これだと原因はわからないですね……。

cbh34680 commented 9 years ago

お忙しい中 再度のご回答ありがとうございました。

原因が不明とのことですので、問題の発生していない 0.2.5 のバージョンのまま 更新せずに利用させていただきます。

tagomoris commented 9 years ago

Let me close this issue at once. Please open another issue if someone find any problem related with this.