microsoft / OMS-Agent-for-Linux

http://www.microsoft.com/oms
Other
407 stars 311 forks source link

Use OmsAgentForLinux-1.13.40 in a Linux Azure VM. Log Analytics workspace can't receive VM data #1404

Open paulliu10 opened 2 years ago

paulliu10 commented 2 years ago

We use OmsAgentForLinux-1.13.40 in a Linux Azure VM.

On the Azure portal I can see that the VM is connected to the workspace, but I can't get the data, please help to solve this issue, I really appreciate it.

I can see the following error message in the VM from /var/opt/microsoft/omsagent/log/omsagent.log:

2021-11-09 06:41:45 +0000 [error]: Error sending the telemetry request to OMS agent management service: execution expired 2021-11-09 06:41:45 +0000 [error]: Error sending OMS agent management service telemetry request. No HTTP code 2021-11-09 06:42:00 +0000 [info]: Sending OMS Heartbeat succeeded at 2021-11-09T06:42:00.213Z 2021-11-09 06:43:00 +0000 [info]: Sending OMS Heartbeat succeeded at 2021-11-09T06:43:00.214Z 2021-11-09 06:44:00 +0000 [info]: Sending OMS Heartbeat succeeded at 2021-11-09T06:44:00.214Z 2021-11-09 06:44:44 +0000 [warn]: retry succeeded. plugin_id="object:3ffacefc052c" 2021-11-09 06:45:00 +0000 [warn]: retry succeeded. plugin_id="object:3ffacf0f229c" 2021-11-09 06:45:00 +0000 [info]: Sending OMS Heartbeat succeeded at 2021-11-09T06:45:00.215Z 2021-11-09 06:45:14 +0000 [info]: Encountered retryable exception. Will retry sending data later. 2021-11-09 06:45:14 +0000 [warn]: temporarily failed to flush the buffer. next_retry=2021-11-09 06:45:14 +0000 error_class="RuntimeError" error="Net::HTTP.Post raises exception: Net::OpenTimeout, 'execution expired'" plugin_id="object:3ffacefc052c" 2021-11-09 06:45:14 +0000 [warn]: /opt/microsoft/omsagent/plugin/out_oms.rb:78:in rescue in handle_record' 2021-11-09 06:45:14 +0000 [warn]: /opt/microsoft/omsagent/plugin/out_oms.rb:55:inhandle_record' 2021-11-09 06:45:14 +0000 [warn]: /opt/microsoft/omsagent/plugin/out_oms.rb:123:in block (2 levels) in self_write' 2021-11-09 06:45:14 +0000 [warn]: /opt/microsoft/omsagent/plugin/out_oms.rb:122:ineach' 2021-11-09 06:45:14 +0000 [warn]: /opt/microsoft/omsagent/plugin/out_oms.rb:122:in block in self_write' 2021-11-09 06:45:14 +0000 [warn]: /opt/microsoft/omsagent/plugin/out_oms.rb:121:ineach' 2021-11-09 06:45:14 +0000 [warn]: /opt/microsoft/omsagent/plugin/out_oms.rb:121:in self_write' 2021-11-09 06:45:14 +0000 [warn]: /opt/microsoft/omsagent/plugin/out_oms.rb:142:inwrite' 2021-11-09 06:45:14 +0000 [warn]: /opt/microsoft/omsagent/ruby/lib/ruby/gems/2.6.0/gems/fluentd-0.12.40/lib/fluent/buffer.rb:354:in write_chunk' 2021-11-09 06:45:14 +0000 [warn]: /opt/microsoft/omsagent/ruby/lib/ruby/gems/2.6.0/gems/fluentd-0.12.40/lib/fluent/buffer.rb:333:inpop' 2021-11-09 06:45:14 +0000 [warn]: /opt/microsoft/omsagent/ruby/lib/ruby/gems/2.6.0/gems/fluentd-0.12.40/lib/fluent/output.rb:342:in try_flush' 2021-11-09 06:45:14 +0000 [warn]: /opt/microsoft/omsagent/ruby/lib/ruby/gems/2.6.0/gems/fluentd-0.12.40/lib/fluent/output.rb:149:inrun' 2021-11-09 06:45:31 +0000 [info]: Encountered retryable exception. Will retry sending data later. 2021-11-09 06:45:31 +0000 [warn]: temporarily failed to flush the buffer. next_retry=2021-11-09 06:45:29 +0000 error_class="RuntimeError" error="Net::HTTP.Post raises exception: Net::OpenTimeout, 'execution expired'" plugin_id="object:3ffacf0f229c" 2021-11-09 06:45:31 +0000 [warn]: suppressed same stacktrace 2021-11-09 06:45:44 +0000 [info]: Encountered retryable exception. Will retry sending data later. 2021-11-09 06:45:44 +0000 [warn]: temporarily failed to flush the buffer. next_retry=2021-11-09 06:46:19 +0000 error_class="RuntimeError" error="Net::HTTP.Post raises exception: Net::OpenTimeout, 'execution expired'" plugin_id="object:3ffacefc052c" 2021-11-09 06:45:44 +0000 [warn]: suppressed same stacktrace 2021-11-09 06:46:00 +0000 [info]: Sending OMS Heartbeat succeeded at 2021-11-09T06:46:00.225Z 2021-11-09 06:46:01 +0000 [info]: Encountered retryable exception. Will retry sending data later. 2021-11-09 06:46:01 +0000 [warn]: temporarily failed to flush the buffer. next_retry=2021-11-09 06:46:27 +0000 error_class="RuntimeError" error="Net::HTTP.Post raises exception: Net::OpenTimeout, 'execution expired'" plugin_id="object:3ffacf0f229c" 2021-11-09 06:46:01 +0000 [warn]: suppressed same stacktrace 2021-11-09 06:46:32 +0000 [info]: nxOMSAuditdPlugin STATUS: {"Timestamp"=>"2021-11-09T06:46:31.000Z", "Computer"=>"cnaz1plappap03", "RecordType"=>"AUOMS_METRIC", "RecordTypeCode"=>10006, "Namespace"=>"DSC", "Name"=>"Test_Start", "version"=>"1.9", "Message"=>"Start", "Data"=>"{\"has_auditd\":true,\"auditd_pid\":1009,\"auomscollect_pid\":1015,\"auoms_pid\":1059}"} 2021-11-09 06:46:38 +0000 [info]: nxOMSAuditdPlugin STATUS: {"Timestamp"=>"2021-11-09T06:46:32.000Z", "Computer"=>"cnaz1plappap03", "RecordType"=>"AUOMS_METRIC", "RecordTypeCode"=>10006, "Namespace"=>"DSC", "Name"=>"Test_End", "version"=>"1.9", "Message"=>"Set Operation Not Needed", "Data"=>"{\"has_auditd\":true,\"auditd_pid\":1009,\"auomscollect_pid\":1015,\"auoms_pid\":1059}"} 2021-11-09 06:46:47 +0000 [error]: Error sending the telemetry request to OMS agent management service: execution expired 2021-11-09 06:46:47 +0000 [error]: Error sending OMS agent management service telemetry request. No HTTP code 2021-11-09 06:46:49 +0000 [info]: Encountered retryable exception. Will retry sending data later. 2021-11-09 06:46:49 +0000 [warn]: temporarily failed to flush the buffer. next_retry=2021-11-09 06:48:26 +0000 error_class="RuntimeError" error="Net::HTTP.Post raises exception: Net::OpenTimeout, 'execution expired'" plugin_id="object:3ffacefc052c" 2021-11-09 06:46:49 +0000 [warn]: suppressed same stacktrace 2021-11-09 06:46:57 +0000 [info]: Encountered retryable exception. Will retry sending data later. 2021-11-09 06:46:57 +0000 [warn]: temporarily failed to flush the buffer. next_retry=2021-11-09 06:48:31 +0000 error_class="RuntimeError" error="Net::HTTP.Post raises exception: Net::OpenTimeout, 'execution expired'" plugin_id="object:3ffacf0f229c" 2021-11-09 06:46:57 +0000 [warn]: suppressed same stacktrace 2021-11-09 06:47:00 +0000 [info]: Sending OMS Heartbeat succeeded at 2021-11-09T06:47:00.226Z 2021-11-09 06:47:33 +0000 [warn]: retry succeeded. plugin_id="object:3ffacf0e397c" 2021-11-09 06:48:00 +0000 [info]: Sending OMS Heartbeat succeeded at 2021-11-09T06:48:00.227Z 2021-11-09 06:48:04 +0000 [info]: Encountered retryable exception. Will retry sending data later. 2021-11-09 06:48:04 +0000 [warn]: temporarily failed to flush the buffer. next_retry=2021-11-09 06:48:06 +0000 error_class="RuntimeError" error="Net::HTTP.Post raises exception: Net::OpenTimeout, 'execution expired'" plugin_id="object:3ffacf0e397c" 2021-11-09 06:48:04 +0000 [warn]: suppressed same stacktrace 2021-11-09 06:48:36 +0000 [info]: Encountered retryable exception. Will retry sending data later. 2021-11-09 06:48:36 +0000 [warn]: temporarily failed to flush the buffer. next_retry=2021-11-09 06:49:13 +0000 error_class="RuntimeError" error="Net::HTTP.Post raises exception: Net::OpenTimeout, 'execution expired'" plugin_id="object:3ffacf0e397c" 2021-11-09 06:48:36 +0000 [warn]: suppressed same stacktrace 2021-11-09 06:48:56 +0000 [info]: Encountered retryable exception. Will retry sending data later. 2021-11-09 06:48:56 +0000 [warn]: temporarily failed to flush the buffer. next_retry=2021-11-09 06:52:02 +0000 error_class="RuntimeError" error="Net::HTTP.Post raises exception: Net::OpenTimeout, 'execution expired'" plugin_id="object:3ffacefc052c" 2021-11-09 06:48:56 +0000 [warn]: suppressed same stacktrace 2021-11-09 06:48:57 +0000 [warn]: retry succeeded. plugin_id="object:3ffacef1724c" 2021-11-09 06:49:00 +0000 [info]: Sending OMS Heartbeat succeeded at 2021-11-09T06:49:00.227Z 2021-11-09 06:49:01 +0000 [info]: Encountered retryable exception. Will retry sending data later. 2021-11-09 06:49:01 +0000 [warn]: temporarily failed to flush the buffer. next_retry=2021-11-09 06:52:05 +0000 error_class="RuntimeError" error="Net::HTTP.Post raises exception: Net::OpenTimeout, 'execution expired'" plugin_id="object:3ffacf0f229c" 2021-11-09 06:49:01 +0000 [warn]: suppressed same stacktrace 2021-11-09 06:49:28 +0000 [info]: Encountered retryable exception. Will retry sending data later. 2021-11-09 06:49:28 +0000 [warn]: temporarily failed to flush the buffer. next_retry=2021-11-09 06:49:28 +0000 error_class="RuntimeError" error="Net::HTTP.Post raises exception: Net::OpenTimeout, 'execution expired'" plugin_id="object:3ffacef1724c" 2021-11-09 06:49:28 +0000 [warn]: suppressed same stacktrace 2021-11-09 06:49:43 +0000 [info]: Encountered retryable exception. Will retry sending data later. 2021-11-09 06:49:43 +0000 [warn]: temporarily failed to flush the buffer. next_retry=2021-11-09 06:51:27 +0000 error_class="RuntimeError" error="Net::HTTP.Post raises exception: Net::OpenTimeout, 'execution expired'" plugin_id="object:3ffacf0e397c" 2021-11-09 06:49:43 +0000 [warn]: suppressed same stacktrace 2021-11-09 06:49:58 +0000 [info]: Encountered retryable exception. Will retry sending data later. 2021-11-09 06:49:58 +0000 [warn]: temporarily failed to flush the buffer. next_retry=2021-11-09 06:50:34 +0000 error_class="RuntimeError" error="Net::HTTP.Post raises exception: Net::OpenTimeout, 'execution expired'" plugin_id="object:3ffacef1724c" 2021-11-09 06:49:58 +0000 [warn]: suppressed same stacktrace 2021-11-09 06:50:00 +0000 [info]: Sending OMS Heartbeat succeeded at 2021-11-09T06:50:00.228Z 2021-11-09 06:51:00 +0000 [info]: Sending OMS Heartbeat succeeded at 2021-11-09T06:51:00.229Z 2021-11-09 06:51:04 +0000 [info]: Encountered retryable exception. Will retry sending data later. 2021-11-09 06:51:04 +0000 [warn]: temporarily failed to flush the buffer. next_retry=2021-11-09 06:52:27 +0000 error_class="RuntimeError" error="Net::HTTP.Post raises exception: Net::OpenTimeout, 'execution expired'" plugin_id="object:3ffacef1724c" 2021-11-09 06:51:04 +0000 [warn]: suppressed same stacktrace 2021-11-09 06:51:50 +0000 [error]: Error sending the telemetry request to OMS agent management service: execution expired 2021-11-09 06:51:50 +0000 [error]: Error sending OMS agent management service telemetry request. No HTTP code 2021-11-09 06:51:57 +0000 [info]: Encountered retryable exception. Will retry sending data later. 2021-11-09 06:51:57 +0000 [warn]: temporarily failed to flush the buffer. next_retry=2021-11-09 06:55:08 +0000 error_class="RuntimeError" error="Net::HTTP.Post raises exception: Net::OpenTimeout, 'execution expired'" plugin_id="object:3ffacf0e397c" 2021-11-09 06:51:57 +0000 [warn]: suppressed same stacktrace 2021-11-09 06:52:00 +0000 [info]: Sending OMS Heartbeat succeeded at 2021-11-09T06:52:00.230Z

omsagentlog omsconfiglog.zip omsagentlog omsconfiglog.zip

paulliu10 commented 2 years ago

Hope you are doing well.

Are there any updates on this issue?

Thank you!

paulliu10 commented 2 years ago

I wonder if anyone could help with this problem, I would really appreciate it.

Thank you!

anthonyAA11 commented 1 year ago

Hi, did you solved this issue, if yes how ?