nvidiagpubeat is an elastic beat that uses NVIDIA System Management Interface (nvidia-smi) to monitor NVIDIA GPU devices and can ingest metrics into Elastic search cluster, with support for both 6.x and 7.x versions of beats. nvidia-smi is a command line utility, based on top of the NVIDIA Management Library (NVML), intended to aid in the management and monitoring of NVIDIA GPU devices.
We're trying to streamline access to our Elastic Search servers so we go through LogStash for some Beats. We also tried sending nvidiagpubeat to LogStash but we get these warnings that are errors since we have an empty index:
[WARN ] 2018-12-09 10:52:59.113 [nioEventLoopGroup-2-1] jsonlines - Received an event that has a different character encoding than you configured. {:text=>"\\x85\\x87S\\xF6\\x92\\xA1peoiij\\xC2\\u0010\\xF2\\u007F\\xDF\\xF3\\u0015E\\xED\\x8F\\a\\u001D\\xC5:NB.\\xC0\\xA0\\xA9\\xB7\\x87\\xF5\\xB6Y\\xD7\\xDD}\\xBD7\\xFA\\x9F\\xD1z\\xD3j\\xFD\\x88\\xE5=\\u0000\\u0000\\xFF\\xFF|[uk", :expected_charset=>"UTF-8"}
[WARN ] 2018-12-09 10:52:59.116 [nioEventLoopGroup-2-1] jsonlines - JSON parse error, original data now in message field {:error=>#<LogStash::Json::ParserError: Unexpected character ('\' (code 92)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
at [Source: (String)"\x85\x87S\xF6\x92\xA1peoiij\xC2\u0010\xF2\u007F\xDF\xF3\u0015E\xED\x8F\a\u001D\xC5:NB.\xC0\xA0\xA9\xB7\x87\xF5\xB6Y\xD7\xDD}\xBD7\xFA\x9F\xD1z\xD3j\xFD\x88\xE5=\u0000\u0000\xFF\xFF|[uk"; line: 1, column: 2]>, :data=>"\\x85\\x87S\\xF6\\x92\\xA1peoiij\\xC2\\u0010\\xF2\\u007F\\xDF\\xF3\\u0015E\\xED\\x8F\\a\\u001D\\xC5:NB.\\xC0\\xA0\\xA9\\xB7\\x87\\xF5\\xB6Y\\xD7\\xDD}\\xBD7\\xFA\\x9F\\xD1z\\xD3j\\xFD\\x88\\xE5=\\u0000\\u0000\\xFF\\xFF|[uk"}
[WARN ] 2018-12-09 10:52:29.318 [nioEventLoopGroup-2-1] jsonlines - JSON parse error, original data now in message field {:error=>#<LogStash::Json::ParserError: Unexpected character ('\' (code 92)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
at [Source: (String)"\xBBM\xB3\xD1X\u0014B\u0012\u0012\x869|Sg\xE4\xC4=L\xD3*\xC8$4´\xFBV+\xBCD\xE62o\xBBEA\xD8\u0005\x8E$9\xF2\xD7iÍ®,hH0O\x88\xE9\u0002\x85!s*\x86\xA3\xF5\xF9"; line: 1, column: 2]>, :data=>"\\xBBM\\xB3\\xD1X\\u0014B\\u0012\\u0012\\x869|Sg\\xE4\\xC4=L\\xD3*\\xC8$4´\\xFBV+\\xBCD\\xE62o\\xBBEA\\xD8\\u0005\\x8E$9\\xF2\\xD7iͮ,hH0O\\x88\\xE9\\u0002\\x85!s*\\x86\\xA3\\xF5\\xF9"}[WARN ] 2018-12-09 10:54:29.195 [nioEventLoopGroup-2-2] jsonlines - Received an event that has a different character encoding than you configured. {:text=>"2W\\u0000\\u0000\\u0000\\u00012C\\u0000\\u0000\\u0000\\xFCx^t\\x90OK\\xC3@\\u0010\\xC5ӯ\\xF2\\xCEӒ&)m\\xF6ԫ\\x9E\\xF5\\xA2x\\x98\\x921.d7\\xCB\\xEEl\\xFF\\u0018\\xF2\\xDD%\\x82\\u0005\\u0011o\\xC30\\xEF\\xC7\\xFC^\\xF5X\\u0014Ū(V~\\xC2щr\\xC7\\xCA0\\u0013\\xF4\\u0016\\u0004\\u0006\\xFEl;\\xCB}\\xC8'a\\u0005\\xE1$\\xAC\\u007F\\xD63!$e\\u0015\\x98\\u0003A\\xC5\\u0005\\x89\\xAC9\\xCA\\u0002\\xEAC\\x86\\xA9v3\\xA1\\u000F\\xF9\\xC1wr\\x85)\\xE9?~V;\\xD8OV;\\xFA{\\xB8$8qc\\xBC\\xC1\\x943\\xE1\\xA8\\xD6IRv\\u0001\\u0006U\\xB9=\\xAC\\xB7պl\\x9Fʽ\\xA9[Sכ\\xA6\\u07BD\\x80\\xEE\\x99\\t:*\\u000F0;\\xA9\\t\\xEFQd\\x99\\xB7-!'\\xE9`\\xAAf\\xFE\\u0011\\x9B\\xF01&\\xF5\\xEC\\u0016\\xF7\\x98.\\xA9mA8KL\\xDF\\u000Fa\\xB7\\xA965\\b\\xBF/f\\x82r\\x9F`^\\u0011\\xD3\\u0005\\x84>KZ\\xDA\\u001A\\xAC\\xCFW\\u0010\\x9EO\\xD9k\\u0006\\xE1*\\xDE\\xF2\\x80\\xB7\\xF9+\\u0000\\u0000\\xFF\\xFF\\v&up", :expected_charset=>"UTF-8"}
Any idea what's happening? Has this ever been tested or are we forced to send data directly to ES?
We're trying to streamline access to our Elastic Search servers so we go through LogStash for some Beats. We also tried sending nvidiagpubeat to LogStash but we get these warnings that are errors since we have an empty index:
Any idea what's happening? Has this ever been tested or are we forced to send data directly to ES?
Ciao, Antonio
Moving existing issues from https://github.com/deepujain/nvidiagpubeat to here Created on behalf of @antoniokaust