Open manjunth-r opened 6 years ago
azure event hub client crashing occasionally and during the time we are able to see "event hub internal error" also increasing on the metrics provided at the Azure portal.
here is the stack trace from the client side,
Jul 05 12:40:36 [CRIT] [0] Jul 05 12:40:36 [CRIT] [1] BUFFER_delete Jul 05 12:40:36 [CRIT] [2] EventData_Destroy Jul 05 12:40:36 [CRIT] [3] Jul 05 12:40:36 [CRIT] [4] Jul 05 12:40:36 [CRIT] [5] Jul 05 12:40:36 [CRIT] [6] Jul 05 12:40:36 [CRIT] [7] Jul 05 12:40:36 [CRIT] [8] Jul 05 12:40:36 [CRIT] [9] Jul 05 12:40:36 [CRIT] [10] Jul 05 12:40:36 [CRIT] [11] frame_codec_receive_bytes Jul 05 12:40:36 [CRIT] [12] Jul 05 12:40:36 [CRIT] [13] Jul 05 12:40:36 [CRIT] [14] Jul 05 12:40:36 [CRIT] [15] Jul 05 12:40:36 [CRIT] [16] Jul 05 12:40:36 [CRIT] [17] socketio_dowork Jul 05 12:40:36 [CRIT] [18] xio_dowork Jul 05 12:40:36 [CRIT] [19] tlsio_openssl_dowork Jul 05 12:40:36 [CRIT] [20] xio_dowork Jul 05 12:40:36 [CRIT] [21] saslclientio_dowork Jul 05 12:40:36 [CRIT] [22] xio_dowork Jul 05 12:40:36 [CRIT] [23] connection_dowork Jul 05 12:40:36 [CRIT] [24] EventHubClient_LL_DoWork Jul 05 12:40:36 [CRIT] [25] Jul 05 12:40:36 [CRIT] [26] Jul 05 12:40:36 [CRIT] [27] Jul 05 12:40:36 [CRIT] [28] clone
one more,
Jul 04 16:56:01 [CRIT] <<<<<< Printing Stack Trace >>>>>> Jul 04 16:56:01 [CRIT] [0] Jul 04 16:56:01 [CRIT] [1] freeaddrinfo Jul 04 16:56:01 [CRIT] [2] socketio_open Jul 04 16:56:01 [CRIT] [3] xio_open Jul 04 16:56:01 [CRIT] [4] tlsio_openssl_open Jul 04 16:56:01 [CRIT] [5] xio_open Jul 04 16:56:01 [CRIT] [6] saslclientio_open Jul 04 16:56:01 [CRIT] [7] xio_open Jul 04 16:56:01 [CRIT] [8] connection_open Jul 04 16:56:01 [CRIT] [9] session_begin Jul 04 16:56:01 [CRIT] [10] link_attach Jul 04 16:56:01 [CRIT] [11] messagereceiver_open Jul 04 16:56:01 [CRIT] [12] amqp_management_open_async Jul 04 16:56:01 [CRIT] [13] cbs_open_async Jul 04 16:56:01 [CRIT] [14] EventHubAuthCBS_Create Jul 04 16:56:01 [CRIT] [15] Jul 04 16:56:01 [CRIT] [16] Jul 04 16:56:01 [CRIT] [17] Jul 04 16:56:01 [CRIT] [18] EventHubClient_LL_DoWork Jul 04 16:56:01 [CRIT] [19] Jul 04 16:56:01 [CRIT] [20] Jul 04 16:56:01 [CRIT] [21] Jul 04 16:56:01 [CRIT] [22] clone
we are able to correlate "event hub internal error" on the metrics provided at the Azure portal.
azure event hub client crashing occasionally and during the time we are able to see "event hub internal error" also increasing on the metrics provided at the Azure portal.
here is the stack trace from the client side,
Jul 05 12:40:36 [CRIT] [0] Jul 05 12:40:36 [CRIT] [1] BUFFER_delete Jul 05 12:40:36 [CRIT] [2] EventData_Destroy Jul 05 12:40:36 [CRIT] [3] Jul 05 12:40:36 [CRIT] [4] Jul 05 12:40:36 [CRIT] [5] Jul 05 12:40:36 [CRIT] [6] Jul 05 12:40:36 [CRIT] [7] Jul 05 12:40:36 [CRIT] [8] Jul 05 12:40:36 [CRIT] [9] Jul 05 12:40:36 [CRIT] [10] Jul 05 12:40:36 [CRIT] [11] frame_codec_receive_bytes Jul 05 12:40:36 [CRIT] [12] Jul 05 12:40:36 [CRIT] [13] Jul 05 12:40:36 [CRIT] [14] Jul 05 12:40:36 [CRIT] [15] Jul 05 12:40:36 [CRIT] [16] Jul 05 12:40:36 [CRIT] [17] socketio_dowork Jul 05 12:40:36 [CRIT] [18] xio_dowork Jul 05 12:40:36 [CRIT] [19] tlsio_openssl_dowork Jul 05 12:40:36 [CRIT] [20] xio_dowork Jul 05 12:40:36 [CRIT] [21] saslclientio_dowork Jul 05 12:40:36 [CRIT] [22] xio_dowork Jul 05 12:40:36 [CRIT] [23] connection_dowork Jul 05 12:40:36 [CRIT] [24] EventHubClient_LL_DoWork Jul 05 12:40:36 [CRIT] [25] Jul 05 12:40:36 [CRIT] [26] Jul 05 12:40:36 [CRIT] [27] Jul 05 12:40:36 [CRIT] [28] clone
one more,
Jul 04 16:56:01 [CRIT] <<<<<< Printing Stack Trace >>>>>> Jul 04 16:56:01 [CRIT] [0] Jul 04 16:56:01 [CRIT] [1] freeaddrinfo Jul 04 16:56:01 [CRIT] [2] socketio_open Jul 04 16:56:01 [CRIT] [3] xio_open Jul 04 16:56:01 [CRIT] [4] tlsio_openssl_open Jul 04 16:56:01 [CRIT] [5] xio_open Jul 04 16:56:01 [CRIT] [6] saslclientio_open Jul 04 16:56:01 [CRIT] [7] xio_open Jul 04 16:56:01 [CRIT] [8] connection_open Jul 04 16:56:01 [CRIT] [9] session_begin Jul 04 16:56:01 [CRIT] [10] link_attach Jul 04 16:56:01 [CRIT] [11] messagereceiver_open Jul 04 16:56:01 [CRIT] [12] amqp_management_open_async Jul 04 16:56:01 [CRIT] [13] cbs_open_async Jul 04 16:56:01 [CRIT] [14] EventHubAuthCBS_Create Jul 04 16:56:01 [CRIT] [15] Jul 04 16:56:01 [CRIT] [16] Jul 04 16:56:01 [CRIT] [17] Jul 04 16:56:01 [CRIT] [18] EventHubClient_LL_DoWork Jul 04 16:56:01 [CRIT] [19] Jul 04 16:56:01 [CRIT] [20] Jul 04 16:56:01 [CRIT] [21] Jul 04 16:56:01 [CRIT] [22] clone
we are able to correlate "event hub internal error" on the metrics provided at the Azure portal.