Open ByeongHunKim opened 2 weeks ago
Issue Description / 이슈 설명 발생한 문제에 대해 간단히 설명해주세요
istio_requests_total istio_response_bytes_bucket istio_request_bytes_count istio_request_duration_milliseconds_bucket istio_request_duration_milliseconds_count # TYPE istio_response_bytes histogram istio_request_bytes_bucket
# TYPE envoy_listener_manager_lds_init_fetch_timeout counter envoy_listener_manager_lds_init_fetch_timeout{} 0 # TYPE envoy_listener_manager_lds_update_attempt counter envoy_listener_manager_lds_update_attempt{} 2316 # TYPE envoy_listener_manager_lds_update_failure counter envoy_listener_manager_lds_update_failure{} 895 # TYPE envoy_listener_manager_lds_update_rejected counter envoy_listener_manager_lds_update_rejected{} 0 # TYPE envoy_listener_manager_lds_update_success counter envoy_listener_manager_lds_update_success{} 1420 # TYPE envoy_listener_manager_listener_added counter envoy_listener_manager_listener_added{} 4 # TYPE envoy_listener_manager_listener_create_failure counter envoy_listener_manager_listener_create_failure{} 0 # TYPE envoy_listener_manager_listener_create_success counter envoy_listener_manager_listener_create_success{} 122 # TYPE envoy_listener_manager_listener_in_place_updated counter envoy_listener_manager_listener_in_place_updated{} 57 # TYPE envoy_listener_manager_listener_modified counter envoy_listener_manager_listener_modified{} 57 # TYPE envoy_listener_manager_listener_removed counter envoy_listener_manager_listener_removed{} 0 # TYPE envoy_listener_manager_listener_stopped counter envoy_listener_manager_listener_stopped{} 0 # TYPE envoy_server_debug_assertion_failures counter envoy_server_debug_assertion_failures{} 0 # TYPE envoy_server_dropped_stat_flushes counter envoy_server_dropped_stat_flushes{} 0 # TYPE envoy_server_dynamic_unknown_fields counter envoy_server_dynamic_unknown_fields{} 0 # TYPE envoy_server_envoy_bug_failures counter envoy_server_envoy_bug_failures{} 0 # TYPE envoy_server_main_thread_watchdog_mega_miss counter envoy_server_main_thread_watchdog_mega_miss{} 0 # TYPE envoy_server_main_thread_watchdog_miss counter envoy_server_main_thread_watchdog_miss{} 9 # TYPE envoy_server_static_unknown_fields counter envoy_server_static_unknown_fields{} 0 # TYPE envoy_server_wip_protos counter envoy_server_wip_protos{} 0 # TYPE envoy_server_worker_0_watchdog_mega_miss counter envoy_server_worker_0_watchdog_mega_miss{} 0 # TYPE envoy_server_worker_0_watchdog_miss counter envoy_server_worker_0_watchdog_miss{} 0 # TYPE envoy_server_worker_1_watchdog_mega_miss counter envoy_server_worker_1_watchdog_mega_miss{} 0 # TYPE envoy_server_worker_1_watchdog_miss counter envoy_server_worker_1_watchdog_miss{} 0 # TYPE envoy_cluster_circuit_breakers_default_cx_open gauge envoy_cluster_circuit_breakers_default_cx_open{cluster_name="xds-grpc"} 0 # TYPE envoy_cluster_circuit_breakers_default_cx_pool_open gauge envoy_cluster_circuit_breakers_default_cx_pool_open{cluster_name="xds-grpc"} 0 # TYPE envoy_cluster_circuit_breakers_default_rq_open gauge envoy_cluster_circuit_breakers_default_rq_open{cluster_name="xds-grpc"} 0 # TYPE envoy_cluster_circuit_breakers_default_rq_pending_open gauge envoy_cluster_circuit_breakers_default_rq_pending_open{cluster_name="xds-grpc"} 0 # TYPE envoy_cluster_circuit_breakers_default_rq_retry_open gauge envoy_cluster_circuit_breakers_default_rq_retry_open{cluster_name="xds-grpc"} 0 # TYPE envoy_cluster_circuit_breakers_high_cx_open gauge envoy_cluster_circuit_breakers_high_cx_open{cluster_name="xds-grpc"} 0 # TYPE envoy_cluster_circuit_breakers_high_cx_pool_open gauge envoy_cluster_circuit_breakers_high_cx_pool_open{cluster_name="xds-grpc"} 0 # TYPE envoy_cluster_circuit_breakers_high_rq_open gauge envoy_cluster_circuit_breakers_high_rq_open{cluster_name="xds-grpc"} 0 # TYPE envoy_cluster_circuit_breakers_high_rq_pending_open gauge envoy_cluster_circuit_breakers_high_rq_pending_open{cluster_name="xds-grpc"} 0 # TYPE envoy_cluster_circuit_breakers_high_rq_retry_open gauge envoy_cluster_circuit_breakers_high_rq_retry_open{cluster_name="xds-grpc"} 0 # TYPE envoy_cluster_http2_deferred_stream_close gauge envoy_cluster_http2_deferred_stream_close{cluster_name="xds-grpc"} 0 # TYPE envoy_cluster_http2_outbound_control_frames_active gauge envoy_cluster_http2_outbound_control_frames_active{cluster_name="xds-grpc"} 0 # TYPE envoy_cluster_http2_outbound_frames_active gauge envoy_cluster_http2_outbound_frames_active{cluster_name="xds-grpc"} 0 # TYPE envoy_cluster_http2_pending_send_bytes gauge envoy_cluster_http2_pending_send_bytes{cluster_name="xds-grpc"} 0 # TYPE envoy_cluster_http2_streams_active gauge envoy_cluster_http2_streams_active{cluster_name="xds-grpc"} 1 # TYPE envoy_cluster_lb_subsets_active gauge envoy_cluster_lb_subsets_active{cluster_name="xds-grpc"} 0 # TYPE envoy_cluster_max_host_weight gauge envoy_cluster_max_host_weight{cluster_name="xds-grpc"} 0 # TYPE envoy_cluster_membership_degraded gauge envoy_cluster_membership_degraded{cluster_name="xds-grpc"} 0 # TYPE envoy_cluster_membership_excluded gauge envoy_cluster_membership_excluded{cluster_name="xds-grpc"} 0 # TYPE envoy_cluster_membership_healthy gauge envoy_cluster_membership_healthy{cluster_name="xds-grpc"} 1 # TYPE envoy_cluster_membership_total gauge envoy_cluster_membership_total{cluster_name="xds-grpc"} 1 # TYPE envoy_cluster_upstream_cx_active gauge envoy_cluster_upstream_cx_active{cluster_name="xds-grpc"} 1 # TYPE envoy_cluster_upstream_cx_rx_bytes_buffered gauge envoy_cluster_upstream_cx_rx_bytes_buffered{cluster_name="xds-grpc"} 17 # TYPE envoy_cluster_upstream_cx_tx_bytes_buffered gauge envoy_cluster_upstream_cx_tx_bytes_buffered{cluster_name="xds-grpc"} 0 # TYPE envoy_cluster_upstream_rq_active gauge envoy_cluster_upstream_rq_active{cluster_name="xds-grpc"} 1 # TYPE envoy_cluster_upstream_rq_pending_active gauge envoy_cluster_upstream_rq_pending_active{cluster_name="xds-grpc"} 0 # TYPE envoy_cluster_version gauge envoy_cluster_version{cluster_name="xds-grpc"} 0 # TYPE envoy_cluster_warming_state gauge envoy_cluster_warming_state{cluster_name="xds-grpc"} 0 # TYPE envoy_cluster_manager_active_clusters gauge envoy_cluster_manager_active_clusters{} 103 # TYPE envoy_cluster_manager_cds_update_time gauge envoy_cluster_manager_cds_update_time{} 1731032412362 # TYPE envoy_cluster_manager_cds_version gauge envoy_cluster_manager_cds_version{} 1704168858431710892 # TYPE envoy_cluster_manager_warming_clusters gauge envoy_cluster_manager_warming_clusters{} 0 # TYPE istio_build gauge istio_build{component="proxy",tag="1.21.0"} 1 # TYPE envoy_listener_manager_lds_update_time gauge envoy_listener_manager_lds_update_time{} 1731032412380 # TYPE envoy_listener_manager_lds_version gauge envoy_listener_manager_lds_version{} 1704168858431710892 # TYPE envoy_listener_manager_total_filter_chains_draining gauge envoy_listener_manager_total_filter_chains_draining{} 0 # TYPE envoy_listener_manager_total_listeners_active gauge envoy_listener_manager_total_listeners_active{} 4 # TYPE envoy_listener_manager_total_listeners_draining gauge envoy_listener_manager_total_listeners_draining{} 0 # TYPE envoy_listener_manager_total_listeners_warming gauge envoy_listener_manager_total_listeners_warming{} 0 # TYPE envoy_listener_manager_workers_started gauge envoy_listener_manager_workers_started{} 1 # TYPE envoy_server_compilation_settings_fips_mode gauge envoy_server_compilation_settings_fips_mode{} 0 # TYPE envoy_server_concurrency gauge envoy_server_concurrency{} 2 # TYPE envoy_server_days_until_first_cert_expiring gauge envoy_server_days_until_first_cert_expiring{} 0 # TYPE envoy_server_hot_restart_epoch gauge envoy_server_hot_restart_epoch{} 0 # TYPE envoy_server_live gauge envoy_server_live{} 1 # TYPE envoy_server_memory_allocated gauge envoy_server_memory_allocated{} 35050912 # TYPE envoy_server_memory_heap_size gauge envoy_server_memory_heap_size{} 109101056 # TYPE envoy_server_memory_physical_size gauge envoy_server_memory_physical_size{} 111984640 # TYPE envoy_server_parent_connections gauge envoy_server_parent_connections{} 0 # TYPE envoy_server_seconds_until_first_ocsp_response_expiring gauge envoy_server_seconds_until_first_ocsp_response_expiring{} 0 # TYPE envoy_server_state gauge envoy_server_state{} 0 # TYPE envoy_server_stats_recent_lookups gauge envoy_server_stats_recent_lookups{} 274766 # TYPE envoy_server_total_connections gauge envoy_server_total_connections{} 269 # TYPE envoy_server_uptime gauge envoy_server_uptime{} 1614817 # TYPE envoy_server_version gauge envoy_server_version{} 15188609 # TYPE envoy_cluster_upstream_cx_connect_ms histogram envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="0.5"} 894 envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="1"} 894 envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="5"} 894 envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="10"} 896 envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="25"} 896 envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="50"} 896 envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="100"} 896 envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="250"} 896 envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="500"} 896 envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="1000"} 896 envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="2500"} 896 envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="5000"} 896 envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="10000"} 896 envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="30000"} 896 envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="60000"} 896 envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="300000"} 896 envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="600000"} 896 envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="1800000"} 896 envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="3600000"} 896 envoy_cluster_upstream_cx_connect_ms_bucket{cluster_name="xds-grpc",le="+Inf"} 896 envoy_cluster_upstream_cx_connect_ms_sum{cluster_name="xds-grpc"} 13.09999999999999964472863211995 envoy_cluster_upstream_cx_connect_ms_count{cluster_name="xds-grpc"} 896 # TYPE envoy_cluster_upstream_cx_length_ms histogram envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="0.5"} 0 envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="1"} 0 envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="5"} 0 envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="10"} 0 envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="25"} 0 envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="50"} 0 envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="100"} 0 envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="250"} 0 envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="500"} 0 envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="1000"} 0 envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="2500"} 0 envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="5000"} 0 envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="10000"} 0 envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="30000"} 0 envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="60000"} 0 envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="300000"} 0 envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="600000"} 0 envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="1800000"} 449 envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="3600000"} 895 envoy_cluster_upstream_cx_length_ms_bucket{cluster_name="xds-grpc",le="+Inf"} 895 envoy_cluster_upstream_cx_length_ms_sum{cluster_name="xds-grpc"} 1612650000 envoy_cluster_upstream_cx_length_ms_count{cluster_name="xds-grpc"} 895 # TYPE envoy_cluster_manager_cds_update_duration histogram envoy_cluster_manager_cds_update_duration_bucket{le="0.5"} 0 envoy_cluster_manager_cds_update_duration_bucket{le="1"} 0 envoy_cluster_manager_cds_update_duration_bucket{le="5"} 0 envoy_cluster_manager_cds_update_duration_bucket{le="10"} 657 envoy_cluster_manager_cds_update_duration_bucket{le="25"} 1344 envoy_cluster_manager_cds_update_duration_bucket{le="50"} 1346 envoy_cluster_manager_cds_update_duration_bucket{le="100"} 1347 envoy_cluster_manager_cds_update_duration_bucket{le="250"} 1347 envoy_cluster_manager_cds_update_duration_bucket{le="500"} 1347 envoy_cluster_manager_cds_update_duration_bucket{le="1000"} 1347 envoy_cluster_manager_cds_update_duration_bucket{le="2500"} 1347 envoy_cluster_manager_cds_update_duration_bucket{le="5000"} 1347 envoy_cluster_manager_cds_update_duration_bucket{le="10000"} 1347 envoy_cluster_manager_cds_update_duration_bucket{le="30000"} 1347 envoy_cluster_manager_cds_update_duration_bucket{le="60000"} 1347 envoy_cluster_manager_cds_update_duration_bucket{le="300000"} 1347 envoy_cluster_manager_cds_update_duration_bucket{le="600000"} 1347 envoy_cluster_manager_cds_update_duration_bucket{le="1800000"} 1347 envoy_cluster_manager_cds_update_duration_bucket{le="3600000"} 1347 envoy_cluster_manager_cds_update_duration_bucket{le="+Inf"} 1347 envoy_cluster_manager_cds_update_duration_sum{} 13748.850000000000363797880709171 envoy_cluster_manager_cds_update_duration_count{} 1347
# TYPE envoy_listener_manager_lds_update_duration histogram envoy_listener_manager_lds_update_duration_bucket{le="0.5"} 0 envoy_listener_manager_lds_update_duration_bucket{le="1"} 0 envoy_listener_manager_lds_update_duration_bucket{le="5"} 37 envoy_listener_manager_lds_update_duration_bucket{le="10"} 1338 envoy_listener_manager_lds_update_duration_bucket{le="25"} 1364 envoy_listener_manager_lds_update_duration_bucket{le="50"} 1389 envoy_listener_manager_lds_update_duration_bucket{le="100"} 1420 envoy_listener_manager_lds_update_duration_bucket{le="250"} 1420 envoy_listener_manager_lds_update_duration_bucket{le="500"} 1420 envoy_listener_manager_lds_update_duration_bucket{le="1000"} 1420 envoy_listener_manager_lds_update_duration_bucket{le="2500"} 1420 envoy_listener_manager_lds_update_duration_bucket{le="5000"} 1420 envoy_listener_manager_lds_update_duration_bucket{le="10000"} 1420 envoy_listener_manager_lds_update_duration_bucket{le="30000"} 1420 envoy_listener_manager_lds_update_duration_bucket{le="60000"} 1420 envoy_listener_manager_lds_update_duration_bucket{le="300000"} 1420 envoy_listener_manager_lds_update_duration_bucket{le="600000"} 1420 envoy_listener_manager_lds_update_duration_bucket{le="1800000"} 1420 envoy_listener_manager_lds_update_duration_bucket{le="3600000"} 1420 envoy_listener_manager_lds_update_duration_bucket{le="+Inf"} 1420 envoy_listener_manager_lds_update_duration_sum{} 10968.899999999999636202119290829 envoy_listener_manager_lds_update_duration_count{} 1420 # TYPE envoy_server_initialization_time_ms histogram envoy_server_initialization_time_ms_bucket{le="0.5"} 0 envoy_server_initialization_time_ms_bucket{le="1"} 0 envoy_server_initialization_time_ms_bucket{le="5"} 0 envoy_server_initialization_time_ms_bucket{le="10"} 0 envoy_server_initialization_time_ms_bucket{le="25"} 0 envoy_server_initialization_time_ms_bucket{le="50"} 0 envoy_server_initialization_time_ms_bucket{le="100"} 0 envoy_server_initialization_time_ms_bucket{le="250"} 0 envoy_server_initialization_time_ms_bucket{le="500"} 0 envoy_server_initialization_time_ms_bucket{le="1000"} 0 envoy_server_initialization_time_ms_bucket{le="2500"} 0 envoy_server_initialization_time_ms_bucket{le="5000"} 0 envoy_server_initialization_time_ms_bucket{le="10000"} 0 envoy_server_initialization_time_ms_bucket{le="30000"} 1 envoy_server_initialization_time_ms_bucket{le="60000"} 1 envoy_server_initialization_time_ms_bucket{le="300000"} 1 envoy_server_initialization_time_ms_bucket{le="600000"} 1 envoy_server_initialization_time_ms_bucket{le="1800000"} 1 envoy_server_initialization_time_ms_bucket{le="3600000"} 1 envoy_server_initialization_time_ms_bucket{le="+Inf"} 1 envoy_server_initialization_time_ms_sum{} 15500 envoy_server_initialization_time_ms_count{} 1
Steps to Reproduce / 재현 단계 문제를 재현하기 위한 단계를 설명해주세요: 1. 2. 3.
Expected Behavior / 예상 동작 정상적으로 작동했을 때 예상되는 동작을 설명해주세요
Actual Behavior / 실제 동작 실제로 발생한 동작이나 오류를 설명해주세요
Logs / 로그 관련된 로그나 오류 메시지를 첨부해주세요
여기에 로그를 붙여넣으세요
Configuration / 설정 문제와 관련된 Istio 설정이나 YAML 파일을 첨부해주세요
여기에 설정 파일을 붙여넣으세요
Attempted Solutions / 시도한 해결 방법 문제를 해결하기 위해 시도해본 방법이 있다면 설명해주세요
Impact / 영향 이 문제가 서비스나 사용자에게 미치는 영향이 있다면 설명해주세요
Additional Context / 추가 정보 문제 해결에 도움이 될 만한 추가 정보나 스크린샷이 있다면 첨부해주세요
https://blog.christianposta.com/understanding-istio-telemetry-v2/
ByeongHunKim
commented
2 weeks ago ByeongHunKim
commented
2 weeks ago
Issue Description / 이슈 설명 발생한 문제에 대해 간단히 설명해주세요
Steps to Reproduce / 재현 단계 문제를 재현하기 위한 단계를 설명해주세요: 1. 2. 3.
Expected Behavior / 예상 동작 정상적으로 작동했을 때 예상되는 동작을 설명해주세요
Actual Behavior / 실제 동작 실제로 발생한 동작이나 오류를 설명해주세요
Logs / 로그 관련된 로그나 오류 메시지를 첨부해주세요
Configuration / 설정 문제와 관련된 Istio 설정이나 YAML 파일을 첨부해주세요
Attempted Solutions / 시도한 해결 방법 문제를 해결하기 위해 시도해본 방법이 있다면 설명해주세요
Impact / 영향 이 문제가 서비스나 사용자에게 미치는 영향이 있다면 설명해주세요
Additional Context / 추가 정보 문제 해결에 도움이 될 만한 추가 정보나 스크린샷이 있다면 첨부해주세요