scylladb / scylla-monitoring

Simple monitoring of Scylla with Grafana
https://scylladb.github.io/scylla-monitoring/
Apache License 2.0
241 stars 143 forks source link

Mark base metrics with a tag #1608

Open amnonh opened 2 years ago

amnonh commented 2 years ago

Part of the optimization when using more than one metric server, it will be useful to be able to get only a subset the metrics.

The following is the list of base metrics used by Datadog

scylla_cache_active_reads
scylla_cache_bytes_total
scylla_cache_bytes_used
scylla_cache_concurrent_misses_same_key
scylla_cache_mispopulations
scylla_cache_partition_evictions
scylla_cache_partition_hits
scylla_cache_partition_insertions
scylla_cache_partition_merges
scylla_cache_partition_misses
scylla_cache_partition_removals
scylla_cache_partitions
scylla_cache_pinned_dirty_memory_overload
scylla_cache_reads
scylla_cache_reads_with_misses
scylla_cache_row_evictions
scylla_cache_row_hits
scylla_cache_row_insertions
scylla_cache_row_misses
scylla_cache_row_removals
scylla_cache_rows
scylla_cache_rows_dropped_from_memtable
scylla_cache_rows_merged_from_memtable
scylla_cache_rows_processed_from_memtable
scylla_cache_sstable_partition_skips
scylla_cache_sstable_reader_recreations
scylla_cache_sstable_row_skips
scylla_cache_static_row_insertions
scylla_compaction_manager_compactions
scylla_gossip_heart_beat
scylla_node_operation_mode
scylla_reactor_aio_bytes_read
scylla_reactor_aio_bytes_write
scylla_reactor_aio_errors
scylla_reactor_aio_reads
scylla_reactor_aio_writes
scylla_reactor_cpp_exceptions
scylla_reactor_cpu_busy_ms
scylla_reactor_cpu_steal_time_ms
scylla_reactor_fstream_read_bytes
scylla_reactor_fstream_read_bytes_blocked
scylla_reactor_fstream_reads
scylla_reactor_fstream_reads_ahead_bytes_discarded
scylla_reactor_fstream_reads_aheads_discarded
scylla_reactor_fstream_reads_blocked
scylla_reactor_fsyncs
scylla_reactor_io_queue_requests
scylla_reactor_io_threaded_fallbacks
scylla_reactor_logging_failures
scylla_reactor_polls
scylla_reactor_tasks_pending
scylla_reactor_tasks_processed
scylla_reactor_timers_pending
scylla_reactor_utilization
scylla_storage_proxy_coordinator_background_read_repairs
scylla_storage_proxy_coordinator_background_reads
scylla_storage_proxy_coordinator_background_replica_writes_failed_local_node
scylla_storage_proxy_coordinator_background_write_bytes
scylla_storage_proxy_coordinator_background_writes
scylla_storage_proxy_coordinator_background_writes_failed
scylla_storage_proxy_coordinator_canceled_read_repairs
scylla_storage_proxy_coordinator_completed_reads_local_node
scylla_storage_proxy_coordinator_current_throttled_base_writes
scylla_storage_proxy_coordinator_current_throttled_writes
scylla_storage_proxy_coordinator_foreground_read_repair
scylla_storage_proxy_coordinator_foreground_reads
scylla_storage_proxy_coordinator_foreground_writes
scylla_storage_proxy_coordinator_last_mv_flow_control_delay
scylla_storage_proxy_coordinator_queued_write_bytes
scylla_storage_proxy_coordinator_range_timeouts
scylla_storage_proxy_coordinator_range_unavailable
scylla_storage_proxy_coordinator_read_errors_local_node
scylla_storage_proxy_coordinator_read_latency
scylla_storage_proxy_coordinator_read_repair_write_attempts_local_node
scylla_storage_proxy_coordinator_read_retries
scylla_storage_proxy_coordinator_read_timeouts
scylla_storage_proxy_coordinator_read_unavailable
scylla_storage_proxy_coordinator_reads_local_node
scylla_storage_proxy_coordinator_speculative_data_reads
scylla_storage_proxy_coordinator_speculative_digest_reads
scylla_storage_proxy_coordinator_throttled_writes
scylla_storage_proxy_coordinator_total_write_attempts_local_node
scylla_storage_proxy_coordinator_write_errors_local_node
scylla_storage_proxy_coordinator_write_latency
scylla_storage_proxy_coordinator_write_timeouts
scylla_storage_proxy_coordinator_write_unavailable
scylla_storage_proxy_replica_cross_shard_ops
scylla_storage_proxy_replica_forwarded_mutations
scylla_storage_proxy_replica_forwarding_errors
scylla_storage_proxy_replica_reads
scylla_storage_proxy_replica_received_counter_updates
scylla_storage_proxy_replica_received_mutations
scylla_storage_proxy_coordinator_foreground_read_repairs
scylla_streaming_total_incoming_bytes
scylla_streaming_total_outgoing_bytes
scylla_transport_cql_connections
scylla_transport_current_connections
scylla_transport_requests_blocked_memory
scylla_transport_requests_blocked_memory_current
scylla_transport_requests_served
scylla_transport_requests_serving
amnonh commented 2 years ago

@slivne @tzach the amount of metrics suggest that it should be part of Scylla itself even better with the ability to query only specific caetgory

tzach commented 2 years ago

Can you add tags in Scylla metrics?

amnonh commented 2 years ago

I'm not sure I understand the question, there are many labels in Scylla Metrics, we can just add another one

amnonh commented 1 year ago
scylla_alternator_operation
scylla_alternator_op_latency_bucket
scylla_alternator_op_latency_count
scylla_alternator_op_latency_sum
scylla_alternator_total_operations
scylla_cache_bytes_total
scylla_cache_bytes_used
scylla_cache_partition_evictions
scylla_cache_partition_hits
scylla_cache_partition_insertions
scylla_cache_partition_merges
scylla_cache_partition_misses
scylla_cache_partition_removals
scylla_cache_partitions
scylla_cache_range_tombstone_reads
scylla_cache_reads
scylla_cache_reads_with_misses
scylla_cache_row_evictions
scylla_cache_row_hits
scylla_cache_row_insertions
scylla_cache_row_misses
scylla_cache_row_removals
scylla_cache_rows
scylla_cache_rows_merged_from_memtable
scylla_cache_row_tombstone_reads
scylla_cdc_operations_failed
scylla_cdc_operations_total
scylla_column_family_read_latency_count
scylla_column_family_write_latency_count
scylla_commitlog_allocating_segments
scylla_commitlog_disk_active_bytes
scylla_commitlog_disk_total_bytes
scylla_commitlog_flush
scylla_commitlog_flush_limit_exceeded
scylla_commitlog_pending_allocations
scylla_commitlog_pending_flushes
scylla_commitlog_requests_blocked_memory
scylla_commitlog_segments
scylla_commitlog_unused_segments
scylla_compaction_manager_compactions
scylla_cql
scylla_cql_authorized_prepared_statements_cache_evictions
scylla_cql_batches
scylla_cql_deletes
scylla_cql_deletes_per_ks
scylla_cql_filtered_read_requests
scylla_cql_filtered_rows_dropped_total
scylla_cql_filtered_rows_matched_total
scylla_cql_filtered_rows_read_total
scylla_cql_inserts
scylla_cql_inserts_per_ks
scylla_cql_prepared_cache_evictions
scylla_cql_reads
scylla_cql_reads_per_ks
scylla_cql_reverse_queries
scylla_cql_rows_read
scylla_cql_secondary_index_reads
scylla_cql_select_bypass_caches
scylla_cql_select_partition_range_scan_no_bypass_cache
scylla_cql_statements_in_batches
scylla_cql_unpaged_select_queries
scylla_cql_unpaged_select_queries_per_ks
scylla_cql_updates
scylla_cql_updates_per_ks
scylla_database_active_reads
scylla_database_dropped_view_updates
scylla_database_queued_reads
scylla_database_requests_blocked_memory
scylla_database_requests_blocked_memory_current
scylla_database_schema_changed
scylla_database_total_reads
scylla_database_total_reads_failed
scylla_database_total_view_updates_pushed_local
scylla_database_total_view_updates_pushed_remote
scylla_database_total_writes
scylla_database_total_writes_failed
scylla_database_total_writes_timedout
scylla_database_view_update_backlog
scylla_errors
scylla_expiration_items_deleted
scylla_gossip_heart_beat
scylla_gossip_live
scylla_hints_for_views_manager_sent
scylla_hints_manager_sent
scylla_hints_manager_written
scylla_io_queue_delay
scylla_io_queue_disk_queue_length
scylla_io_queue_queue_length
scylla_io_queue_total_bytes
scylla_io_queue_total_delay_sec
scylla_io_queue_total_exec_sec
scylla_io_queue_total_operations
scylla_lsa_non_lsa_used_space_bytes
scylla_lsa_total_space_bytes
scylla_manager
scylla_manager_backup_files_failed_bytes
scylla_manager_backup_files_skipped_bytes
scylla_manager_backup_files_uploaded_bytes
scylla_manager_backup_percent_progress
scylla_manager_healthcheck_cql_rtt_ms
scylla_manager_healthcheck_cql_status
scylla_manager_repair_progress
scylla_manager_repair_segments_error
scylla_manager_repair_segments_success
scylla_manager_repair_token_ranges_error
scylla_manager_repair_token_ranges_success
scylla_manager_server_current_version
scylla_manager_ssh_open_streams_count
scylla_manager_task_active_count
scylla_manager_task_run_total
scylla_node_operation_mode
scylla_node_ops_finished_percentage
scylla_query_processor_queries
scylla_reactor_abandoned_failed_futures
scylla_reactor_aio_errors
scylla_reactor_cpp_exceptions
scylla_reactor_utilization
scylla_scheduler_runtime_ms
scylla_scheduler_shares
scylla_scheduler_time_spent_on_task_quota_violations_ms
scylla_scylladb_current_version
scylla_sstables_cell_tombstone_writes
scylla_sstables_range_tombstone_reads
scylla_sstables_range_tombstone_writes
scylla_sstables_row_tombstone_reads
scylla_sstables_tombstone_writes
scylla_stall_detector_reported
scylla_storage_proxy_coordinator_background_reads
scylla_storage_proxy_coordinator_background_writes
scylla_storage_proxy_coordinator_cas_background
scylla_storage_proxy_coordinator_cas_dropped_prune
scylla_storage_proxy_coordinator_cas_failed_read_round_optimization
scylla_storage_proxy_coordinator_cas_foreground
scylla_storage_proxy_coordinator_cas_prune
scylla_storage_proxy_coordinator_cas_read_contention_bucket
scylla_storage_proxy_coordinator_cas_read_contention_count
scylla_storage_proxy_coordinator_cas_read_latency_count
scylla_storage_proxy_coordinator_cas_read_latency_sum
scylla_storage_proxy_coordinator_cas_read_timeouts
scylla_storage_proxy_coordinator_cas_read_unavailable
scylla_storage_proxy_coordinator_cas_read_unfinished_commit
scylla_storage_proxy_coordinator_cas_total_operations
scylla_storage_proxy_coordinator_cas_write_condition_not_met
scylla_storage_proxy_coordinator_cas_write_contention_count
scylla_storage_proxy_coordinator_cas_write_latency_count
scylla_storage_proxy_coordinator_cas_write_latency_sum
scylla_storage_proxy_coordinator_cas_write_timeout_due_to_uncertainty
scylla_storage_proxy_coordinator_cas_write_timeouts
scylla_storage_proxy_coordinator_cas_write_unavailable
scylla_storage_proxy_coordinator_cas_write_unfinished_commit
scylla_storage_proxy_coordinator_current_throttled_base_writes
scylla_storage_proxy_coordinator_foreground_reads
scylla_storage_proxy_coordinator_foreground_writes
scylla_storage_proxy_coordinator_range_timeouts
scylla_storage_proxy_coordinator_range_unavailable
scylla_storage_proxy_coordinator_read_errors_local_node
scylla_storage_proxy_coordinator_read_latency_count
scylla_storage_proxy_coordinator_read_latency_sum
scylla_storage_proxy_coordinator_reads_local_node
scylla_storage_proxy_coordinator_reads_remote_node
scylla_storage_proxy_coordinator_read_timeouts
scylla_storage_proxy_coordinator_read_unavailable
scylla_storage_proxy_coordinator_speculative_data_reads
scylla_storage_proxy_coordinator_speculative_digest_reads
scylla_storage_proxy_coordinator_total_write_attempts_local_node
scylla_storage_proxy_coordinator_write_errors_local_node
scylla_storage_proxy_coordinator_write_latency_bucket
scylla_storage_proxy_coordinator_write_latency_count
scylla_storage_proxy_coordinator_write_latency_sum
scylla_storage_proxy_coordinator_write_timeouts
scylla_storage_proxy_coordinator_write_unavailable
scylla_storage_proxy_replica_received_counter_updates
scylla_thrift_served
scylla_transport_cql_errors_total
scylla_transport_current_connections
scylla_transport_requests_served
scylla_transport_requests_shed
scylla_view_builder_builds_in_progress
mykaul commented 1 year ago

@amnonh - what's the status of this issue?

mykaul commented 1 year ago

@amnonh - ping?