This pull request introduces Tarantool Data Grid ver. 2 dashboard templates.
Although some docker-compose and configuration files were added, this PR do not adds a simple functionality to fill all graphs with data: this task is complicated and time-consuming. Almost everything thing was verified manually/semi-automatically, additional verifications will be performed with real TDG applications. Because of the same reason, some commits are missing illustration and most of them are illustrated poorly.
example_cluster: add TDG2 + kafka cluster draft
Add docker-compose file for cluster with TDG2 application. To start it,
you'll need a pre-build TDG2 image. Add TDG configuration example
for simple Kafka activity. Add Telegraf example for TDG2 application
(for now, only Kafka labels are considered).
tdg_dashboard: add TDG2 dashboard with Kafka panels
Add TDG2 Kafka sections:
TDG Kafka common statistics
TDG Kafka brokers statistics
TDG Kafka topics statistics
TDG Kafka consumer statistics
TDG Kafka producer statistics
"TDG Kafka common statistics" section consists of graphs with following
metrics:
tdg_kafka_replyq
tdg_kafka_msg_size
tdg_kafka_msg_cnt
tdg_kafka_tx
tdg_kafka_tx_bytes
tdg_kafka_rx
tdg_kafka_rx_bytes
tdg_kafka_txmsgs
tdg_kafka_txmsg_bytes
tdg_kafka_rxmsgs
tdg_kafka_rxmsg_bytes
"TDG Kafka brokers statistics" section consists of graphs with following
metrics:
tdg_kafka_broker_stateage
tdg_kafka_broker_connects
tdg_kafka_broker_disconnects
tdg_kafka_broker_wakeups
tdg_kafka_broker_outbuf_cnt
tdg_kafka_broker_outbuf_msg_cnt
tdg_kafka_broker_waitresp_cnt
tdg_kafka_broker_waitresp_msg_cnt
tdg_kafka_broker_tx
tdg_kafka_broker_txbytes
tdg_kafka_broker_txerrs
tdg_kafka_broker_txretries
tdg_kafka_broker_txidle
tdg_kafka_broker_req_timeouts
tdg_kafka_broker_rx
tdg_kafka_broker_rxbytes
tdg_kafka_broker_rxerrs
tdg_kafka_broker_rxcorriderrs
tdg_kafka_broker_rxidle
tdg_kafka_broker_rxpartial
tdg_kafka_broker_req
tdg_kafka_broker_int_latency
tdg_kafka_broker_outbuf_latency
tdg_kafka_broker_rtt
tdg_kafka_broker_throttle
"TDG Kafka topics statistics" section consists of graphs with following
metrics:
tdg_kafka_topic_age
tdg_kafka_topic_metadata_age
tdg_kafka_topic_batchsize
tdg_kafka_topic_batchcnt
tdg_kafka_topic_partitions_msgq_cnt
tdg_kafka_topic_partitions_xmit_msgq_cnt
tdg_kafka_topic_partitions_fetchq_cnt
tdg_kafka_topic_partitions_msgq_bytes
tdg_kafka_topic_partitions_xmit_msgq_bytes
tdg_kafka_topic_partitions_fetchq_size
tdg_kafka_partition_txmsgs
tdg_kafka_partition_txbytes
tdg_kafka_partition_rxmsgs
tdg_kafka_partition_rxbytes
tdg_kafka_partition_rx_ver_drops
tdg_kafka_partition_msgs_inflight
"TDG Kafka consumer statistics" section consists of graphs with
following metrics:
tdg_kafka_cgrp_stateage
tdg_kafka_cgrp_rebalance_age
tdg_kafka_cgrp_rebalance_cnt
tdg_kafka_cgrp_assignment_size
"TDG Kafka producer statistics" section consists of graphs with
following metrics:
tdg_kafka_eos_idemp_stateage
tdg_kafka_eos_txn_stateage
See [1] for more detailed info about metrics.
Add a TDG2 dashboard template for Prometheus and InfluxDB. It consists
of all existing Tarantool/Tarantool Cartridge sections and TDG2 Kafka
sections.
This pull request introduces Tarantool Data Grid ver. 2 dashboard templates.
Although some docker-compose and configuration files were added, this PR do not adds a simple functionality to fill all graphs with data: this task is complicated and time-consuming. Almost everything thing was verified manually/semi-automatically, additional verifications will be performed with real TDG applications. Because of the same reason, some commits are missing illustration and most of them are illustrated poorly.
example_cluster: add TDG2 + kafka cluster draft
Add docker-compose file for cluster with TDG2 application. To start it, you'll need a pre-build TDG2 image. Add TDG configuration example for simple Kafka activity. Add Telegraf example for TDG2 application (for now, only Kafka labels are considered).
tdg_dashboard: add TDG2 dashboard with Kafka panels
Add TDG2 Kafka sections:
"TDG Kafka common statistics" section consists of graphs with following metrics:
"TDG Kafka brokers statistics" section consists of graphs with following metrics:
"TDG Kafka topics statistics" section consists of graphs with following metrics:
"TDG Kafka consumer statistics" section consists of graphs with following metrics:
"TDG Kafka producer statistics" section consists of graphs with following metrics:
See [1] for more detailed info about metrics.
Add a TDG2 dashboard template for Prometheus and InfluxDB. It consists of all existing Tarantool/Tarantool Cartridge sections and TDG2 Kafka sections.
tdg_dashboard: add CPU thread time panels
Add CPU thread time panels for TDG2 dashboard. Graphs are based on tnt_cpu_thread metrics.
tdg_dashboard: add expirationd section
Add "TDG expirationd statistics" section to TDG dashboard templates. It consists of panels with following metrics:
tdg_dashboard: add tuples section
Add "TDG tuples statistics" section to TDG dashboard templates. It consists of panels with following metrics:
tdg_dashboard: add file connectors section
Add "TDG file connectors statistics" section to TDG dashboard templates. It consists of panels with following metrics:
tdg_dashboard: add GraphQL requests section
Add "TDG GraphQL requests" section to TDG dashboard templates. It consists of panels with following metrics:
tdg_dashboard: add IProto requests panels
Add "TDG GraphQL requests" section to TDG dashboard templates. It consists of panels with following metrics:
tdg_dashboard: add REST API requests panels
Add "TDG REST API requests" section to TDG dashboard templates. It consists of panels with following metrics:
tdg_dashboard: add tasks statistics panels
Add "TDG tasks statistics" section to TDG dashboard templates. It consists of panels with following metrics:
Closes #134