OpenTSDB / opentsdb-rpc-kafka

A set of OpenTSDB plugins for consuming from Apache Kafka
Apache License 2.0
44 stars 25 forks source link

Any benchmarks around data drops #7

Open chaudhary-harsh opened 6 years ago

chaudhary-harsh commented 6 years ago

Are there any benchmarks to measure if and under what conditions this plugin might be dropping data that it reads from Kafka or writes to TSDB.

This is somehow related to #2 as well

manolama commented 5 years ago

There are a lot of stats that it will output. Everything starting with tsd.plugin.KafkaStorageExceptionHandler and by making calls to https://github.com/OpenTSDB/opentsdb-rpc-kafka/blob/master/src/main/java/net/opentsdb/tsd/KafkaHttpRpcPlugin.java#L86-L88