search

OpenTSDB / opentsdb-rpc-kafka

A set of OpenTSDB plugins for consuming from Apache Kafka
Apache License 2.0
44 stars 25 forks source link

Failed to initialize class net.opentsdb.tsd.KafkaRpcPlugin #6

Open aiwocga opened 6 years ago

aiwocga commented 6 years ago

The full class name of the plugin. This must be

tsd.rpc.plugins = net.opentsdb.tsd.KafkaRpcPlugin

The comma separated list of zookeeper hosts and ports used by the Kafka cluster

KafkaRpcPlugin.kafka.zookeeper.connect = slave02:2181,slave03:2181,slave04:2181

A comma separated list of one or more consumer group names

KafkaRpcPlugin.groups = connect-cluster

A comma separated list of one or more topics for the to consume from

KafkaRpcPlugin.connect-cluster.topics = tagValue

The type of messages written to the queue. TODO. For now, leave it as raw

KafkaRpcPlugin.connect-cluster.consumerType = raw

The deserialization class to use for parsing messages from the Kafka topic.

KafkaRpcPlugin.connect-cluster.Deserializer = net.opentsdb.data.deserializers.JSONDeserializer

How many messages per second to throttle the total of consumer threads at for the consumer group

KafkaRpcPlugin.connect-cluster.rate = 250000

The number of consumer threads to create per group

KafkaRpcPlugin.connect-cluster.threads = 4

A comma separated list of HTTP RPC plugins to load. Included with this package is a

plugin that allows for fetching stats from the Kafka plugin as well as viewing or

modifying the write rate during runtime

tsd.http.rpc.plugins = net.opentsdb.tsd.KafkaHttpRpcPlugin

Whether or not to enable the storage exception handler plugin

tsd.core.storage_exception_handler.enable = true

The full class of the storage exception handler plugin

tsd.core.storage_exception_handler.plugin = net.opentsdb.tsd.KafkaStorageExceptionHandler

The comma separated list of Kafka brokers and ports used to write messages to for

the storage exception handler plugin

KafkaRpcPlugin.kafka.metadata.broker.list = slave02:9092,slave03:9092,slave04:9092

The topic used to write messages to for the storage exception handler

KafkaRpcPlugin.seh.topic.default = tagValue

Successfully initialized storage exception handler plugin [net.opentsdb.tsd.KafkaStorageExceptionHandler] version: 2.4.0 but Failed to initialize class net.opentsdb.tsd.KafkaRpcPlugin

manolama commented 5 years ago

Need some more info here. Is this with 2.4.0 TSD or 2.3.x?