taosdata / kafka-connect-tdengine

GNU Affero General Public License v3.0
14 stars 3 forks source link

TDengine Sink Connector 数据同步失败 #53

Open mackjie opened 8 months ago

mackjie commented 8 months ago

背景使用 TDengine Sink Connector 将Kafka中的数据同步至TDengine中一直同步不成功,怎么查看同步日志 数据库版本:3.1.0.0 Kafka:2.2.2 现象:使用OpenTSDB JSON 协议格式。一直同步不过去,没办法查看日志 sink连接状态显示

image

sink-demo.json文件配置

image

{ "name": "TDengineSinkConnector", "config": { "connector.class":"com.taosdata.kafka.connect.sink.TDengineSinkConnector", "tasks.max": "1", "topics": "bigdata_plateform_meters", "connection.url": "jdbc:TAOS://127.0.0.1:6030", "connection.user": "root", "connection.password": "taosdata", "connection.database": "bigdata_plateform", "db.schemaless": "json", "data.precision": "ms", "key.converter": "org.apache.kafka.connect.storage.StringConverter", "value.converter": "org.apache.kafka.connect.storage.StringConverter", "errors.tolerance": "all", "errors.deadletterqueue.topic.name": "bigdata_plateform_dead_letter_topic", "errors.deadletterqueue.topic.replication.factor": 1 } }

Kafka消息内容

image

[ { "metric": "sys.cpu.nice", "timestamp": 1648432611250000, "value": 18, "tags": { "host": "web01", "dc": "lga" } }, { "metric": "sys.cpu.nice", "timestamp": 1648432311251000, "value": 9, "tags": { "host": "web02", "dc": "lga" } }, { "metric": "sys.cpu.nice", "timestamp": 1648433311251000, "value": 9, "tags": { "host": "web02", "dc": "lga" } } ]