search

pingcap / tidb

TiDB is an open-source, cloud-native, distributed, MySQL-Compatible database for elastic scale and real-time analytics. Try AI-powered Chat2Query free at : https://www.pingcap.com/tidb-serverless/
https://pingcap.com
Apache License 2.0
37.11k stars 5.83k forks source link

drainer error #7744

Closed sakufo closed 6 years ago

sakufo commented 6 years ago

After using the drainer output to the downstream mysql prompt the following error, check the downstream database, no data updates. please help.

2018/09/19 16:00:53 server.go:81: [info] clusterID of drainer server is 6580197893879686949 2018/09/19 16:00:53 checkpoint.go:48: [info] initialize mysql type checkpoint binlog commitTS = 403001324297519112 and positions = map[] with config &{Db:0xc0002ca8c0 Schema:tidb_binlog Table:checkpoint ClusterID:6580197893879686949 InitialCommitTS:403001324297519112 CheckPointFile:data.drainer/savepoint} 2018/09/19 16:00:53 offset_seeker.go:82: [info] kafka consumer version 0.8.2.0 2018/09/19 16:00:53 client.go:120: [sarama] Initializing new client 2018/09/19 16:00:53 config.go:382: [sarama] ClientID is the default of 'sarama', you should consider setting it to something application-specific. 2018/09/19 16:00:53 config.go:382: [sarama] ClientID is the default of 'sarama', you should consider setting it to something application-specific. 2018/09/19 16:00:53 client.go:701: [sarama] client/metadata fetching metadata for all topics from broker 10.10.8.29:9092 2018/09/19 16:00:53 broker.go:148: [sarama] Connected to broker at 10.10.8.29:9092 (unregistered) 2018/09/19 16:00:53 client.go:477: [sarama] client/brokers registered new broker #2 at 10.10.8.24:9092 2018/09/19 16:00:53 client.go:477: [sarama] client/brokers registered new broker #1 at 10.10.8.29:9092 2018/09/19 16:00:53 client.go:477: [sarama] client/brokers registered new broker #3 at 10.10.8.31:9092 2018/09/19 16:00:53 client.go:167: [sarama] Successfully initialized new client 2018/09/19 16:00:53 client.go:120: [sarama] Initializing new client 2018/09/19 16:00:53 config.go:382: [sarama] ClientID is the default of 'sarama', you should consider setting it to something application-specific. 2018/09/19 16:00:53 config.go:382: [sarama] ClientID is the default of 'sarama', you should consider setting it to something application-specific. 2018/09/19 16:00:53 client.go:701: [sarama] client/metadata fetching metadata for all topics from broker 10.10.8.31:9092 2018/09/19 16:00:53 broker.go:148: [sarama] Connected to broker at 10.10.8.31:9092 (unregistered) 2018/09/19 16:00:53 client.go:477: [sarama] client/brokers registered new broker #2 at 10.10.8.24:9092 2018/09/19 16:00:53 client.go:477: [sarama] client/brokers registered new broker #1 at 10.10.8.29:9092 2018/09/19 16:00:53 client.go:477: [sarama] client/brokers registered new broker #3 at 10.10.8.31:9092 2018/09/19 16:00:53 client.go:167: [sarama] Successfully initialized new client 2018/09/19 16:00:54 syncer.go:115: [info] [prepare] begin to construct schema infomation in syncer 2018/09/19 16:01:04 collector.go:365: [info] commit ts 403001324297519112's safe commit ts is 403001009724719112 2018/09/19 16:01:04 config.go:382: [sarama] ClientID is the default of 'sarama', you should consider setting it to something application-specific. 2018/09/19 16:01:04 broker.go:146: [sarama] Connected to broker at 10.10.8.24:9092 (registered as #2) 2018/09/19 16:01:04 offset.go:115: [info] seek position 403001009724719112 in topic 6580197893879686949_VM_8_2_centos_8250 partition 0, oldest offset 0, newest offset 7111 2018/09/19 16:01:04 config.go:382: [sarama] ClientID is the default of 'sarama', you should consider setting it to something application-specific. 2018/09/19 16:01:04 broker.go:146: [sarama] Connected to broker at 10.10.8.24:9092 (registered as #2) 2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0 2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0 2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0 2018/09/19 16:01:04 assemble.go:110: [warning] assembler was canceled: context canceled 2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0 2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0 2018/09/19 16:01:04 assemble.go:110: [warning] assembler was canceled: context canceled 2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0 2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0 2018/09/19 16:01:04 assemble.go:110: [warning] assembler was canceled: context canceled 2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0 2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0 2018/09/19 16:01:04 assemble.go:110: [warning] assembler was canceled: context canceled 2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0 2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0 2018/09/19 16:01:04 assemble.go:110: [warning] assembler was canceled: context canceled 2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0 2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0 2018/09/19 16:01:04 assemble.go:110: [warning] assembler was canceled: context canceled 2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0 2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0 2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0 2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0 2018/09/19 16:01:04 assemble.go:110: [warning] assembler was canceled: context canceled 2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0 2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0 2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0 2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0 2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0 2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0 2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0 2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0 2018/09/19 16:01:04 assemble.go:110: [warning] assembler was canceled: context canceled 2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0 2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0 2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0 2018/09/19 16:01:04 offset.go:120: [info] seek position 403001009724719112 in topic 6580197893879686949_VM_8_2_centos_8250 partition 0, offset 1374 2018/09/19 16:01:04 collector.go:226: [info] node VM_8_2_centos:8250 get save point {0 1374} 2018/09/19 16:01:04 kafka.go:80: [info] kafka consumer version 0.8.2.0 2018/09/19 16:01:04 client.go:120: [sarama] Initializing new client 2018/09/19 16:01:04 config.go:382: [sarama] ClientID is the default of 'sarama', you should consider setting it to something application-specific. 2018/09/19 16:01:04 config.go:382: [sarama] ClientID is the default of 'sarama', you should consider setting it to something application-specific. 2018/09/19 16:01:04 client.go:701: [sarama] client/metadata fetching metadata for all topics from broker 10.10.8.24:9092 2018/09/19 16:01:04 broker.go:148: [sarama] Connected to broker at 10.10.8.24:9092 (unregistered) 2018/09/19 16:01:04 client.go:477: [sarama] client/brokers registered new broker #2 at 10.10.8.24:9092 2018/09/19 16:01:04 client.go:477: [sarama] client/brokers registered new broker #1 at 10.10.8.29:9092 2018/09/19 16:01:04 client.go:477: [sarama] client/brokers registered new broker #3 at 10.10.8.31:9092 2018/09/19 16:01:04 client.go:167: [sarama] Successfully initialized new client 2018/09/19 16:01:04 pump.go:433: [info] [pump VM_8_2_centos:8250] consume from topic 6580197893879686949_VM_8_2_centos_8250 partition 0 offset 1374 2018/09/19 16:01:04 config.go:382: [sarama] ClientID is the default of 'sarama', you should consider setting it to something application-specific. 2018/09/19 16:01:04 broker.go:146: [sarama] Connected to broker at 10.10.8.24:9092 (registered as #2) 2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0

Question

Before asking a question, make sure you have:

sakufo commented 6 years ago

Find the reason, the pump startup sequence problem Since my Pump is post-deployed, I started the Pump directly after deployment and ignored the instructions in the documentation to start Pump and then start Tidb. Restart the tidb with ansible-playbook.