shenli
commented
7 years ago @chenbobaoge
2017/09/30 16:54:26.117 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable 2017/09/30 16:54:26.117 session.go:309: [warning] [1] finished txn:, [global:3]critical error rpc error: code = Unavailable desc = grpc: the connection is unavailable
From the log I can tell that there is something wrong with the communication between tidb-server and binlog module. @ian PTAL
IANTHEREAL
chenbobaoge
Please answer these questions before submitting your issue. Thanks!
你好 想通过TiDB-Binlog 连接mysql做实时备份。
按教程一开始启动全部正常，pump Drainer 启动正常，日志也无报错
可是一执行insert 语句， tidb进程就卡死，只有重启tidb服务才能恢复正常
tidb.log内容, [global:3]critical error rpc error: code = Unavailable desc = grpc: the connection is unavailable
2017/09/30 16:54:26.117 session.go:670: [warning] [1] session error:
/home/jenkins/workspace/build_tidb_master/go/src/github.com/pingcap/tidb/sessionctx/binloginfo/binloginfo.go:91: [global:3]critical error rpc error: code = Unavailable desc = grpc: the connection is unavailable
/home/jenkins/workspace/build_tidb_master/go/src/github.com/pingcap/tidb/store/tikv/2pc.go:634:
/home/jenkins/workspace/build_tidb_master/go/src/github.com/pingcap/tidb/store/tikv/2pc.go:560:
/home/jenkins/workspace/build_tidb_master/go/src/github.com/pingcap/tidb/store/tikv/txn.go:157:
/home/jenkins/workspace/build_tidb_master/go/src/github.com/pingcap/tidb/session.go:286:
/home/jenkins/workspace/build_tidb_master/go/src/github.com/pingcap/tidb/session.go:310:
/home/jenkins/workspace/build_tidb_master/go/src/github.com/pingcap/tidb/tidb.go:173:
{
"currDBName": "test2",
"id": 1,
"status": 2,
"strictMode": true,
"user": {
"Username": "root",
"Hostname": "192.168.2.68"
}
}
2017/09/30 16:54:26.117 conn.go:417: [error] [1] critical error, stop the server listener /home/jenkins/workspace/build_tidb_master/go/src/github.com/pingcap/tidb/sessionctx/binloginfo/binloginfo.go:91: [global:3]critical error rpc error: code = Unavailable desc = grpc: the connection is unavailable
/home/jenkins/workspace/build_tidb_master/go/src/github.com/pingcap/tidb/store/tikv/2pc.go:634:
/home/jenkins/workspace/build_tidb_master/go/src/github.com/pingcap/tidb/store/tikv/2pc.go:560:
/home/jenkins/workspace/build_tidb_master/go/src/github.com/pingcap/tidb/store/tikv/txn.go:157:
/home/jenkins/workspace/build_tidb_master/go/src/github.com/pingcap/tidb/session.go:286:
/home/jenkins/workspace/build_tidb_master/go/src/github.com/pingcap/tidb/session.go:310:
/home/jenkins/workspace/build_tidb_master/go/src/github.com/pingcap/tidb/tidb.go:173:
/home/jenkins/workspace/build_tidb_master/go/src/github.com/pingcap/tidb/session.go:672:
/home/jenkins/workspace/build_tidb_master/go/src/github.com/pingcap/tidb/server/conn.go:730:
2017/09/30 16:54:26.117 server.go:277: [info] [1] close connection
2017/09/30 16:54:26.121 server.go:248: [error] listener stopped, waiting for manual kill.
2017/09/30 16:54:26.129 2pc.go:548: [info] 2PC clean up done, tid: 394988524946063365
2017/09/30 16:54:27.117 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable
2017/09/30 16:54:28.117 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable
2017/09/30 16:54:29.118 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable
2017/09/30 16:54:30.118 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable
2017/09/30 16:54:31.118 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable
2017/09/30 16:54:32.118 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable
2017/09/30 16:54:33.118 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable
2017/09/30 16:54:34.119 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable
2017/09/30 16:54:35.119 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable
2017/09/30 16:54:36.119 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable
2017/09/30 16:54:37.119 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable
2017/09/30 16:54:38.120 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable
2017/09/30 16:54:39.120 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable
2017/09/30 16:54:40.120 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable
2017/09/30 16:54:41.121 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable
2017/09/30 16:54:42.121 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable
2017/09/30 16:54:43.121 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable
2017/09/30 16:54:44.121 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable
2017/09/30 16:54:45.121 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable
2017/09/30 16:54:46.122 2pc.go:649: [error] failed to write binlog: [global:3]critical error rpc error: code = Unavailable desc = grpc: the connection is unavailable
2017/09/30 16:55:26.121 server.go:248: [error] listener stopped, waiting for manual kill.
2017/09/30 16:56:26.121 server.go:248: [error] listener stopped, waiting for manual kill.
2017/09/30 16:57:26.122 server.go:248: [error] listener stopped, waiting for manual kill.
2017/09/30 16:42:50.219 server.go:162: [info] Server is running MySQL Protocol at [0.0.0.0:4000] 2017/09/30 16:42:50.219 main.go:178: [info] disable Prometheus push client 2017/09/30 16:42:50.219 systime_mon.go:24: [info] start system time monitor 2017/09/30 16:42:50.219 http_status.go:58: [info] Listening on :10080 for status and metrics report. 2017/09/30 16:42:50.226 simple.go:127: [info] [0] execute rollback statement 2017/09/30 16:42:50.226 txn.go:174: [info] [kv] Rollback txn 394988347771846666 2017/09/30 16:42:57.166 server.go:118: [info] [1] new connection 192.168.2.68:2044 2017/09/30 16:42:57.167 conn.go:273: [warning] parse attrs error:EOF /home/jenkins/workspace/build_tidb_master/go/src/github.com/pingcap/tidb/server/conn.go:290: 2017/09/30 16:42:57.187 set.go:145: [info] [1] set system variable autocommit = 1 2017/09/30 16:42:57.205 set.go:145: [info] [1] set system variable net_write_timeout = 600 2017/09/30 16:42:57.205 set.go:145: [info] [1] set system variable sql_select_limit = 502 2017/09/30 16:42:57.206 metrics.go:355: [warning] [EXPENSIVE_QUERY] / ApplicationName=DataGrip 2017.2.2 / select * from t1 2017/09/30 16:42:57.217 set.go:145: [info] [1] set system variable sql_select_limit = 18446744073709551615 2017/09/30 16:43:06.355 set.go:145: [info] [1] set system variable net_write_timeout = 600 2017/09/30 16:54:06.112 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable 2017/09/30 16:54:07.112 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable 2017/09/30 16:54:08.112 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable 2017/09/30 16:54:09.113 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable 2017/09/30 16:54:10.113 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable 2017/09/30 16:54:11.113 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable 2017/09/30 16:54:12.113 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable 2017/09/30 16:54:13.114 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable 2017/09/30 16:54:14.114 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable 2017/09/30 16:54:15.114 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable 2017/09/30 16:54:16.115 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable 2017/09/30 16:54:17.115 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable 2017/09/30 16:54:18.115 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable 2017/09/30 16:54:19.115 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable 2017/09/30 16:54:20.115 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable 2017/09/30 16:54:21.116 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable 2017/09/30 16:54:22.116 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable 2017/09/30 16:54:23.116 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable 2017/09/30 16:54:24.116 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable 2017/09/30 16:54:25.116 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable 2017/09/30 16:54:26.117 binloginfo.go:88: [error] write binlog error rpc error: code = Unavailable desc = grpc: the connection is unavailable 2017/09/30 16:54:26.117 session.go:309: [warning] [1] finished txn:
pump.toml配置文件
addr = "127.0.0.1:8250" advertise-addr = "" gc = 7 data-dir = "data.pump" log-file = "pump.log" heartbeat-interval = 3 pd-urls = "http://192.168.2.194:2379" socket = "unix:///tmp/pump.sock"
drainer.toml配置文件 addr = "127.0.0.1:8249" detect-interval = 10 data-dir = "data.drainer" pd-urls = "http://192.168.2.194:2379" log-file = "drainer.log" [syncer] ignore-schemas = "INFORMATION_SCHEMA,PERFORMANCE_SCHEMA,mysql" txn-batch = 1 worker-count = 1 disable-dispatch = false db-type = "mysql" replicate-do-db =["test2"] [syncer.to] host = "192.168.2.68" user = "root" password = "123456" port = 3306
mysql 是在192.168.2.68上。 希望指点迷津
What did you see instead?
What version of TiDB are you using (
tidb-server -V)?Release Version: 0.9.0 Git Commit Hash: fe31f4b5974a68a3e5698f2b3473101691217d18 Git Commit Branch: master UTC Build Time: 2017-09-20 01:56:02