search

github / gh-ost

GitHub's Online Schema-migration Tool for MySQL
MIT License
12.39k stars 1.26k forks source link

gh-ost is never end #762

Open xinxinfly opened 5 years ago

xinxinfly commented 5 years ago

I have a big table, and add index for it use gh-ost The log can see that it has been running for more than 20 hours with a completion rate of 100%, but it's not over yet. but I can see from the table, the index has been added successfully. What's the situation? Anyone knows? Thank you for your help!

log as: Copy: 248927341/248927341 100.0%; Applied: 423723; Backlog: 1000/1000; Time: 22h30m0s(total), 8h25m31s(copy); streamer: mysql-bin.023556:46682495; State: migrating; ETA: due Copy: 248927341/248927341 100.0%; Applied: 423723; Backlog: 1000/1000; Time: 22h30m30s(total), 8h25m31s(copy); streamer: mysql-bin.023556:46682495; State: migrating; ETA: due Copy: 248927341/248927341 100.0%; Applied: 423723; Backlog: 1000/1000; Time: 22h31m0s(total), 8h25m31s(copy); streamer: mysql-bin.023556:46682495; State: migrating; ETA: due Copy: 248927341/248927341 100.0%; Applied: 423723; Backlog: 1000/1000; Time: 22h31m30s(total), 8h25m31s(copy); streamer: mysql-bin.023556:46682495; State: migrating; ETA: due Copy: 248927341/248927341 100.0%; Applied: 423723; Backlog: 1000/1000; Time: 22h32m0s(total), 8h25m31s(copy); streamer: mysql-bin.023556:46682495; State: migrating; ETA: due Copy: 248927341/248927341 100.0%; Applied: 423723; Backlog: 1000/1000; Time: 22h32m30s(total), 8h25m31s(copy); streamer: mysql-bin.023556:46682495; State: migrating; ETA: due Copy: 248927341/248927341 100.0%; Applied: 423723; Backlog: 1000/1000; Time: 22h33m0s(total), 8h25m31s(copy); streamer: mysql-bin.023556:46682495; State: migrating; ETA: due Copy: 248927341/248927341 100.0%; Applied: 423723; Backlog: 1000/1000; Time: 22h33m30s(total), 8h25m31s(copy); streamer: mysql-bin.023556:46682495; State: migrating; ETA: due Copy: 248927341/248927341 100.0%; Applied: 423723; Backlog: 1000/1000; Time: 22h34m0s(total), 8h25m31s(copy); streamer: mysql-bin.023556:46682495; State: migrating; ETA: due Copy: 248927341/248927341 100.0%; Applied: 423723; Backlog: 1000/1000; Time: 22h34m30s(total), 8h25m31s(copy); streamer: mysql-bin.023556:46682495; State: migrating; ETA: due Copy: 248927341/248927341 100.0%; Applied: 423723; Backlog: 1000/1000; Time: 22h35m0s(total), 8h25m31s(copy); streamer: mysql-bin.023556:46682495; State: migrating; ETA: due Copy: 248927341/248927341 100.0%; Applied: 423723; Backlog: 1000/1000; Time: 22h35m30s(total), 8h25m31s(copy); streamer: mysql-bin.023556:46682495; State: migrating; ETA: due Copy: 248927341/248927341 100.0%; Applied: 423723; Backlog: 1000/1000; Time: 22h36m0s(total), 8h25m31s(copy); streamer: mysql-bin.023556:46682495; State: migrating; ETA: due Copy: 248927341/248927341 100.0%; Applied: 423723; Backlog: 1000/1000; Time: 22h36m30s(total), 8h25m31s(copy); streamer: mysql-bin.023556:46682495; State: migrating; ETA: due Copy: 248927341/248927341 100.0%; Applied: 423723; Backlog: 1000/1000; Time: 22h37m0s(total), 8h25m31s(copy); streamer: mysql-bin.023556:46682495; State: migrating; ETA: due Copy: 248927341/248927341 100.0%; Applied: 423723; Backlog: 1000/1000; Time: 22h37m30s(total), 8h25m31s(copy); streamer: mysql-bin.023556:46682495; State: migrating; ETA: due (END)

shlomi-noach commented 5 years ago

If this is a bug report, please provide a test case (e.g., your table definition and gh-ost command) and the error output.

xinxinfly commented 5 years ago

If this is a bug report, please provide a test case (e.g., your table definition and gh-ost command) and the error output.

  • Did you use --exact-rowcount? maybe the calculation of rows is not exact
  • seems like backlog is at 1000/1000 which means gh-ost is unable to keep up with binary logs. I'm really missing some input here; when did the backlog increase to 1000/1000? Is the table very busy? See also #761

1.hey，I did not use '--exact-rowcount' and the same time I see the database,the 'xxx_gho' table is deleted and only has the 'xxx_ghc' table. 2.yes，the table is very big and very busy. 3.Finally,I killed it ,But the index is added successfully. by the way， I used it with MariaDB

deepweb12 commented 4 years ago

I have a big table, and add index for it use gh-ost The log can see that it has been running for more than 20 hours with a completion rate of 100%, but it's not over yet. but I can see from the table, the index has been added successfully. What's the situation? Anyone knows? Thank you for your help!

log as: Copy: 248927341/248927341 100.0%; Applied: 423723; Backlog: 1000/1000; Time: 22h30m0s(total), 8h25m31s(copy); streamer: mysql-bin.023556:46682495; State: migrating; ETA: due Copy: 248927341/248927341 100.0%; Applied: 423723; Backlog: 1000/1000; Time: 22h30m30s(total), 8h25m31s(copy); streamer: mysql-bin.023556:46682495; State: migrating; ETA: due Copy: 248927341/248927341 100.0%; Applied: 423723; Backlog: 1000/1000; Time: 22h31m0s(total), 8h25m31s(copy); streamer: mysql-bin.023556:46682495; State: migrating; ETA: due Copy: 248927341/248927341 100.0%; Applied: 423723; Backlog: 1000/1000; Time: 22h31m30s(total), 8h25m31s(copy); streamer: mysql-bin.023556:46682495; State: migrating; ETA: due Copy: 248927341/248927341 100.0%; Applied: 423723; Backlog: 1000/1000; Time: 22h32m0s(total), 8h25m31s(copy); streamer: mysql-bin.023556:46682495; State: migrating; ETA: due Copy: 248927341/248927341 100.0%; Applied: 423723; Backlog: 1000/1000; Time: 22h32m30s(total), 8h25m31s(copy); streamer: mysql-bin.023556:46682495; State: migrating; ETA: due Copy: 248927341/248927341 100.0%; Applied: 423723; Backlog: 1000/1000; Time: 22h33m0s(total), 8h25m31s(copy); streamer: mysql-bin.023556:46682495; State: migrating; ETA: due Copy: 248927341/248927341 100.0%; Applied: 423723; Backlog: 1000/1000; Time: 22h33m30s(total), 8h25m31s(copy); streamer: mysql-bin.023556:46682495; State: migrating; ETA: due Copy: 248927341/248927341 100.0%; Applied: 423723; Backlog: 1000/1000; Time: 22h34m0s(total), 8h25m31s(copy); streamer: mysql-bin.023556:46682495; State: migrating; ETA: due Copy: 248927341/248927341 100.0%; Applied: 423723; Backlog: 1000/1000; Time: 22h34m30s(total), 8h25m31s(copy); streamer: mysql-bin.023556:46682495; State: migrating; ETA: due Copy: 248927341/248927341 100.0%; Applied: 423723; Backlog: 1000/1000; Time: 22h35m0s(total), 8h25m31s(copy); streamer: mysql-bin.023556:46682495; State: migrating; ETA: due Copy: 248927341/248927341 100.0%; Applied: 423723; Backlog: 1000/1000; Time: 22h35m30s(total), 8h25m31s(copy); streamer: mysql-bin.023556:46682495; State: migrating; ETA: due Copy: 248927341/248927341 100.0%; Applied: 423723; Backlog: 1000/1000; Time: 22h36m0s(total), 8h25m31s(copy); streamer: mysql-bin.023556:46682495; State: migrating; ETA: due Copy: 248927341/248927341 100.0%; Applied: 423723; Backlog: 1000/1000; Time: 22h36m30s(total), 8h25m31s(copy); streamer: mysql-bin.023556:46682495; State: migrating; ETA: due Copy: 248927341/248927341 100.0%; Applied: 423723; Backlog: 1000/1000; Time: 22h37m0s(total), 8h25m31s(copy); streamer: mysql-bin.023556:46682495; State: migrating; ETA: due Copy: 248927341/248927341 100.0%; Applied: 423723; Backlog: 1000/1000; Time: 22h37m30s(total), 8h25m31s(copy); streamer: mysql-bin.023556:46682495; State: migrating; ETA: due (END)

Anonymous regahawlery here