search

deliciousbrains / wp-migrate-db

WordPress plugin that exports your database, does a find and replace on URLs and file paths, then allows you to save it to your computer.
https://wordpress.org/plugins/wp-migrate-db/
342 stars 515 forks source link

Query throttling #31

Closed andrebian closed 10 years ago

andrebian commented 10 years ago

The changes made perform a better import way. This reduces very much the queries, making the import proccess less expensive.

aprea commented 10 years ago

Hi Andre,

Thanks for your effort on this. Unfortunately your solution isn't very effective for certain circumstances.

The problem is that you're simply assigning a hard cap on the number of rows per INSERT.

This become troublesome when a particular row has a lot of data in it. e.g. a row in wp_options may contain 100kb of data or so.

If you have several of these rows included in a single INSERT you're going to end up with problems when trying to import that data. The MySQL server will run into "mysql server has gone away" errors.

We've actually already fixed this problem in the pro version of the plugin. Instead of exporting each row as a single INSERT we instead fill up the INSERT query until it has about 50kb of data.

We'll try to translate this fix into the free version soonish.

Thanks again for looking into it though.

andrebian commented 10 years ago

Ok thanks for attention. I will keep unsing my solution cause is very fast, maybe reduce for 200 or 300 rows at each insert.

Just for your information, I have a database with +70k registers (data row), with the original solution it takes kind of 25 min to import via mysql workbench and all the times timeout or locked mysql proccess using phpmyadmin and never finish the import. In the same machine and same database, using the slution provided by me the import process takes only 3 secs using mysql workbench and 38 secs phpmyadmin.

;)

andrebian commented 10 years ago

Oh, I know It's all about MONEY ok, I will develop a free and full backup/migrate tool. Thanks!

http://deliciousbrains.com/wp-migrate-db-pro/pricing/?utm_source=insideplugin&utm_medium=web&utm_campaign=freeplugin