Safe margin in BULK INSERTS

webyog / sqlyog-community

Webyog provides monitoring and management tools for open source relational databases. We develop easy-to-use MySQL client tools for performance tuning and database management. Webyog's solutions include SQL Diagnostic Manager for MySQL performance optimization and SQLyog for MySQL administration. More than 35,000 companies (including Amazon, IBM, Salesforce, AT&T, eBay, and GE) and 2.5 million users rely on Webyog's solutions to provide valuable insights into their databases. Webyog is an Idera, Inc. company.

https://webyog.com/

GNU General Public License v2.0

2.21k stars 326 forks source link

Safe margin in BULK INSERTS #1772

Open atulwy opened 9 years ago

atulwy commented 9 years ago

Original issue 1772 created by webyog on 2012-03-09T14:38:36.000Z:

Refer: http://bugs.mysql.com/bug.php?id=60926

A BULK INSERT as big as accepted by max_allowed_packet to a replication master may break replication.

I think we should reserve some safe margin (10% - 15%) between the size of BULK INSERTS we generate and max_allowed_packet. Currently we generate BULK INSERT 'to the edge' as long as max_allowed_packet <= 16M

Applies to Data Sync, Export/Backup,

atulwy commented 9 years ago

Comment #1 originally posted by webyog on 2012-06-07T10:59:24.000Z:

Also see http://www.mysqlperformanceblog.com/2012/06/06/read_buffer_size-can-break-your-replication/