mysql参数max_allowed_packet提高批量插入性能


原文链接: mysql参数max_allowed_packet提高批量插入性能

MySQL根据配置文件会限制Server接受的数据包大小。有时候大的插入和更新会受 max_allowed_packet 参数限制,导致大数据写入或者更新失败。

set global max_allowed_packet = 1024*1024*1024 1G

查看目前配置:

mysql> show VARIABLES like 'max_allowed_packet';
+--------------------+------------+
| Variable_name | Value |
+--------------------+------------+
| max_allowed_packet | 1073741824 |
+--------------------+------------+
1 row in set

max_allowed_packet的单位为字节:

-- 转化为Mb,就是1024Mb
mysql> select 1073741824/1024/1024;
+----------------------+
| 1073741824/1024/1024 |
+----------------------+
| 1024.00000000 |
+----------------------+
1 row in set

修改方法1-配置文件修改

可以编辑my.cnf,在[mysqld]段或者mysql的server配置段进行修改。

max_allowed_packet = 20M

修改my.cnf,配置要重载才能生效
注意: max_allowed_packed一定是添加在【mysqld】才能生效。

修改方法2-命令修改

参数生效范围为global,不是session. 如果服务器重启设置会失效

set global max_allowed_packet = 2*1024*1024*10

注意

查询时使用的是show variables的话,发现设置好像并没有生效,这是因为show variables等同于show session variables,查询的是会话变量,只有使用show global variables,查询的才是全局变量。

示例:

查询 max_allowed_packet = 1073741824

mysql> show VARIABLES like 'max_allowed_packet';
+--------------------+------------+
| Variable_name | Value |
+--------------------+------------+
| max_allowed_packet | 1073741824 |
+--------------------+------------+
1 row in set

设置 max_allowed_packet = 1048576

mysql> set global max_allowed_packet = 1*1024*1024;
Query OK, 0 rows affected

查询结果没变

mysql> show VARIABLES like 'max_allowed_packet';
+--------------------+------------+
| Variable_name | Value |
+--------------------+------------+
| max_allowed_packet | 1073741824 |
+--------------------+------------+
1 row in set

全局查看

mysql> show global VARIABLES like 'max_allowed_packet';
+--------------------+---------+
| Variable_name | Value |
+--------------------+---------+
| max_allowed_packet | 1048576 |
+--------------------+---------+
1 row in set

max_allowed_packet 值设置过小将导致单个记录超过限制后写入数据库失败,且后续记录写入也将失败,为了数据完整性,需要考虑到事务因素。

`