search

sysown / proxysql

High-performance MySQL proxy with a GPL license.
http://www.proxysql.com
GNU General Public License v3.0
6.05k stars 983 forks source link

Proxysql restarts multiple times with error signal 11 and 6 #3594

Closed GROpten closed 1 year ago

GROpten commented 3 years ago

snip


Error: signal 11:
/usr/bin/proxysql(_Z13crash_handleri+0x40)[0x55c0d4c6f7f0]
/lib/x86_64-linux-gnu/libc.so.6(+0x46210)[0x7f4196571210]
/lib/x86_64-linux-gnu/libc.so.6(+0x18e7b8)[0x7f41966b97b8]
/usr/bin/proxysql(_ZN17MySQL_Data_Stream12array2bufferEv+0xc0)[0x55c0d4cbf920]
/usr/bin/proxysql(_ZN17MySQL_Data_Stream17array2buffer_fullEv+0x23)[0x55c0d4cbfc93]
/usr/bin/proxysql(_ZN13MySQL_Session8writeoutEv+0x64)[0x55c0d4cd79c4]
/usr/bin/proxysql(_ZN12MySQL_Thread30listener_handle_new_connectionEP17MySQL_Data_Streamj+0x205)[0x55c0d4cc5ad5]
/usr/bin/proxysql(_ZN12MySQL_Thread24ProcessAllMyDS_AfterPollEv+0xb5)[0x55c0d4cc8475]
/usr/bin/proxysql(_ZN12MySQL_Thread3runEv+0x62b)[0x55c0d4cd339b]
/usr/bin/proxysql(_Z24mysql_worker_thread_funcPv+0x84)[0x55c0d4c67704]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x9609)[0x7f4196a7a609]
/lib/x86_64-linux-gnu/libc.so.6(clone+0x43)[0x7f419664d293]
 ---- /usr/bin/proxysql(_Z13crash_handleri+0x40) [0x55c0d4c6f7f0] : crash_handler(int)
 ---- /usr/bin/proxysql(_ZN17MySQL_Data_Stream12array2bufferEv+0xc0) [0x55c0d4cbf920] : MySQL_Data_Stream::array2buffer()
 ---- /usr/bin/proxysql(_ZN17MySQL_Data_Stream17array2buffer_fullEv+0x23) [0x55c0d4cbfc93] : MySQL_Data_Stream::array2buffer_full()
 ---- /usr/bin/proxysql(_ZN13MySQL_Session8writeoutEv+0x64) [0x55c0d4cd79c4] : MySQL_Session::writeout()
 ---- /usr/bin/proxysql(_ZN12MySQL_Thread30listener_handle_new_connectionEP17MySQL_Data_Streamj+0x205) [0x55c0d4cc5ad5] : MySQL_Thread::listener_handle_new_connection(MySQL_Data_Stream*, unsigned int)
 ---- /usr/bin/proxysql(_ZN12MySQL_Thread24ProcessAllMyDS_AfterPollEv+0xb5) [0x55c0d4cc8475] : MySQL_Thread::ProcessAllMyDS_AfterPoll()
 ---- /usr/bin/proxysql(_ZN12MySQL_Thread3runEv+0x62b) [0x55c0d4cd339b] : MySQL_Thread::run()
 ---- /usr/bin/proxysql(_Z24mysql_worker_thread_funcPv+0x84) [0x55c0d4c67704] : mysql_worker_thread_func(void*)
2021-08-31 10:15:56 main.cpp:1613:ProxySQL_daemonize_phase3(): [ERROR] ProxySQL crashed. Restarting!
2021-08-31 10:15:56 [INFO] ProxySQL version 2.2.0-72-ge14accd
2021-08-31 10:15:56 [INFO] ProxySQL SHA1 checksum: 08868378ba2cd90e2c80aa8f52845461198da8fa
2021-08-31 10:15:57 [INFO] Angel process started ProxySQL process 3859105
2021-08-31 10:15:57 [INFO] Loaded built-in SQLite3
Standard ProxySQL MySQL Logger rev. 2.0.0714 -- MySQL_Logger.cpp -- Fri Jun  4 09:46:06 2021
Standard ProxySQL Cluster rev. 0.4.0906 -- ProxySQL_Cluster.cpp -- Fri Jun  4 09:46:06 2021
Standard ProxySQL Statistics rev. 1.4.1027 -- ProxySQL_Statistics.cpp -- Fri Jun  4 09:46:06 2021
Standard ProxySQL HTTP Server Handler rev. 1.4.1031 -- ProxySQL_HTTP_Server.cpp -- Fri Jun  4 09:46:06 2021
2021-08-31 10:15:58 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_action with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:15:58 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_names with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:15:58 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_sql_safe_updates with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:15:58 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_sql_select_limit with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:15:58 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_sql_mode with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:15:58 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_time_zone with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:15:58 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_isolation_level with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:15:58 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_transaction_read with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:15:58 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_sql_auto_is_null with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:15:58 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_net_write_timeout with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:15:58 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_max_join_size with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:15:58 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_sql_log_bin with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:15:58 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_wsrep_sync_wait with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:15:58 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_group_concat_max_len with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:15:58 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_CHARSET with value "utf8". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:15:58 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_character_set_results with value "utf8". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:15:58 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_character_set_connection with value "utf8". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:15:58 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_character_set_client with value "utf8". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:15:58 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_character_set_database with value "utf8". Deleting. If the variable name is correct, this version doesn't support it
Standard ProxySQL Admin rev. 2.0.6.0805 -- ProxySQL_Admin.cpp -- Fri Jun  4 09:46:06 2021
2021-08-31 10:15:58 [INFO] ProxySQL SHA1 checksum: 08868378ba2cd90e2c80aa8f52845461198da8fa
Standard MySQL Threads Handler rev. 0.2.0902 -- MySQL_Thread.cpp -- Fri Jun  4 09:46:06 2021
Standard MySQL Authentication rev. 0.2.0902 -- MySQL_Authentication.cpp -- Fri Jun  4 09:46:06 2021
2021-08-31 10:15:58 [INFO] Dumping mysql_servers_incoming
+--------------+---------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
| hostgroup_id | hostname      | port | gtid_port | weight | status | compression | max_connections | max_replication_lag | use_ssl | max_latency_ms | comment |
+--------------+---------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
| 0            | 192.168.111.5 | 6033 | 0         | 100    | 0      | 0           | 1000            | 0                   | 0       | 0              |         |
| 0            | 192.168.111.6 | 6033 | 0         | 1      | 0      | 0           | 1000            | 0                   | 0       | 0              |         |
+--------------+---------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
2021-08-31 10:15:58 [INFO] Dumping mysql_servers LEFT JOIN mysql_servers_incoming
+-------------+--------------+----------+------+
| mem_pointer | hostgroup_id | hostname | port |
+-------------+--------------+----------+------+
+-------------+--------------+----------+------+
2021-08-31 10:15:58 [INFO] Dumping mysql_servers JOIN mysql_servers_incoming
+--------------+---------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+-------------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
| hostgroup_id | hostname      | port | gtid_port | weight | status | compression | max_connections | max_replication_lag | use_ssl | max_latency_ms | comment | mem_pointer | gtid_port | weight | status | compression | max_connections | max_replication_lag | use_ssl | max_latency_ms | comment |
+--------------+---------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+-------------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
| 0            | 192.168.111.5 | 6033 | 0         | 100    | 0      | 0           | 1000            | 0                   | 0       | 0              |         | 0           | 0         | 100    | 0      | 0           | 1000            | 0                   | 0       | 0              |         |
| 0            | 192.168.111.6 | 6033 | 0         | 1      | 0      | 0           | 1000            | 0                   | 0       | 0              |         | 0           | 0         | 1      | 0      | 0           | 1000            | 0                   | 0       | 0              |         |
+--------------+---------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+-------------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
2021-08-31 10:15:58 [INFO] Creating new server in HG 0 : 192.168.111.5:6033 , gtid_port=0, weight=100, status=0
2021-08-31 10:15:58 [INFO] Creating new server in HG 0 : 192.168.111.6:6033 , gtid_port=0, weight=1, status=0
2021-08-31 10:15:58 [INFO] New mysql_group_replication_hostgroups table
2021-08-31 10:15:58 [INFO] New mysql_galera_hostgroups table
2021-08-31 10:15:58 [INFO] New mysql_aws_aurora_hostgroups table
2021-08-31 10:15:58 [INFO] Checksum for table mysql_servers is 8560024088533598405
2021-08-31 10:15:58 [INFO] MySQL_HostGroups_Manager::commit() locked for 2ms
2021-08-31 10:15:58 [INFO] Created new Cluster Node Entry for host 192.168.111.110:6032
2021-08-31 10:15:58 [INFO] Created new Cluster Node Entry for host 192.168.111.111:6032
2021-08-31 10:15:58 [INFO] Created new Cluster Node Entry for host 192.168.111.112:6032
2021-08-31 10:15:58 [INFO] Cluster: starting thread for peer 192.168.111.110:6032
Standard Query Processor rev. 2.0.6.0805 -- Query_Processor.cpp -- Fri Jun  4 09:46:06 2021
2021-08-31 10:15:58 [INFO] Cluster: starting thread for peer 192.168.111.111:6032
2021-08-31 10:15:58 [INFO] Cluster: starting thread for peer 192.168.111.112:6032
2021-08-31 10:15:58 ProxySQL_Cluster.cpp:251:ProxySQL_Cluster_Monitor_thread(): [WARNING] Cluster: unable to connect to peer 192.168.111.110:6032 . Error: Can't connect to MySQL server on '192.168.111.110' (115)
In memory Standard Query Cache (SQC) rev. 1.2.0905 -- Query_Cache.cpp -- Fri Jun  4 09:46:06 2021
2021-08-31 10:15:58 [INFO] Cluster: clustering with peer 192.168.111.111:6032 . Remote version: 2.2.0-72-ge14accd . Self version: 2.2.0-72-ge14accd
2021-08-31 10:15:58 [INFO] Cluster: clustering with peer 192.168.111.112:6032 . Remote version: 2.2.0-72-ge14accd . Self version: 2.2.0-72-ge14accd
2021-08-31 10:15:58 [INFO] Cluster: detected a new checksum for admin_variables from peer 192.168.111.111:6032, version 1, epoch 1630397630, checksum 0xD0DD4CB73BA81F0F . Not syncing yet ...
2021-08-31 10:15:58 [INFO] Cluster: detected a new checksum for mysql_query_rules from peer 192.168.111.111:6032, version 1, epoch 1630397630, checksum 0x0000000000000000 . Not syncing yet ...
2021-08-31 10:15:58 [INFO] Cluster: checksum for mysql_query_rules from peer 192.168.111.111:6032 matches with local checksum 0x0000000000000000 , we won't sync.
2021-08-31 10:15:58 [INFO] Cluster: detected a new checksum for mysql_servers from peer 192.168.111.111:6032, version 1, epoch 1630397630, checksum 0xABE7AC481A93C2A1 . Not syncing yet ...
2021-08-31 10:15:58 [INFO] Cluster: checksum for mysql_servers from peer 192.168.111.111:6032 matches with local checksum 0xABE7AC481A93C2A1 , we won't sync.
2021-08-31 10:15:58 [INFO] Cluster: detected a new checksum for mysql_users from peer 192.168.111.111:6032, version 1, epoch 1630397630, checksum 0x7136A19C9114F4C6 . Not syncing yet ...
2021-08-31 10:15:58 [INFO] Cluster: checksum for mysql_users from peer 192.168.111.111:6032 matches with local checksum 0x7136A19C9114F4C6 , we won't sync.
2021-08-31 10:15:58 [INFO] Cluster: detected a new checksum for mysql_variables from peer 192.168.111.111:6032, version 1, epoch 1630397630, checksum 0x72B3C8FF90325600 . Not syncing yet ...
2021-08-31 10:15:58 [INFO] Cluster: checksum for mysql_variables from peer 192.168.111.111:6032 matches with local checksum 0x72B3C8FF90325600 , we won't sync.
2021-08-31 10:15:58 [INFO] Cluster: detected a new checksum for proxysql_servers from peer 192.168.111.111:6032, version 1, epoch 1630397630, checksum 0xDA544307A3A1AE9C . Not syncing yet ...
2021-08-31 10:15:58 [INFO] Cluster: checksum for proxysql_servers from peer 192.168.111.111:6032 matches with local checksum 0xDA544307A3A1AE9C , we won't sync.
2021-08-31 10:15:58 [INFO] Cluster: detected a new checksum for admin_variables from peer 192.168.111.112:6032, version 1, epoch 1629902602, checksum 0xD0DD4CB73BA81F0F . Not syncing yet ...
2021-08-31 10:15:58 [INFO] Cluster: detected a new checksum for mysql_query_rules from peer 192.168.111.112:6032, version 1, epoch 1629902602, checksum 0x0000000000000000 . Not syncing yet ...
2021-08-31 10:15:58 [INFO] Cluster: checksum for mysql_query_rules from peer 192.168.111.112:6032 matches with local checksum 0x0000000000000000 , we won't sync.
2021-08-31 10:15:58 [INFO] Cluster: detected a new checksum for mysql_servers from peer 192.168.111.112:6032, version 1, epoch 1629902602, checksum 0xABE7AC481A93C2A1 . Not syncing yet ...
2021-08-31 10:15:58 [INFO] Cluster: checksum for mysql_servers from peer 192.168.111.112:6032 matches with local checksum 0xABE7AC481A93C2A1 , we won't sync.
2021-08-31 10:15:58 [INFO] Cluster: detected a new checksum for mysql_users from peer 192.168.111.112:6032, version 1, epoch 1629902602, checksum 0x7136A19C9114F4C6 . Not syncing yet ...
2021-08-31 10:15:58 [INFO] Cluster: checksum for mysql_users from peer 192.168.111.112:6032 matches with local checksum 0x7136A19C9114F4C6 , we won't sync.
2021-08-31 10:15:58 [INFO] Cluster: detected a new checksum for mysql_variables from peer 192.168.111.112:6032, version 1, epoch 1629902602, checksum 0x72B3C8FF90325600 . Not syncing yet ...
2021-08-31 10:15:58 [INFO] Cluster: checksum for mysql_variables from peer 192.168.111.112:6032 matches with local checksum 0x72B3C8FF90325600 , we won't sync.
2021-08-31 10:15:58 [INFO] Cluster: detected a new checksum for proxysql_servers from peer 192.168.111.112:6032, version 1, epoch 1629902602, checksum 0xDA544307A3A1AE9C . Not syncing yet ...
2021-08-31 10:15:58 [INFO] Cluster: checksum for proxysql_servers from peer 192.168.111.112:6032 matches with local checksum 0xDA544307A3A1AE9C , we won't sync.
2021-08-31 10:15:59 [INFO] Cluster: clustering with peer 192.168.111.110:6032 . Remote version: 2.2.0-72-ge14accd . Self version: 2.2.0-72-ge14accd
2021-08-31 10:15:59 [INFO] Cluster: detected a new checksum for admin_variables from peer 192.168.111.110:6032, version 1, epoch 1630397758, checksum 0xD0DD4CB73BA81F0F . Not syncing yet ...
2021-08-31 10:15:59 [INFO] Cluster: detected a new checksum for mysql_query_rules from peer 192.168.111.110:6032, version 1, epoch 1630397758, checksum 0x0000000000000000 . Not syncing yet ...
2021-08-31 10:15:59 [INFO] Cluster: checksum for mysql_query_rules from peer 192.168.111.110:6032 matches with local checksum 0x0000000000000000 , we won't sync.
2021-08-31 10:15:59 [INFO] Cluster: detected a new checksum for mysql_servers from peer 192.168.111.110:6032, version 1, epoch 1630397758, checksum 0xABE7AC481A93C2A1 . Not syncing yet ...
2021-08-31 10:15:59 [INFO] Cluster: checksum for mysql_servers from peer 192.168.111.110:6032 matches with local checksum 0xABE7AC481A93C2A1 , we won't sync.
2021-08-31 10:15:59 [INFO] Cluster: detected a new checksum for mysql_users from peer 192.168.111.110:6032, version 1, epoch 1630397758, checksum 0x7136A19C9114F4C6 . Not syncing yet ...
2021-08-31 10:15:59 [INFO] Cluster: checksum for mysql_users from peer 192.168.111.110:6032 matches with local checksum 0x7136A19C9114F4C6 , we won't sync.
2021-08-31 10:15:59 [INFO] Cluster: detected a new checksum for mysql_variables from peer 192.168.111.110:6032, version 1, epoch 1630397758, checksum 0x72B3C8FF90325600 . Not syncing yet ...
2021-08-31 10:15:59 [INFO] Cluster: checksum for mysql_variables from peer 192.168.111.110:6032 matches with local checksum 0x72B3C8FF90325600 , we won't sync.
2021-08-31 10:15:59 [INFO] Cluster: detected a new checksum for proxysql_servers from peer 192.168.111.110:6032, version 1, epoch 1630397758, checksum 0xDA544307A3A1AE9C . Not syncing yet ...
2021-08-31 10:15:59 [INFO] Cluster: checksum for proxysql_servers from peer 192.168.111.110:6032 matches with local checksum 0xDA544307A3A1AE9C , we won't sync.
Standard MySQL Monitor (StdMyMon) rev. 2.0.1226 -- MySQL_Monitor.cpp -- Fri Jun  4 09:46:06 2021
2021-08-31 10:16:00 [INFO] Latest ProxySQL version available: 2.2.0-72-ge14accd
2021-08-31 10:16:02 MySQL_Thread.cpp:3422:process_all_sessions(): [WARNING] Closing unhealthy client connection 127.0.0.1:38182
2021-08-31 10:16:02 MySQL_Thread.cpp:3422:process_all_sessions(): [WARNING] Closing unhealthy client connection 127.0.0.1:38406
2021-08-31 10:16:02 MySQL_Thread.cpp:3422:process_all_sessions(): [WARNING] Closing unhealthy client connection 127.0.0.1:38244
2021-08-31 10:16:02 MySQL_Monitor.cpp:1010:monitor_ping_thread(): [ERROR] Error on server 192.168.111.5:6033 : timeout
2021-08-31 10:16:02 MySQL_Monitor.cpp:1010:monitor_ping_thread(): [ERROR] Error on server 192.168.111.6:6033 : timeout
proxysql: mysql_data_stream.cpp:1106: void MySQL_Data_Stream::generate_compressed_packet(): Assertion `rc==Z_OK' failed.
Error: signal 6:
/usr/bin/proxysql(_Z13crash_handleri+0x40)[0x55c0d4c6f7f0]
/lib/x86_64-linux-gnu/libc.so.6(+0x46210)[0x7f4196571210]
/lib/x86_64-linux-gnu/libc.so.6(gsignal+0xcb)[0x7f419657118b]
/lib/x86_64-linux-gnu/libc.so.6(abort+0x12b)[0x7f4196550859]
/lib/x86_64-linux-gnu/libc.so.6(+0x25729)[0x7f4196550729]
/lib/x86_64-linux-gnu/libc.so.6(+0x36f36)[0x7f4196561f36]
/usr/bin/proxysql(+0x2e185d)[0x55c0d4cbf85d]
/usr/bin/proxysql(_ZN17MySQL_Data_Stream12array2bufferEv+0x97)[0x55c0d4cbf8f7]
/usr/bin/proxysql(_ZN17MySQL_Data_Stream17array2buffer_fullEv+0x23)[0x55c0d4cbfc93]
/usr/bin/proxysql(_ZN13MySQL_Session8writeoutEv+0x64)[0x55c0d4cd79c4]
/usr/bin/proxysql(_ZN13MySQL_Session7handlerEv+0x24c)[0x55c0d4cf1dbc]
/usr/bin/proxysql(_ZN12MySQL_Thread20process_all_sessionsEv+0x33c)[0x55c0d4cc52ec]
/usr/bin/proxysql(_ZN12MySQL_Thread3runEv+0x4d2)[0x55c0d4cd3242]
/usr/bin/proxysql(_Z24mysql_worker_thread_funcPv+0x84)[0x55c0d4c67704]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x9609)[0x7f4196a7a609]
/lib/x86_64-linux-gnu/libc.so.6(clone+0x43)[0x7f419664d293]
 ---- /usr/bin/proxysql(_Z13crash_handleri+0x40) [0x55c0d4c6f7f0] : crash_handler(int)
 ---- /usr/bin/proxysql(_ZN17MySQL_Data_Stream12array2bufferEv+0x97) [0x55c0d4cbf8f7] : MySQL_Data_Stream::array2buffer()
 ---- /usr/bin/proxysql(_ZN17MySQL_Data_Stream17array2buffer_fullEv+0x23) [0x55c0d4cbfc93] : MySQL_Data_Stream::array2buffer_full()
 ---- /usr/bin/proxysql(_ZN13MySQL_Session8writeoutEv+0x64) [0x55c0d4cd79c4] : MySQL_Session::writeout()
 ---- /usr/bin/proxysql(_ZN13MySQL_Session7handlerEv+0x24c) [0x55c0d4cf1dbc] : MySQL_Session::handler()
 ---- /usr/bin/proxysql(_ZN12MySQL_Thread20process_all_sessionsEv+0x33c) [0x55c0d4cc52ec] : MySQL_Thread::process_all_sessions()
 ---- /usr/bin/proxysql(_ZN12MySQL_Thread3runEv+0x4d2) [0x55c0d4cd3242] : MySQL_Thread::run()
 ---- /usr/bin/proxysql(_Z24mysql_worker_thread_funcPv+0x84) [0x55c0d4c67704] : mysql_worker_thread_func(void*)
2021-08-31 10:16:07 main.cpp:1613:ProxySQL_daemonize_phase3(): [ERROR] ProxySQL crashed. Restarting!
2021-08-31 10:16:07 [INFO] ProxySQL version 2.2.0-72-ge14accd
2021-08-31 10:16:07 [INFO] ProxySQL SHA1 checksum: 08868378ba2cd90e2c80aa8f52845461198da8fa
2021-08-31 10:16:07 [INFO] Angel process started ProxySQL process 3861574
2021-08-31 10:16:07 [INFO] Loaded built-in SQLite3
Standard ProxySQL MySQL Logger rev. 2.0.0714 -- MySQL_Logger.cpp -- Fri Jun  4 09:46:06 2021
Standard ProxySQL Cluster rev. 0.4.0906 -- ProxySQL_Cluster.cpp -- Fri Jun  4 09:46:06 2021
Standard ProxySQL Statistics rev. 1.4.1027 -- ProxySQL_Statistics.cpp -- Fri Jun  4 09:46:06 2021
Standard ProxySQL HTTP Server Handler rev. 1.4.1031 -- ProxySQL_HTTP_Server.cpp -- Fri Jun  4 09:46:06 2021
2021-08-31 10:16:07 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_action with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:07 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_names with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:07 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_sql_safe_updates with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:07 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_sql_select_limit with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:07 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_sql_mode with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:07 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_time_zone with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:07 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_isolation_level with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:07 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_transaction_read with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:07 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_sql_auto_is_null with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:07 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_net_write_timeout with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:07 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_max_join_size with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:07 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_sql_log_bin with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:07 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_wsrep_sync_wait with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:07 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_group_concat_max_len with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:07 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_CHARSET with value "utf8". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:07 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_character_set_results with value "utf8". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:07 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_character_set_connection with value "utf8". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:07 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_character_set_client with value "utf8". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:07 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_character_set_database with value "utf8". Deleting. If the variable name is correct, this version doesn't support it
Standard ProxySQL Admin rev. 2.0.6.0805 -- ProxySQL_Admin.cpp -- Fri Jun  4 09:46:06 2021
2021-08-31 10:16:07 [INFO] ProxySQL SHA1 checksum: 08868378ba2cd90e2c80aa8f52845461198da8fa
Standard MySQL Threads Handler rev. 0.2.0902 -- MySQL_Thread.cpp -- Fri Jun  4 09:46:06 2021
Standard MySQL Authentication rev. 0.2.0902 -- MySQL_Authentication.cpp -- Fri Jun  4 09:46:06 2021
2021-08-31 10:16:07 [INFO] Dumping mysql_servers_incoming
+--------------+---------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
| hostgroup_id | hostname      | port | gtid_port | weight | status | compression | max_connections | max_replication_lag | use_ssl | max_latency_ms | comment |
+--------------+---------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
| 0            | 192.168.111.5 | 6033 | 0         | 100    | 0      | 0           | 1000            | 0                   | 0       | 0              |         |
| 0            | 192.168.111.6 | 6033 | 0         | 1      | 0      | 0           | 1000            | 0                   | 0       | 0              |         |
+--------------+---------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
2021-08-31 10:16:07 [INFO] Dumping mysql_servers LEFT JOIN mysql_servers_incoming
+-------------+--------------+----------+------+
| mem_pointer | hostgroup_id | hostname | port |
+-------------+--------------+----------+------+
+-------------+--------------+----------+------+
2021-08-31 10:16:07 [INFO] Dumping mysql_servers JOIN mysql_servers_incoming
+--------------+---------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+-------------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
| hostgroup_id | hostname      | port | gtid_port | weight | status | compression | max_connections | max_replication_lag | use_ssl | max_latency_ms | comment | mem_pointer | gtid_port | weight | status | compression | max_connections | max_replication_lag | use_ssl | max_latency_ms | comment |
+--------------+---------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+-------------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
| 0            | 192.168.111.5 | 6033 | 0         | 100    | 0      | 0           | 1000            | 0                   | 0       | 0              |         | 0           | 0         | 100    | 0      | 0           | 1000            | 0                   | 0       | 0              |         |
| 0            | 192.168.111.6 | 6033 | 0         | 1      | 0      | 0           | 1000            | 0                   | 0       | 0              |         | 0           | 0         | 1      | 0      | 0           | 1000            | 0                   | 0       | 0              |         |
+--------------+---------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+-------------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
2021-08-31 10:16:07 [INFO] Creating new server in HG 0 : 192.168.111.5:6033 , gtid_port=0, weight=100, status=0
2021-08-31 10:16:07 [INFO] Creating new server in HG 0 : 192.168.111.6:6033 , gtid_port=0, weight=1, status=0
2021-08-31 10:16:07 [INFO] New mysql_group_replication_hostgroups table
2021-08-31 10:16:07 [INFO] New mysql_galera_hostgroups table
2021-08-31 10:16:07 [INFO] New mysql_aws_aurora_hostgroups table
2021-08-31 10:16:07 [INFO] Checksum for table mysql_servers is 8560024088533598405
2021-08-31 10:16:07 [INFO] MySQL_HostGroups_Manager::commit() locked for 2ms
2021-08-31 10:16:07 [INFO] Created new Cluster Node Entry for host 192.168.111.110:6032
2021-08-31 10:16:07 [INFO] Created new Cluster Node Entry for host 192.168.111.111:6032
2021-08-31 10:16:07 [INFO] Created new Cluster Node Entry for host 192.168.111.112:6032
Standard Query Processor rev. 2.0.6.0805 -- Query_Processor.cpp -- Fri Jun  4 09:46:06 2021
2021-08-31 10:16:07 [INFO] Cluster: starting thread for peer 192.168.111.111:6032
2021-08-31 10:16:07 [INFO] Cluster: starting thread for peer 192.168.111.110:6032
2021-08-31 10:16:07 ProxySQL_Cluster.cpp:251:ProxySQL_Cluster_Monitor_thread(): [WARNING] Cluster: unable to connect to peer 192.168.111.110:6032 . Error: Can't connect to MySQL server on '192.168.111.110' (115)
In memory Standard Query Cache (SQC) rev. 1.2.0905 -- Query_Cache.cpp -- Fri Jun  4 09:46:06 2021
2021-08-31 10:16:07 [INFO] Cluster: starting thread for peer 192.168.111.112:6032
2021-08-31 10:16:07 [INFO] Cluster: clustering with peer 192.168.111.111:6032 . Remote version: 2.2.0-72-ge14accd . Self version: 2.2.0-72-ge14accd
2021-08-31 10:16:07 [INFO] Cluster: clustering with peer 192.168.111.112:6032 . Remote version: 2.2.0-72-ge14accd . Self version: 2.2.0-72-ge14accd
2021-08-31 10:16:07 [INFO] Cluster: detected a new checksum for admin_variables from peer 192.168.111.112:6032, version 1, epoch 1629902602, checksum 0xD0DD4CB73BA81F0F . Not syncing yet ...
2021-08-31 10:16:07 [INFO] Cluster: detected a new checksum for mysql_query_rules from peer 192.168.111.112:6032, version 1, epoch 1629902602, checksum 0x0000000000000000 . Not syncing yet ...
2021-08-31 10:16:07 [INFO] Cluster: checksum for mysql_query_rules from peer 192.168.111.112:6032 matches with local checksum 0x0000000000000000 , we won't sync.
2021-08-31 10:16:07 [INFO] Cluster: detected a new checksum for mysql_servers from peer 192.168.111.112:6032, version 1, epoch 1629902602, checksum 0xABE7AC481A93C2A1 . Not syncing yet ...
2021-08-31 10:16:07 [INFO] Cluster: checksum for mysql_servers from peer 192.168.111.112:6032 matches with local checksum 0xABE7AC481A93C2A1 , we won't sync.
2021-08-31 10:16:07 [INFO] Cluster: detected a new checksum for mysql_users from peer 192.168.111.112:6032, version 1, epoch 1629902602, checksum 0x7136A19C9114F4C6 . Not syncing yet ...
2021-08-31 10:16:07 [INFO] Cluster: checksum for mysql_users from peer 192.168.111.112:6032 matches with local checksum 0x7136A19C9114F4C6 , we won't sync.
2021-08-31 10:16:07 [INFO] Cluster: detected a new checksum for mysql_variables from peer 192.168.111.112:6032, version 1, epoch 1629902602, checksum 0x72B3C8FF90325600 . Not syncing yet ...
2021-08-31 10:16:07 [INFO] Cluster: checksum for mysql_variables from peer 192.168.111.112:6032 matches with local checksum 0x72B3C8FF90325600 , we won't sync.
2021-08-31 10:16:07 [INFO] Cluster: detected a new checksum for proxysql_servers from peer 192.168.111.112:6032, version 1, epoch 1629902602, checksum 0xDA544307A3A1AE9C . Not syncing yet ...
2021-08-31 10:16:07 [INFO] Cluster: checksum for proxysql_servers from peer 192.168.111.112:6032 matches with local checksum 0xDA544307A3A1AE9C , we won't sync.
2021-08-31 10:16:07 [INFO] Cluster: detected a new checksum for admin_variables from peer 192.168.111.111:6032, version 1, epoch 1630397630, checksum 0xD0DD4CB73BA81F0F . Not syncing yet ...
2021-08-31 10:16:07 [INFO] Cluster: detected a new checksum for mysql_query_rules from peer 192.168.111.111:6032, version 1, epoch 1630397630, checksum 0x0000000000000000 . Not syncing yet ...
2021-08-31 10:16:07 [INFO] Cluster: checksum for mysql_query_rules from peer 192.168.111.111:6032 matches with local checksum 0x0000000000000000 , we won't sync.
2021-08-31 10:16:07 [INFO] Cluster: detected a new checksum for mysql_servers from peer 192.168.111.111:6032, version 1, epoch 1630397630, checksum 0xABE7AC481A93C2A1 . Not syncing yet ...
2021-08-31 10:16:07 [INFO] Cluster: checksum for mysql_servers from peer 192.168.111.111:6032 matches with local checksum 0xABE7AC481A93C2A1 , we won't sync.
2021-08-31 10:16:07 [INFO] Cluster: detected a new checksum for mysql_users from peer 192.168.111.111:6032, version 1, epoch 1630397630, checksum 0x7136A19C9114F4C6 . Not syncing yet ...
2021-08-31 10:16:07 [INFO] Cluster: checksum for mysql_users from peer 192.168.111.111:6032 matches with local checksum 0x7136A19C9114F4C6 , we won't sync.
2021-08-31 10:16:07 [INFO] Cluster: detected a new checksum for mysql_variables from peer 192.168.111.111:6032, version 1, epoch 1630397630, checksum 0x72B3C8FF90325600 . Not syncing yet ...
2021-08-31 10:16:07 [INFO] Cluster: checksum for mysql_variables from peer 192.168.111.111:6032 matches with local checksum 0x72B3C8FF90325600 , we won't sync.
2021-08-31 10:16:07 [INFO] Cluster: detected a new checksum for proxysql_servers from peer 192.168.111.111:6032, version 1, epoch 1630397630, checksum 0xDA544307A3A1AE9C . Not syncing yet ...
2021-08-31 10:16:07 [INFO] Cluster: checksum for proxysql_servers from peer 192.168.111.111:6032 matches with local checksum 0xDA544307A3A1AE9C , we won't sync.
2021-08-31 10:16:08 [INFO] Cluster: clustering with peer 192.168.111.110:6032 . Remote version: 2.2.0-72-ge14accd . Self version: 2.2.0-72-ge14accd
2021-08-31 10:16:08 [INFO] Cluster: detected a new checksum for admin_variables from peer 192.168.111.110:6032, version 1, epoch 1630397767, checksum 0xD0DD4CB73BA81F0F . Not syncing yet ...
2021-08-31 10:16:08 [INFO] Cluster: detected a new checksum for mysql_query_rules from peer 192.168.111.110:6032, version 1, epoch 1630397767, checksum 0x0000000000000000 . Not syncing yet ...
2021-08-31 10:16:08 [INFO] Cluster: checksum for mysql_query_rules from peer 192.168.111.110:6032 matches with local checksum 0x0000000000000000 , we won't sync.
2021-08-31 10:16:08 [INFO] Cluster: detected a new checksum for mysql_servers from peer 192.168.111.110:6032, version 1, epoch 1630397767, checksum 0xABE7AC481A93C2A1 . Not syncing yet ...
2021-08-31 10:16:08 [INFO] Cluster: checksum for mysql_servers from peer 192.168.111.110:6032 matches with local checksum 0xABE7AC481A93C2A1 , we won't sync.
2021-08-31 10:16:08 [INFO] Cluster: detected a new checksum for mysql_users from peer 192.168.111.110:6032, version 1, epoch 1630397767, checksum 0x7136A19C9114F4C6 . Not syncing yet ...
2021-08-31 10:16:08 [INFO] Cluster: checksum for mysql_users from peer 192.168.111.110:6032 matches with local checksum 0x7136A19C9114F4C6 , we won't sync.
2021-08-31 10:16:08 [INFO] Cluster: detected a new checksum for mysql_variables from peer 192.168.111.110:6032, version 1, epoch 1630397767, checksum 0x72B3C8FF90325600 . Not syncing yet ...
2021-08-31 10:16:08 [INFO] Cluster: checksum for mysql_variables from peer 192.168.111.110:6032 matches with local checksum 0x72B3C8FF90325600 , we won't sync.
2021-08-31 10:16:08 [INFO] Cluster: detected a new checksum for proxysql_servers from peer 192.168.111.110:6032, version 1, epoch 1630397767, checksum 0xDA544307A3A1AE9C . Not syncing yet ...
2021-08-31 10:16:08 [INFO] Cluster: checksum for proxysql_servers from peer 192.168.111.110:6032 matches with local checksum 0xDA544307A3A1AE9C , we won't sync.
Standard MySQL Monitor (StdMyMon) rev. 2.0.1226 -- MySQL_Monitor.cpp -- Fri Jun  4 09:46:06 2021
2021-08-31 10:16:09 [INFO] Latest ProxySQL version available: 2.2.0-72-ge14accd
2021-08-31 10:16:11 MySQL_Monitor.cpp:1010:monitor_ping_thread(): [ERROR] Error on server 192.168.111.6:6033 : timeout
2021-08-31 10:16:11 MySQL_Monitor.cpp:1010:monitor_ping_thread(): [ERROR] Error on server 192.168.111.5:6033 : timeout
proxysql: mysql_data_stream.cpp:1106: void MySQL_Data_Stream::generate_compressed_packet(): Assertion `rc==Z_OK' failed.
Error: signal 6:
/usr/bin/proxysql(_Z13crash_handleri+0x40)[0x55c0d4c6f7f0]
/lib/x86_64-linux-gnu/libc.so.6(+0x46210)[0x7f4196571210]
/lib/x86_64-linux-gnu/libc.so.6(gsignal+0xcb)[0x7f419657118b]
/lib/x86_64-linux-gnu/libc.so.6(abort+0x12b)[0x7f4196550859]
/lib/x86_64-linux-gnu/libc.so.6(+0x25729)[0x7f4196550729]
/lib/x86_64-linux-gnu/libc.so.6(+0x36f36)[0x7f4196561f36]
/usr/bin/proxysql(+0x2e185d)[0x55c0d4cbf85d]
/usr/bin/proxysql(_ZN17MySQL_Data_Stream12array2bufferEv+0x97)[0x55c0d4cbf8f7]
/usr/bin/proxysql(_ZN17MySQL_Data_Stream17array2buffer_fullEv+0x23)[0x55c0d4cbfc93]
/usr/bin/proxysql(_ZN13MySQL_Session8writeoutEv+0x64)[0x55c0d4cd79c4]
/usr/bin/proxysql(_ZN13MySQL_Session7handlerEv+0x24c)[0x55c0d4cf1dbc]
/usr/bin/proxysql(_ZN12MySQL_Thread20process_all_sessionsEv+0x33c)[0x55c0d4cc52ec]
/usr/bin/proxysql(_ZN12MySQL_Thread3runEv+0x4d2)[0x55c0d4cd3242]
/usr/bin/proxysql(_Z24mysql_worker_thread_funcPv+0x84)[0x55c0d4c67704]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x9609)[0x7f4196a7a609]
/lib/x86_64-linux-gnu/libc.so.6(clone+0x43)[0x7f419664d293]
 ---- /usr/bin/proxysql(_Z13crash_handleri+0x40) [0x55c0d4c6f7f0] : crash_handler(int)
 ---- /usr/bin/proxysql(_ZN17MySQL_Data_Stream12array2bufferEv+0x97) [0x55c0d4cbf8f7] : MySQL_Data_Stream::array2buffer()
 ---- /usr/bin/proxysql(_ZN17MySQL_Data_Stream17array2buffer_fullEv+0x23) [0x55c0d4cbfc93] : MySQL_Data_Stream::array2buffer_full()
 ---- /usr/bin/proxysql(_ZN13MySQL_Session8writeoutEv+0x64) [0x55c0d4cd79c4] : MySQL_Session::writeout()
 ---- /usr/bin/proxysql(_ZN13MySQL_Session7handlerEv+0x24c) [0x55c0d4cf1dbc] : MySQL_Session::handler()
 ---- /usr/bin/proxysql(_ZN12MySQL_Thread20process_all_sessionsEv+0x33c) [0x55c0d4cc52ec] : MySQL_Thread::process_all_sessions()
 ---- /usr/bin/proxysql(_ZN12MySQL_Thread3runEv+0x4d2) [0x55c0d4cd3242] : MySQL_Thread::run()
 ---- /usr/bin/proxysql(_Z24mysql_worker_thread_funcPv+0x84) [0x55c0d4c67704] : mysql_worker_thread_func(void*)
2021-08-31 10:16:19 main.cpp:1613:ProxySQL_daemonize_phase3(): [ERROR] ProxySQL crashed. Restarting!
2021-08-31 10:16:19 [INFO] ProxySQL version 2.2.0-72-ge14accd
2021-08-31 10:16:19 [INFO] ProxySQL SHA1 checksum: 08868378ba2cd90e2c80aa8f52845461198da8fa
2021-08-31 10:16:19 [INFO] Angel process started ProxySQL process 3863761
2021-08-31 10:16:19 [INFO] Loaded built-in SQLite3
Standard ProxySQL MySQL Logger rev. 2.0.0714 -- MySQL_Logger.cpp -- Fri Jun  4 09:46:06 2021
Standard ProxySQL Cluster rev. 0.4.0906 -- ProxySQL_Cluster.cpp -- Fri Jun  4 09:46:06 2021
Standard ProxySQL Statistics rev. 1.4.1027 -- ProxySQL_Statistics.cpp -- Fri Jun  4 09:46:06 2021
Standard ProxySQL HTTP Server Handler rev. 1.4.1031 -- ProxySQL_HTTP_Server.cpp -- Fri Jun  4 09:46:06 2021
2021-08-31 10:16:19 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_action with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:19 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_names with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:19 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_sql_safe_updates with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:19 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_sql_select_limit with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:19 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_sql_mode with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:19 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_time_zone with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:19 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_isolation_level with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:19 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_transaction_read with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:19 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_sql_auto_is_null with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:19 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_net_write_timeout with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:19 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_max_join_size with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:19 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_sql_log_bin with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:19 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_wsrep_sync_wait with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:19 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_group_concat_max_len with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:19 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_CHARSET with value "utf8". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:19 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_character_set_results with value "utf8". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:19 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_character_set_connection with value "utf8". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:19 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_character_set_client with value "utf8". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:19 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_character_set_database with value "utf8". Deleting. If the variable name is correct, this version doesn't support it
Standard ProxySQL Admin rev. 2.0.6.0805 -- ProxySQL_Admin.cpp -- Fri Jun  4 09:46:06 2021
2021-08-31 10:16:19 [INFO] ProxySQL SHA1 checksum: 08868378ba2cd90e2c80aa8f52845461198da8fa
Standard MySQL Threads Handler rev. 0.2.0902 -- MySQL_Thread.cpp -- Fri Jun  4 09:46:06 2021
Standard MySQL Authentication rev. 0.2.0902 -- MySQL_Authentication.cpp -- Fri Jun  4 09:46:06 2021
2021-08-31 10:16:19 [INFO] Dumping mysql_servers_incoming
+--------------+---------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
| hostgroup_id | hostname      | port | gtid_port | weight | status | compression | max_connections | max_replication_lag | use_ssl | max_latency_ms | comment |
+--------------+---------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
| 0            | 192.168.111.5 | 6033 | 0         | 100    | 0      | 0           | 1000            | 0                   | 0       | 0              |         |
| 0            | 192.168.111.6 | 6033 | 0         | 1      | 0      | 0           | 1000            | 0                   | 0       | 0              |         |
+--------------+---------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
2021-08-31 10:16:19 [INFO] Dumping mysql_servers LEFT JOIN mysql_servers_incoming
+-------------+--------------+----------+------+
| mem_pointer | hostgroup_id | hostname | port |
+-------------+--------------+----------+------+
+-------------+--------------+----------+------+
2021-08-31 10:16:19 [INFO] Dumping mysql_servers JOIN mysql_servers_incoming
+--------------+---------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+-------------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
| hostgroup_id | hostname      | port | gtid_port | weight | status | compression | max_connections | max_replication_lag | use_ssl | max_latency_ms | comment | mem_pointer | gtid_port | weight | status | compression | max_connections | max_replication_lag | use_ssl | max_latency_ms | comment |
+--------------+---------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+-------------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
| 0            | 192.168.111.5 | 6033 | 0         | 100    | 0      | 0           | 1000            | 0                   | 0       | 0              |         | 0           | 0         | 100    | 0      | 0           | 1000            | 0                   | 0       | 0              |         |
| 0            | 192.168.111.6 | 6033 | 0         | 1      | 0      | 0           | 1000            | 0                   | 0       | 0              |         | 0           | 0         | 1      | 0      | 0           | 1000            | 0                   | 0       | 0              |         |
+--------------+---------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+-------------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
2021-08-31 10:16:19 [INFO] Creating new server in HG 0 : 192.168.111.5:6033 , gtid_port=0, weight=100, status=0
2021-08-31 10:16:19 [INFO] Creating new server in HG 0 : 192.168.111.6:6033 , gtid_port=0, weight=1, status=0
2021-08-31 10:16:19 [INFO] New mysql_group_replication_hostgroups table
2021-08-31 10:16:19 [INFO] New mysql_galera_hostgroups table
2021-08-31 10:16:19 [INFO] New mysql_aws_aurora_hostgroups table
2021-08-31 10:16:19 [INFO] Checksum for table mysql_servers is 8560024088533598405
2021-08-31 10:16:19 [INFO] MySQL_HostGroups_Manager::commit() locked for 2ms
2021-08-31 10:16:19 [INFO] Created new Cluster Node Entry for host 192.168.111.110:6032
2021-08-31 10:16:19 [INFO] Created new Cluster Node Entry for host 192.168.111.111:6032
2021-08-31 10:16:19 [INFO] Cluster: starting thread for peer 192.168.111.110:6032
2021-08-31 10:16:19 [INFO] Created new Cluster Node Entry for host 192.168.111.112:6032
Standard Query Processor rev. 2.0.6.0805 -- Query_Processor.cpp -- Fri Jun  4 09:46:06 2021
2021-08-31 10:16:19 [INFO] Cluster: starting thread for peer 192.168.111.111:6032
2021-08-31 10:16:19 [INFO] Cluster: starting thread for peer 192.168.111.112:6032
2021-08-31 10:16:19 ProxySQL_Cluster.cpp:251:ProxySQL_Cluster_Monitor_thread(): [WARNING] Cluster: unable to connect to peer 192.168.111.110:6032 . Error: Can't connect to MySQL server on '192.168.111.110' (115)
In memory Standard Query Cache (SQC) rev. 1.2.0905 -- Query_Cache.cpp -- Fri Jun  4 09:46:06 2021
2021-08-31 10:16:19 [INFO] Cluster: clustering with peer 192.168.111.111:6032 . Remote version: 2.2.0-72-ge14accd . Self version: 2.2.0-72-ge14accd
2021-08-31 10:16:19 [INFO] Cluster: clustering with peer 192.168.111.112:6032 . Remote version: 2.2.0-72-ge14accd . Self version: 2.2.0-72-ge14accd
2021-08-31 10:16:19 [INFO] Cluster: detected a new checksum for admin_variables from peer 192.168.111.111:6032, version 1, epoch 1630397630, checksum 0xD0DD4CB73BA81F0F . Not syncing yet ...
2021-08-31 10:16:19 [INFO] Cluster: detected a new checksum for mysql_query_rules from peer 192.168.111.111:6032, version 1, epoch 1630397630, checksum 0x0000000000000000 . Not syncing yet ...
2021-08-31 10:16:19 [INFO] Cluster: checksum for mysql_query_rules from peer 192.168.111.111:6032 matches with local checksum 0x0000000000000000 , we won't sync.
2021-08-31 10:16:19 [INFO] Cluster: detected a new checksum for mysql_servers from peer 192.168.111.111:6032, version 1, epoch 1630397630, checksum 0xABE7AC481A93C2A1 . Not syncing yet ...
2021-08-31 10:16:19 [INFO] Cluster: checksum for mysql_servers from peer 192.168.111.111:6032 matches with local checksum 0xABE7AC481A93C2A1 , we won't sync.
2021-08-31 10:16:19 [INFO] Cluster: detected a new checksum for mysql_users from peer 192.168.111.111:6032, version 1, epoch 1630397630, checksum 0x7136A19C9114F4C6 . Not syncing yet ...
2021-08-31 10:16:19 [INFO] Cluster: checksum for mysql_users from peer 192.168.111.111:6032 matches with local checksum 0x7136A19C9114F4C6 , we won't sync.
2021-08-31 10:16:19 [INFO] Cluster: detected a new checksum for mysql_variables from peer 192.168.111.111:6032, version 1, epoch 1630397630, checksum 0x72B3C8FF90325600 . Not syncing yet ...
2021-08-31 10:16:19 [INFO] Cluster: checksum for mysql_variables from peer 192.168.111.111:6032 matches with local checksum 0x72B3C8FF90325600 , we won't sync.
2021-08-31 10:16:19 [INFO] Cluster: detected a new checksum for proxysql_servers from peer 192.168.111.111:6032, version 1, epoch 1630397630, checksum 0xDA544307A3A1AE9C . Not syncing yet ...
2021-08-31 10:16:19 [INFO] Cluster: checksum for proxysql_servers from peer 192.168.111.111:6032 matches with local checksum 0xDA544307A3A1AE9C , we won't sync.
2021-08-31 10:16:19 [INFO] Cluster: detected a new checksum for admin_variables from peer 192.168.111.112:6032, version 1, epoch 1629902602, checksum 0xD0DD4CB73BA81F0F . Not syncing yet ...
2021-08-31 10:16:19 [INFO] Cluster: detected a new checksum for mysql_query_rules from peer 192.168.111.112:6032, version 1, epoch 1629902602, checksum 0x0000000000000000 . Not syncing yet ...
2021-08-31 10:16:19 [INFO] Cluster: checksum for mysql_query_rules from peer 192.168.111.112:6032 matches with local checksum 0x0000000000000000 , we won't sync.
2021-08-31 10:16:19 [INFO] Cluster: detected a new checksum for mysql_servers from peer 192.168.111.112:6032, version 1, epoch 1629902602, checksum 0xABE7AC481A93C2A1 . Not syncing yet ...
2021-08-31 10:16:19 [INFO] Cluster: checksum for mysql_servers from peer 192.168.111.112:6032 matches with local checksum 0xABE7AC481A93C2A1 , we won't sync.
2021-08-31 10:16:19 [INFO] Cluster: detected a new checksum for mysql_users from peer 192.168.111.112:6032, version 1, epoch 1629902602, checksum 0x7136A19C9114F4C6 . Not syncing yet ...
2021-08-31 10:16:19 [INFO] Cluster: checksum for mysql_users from peer 192.168.111.112:6032 matches with local checksum 0x7136A19C9114F4C6 , we won't sync.
2021-08-31 10:16:19 [INFO] Cluster: detected a new checksum for mysql_variables from peer 192.168.111.112:6032, version 1, epoch 1629902602, checksum 0x72B3C8FF90325600 . Not syncing yet ...
2021-08-31 10:16:19 [INFO] Cluster: checksum for mysql_variables from peer 192.168.111.112:6032 matches with local checksum 0x72B3C8FF90325600 , we won't sync.
2021-08-31 10:16:19 [INFO] Cluster: detected a new checksum for proxysql_servers from peer 192.168.111.112:6032, version 1, epoch 1629902602, checksum 0xDA544307A3A1AE9C . Not syncing yet ...
2021-08-31 10:16:19 [INFO] Cluster: checksum for proxysql_servers from peer 192.168.111.112:6032 matches with local checksum 0xDA544307A3A1AE9C , we won't sync.
2021-08-31 10:16:20 [INFO] Cluster: clustering with peer 192.168.111.110:6032 . Remote version: 2.2.0-72-ge14accd . Self version: 2.2.0-72-ge14accd
2021-08-31 10:16:20 [INFO] Cluster: detected a new checksum for admin_variables from peer 192.168.111.110:6032, version 1, epoch 1630397779, checksum 0xD0DD4CB73BA81F0F . Not syncing yet ...
2021-08-31 10:16:20 [INFO] Cluster: detected a new checksum for mysql_query_rules from peer 192.168.111.110:6032, version 1, epoch 1630397779, checksum 0x0000000000000000 . Not syncing yet ...
2021-08-31 10:16:20 [INFO] Cluster: checksum for mysql_query_rules from peer 192.168.111.110:6032 matches with local checksum 0x0000000000000000 , we won't sync.
2021-08-31 10:16:20 [INFO] Cluster: detected a new checksum for mysql_servers from peer 192.168.111.110:6032, version 1, epoch 1630397779, checksum 0xABE7AC481A93C2A1 . Not syncing yet ...
2021-08-31 10:16:20 [INFO] Cluster: checksum for mysql_servers from peer 192.168.111.110:6032 matches with local checksum 0xABE7AC481A93C2A1 , we won't sync.
2021-08-31 10:16:20 [INFO] Cluster: detected a new checksum for mysql_users from peer 192.168.111.110:6032, version 1, epoch 1630397779, checksum 0x7136A19C9114F4C6 . Not syncing yet ...
2021-08-31 10:16:20 [INFO] Cluster: checksum for mysql_users from peer 192.168.111.110:6032 matches with local checksum 0x7136A19C9114F4C6 , we won't sync.
2021-08-31 10:16:20 [INFO] Cluster: detected a new checksum for mysql_variables from peer 192.168.111.110:6032, version 1, epoch 1630397779, checksum 0x72B3C8FF90325600 . Not syncing yet ...
2021-08-31 10:16:20 [INFO] Cluster: checksum for mysql_variables from peer 192.168.111.110:6032 matches with local checksum 0x72B3C8FF90325600 , we won't sync.
2021-08-31 10:16:20 [INFO] Cluster: detected a new checksum for proxysql_servers from peer 192.168.111.110:6032, version 1, epoch 1630397779, checksum 0xDA544307A3A1AE9C . Not syncing yet ...
2021-08-31 10:16:20 [INFO] Cluster: checksum for proxysql_servers from peer 192.168.111.110:6032 matches with local checksum 0xDA544307A3A1AE9C , we won't sync.
Standard MySQL Monitor (StdMyMon) rev. 2.0.1226 -- MySQL_Monitor.cpp -- Fri Jun  4 09:46:06 2021
2021-08-31 10:16:22 [INFO] Latest ProxySQL version available: 2.2.0-72-ge14accd

snip

(gdb) bt full
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:50
        set = {__val = {0, 94286696071280, 139921372053504, 139919563751808, 139919563751909, 139919563751808, 139919563751808, 139919563751929, 139919563752108, 139919563751808, 139919563752108, 0, 0, 0, 0, 0}}
        pid = <optimized out>
        tid = <optimized out>
        ret = <optimized out>
#1  0x00007f4196550859 in __GI_abort () at abort.c:79
        save_stage = 1
        act = {__sigaction_handler = {sa_handler = 0x7f4195e008c0, sa_sigaction = 0x7f4195e008c0}, sa_mask = {__val = {320, 4, 53953990656, 0, 0, 139919673402373, 0, 21474836480, 139919578080832, 9040, 139919673434128, 0, 94286697066325, 139919673402373, 139919673619904, 139919673623712}}, sa_flags = -1772419770,
          sa_restorer = 0x55c0d5282368}
        sigs = {__val = {32, 0 <repeats 15 times>}}
#2  0x00007f4196550729 in __assert_fail_base (fmt=0x7f41966e6588 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=0x55c0d5282285 "rc==Z_OK", file=0x55c0d5282261 "mysql_data_stream.cpp", line=1106, function=<optimized out>) at assert.c:92
        str = 0x7f4187623a00 "proxysql: mysql_data_stream.cpp:1106: void MySQL_Data_Stream::generate_compressed_packet(): Assertion `rc==Z_OK' failed.\n"
        total = 4096
#3  0x00007f4196561f36 in __GI___assert_fail (assertion=assertion@entry=0x55c0d5282285 "rc==Z_OK", file=file@entry=0x55c0d5282261 "mysql_data_stream.cpp", line=line@entry=1106, function=function@entry=0x55c0d5282368 "void MySQL_Data_Stream::generate_compressed_packet()") at assert.c:101
No locals.
#4  0x000055c0d4cbf85d in MySQL_Data_Stream::generate_compressed_packet (this=this@entry=0x7f4187649b80) at mysql_data_stream.cpp:1098
        destLen = 88881
        dest = 0x0
        sourceLen = <optimized out>
        source = 0x7f41843b5a00 "\001"
        rc = <optimized out>
        hdr = {pkt_length = 6091273, pkt_id = 150}
        total_size = <optimized out>
        i = 0
        p = <optimized out>
        __PRETTY_FUNCTION__ = "void MySQL_Data_Stream::generate_compressed_packet()"
#5  0x000055c0d4cbf8f7 in MySQL_Data_Stream::array2buffer (this=this@entry=0x7f4187649b80) at mysql_data_stream.cpp:1190
        b = <optimized out>
        ret = <optimized out>
        idx = <optimized out>
        cont = <optimized out>
#6  0x000055c0d4cbfc93 in MySQL_Data_Stream::array2buffer_full (this=0x7f4187649b80) at mysql_data_stream.cpp:1307
        rc = 0
        r = <optimized out>
#7  0x000055c0d4cd79c4 in MySQL_Session::writeout (this=this@entry=0x7f41875b4400) at MySQL_Session.cpp:665
        total_written = 0
        last_sent_ = 0
        disable_throttle = true
        mwpl = 0
        __PRETTY_FUNCTION__ = "void MySQL_Session::writeout()"
#8  0x000055c0d4cf1dbc in MySQL_Session::handler (this=this@entry=0x7f41875b4400) at MySQL_Session.cpp:4703
        handler_ret = 0
        prepared_stmt_with_no_params = false
        wrong_pass = false
        pkt = {ptr = 0x7f4187545a80, size = 19}
        __PRETTY_FUNCTION__ = "int MySQL_Session::handler()"
        __func__ = "handler"
#9  0x000055c0d4cc52ec in MySQL_Thread::process_all_sessions (this=this@entry=0x7f418fe00000) at MySQL_Thread.cpp:3433
        sess = 0x7f41875b4400
        n = 51
        total_active_transactions_ = 0
        idle_maintenance_thread = false
        rc = <optimized out>
        sess_sort = <optimized out>
        __func__ = "process_all_sessions"
#10 0x000055c0d4cd3242 in MySQL_Thread::run (this=0x7f418fe00000) at MySQL_Thread.cpp:2951
        num_idles = 0
        ttw = <optimized out>
        maintenance_interval = <optimized out>
        n = <optimized out>
        rc = <optimized out>
        idle_maintenance_thread = <optimized out>
        __PRETTY_FUNCTION__ = "void MySQL_Thread::run()"
#11 0x000055c0d4c67704 in mysql_worker_thread_func (arg=0x7f4195cdac60) at main.cpp:789
        thread_attr = {__size = '\000' <repeats 17 times>, "\020", '\000' <repeats 37 times>, __align = 0}
        tmp_stack_size = 8388608
        mysql_thread = 0x7f4195cdac60
        worker = 0x7f418fe00000
#12 0x00007f4196a7a609 in start_thread (arg=<optimized out>) at pthread_create.c:477
        ret = <optimized out>
        pd = <optimized out>
        unwind_buf = {cancel_jmp_buf = {{jmp_buf = {139919578093312, 339346931040459892, 140725914326526, 140725914326527, 139919663040016, 139919578083392, -416940017986233228, -416944210211824524}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}}
        not_first_call = 0
#13 0x00007f419664d293 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
No locals.

Thanks, Robert

renecannao commented 3 years ago

Hi Robert,

Can you please share the core dump, publicly or privately?

Thanks

GROpten commented 3 years ago

Hi,

Sure, I would prefer the private way.

Thanks

GROpten commented 3 years ago

Hi,

Rene, i will upload the logs/core files, but could you give me an email address, it will be easier.

Robert

JavierJF commented 3 years ago

Hi @GROpten,

could you please share the logs/coredumps with me at the following email address? javier@proxysql.com.

Thanks you!