Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Proxysql restarts multiple times with error signal 11 and 6 #3594

Closed
6 tasks
GROpten opened this issue Aug 31, 2021 · 4 comments
Closed
6 tasks

Proxysql restarts multiple times with error signal 11 and 6 #3594

GROpten opened this issue Aug 31, 2021 · 4 comments

Comments

@GROpten
Copy link

GROpten commented Aug 31, 2021

  • A clear description of the issue - Proxysql restarts multiple times with error signal 11 and 6
  • ProxySQL version - 2.2.0-72-ge14accd, codename Truls
  • OS version - Ubuntu 20.04.2 LTS
  • The steps to reproduce the issue - could not reproduce yet

snip


Error: signal 11:
/usr/bin/proxysql(_Z13crash_handleri+0x40)[0x55c0d4c6f7f0]
/lib/x86_64-linux-gnu/libc.so.6(+0x46210)[0x7f4196571210]
/lib/x86_64-linux-gnu/libc.so.6(+0x18e7b8)[0x7f41966b97b8]
/usr/bin/proxysql(_ZN17MySQL_Data_Stream12array2bufferEv+0xc0)[0x55c0d4cbf920]
/usr/bin/proxysql(_ZN17MySQL_Data_Stream17array2buffer_fullEv+0x23)[0x55c0d4cbfc93]
/usr/bin/proxysql(_ZN13MySQL_Session8writeoutEv+0x64)[0x55c0d4cd79c4]
/usr/bin/proxysql(_ZN12MySQL_Thread30listener_handle_new_connectionEP17MySQL_Data_Streamj+0x205)[0x55c0d4cc5ad5]
/usr/bin/proxysql(_ZN12MySQL_Thread24ProcessAllMyDS_AfterPollEv+0xb5)[0x55c0d4cc8475]
/usr/bin/proxysql(_ZN12MySQL_Thread3runEv+0x62b)[0x55c0d4cd339b]
/usr/bin/proxysql(_Z24mysql_worker_thread_funcPv+0x84)[0x55c0d4c67704]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x9609)[0x7f4196a7a609]
/lib/x86_64-linux-gnu/libc.so.6(clone+0x43)[0x7f419664d293]
 ---- /usr/bin/proxysql(_Z13crash_handleri+0x40) [0x55c0d4c6f7f0] : crash_handler(int)
 ---- /usr/bin/proxysql(_ZN17MySQL_Data_Stream12array2bufferEv+0xc0) [0x55c0d4cbf920] : MySQL_Data_Stream::array2buffer()
 ---- /usr/bin/proxysql(_ZN17MySQL_Data_Stream17array2buffer_fullEv+0x23) [0x55c0d4cbfc93] : MySQL_Data_Stream::array2buffer_full()
 ---- /usr/bin/proxysql(_ZN13MySQL_Session8writeoutEv+0x64) [0x55c0d4cd79c4] : MySQL_Session::writeout()
 ---- /usr/bin/proxysql(_ZN12MySQL_Thread30listener_handle_new_connectionEP17MySQL_Data_Streamj+0x205) [0x55c0d4cc5ad5] : MySQL_Thread::listener_handle_new_connection(MySQL_Data_Stream*, unsigned int)
 ---- /usr/bin/proxysql(_ZN12MySQL_Thread24ProcessAllMyDS_AfterPollEv+0xb5) [0x55c0d4cc8475] : MySQL_Thread::ProcessAllMyDS_AfterPoll()
 ---- /usr/bin/proxysql(_ZN12MySQL_Thread3runEv+0x62b) [0x55c0d4cd339b] : MySQL_Thread::run()
 ---- /usr/bin/proxysql(_Z24mysql_worker_thread_funcPv+0x84) [0x55c0d4c67704] : mysql_worker_thread_func(void*)
2021-08-31 10:15:56 main.cpp:1613:ProxySQL_daemonize_phase3(): [ERROR] ProxySQL crashed. Restarting!
2021-08-31 10:15:56 [INFO] ProxySQL version 2.2.0-72-ge14accd
2021-08-31 10:15:56 [INFO] ProxySQL SHA1 checksum: 08868378ba2cd90e2c80aa8f52845461198da8fa
2021-08-31 10:15:57 [INFO] Angel process started ProxySQL process 3859105
2021-08-31 10:15:57 [INFO] Loaded built-in SQLite3
Standard ProxySQL MySQL Logger rev. 2.0.0714 -- MySQL_Logger.cpp -- Fri Jun  4 09:46:06 2021
Standard ProxySQL Cluster rev. 0.4.0906 -- ProxySQL_Cluster.cpp -- Fri Jun  4 09:46:06 2021
Standard ProxySQL Statistics rev. 1.4.1027 -- ProxySQL_Statistics.cpp -- Fri Jun  4 09:46:06 2021
Standard ProxySQL HTTP Server Handler rev. 1.4.1031 -- ProxySQL_HTTP_Server.cpp -- Fri Jun  4 09:46:06 2021
2021-08-31 10:15:58 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_action with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:15:58 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_names with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:15:58 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_sql_safe_updates with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:15:58 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_sql_select_limit with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:15:58 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_sql_mode with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:15:58 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_time_zone with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:15:58 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_isolation_level with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:15:58 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_transaction_read with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:15:58 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_sql_auto_is_null with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:15:58 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_net_write_timeout with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:15:58 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_max_join_size with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:15:58 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_sql_log_bin with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:15:58 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_wsrep_sync_wait with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:15:58 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_group_concat_max_len with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:15:58 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_CHARSET with value "utf8". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:15:58 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_character_set_results with value "utf8". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:15:58 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_character_set_connection with value "utf8". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:15:58 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_character_set_client with value "utf8". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:15:58 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_character_set_database with value "utf8". Deleting. If the variable name is correct, this version doesn't support it
Standard ProxySQL Admin rev. 2.0.6.0805 -- ProxySQL_Admin.cpp -- Fri Jun  4 09:46:06 2021
2021-08-31 10:15:58 [INFO] ProxySQL SHA1 checksum: 08868378ba2cd90e2c80aa8f52845461198da8fa
Standard MySQL Threads Handler rev. 0.2.0902 -- MySQL_Thread.cpp -- Fri Jun  4 09:46:06 2021
Standard MySQL Authentication rev. 0.2.0902 -- MySQL_Authentication.cpp -- Fri Jun  4 09:46:06 2021
2021-08-31 10:15:58 [INFO] Dumping mysql_servers_incoming
+--------------+---------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
| hostgroup_id | hostname      | port | gtid_port | weight | status | compression | max_connections | max_replication_lag | use_ssl | max_latency_ms | comment |
+--------------+---------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
| 0            | 192.168.111.5 | 6033 | 0         | 100    | 0      | 0           | 1000            | 0                   | 0       | 0              |         |
| 0            | 192.168.111.6 | 6033 | 0         | 1      | 0      | 0           | 1000            | 0                   | 0       | 0              |         |
+--------------+---------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
2021-08-31 10:15:58 [INFO] Dumping mysql_servers LEFT JOIN mysql_servers_incoming
+-------------+--------------+----------+------+
| mem_pointer | hostgroup_id | hostname | port |
+-------------+--------------+----------+------+
+-------------+--------------+----------+------+
2021-08-31 10:15:58 [INFO] Dumping mysql_servers JOIN mysql_servers_incoming
+--------------+---------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+-------------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
| hostgroup_id | hostname      | port | gtid_port | weight | status | compression | max_connections | max_replication_lag | use_ssl | max_latency_ms | comment | mem_pointer | gtid_port | weight | status | compression | max_connections | max_replication_lag | use_ssl | max_latency_ms | comment |
+--------------+---------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+-------------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
| 0            | 192.168.111.5 | 6033 | 0         | 100    | 0      | 0           | 1000            | 0                   | 0       | 0              |         | 0           | 0         | 100    | 0      | 0           | 1000            | 0                   | 0       | 0              |         |
| 0            | 192.168.111.6 | 6033 | 0         | 1      | 0      | 0           | 1000            | 0                   | 0       | 0              |         | 0           | 0         | 1      | 0      | 0           | 1000            | 0                   | 0       | 0              |         |
+--------------+---------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+-------------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
2021-08-31 10:15:58 [INFO] Creating new server in HG 0 : 192.168.111.5:6033 , gtid_port=0, weight=100, status=0
2021-08-31 10:15:58 [INFO] Creating new server in HG 0 : 192.168.111.6:6033 , gtid_port=0, weight=1, status=0
2021-08-31 10:15:58 [INFO] New mysql_group_replication_hostgroups table
2021-08-31 10:15:58 [INFO] New mysql_galera_hostgroups table
2021-08-31 10:15:58 [INFO] New mysql_aws_aurora_hostgroups table
2021-08-31 10:15:58 [INFO] Checksum for table mysql_servers is 8560024088533598405
2021-08-31 10:15:58 [INFO] MySQL_HostGroups_Manager::commit() locked for 2ms
2021-08-31 10:15:58 [INFO] Created new Cluster Node Entry for host 192.168.111.110:6032
2021-08-31 10:15:58 [INFO] Created new Cluster Node Entry for host 192.168.111.111:6032
2021-08-31 10:15:58 [INFO] Created new Cluster Node Entry for host 192.168.111.112:6032
2021-08-31 10:15:58 [INFO] Cluster: starting thread for peer 192.168.111.110:6032
Standard Query Processor rev. 2.0.6.0805 -- Query_Processor.cpp -- Fri Jun  4 09:46:06 2021
2021-08-31 10:15:58 [INFO] Cluster: starting thread for peer 192.168.111.111:6032
2021-08-31 10:15:58 [INFO] Cluster: starting thread for peer 192.168.111.112:6032
2021-08-31 10:15:58 ProxySQL_Cluster.cpp:251:ProxySQL_Cluster_Monitor_thread(): [WARNING] Cluster: unable to connect to peer 192.168.111.110:6032 . Error: Can't connect to MySQL server on '192.168.111.110' (115)
In memory Standard Query Cache (SQC) rev. 1.2.0905 -- Query_Cache.cpp -- Fri Jun  4 09:46:06 2021
2021-08-31 10:15:58 [INFO] Cluster: clustering with peer 192.168.111.111:6032 . Remote version: 2.2.0-72-ge14accd . Self version: 2.2.0-72-ge14accd
2021-08-31 10:15:58 [INFO] Cluster: clustering with peer 192.168.111.112:6032 . Remote version: 2.2.0-72-ge14accd . Self version: 2.2.0-72-ge14accd
2021-08-31 10:15:58 [INFO] Cluster: detected a new checksum for admin_variables from peer 192.168.111.111:6032, version 1, epoch 1630397630, checksum 0xD0DD4CB73BA81F0F . Not syncing yet ...
2021-08-31 10:15:58 [INFO] Cluster: detected a new checksum for mysql_query_rules from peer 192.168.111.111:6032, version 1, epoch 1630397630, checksum 0x0000000000000000 . Not syncing yet ...
2021-08-31 10:15:58 [INFO] Cluster: checksum for mysql_query_rules from peer 192.168.111.111:6032 matches with local checksum 0x0000000000000000 , we won't sync.
2021-08-31 10:15:58 [INFO] Cluster: detected a new checksum for mysql_servers from peer 192.168.111.111:6032, version 1, epoch 1630397630, checksum 0xABE7AC481A93C2A1 . Not syncing yet ...
2021-08-31 10:15:58 [INFO] Cluster: checksum for mysql_servers from peer 192.168.111.111:6032 matches with local checksum 0xABE7AC481A93C2A1 , we won't sync.
2021-08-31 10:15:58 [INFO] Cluster: detected a new checksum for mysql_users from peer 192.168.111.111:6032, version 1, epoch 1630397630, checksum 0x7136A19C9114F4C6 . Not syncing yet ...
2021-08-31 10:15:58 [INFO] Cluster: checksum for mysql_users from peer 192.168.111.111:6032 matches with local checksum 0x7136A19C9114F4C6 , we won't sync.
2021-08-31 10:15:58 [INFO] Cluster: detected a new checksum for mysql_variables from peer 192.168.111.111:6032, version 1, epoch 1630397630, checksum 0x72B3C8FF90325600 . Not syncing yet ...
2021-08-31 10:15:58 [INFO] Cluster: checksum for mysql_variables from peer 192.168.111.111:6032 matches with local checksum 0x72B3C8FF90325600 , we won't sync.
2021-08-31 10:15:58 [INFO] Cluster: detected a new checksum for proxysql_servers from peer 192.168.111.111:6032, version 1, epoch 1630397630, checksum 0xDA544307A3A1AE9C . Not syncing yet ...
2021-08-31 10:15:58 [INFO] Cluster: checksum for proxysql_servers from peer 192.168.111.111:6032 matches with local checksum 0xDA544307A3A1AE9C , we won't sync.
2021-08-31 10:15:58 [INFO] Cluster: detected a new checksum for admin_variables from peer 192.168.111.112:6032, version 1, epoch 1629902602, checksum 0xD0DD4CB73BA81F0F . Not syncing yet ...
2021-08-31 10:15:58 [INFO] Cluster: detected a new checksum for mysql_query_rules from peer 192.168.111.112:6032, version 1, epoch 1629902602, checksum 0x0000000000000000 . Not syncing yet ...
2021-08-31 10:15:58 [INFO] Cluster: checksum for mysql_query_rules from peer 192.168.111.112:6032 matches with local checksum 0x0000000000000000 , we won't sync.
2021-08-31 10:15:58 [INFO] Cluster: detected a new checksum for mysql_servers from peer 192.168.111.112:6032, version 1, epoch 1629902602, checksum 0xABE7AC481A93C2A1 . Not syncing yet ...
2021-08-31 10:15:58 [INFO] Cluster: checksum for mysql_servers from peer 192.168.111.112:6032 matches with local checksum 0xABE7AC481A93C2A1 , we won't sync.
2021-08-31 10:15:58 [INFO] Cluster: detected a new checksum for mysql_users from peer 192.168.111.112:6032, version 1, epoch 1629902602, checksum 0x7136A19C9114F4C6 . Not syncing yet ...
2021-08-31 10:15:58 [INFO] Cluster: checksum for mysql_users from peer 192.168.111.112:6032 matches with local checksum 0x7136A19C9114F4C6 , we won't sync.
2021-08-31 10:15:58 [INFO] Cluster: detected a new checksum for mysql_variables from peer 192.168.111.112:6032, version 1, epoch 1629902602, checksum 0x72B3C8FF90325600 . Not syncing yet ...
2021-08-31 10:15:58 [INFO] Cluster: checksum for mysql_variables from peer 192.168.111.112:6032 matches with local checksum 0x72B3C8FF90325600 , we won't sync.
2021-08-31 10:15:58 [INFO] Cluster: detected a new checksum for proxysql_servers from peer 192.168.111.112:6032, version 1, epoch 1629902602, checksum 0xDA544307A3A1AE9C . Not syncing yet ...
2021-08-31 10:15:58 [INFO] Cluster: checksum for proxysql_servers from peer 192.168.111.112:6032 matches with local checksum 0xDA544307A3A1AE9C , we won't sync.
2021-08-31 10:15:59 [INFO] Cluster: clustering with peer 192.168.111.110:6032 . Remote version: 2.2.0-72-ge14accd . Self version: 2.2.0-72-ge14accd
2021-08-31 10:15:59 [INFO] Cluster: detected a new checksum for admin_variables from peer 192.168.111.110:6032, version 1, epoch 1630397758, checksum 0xD0DD4CB73BA81F0F . Not syncing yet ...
2021-08-31 10:15:59 [INFO] Cluster: detected a new checksum for mysql_query_rules from peer 192.168.111.110:6032, version 1, epoch 1630397758, checksum 0x0000000000000000 . Not syncing yet ...
2021-08-31 10:15:59 [INFO] Cluster: checksum for mysql_query_rules from peer 192.168.111.110:6032 matches with local checksum 0x0000000000000000 , we won't sync.
2021-08-31 10:15:59 [INFO] Cluster: detected a new checksum for mysql_servers from peer 192.168.111.110:6032, version 1, epoch 1630397758, checksum 0xABE7AC481A93C2A1 . Not syncing yet ...
2021-08-31 10:15:59 [INFO] Cluster: checksum for mysql_servers from peer 192.168.111.110:6032 matches with local checksum 0xABE7AC481A93C2A1 , we won't sync.
2021-08-31 10:15:59 [INFO] Cluster: detected a new checksum for mysql_users from peer 192.168.111.110:6032, version 1, epoch 1630397758, checksum 0x7136A19C9114F4C6 . Not syncing yet ...
2021-08-31 10:15:59 [INFO] Cluster: checksum for mysql_users from peer 192.168.111.110:6032 matches with local checksum 0x7136A19C9114F4C6 , we won't sync.
2021-08-31 10:15:59 [INFO] Cluster: detected a new checksum for mysql_variables from peer 192.168.111.110:6032, version 1, epoch 1630397758, checksum 0x72B3C8FF90325600 . Not syncing yet ...
2021-08-31 10:15:59 [INFO] Cluster: checksum for mysql_variables from peer 192.168.111.110:6032 matches with local checksum 0x72B3C8FF90325600 , we won't sync.
2021-08-31 10:15:59 [INFO] Cluster: detected a new checksum for proxysql_servers from peer 192.168.111.110:6032, version 1, epoch 1630397758, checksum 0xDA544307A3A1AE9C . Not syncing yet ...
2021-08-31 10:15:59 [INFO] Cluster: checksum for proxysql_servers from peer 192.168.111.110:6032 matches with local checksum 0xDA544307A3A1AE9C , we won't sync.
Standard MySQL Monitor (StdMyMon) rev. 2.0.1226 -- MySQL_Monitor.cpp -- Fri Jun  4 09:46:06 2021
2021-08-31 10:16:00 [INFO] Latest ProxySQL version available: 2.2.0-72-ge14accd
2021-08-31 10:16:02 MySQL_Thread.cpp:3422:process_all_sessions(): [WARNING] Closing unhealthy client connection 127.0.0.1:38182
2021-08-31 10:16:02 MySQL_Thread.cpp:3422:process_all_sessions(): [WARNING] Closing unhealthy client connection 127.0.0.1:38406
2021-08-31 10:16:02 MySQL_Thread.cpp:3422:process_all_sessions(): [WARNING] Closing unhealthy client connection 127.0.0.1:38244
2021-08-31 10:16:02 MySQL_Monitor.cpp:1010:monitor_ping_thread(): [ERROR] Error on server 192.168.111.5:6033 : timeout
2021-08-31 10:16:02 MySQL_Monitor.cpp:1010:monitor_ping_thread(): [ERROR] Error on server 192.168.111.6:6033 : timeout
proxysql: mysql_data_stream.cpp:1106: void MySQL_Data_Stream::generate_compressed_packet(): Assertion `rc==Z_OK' failed.
Error: signal 6:
/usr/bin/proxysql(_Z13crash_handleri+0x40)[0x55c0d4c6f7f0]
/lib/x86_64-linux-gnu/libc.so.6(+0x46210)[0x7f4196571210]
/lib/x86_64-linux-gnu/libc.so.6(gsignal+0xcb)[0x7f419657118b]
/lib/x86_64-linux-gnu/libc.so.6(abort+0x12b)[0x7f4196550859]
/lib/x86_64-linux-gnu/libc.so.6(+0x25729)[0x7f4196550729]
/lib/x86_64-linux-gnu/libc.so.6(+0x36f36)[0x7f4196561f36]
/usr/bin/proxysql(+0x2e185d)[0x55c0d4cbf85d]
/usr/bin/proxysql(_ZN17MySQL_Data_Stream12array2bufferEv+0x97)[0x55c0d4cbf8f7]
/usr/bin/proxysql(_ZN17MySQL_Data_Stream17array2buffer_fullEv+0x23)[0x55c0d4cbfc93]
/usr/bin/proxysql(_ZN13MySQL_Session8writeoutEv+0x64)[0x55c0d4cd79c4]
/usr/bin/proxysql(_ZN13MySQL_Session7handlerEv+0x24c)[0x55c0d4cf1dbc]
/usr/bin/proxysql(_ZN12MySQL_Thread20process_all_sessionsEv+0x33c)[0x55c0d4cc52ec]
/usr/bin/proxysql(_ZN12MySQL_Thread3runEv+0x4d2)[0x55c0d4cd3242]
/usr/bin/proxysql(_Z24mysql_worker_thread_funcPv+0x84)[0x55c0d4c67704]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x9609)[0x7f4196a7a609]
/lib/x86_64-linux-gnu/libc.so.6(clone+0x43)[0x7f419664d293]
 ---- /usr/bin/proxysql(_Z13crash_handleri+0x40) [0x55c0d4c6f7f0] : crash_handler(int)
 ---- /usr/bin/proxysql(_ZN17MySQL_Data_Stream12array2bufferEv+0x97) [0x55c0d4cbf8f7] : MySQL_Data_Stream::array2buffer()
 ---- /usr/bin/proxysql(_ZN17MySQL_Data_Stream17array2buffer_fullEv+0x23) [0x55c0d4cbfc93] : MySQL_Data_Stream::array2buffer_full()
 ---- /usr/bin/proxysql(_ZN13MySQL_Session8writeoutEv+0x64) [0x55c0d4cd79c4] : MySQL_Session::writeout()
 ---- /usr/bin/proxysql(_ZN13MySQL_Session7handlerEv+0x24c) [0x55c0d4cf1dbc] : MySQL_Session::handler()
 ---- /usr/bin/proxysql(_ZN12MySQL_Thread20process_all_sessionsEv+0x33c) [0x55c0d4cc52ec] : MySQL_Thread::process_all_sessions()
 ---- /usr/bin/proxysql(_ZN12MySQL_Thread3runEv+0x4d2) [0x55c0d4cd3242] : MySQL_Thread::run()
 ---- /usr/bin/proxysql(_Z24mysql_worker_thread_funcPv+0x84) [0x55c0d4c67704] : mysql_worker_thread_func(void*)
2021-08-31 10:16:07 main.cpp:1613:ProxySQL_daemonize_phase3(): [ERROR] ProxySQL crashed. Restarting!
2021-08-31 10:16:07 [INFO] ProxySQL version 2.2.0-72-ge14accd
2021-08-31 10:16:07 [INFO] ProxySQL SHA1 checksum: 08868378ba2cd90e2c80aa8f52845461198da8fa
2021-08-31 10:16:07 [INFO] Angel process started ProxySQL process 3861574
2021-08-31 10:16:07 [INFO] Loaded built-in SQLite3
Standard ProxySQL MySQL Logger rev. 2.0.0714 -- MySQL_Logger.cpp -- Fri Jun  4 09:46:06 2021
Standard ProxySQL Cluster rev. 0.4.0906 -- ProxySQL_Cluster.cpp -- Fri Jun  4 09:46:06 2021
Standard ProxySQL Statistics rev. 1.4.1027 -- ProxySQL_Statistics.cpp -- Fri Jun  4 09:46:06 2021
Standard ProxySQL HTTP Server Handler rev. 1.4.1031 -- ProxySQL_HTTP_Server.cpp -- Fri Jun  4 09:46:06 2021
2021-08-31 10:16:07 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_action with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:07 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_names with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:07 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_sql_safe_updates with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:07 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_sql_select_limit with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:07 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_sql_mode with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:07 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_time_zone with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:07 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_isolation_level with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:07 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_transaction_read with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:07 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_sql_auto_is_null with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:07 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_net_write_timeout with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:07 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_max_join_size with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:07 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_sql_log_bin with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:07 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_wsrep_sync_wait with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:07 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_group_concat_max_len with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:07 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_CHARSET with value "utf8". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:07 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_character_set_results with value "utf8". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:07 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_character_set_connection with value "utf8". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:07 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_character_set_client with value "utf8". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:07 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_character_set_database with value "utf8". Deleting. If the variable name is correct, this version doesn't support it
Standard ProxySQL Admin rev. 2.0.6.0805 -- ProxySQL_Admin.cpp -- Fri Jun  4 09:46:06 2021
2021-08-31 10:16:07 [INFO] ProxySQL SHA1 checksum: 08868378ba2cd90e2c80aa8f52845461198da8fa
Standard MySQL Threads Handler rev. 0.2.0902 -- MySQL_Thread.cpp -- Fri Jun  4 09:46:06 2021
Standard MySQL Authentication rev. 0.2.0902 -- MySQL_Authentication.cpp -- Fri Jun  4 09:46:06 2021
2021-08-31 10:16:07 [INFO] Dumping mysql_servers_incoming
+--------------+---------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
| hostgroup_id | hostname      | port | gtid_port | weight | status | compression | max_connections | max_replication_lag | use_ssl | max_latency_ms | comment |
+--------------+---------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
| 0            | 192.168.111.5 | 6033 | 0         | 100    | 0      | 0           | 1000            | 0                   | 0       | 0              |         |
| 0            | 192.168.111.6 | 6033 | 0         | 1      | 0      | 0           | 1000            | 0                   | 0       | 0              |         |
+--------------+---------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
2021-08-31 10:16:07 [INFO] Dumping mysql_servers LEFT JOIN mysql_servers_incoming
+-------------+--------------+----------+------+
| mem_pointer | hostgroup_id | hostname | port |
+-------------+--------------+----------+------+
+-------------+--------------+----------+------+
2021-08-31 10:16:07 [INFO] Dumping mysql_servers JOIN mysql_servers_incoming
+--------------+---------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+-------------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
| hostgroup_id | hostname      | port | gtid_port | weight | status | compression | max_connections | max_replication_lag | use_ssl | max_latency_ms | comment | mem_pointer | gtid_port | weight | status | compression | max_connections | max_replication_lag | use_ssl | max_latency_ms | comment |
+--------------+---------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+-------------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
| 0            | 192.168.111.5 | 6033 | 0         | 100    | 0      | 0           | 1000            | 0                   | 0       | 0              |         | 0           | 0         | 100    | 0      | 0           | 1000            | 0                   | 0       | 0              |         |
| 0            | 192.168.111.6 | 6033 | 0         | 1      | 0      | 0           | 1000            | 0                   | 0       | 0              |         | 0           | 0         | 1      | 0      | 0           | 1000            | 0                   | 0       | 0              |         |
+--------------+---------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+-------------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
2021-08-31 10:16:07 [INFO] Creating new server in HG 0 : 192.168.111.5:6033 , gtid_port=0, weight=100, status=0
2021-08-31 10:16:07 [INFO] Creating new server in HG 0 : 192.168.111.6:6033 , gtid_port=0, weight=1, status=0
2021-08-31 10:16:07 [INFO] New mysql_group_replication_hostgroups table
2021-08-31 10:16:07 [INFO] New mysql_galera_hostgroups table
2021-08-31 10:16:07 [INFO] New mysql_aws_aurora_hostgroups table
2021-08-31 10:16:07 [INFO] Checksum for table mysql_servers is 8560024088533598405
2021-08-31 10:16:07 [INFO] MySQL_HostGroups_Manager::commit() locked for 2ms
2021-08-31 10:16:07 [INFO] Created new Cluster Node Entry for host 192.168.111.110:6032
2021-08-31 10:16:07 [INFO] Created new Cluster Node Entry for host 192.168.111.111:6032
2021-08-31 10:16:07 [INFO] Created new Cluster Node Entry for host 192.168.111.112:6032
Standard Query Processor rev. 2.0.6.0805 -- Query_Processor.cpp -- Fri Jun  4 09:46:06 2021
2021-08-31 10:16:07 [INFO] Cluster: starting thread for peer 192.168.111.111:6032
2021-08-31 10:16:07 [INFO] Cluster: starting thread for peer 192.168.111.110:6032
2021-08-31 10:16:07 ProxySQL_Cluster.cpp:251:ProxySQL_Cluster_Monitor_thread(): [WARNING] Cluster: unable to connect to peer 192.168.111.110:6032 . Error: Can't connect to MySQL server on '192.168.111.110' (115)
In memory Standard Query Cache (SQC) rev. 1.2.0905 -- Query_Cache.cpp -- Fri Jun  4 09:46:06 2021
2021-08-31 10:16:07 [INFO] Cluster: starting thread for peer 192.168.111.112:6032
2021-08-31 10:16:07 [INFO] Cluster: clustering with peer 192.168.111.111:6032 . Remote version: 2.2.0-72-ge14accd . Self version: 2.2.0-72-ge14accd
2021-08-31 10:16:07 [INFO] Cluster: clustering with peer 192.168.111.112:6032 . Remote version: 2.2.0-72-ge14accd . Self version: 2.2.0-72-ge14accd
2021-08-31 10:16:07 [INFO] Cluster: detected a new checksum for admin_variables from peer 192.168.111.112:6032, version 1, epoch 1629902602, checksum 0xD0DD4CB73BA81F0F . Not syncing yet ...
2021-08-31 10:16:07 [INFO] Cluster: detected a new checksum for mysql_query_rules from peer 192.168.111.112:6032, version 1, epoch 1629902602, checksum 0x0000000000000000 . Not syncing yet ...
2021-08-31 10:16:07 [INFO] Cluster: checksum for mysql_query_rules from peer 192.168.111.112:6032 matches with local checksum 0x0000000000000000 , we won't sync.
2021-08-31 10:16:07 [INFO] Cluster: detected a new checksum for mysql_servers from peer 192.168.111.112:6032, version 1, epoch 1629902602, checksum 0xABE7AC481A93C2A1 . Not syncing yet ...
2021-08-31 10:16:07 [INFO] Cluster: checksum for mysql_servers from peer 192.168.111.112:6032 matches with local checksum 0xABE7AC481A93C2A1 , we won't sync.
2021-08-31 10:16:07 [INFO] Cluster: detected a new checksum for mysql_users from peer 192.168.111.112:6032, version 1, epoch 1629902602, checksum 0x7136A19C9114F4C6 . Not syncing yet ...
2021-08-31 10:16:07 [INFO] Cluster: checksum for mysql_users from peer 192.168.111.112:6032 matches with local checksum 0x7136A19C9114F4C6 , we won't sync.
2021-08-31 10:16:07 [INFO] Cluster: detected a new checksum for mysql_variables from peer 192.168.111.112:6032, version 1, epoch 1629902602, checksum 0x72B3C8FF90325600 . Not syncing yet ...
2021-08-31 10:16:07 [INFO] Cluster: checksum for mysql_variables from peer 192.168.111.112:6032 matches with local checksum 0x72B3C8FF90325600 , we won't sync.
2021-08-31 10:16:07 [INFO] Cluster: detected a new checksum for proxysql_servers from peer 192.168.111.112:6032, version 1, epoch 1629902602, checksum 0xDA544307A3A1AE9C . Not syncing yet ...
2021-08-31 10:16:07 [INFO] Cluster: checksum for proxysql_servers from peer 192.168.111.112:6032 matches with local checksum 0xDA544307A3A1AE9C , we won't sync.
2021-08-31 10:16:07 [INFO] Cluster: detected a new checksum for admin_variables from peer 192.168.111.111:6032, version 1, epoch 1630397630, checksum 0xD0DD4CB73BA81F0F . Not syncing yet ...
2021-08-31 10:16:07 [INFO] Cluster: detected a new checksum for mysql_query_rules from peer 192.168.111.111:6032, version 1, epoch 1630397630, checksum 0x0000000000000000 . Not syncing yet ...
2021-08-31 10:16:07 [INFO] Cluster: checksum for mysql_query_rules from peer 192.168.111.111:6032 matches with local checksum 0x0000000000000000 , we won't sync.
2021-08-31 10:16:07 [INFO] Cluster: detected a new checksum for mysql_servers from peer 192.168.111.111:6032, version 1, epoch 1630397630, checksum 0xABE7AC481A93C2A1 . Not syncing yet ...
2021-08-31 10:16:07 [INFO] Cluster: checksum for mysql_servers from peer 192.168.111.111:6032 matches with local checksum 0xABE7AC481A93C2A1 , we won't sync.
2021-08-31 10:16:07 [INFO] Cluster: detected a new checksum for mysql_users from peer 192.168.111.111:6032, version 1, epoch 1630397630, checksum 0x7136A19C9114F4C6 . Not syncing yet ...
2021-08-31 10:16:07 [INFO] Cluster: checksum for mysql_users from peer 192.168.111.111:6032 matches with local checksum 0x7136A19C9114F4C6 , we won't sync.
2021-08-31 10:16:07 [INFO] Cluster: detected a new checksum for mysql_variables from peer 192.168.111.111:6032, version 1, epoch 1630397630, checksum 0x72B3C8FF90325600 . Not syncing yet ...
2021-08-31 10:16:07 [INFO] Cluster: checksum for mysql_variables from peer 192.168.111.111:6032 matches with local checksum 0x72B3C8FF90325600 , we won't sync.
2021-08-31 10:16:07 [INFO] Cluster: detected a new checksum for proxysql_servers from peer 192.168.111.111:6032, version 1, epoch 1630397630, checksum 0xDA544307A3A1AE9C . Not syncing yet ...
2021-08-31 10:16:07 [INFO] Cluster: checksum for proxysql_servers from peer 192.168.111.111:6032 matches with local checksum 0xDA544307A3A1AE9C , we won't sync.
2021-08-31 10:16:08 [INFO] Cluster: clustering with peer 192.168.111.110:6032 . Remote version: 2.2.0-72-ge14accd . Self version: 2.2.0-72-ge14accd
2021-08-31 10:16:08 [INFO] Cluster: detected a new checksum for admin_variables from peer 192.168.111.110:6032, version 1, epoch 1630397767, checksum 0xD0DD4CB73BA81F0F . Not syncing yet ...
2021-08-31 10:16:08 [INFO] Cluster: detected a new checksum for mysql_query_rules from peer 192.168.111.110:6032, version 1, epoch 1630397767, checksum 0x0000000000000000 . Not syncing yet ...
2021-08-31 10:16:08 [INFO] Cluster: checksum for mysql_query_rules from peer 192.168.111.110:6032 matches with local checksum 0x0000000000000000 , we won't sync.
2021-08-31 10:16:08 [INFO] Cluster: detected a new checksum for mysql_servers from peer 192.168.111.110:6032, version 1, epoch 1630397767, checksum 0xABE7AC481A93C2A1 . Not syncing yet ...
2021-08-31 10:16:08 [INFO] Cluster: checksum for mysql_servers from peer 192.168.111.110:6032 matches with local checksum 0xABE7AC481A93C2A1 , we won't sync.
2021-08-31 10:16:08 [INFO] Cluster: detected a new checksum for mysql_users from peer 192.168.111.110:6032, version 1, epoch 1630397767, checksum 0x7136A19C9114F4C6 . Not syncing yet ...
2021-08-31 10:16:08 [INFO] Cluster: checksum for mysql_users from peer 192.168.111.110:6032 matches with local checksum 0x7136A19C9114F4C6 , we won't sync.
2021-08-31 10:16:08 [INFO] Cluster: detected a new checksum for mysql_variables from peer 192.168.111.110:6032, version 1, epoch 1630397767, checksum 0x72B3C8FF90325600 . Not syncing yet ...
2021-08-31 10:16:08 [INFO] Cluster: checksum for mysql_variables from peer 192.168.111.110:6032 matches with local checksum 0x72B3C8FF90325600 , we won't sync.
2021-08-31 10:16:08 [INFO] Cluster: detected a new checksum for proxysql_servers from peer 192.168.111.110:6032, version 1, epoch 1630397767, checksum 0xDA544307A3A1AE9C . Not syncing yet ...
2021-08-31 10:16:08 [INFO] Cluster: checksum for proxysql_servers from peer 192.168.111.110:6032 matches with local checksum 0xDA544307A3A1AE9C , we won't sync.
Standard MySQL Monitor (StdMyMon) rev. 2.0.1226 -- MySQL_Monitor.cpp -- Fri Jun  4 09:46:06 2021
2021-08-31 10:16:09 [INFO] Latest ProxySQL version available: 2.2.0-72-ge14accd
2021-08-31 10:16:11 MySQL_Monitor.cpp:1010:monitor_ping_thread(): [ERROR] Error on server 192.168.111.6:6033 : timeout
2021-08-31 10:16:11 MySQL_Monitor.cpp:1010:monitor_ping_thread(): [ERROR] Error on server 192.168.111.5:6033 : timeout
proxysql: mysql_data_stream.cpp:1106: void MySQL_Data_Stream::generate_compressed_packet(): Assertion `rc==Z_OK' failed.
Error: signal 6:
/usr/bin/proxysql(_Z13crash_handleri+0x40)[0x55c0d4c6f7f0]
/lib/x86_64-linux-gnu/libc.so.6(+0x46210)[0x7f4196571210]
/lib/x86_64-linux-gnu/libc.so.6(gsignal+0xcb)[0x7f419657118b]
/lib/x86_64-linux-gnu/libc.so.6(abort+0x12b)[0x7f4196550859]
/lib/x86_64-linux-gnu/libc.so.6(+0x25729)[0x7f4196550729]
/lib/x86_64-linux-gnu/libc.so.6(+0x36f36)[0x7f4196561f36]
/usr/bin/proxysql(+0x2e185d)[0x55c0d4cbf85d]
/usr/bin/proxysql(_ZN17MySQL_Data_Stream12array2bufferEv+0x97)[0x55c0d4cbf8f7]
/usr/bin/proxysql(_ZN17MySQL_Data_Stream17array2buffer_fullEv+0x23)[0x55c0d4cbfc93]
/usr/bin/proxysql(_ZN13MySQL_Session8writeoutEv+0x64)[0x55c0d4cd79c4]
/usr/bin/proxysql(_ZN13MySQL_Session7handlerEv+0x24c)[0x55c0d4cf1dbc]
/usr/bin/proxysql(_ZN12MySQL_Thread20process_all_sessionsEv+0x33c)[0x55c0d4cc52ec]
/usr/bin/proxysql(_ZN12MySQL_Thread3runEv+0x4d2)[0x55c0d4cd3242]
/usr/bin/proxysql(_Z24mysql_worker_thread_funcPv+0x84)[0x55c0d4c67704]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x9609)[0x7f4196a7a609]
/lib/x86_64-linux-gnu/libc.so.6(clone+0x43)[0x7f419664d293]
 ---- /usr/bin/proxysql(_Z13crash_handleri+0x40) [0x55c0d4c6f7f0] : crash_handler(int)
 ---- /usr/bin/proxysql(_ZN17MySQL_Data_Stream12array2bufferEv+0x97) [0x55c0d4cbf8f7] : MySQL_Data_Stream::array2buffer()
 ---- /usr/bin/proxysql(_ZN17MySQL_Data_Stream17array2buffer_fullEv+0x23) [0x55c0d4cbfc93] : MySQL_Data_Stream::array2buffer_full()
 ---- /usr/bin/proxysql(_ZN13MySQL_Session8writeoutEv+0x64) [0x55c0d4cd79c4] : MySQL_Session::writeout()
 ---- /usr/bin/proxysql(_ZN13MySQL_Session7handlerEv+0x24c) [0x55c0d4cf1dbc] : MySQL_Session::handler()
 ---- /usr/bin/proxysql(_ZN12MySQL_Thread20process_all_sessionsEv+0x33c) [0x55c0d4cc52ec] : MySQL_Thread::process_all_sessions()
 ---- /usr/bin/proxysql(_ZN12MySQL_Thread3runEv+0x4d2) [0x55c0d4cd3242] : MySQL_Thread::run()
 ---- /usr/bin/proxysql(_Z24mysql_worker_thread_funcPv+0x84) [0x55c0d4c67704] : mysql_worker_thread_func(void*)
2021-08-31 10:16:19 main.cpp:1613:ProxySQL_daemonize_phase3(): [ERROR] ProxySQL crashed. Restarting!
2021-08-31 10:16:19 [INFO] ProxySQL version 2.2.0-72-ge14accd
2021-08-31 10:16:19 [INFO] ProxySQL SHA1 checksum: 08868378ba2cd90e2c80aa8f52845461198da8fa
2021-08-31 10:16:19 [INFO] Angel process started ProxySQL process 3863761
2021-08-31 10:16:19 [INFO] Loaded built-in SQLite3
Standard ProxySQL MySQL Logger rev. 2.0.0714 -- MySQL_Logger.cpp -- Fri Jun  4 09:46:06 2021
Standard ProxySQL Cluster rev. 0.4.0906 -- ProxySQL_Cluster.cpp -- Fri Jun  4 09:46:06 2021
Standard ProxySQL Statistics rev. 1.4.1027 -- ProxySQL_Statistics.cpp -- Fri Jun  4 09:46:06 2021
Standard ProxySQL HTTP Server Handler rev. 1.4.1031 -- ProxySQL_HTTP_Server.cpp -- Fri Jun  4 09:46:06 2021
2021-08-31 10:16:19 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_action with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:19 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_names with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:19 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_sql_safe_updates with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:19 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_sql_select_limit with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:19 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_sql_mode with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:19 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_time_zone with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:19 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_isolation_level with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:19 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_transaction_read with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:19 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_sql_auto_is_null with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:19 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_net_write_timeout with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:19 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_max_join_size with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:19 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_sql_log_bin with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:19 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_wsrep_sync_wait with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:19 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_group_concat_max_len with value "". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:19 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_CHARSET with value "utf8". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:19 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_character_set_results with value "utf8". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:19 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_character_set_connection with value "utf8". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:19 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_character_set_client with value "utf8". Deleting. If the variable name is correct, this version doesn't support it
2021-08-31 10:16:19 ProxySQL_Admin.cpp:6191:flush_mysql_variables___database_to_runtime(): [WARNING] Impossible to set not existing variable default_character_set_database with value "utf8". Deleting. If the variable name is correct, this version doesn't support it
Standard ProxySQL Admin rev. 2.0.6.0805 -- ProxySQL_Admin.cpp -- Fri Jun  4 09:46:06 2021
2021-08-31 10:16:19 [INFO] ProxySQL SHA1 checksum: 08868378ba2cd90e2c80aa8f52845461198da8fa
Standard MySQL Threads Handler rev. 0.2.0902 -- MySQL_Thread.cpp -- Fri Jun  4 09:46:06 2021
Standard MySQL Authentication rev. 0.2.0902 -- MySQL_Authentication.cpp -- Fri Jun  4 09:46:06 2021
2021-08-31 10:16:19 [INFO] Dumping mysql_servers_incoming
+--------------+---------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
| hostgroup_id | hostname      | port | gtid_port | weight | status | compression | max_connections | max_replication_lag | use_ssl | max_latency_ms | comment |
+--------------+---------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
| 0            | 192.168.111.5 | 6033 | 0         | 100    | 0      | 0           | 1000            | 0                   | 0       | 0              |         |
| 0            | 192.168.111.6 | 6033 | 0         | 1      | 0      | 0           | 1000            | 0                   | 0       | 0              |         |
+--------------+---------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
2021-08-31 10:16:19 [INFO] Dumping mysql_servers LEFT JOIN mysql_servers_incoming
+-------------+--------------+----------+------+
| mem_pointer | hostgroup_id | hostname | port |
+-------------+--------------+----------+------+
+-------------+--------------+----------+------+
2021-08-31 10:16:19 [INFO] Dumping mysql_servers JOIN mysql_servers_incoming
+--------------+---------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+-------------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
| hostgroup_id | hostname      | port | gtid_port | weight | status | compression | max_connections | max_replication_lag | use_ssl | max_latency_ms | comment | mem_pointer | gtid_port | weight | status | compression | max_connections | max_replication_lag | use_ssl | max_latency_ms | comment |
+--------------+---------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+-------------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
| 0            | 192.168.111.5 | 6033 | 0         | 100    | 0      | 0           | 1000            | 0                   | 0       | 0              |         | 0           | 0         | 100    | 0      | 0           | 1000            | 0                   | 0       | 0              |         |
| 0            | 192.168.111.6 | 6033 | 0         | 1      | 0      | 0           | 1000            | 0                   | 0       | 0              |         | 0           | 0         | 1      | 0      | 0           | 1000            | 0                   | 0       | 0              |         |
+--------------+---------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+-------------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+---------+
2021-08-31 10:16:19 [INFO] Creating new server in HG 0 : 192.168.111.5:6033 , gtid_port=0, weight=100, status=0
2021-08-31 10:16:19 [INFO] Creating new server in HG 0 : 192.168.111.6:6033 , gtid_port=0, weight=1, status=0
2021-08-31 10:16:19 [INFO] New mysql_group_replication_hostgroups table
2021-08-31 10:16:19 [INFO] New mysql_galera_hostgroups table
2021-08-31 10:16:19 [INFO] New mysql_aws_aurora_hostgroups table
2021-08-31 10:16:19 [INFO] Checksum for table mysql_servers is 8560024088533598405
2021-08-31 10:16:19 [INFO] MySQL_HostGroups_Manager::commit() locked for 2ms
2021-08-31 10:16:19 [INFO] Created new Cluster Node Entry for host 192.168.111.110:6032
2021-08-31 10:16:19 [INFO] Created new Cluster Node Entry for host 192.168.111.111:6032
2021-08-31 10:16:19 [INFO] Cluster: starting thread for peer 192.168.111.110:6032
2021-08-31 10:16:19 [INFO] Created new Cluster Node Entry for host 192.168.111.112:6032
Standard Query Processor rev. 2.0.6.0805 -- Query_Processor.cpp -- Fri Jun  4 09:46:06 2021
2021-08-31 10:16:19 [INFO] Cluster: starting thread for peer 192.168.111.111:6032
2021-08-31 10:16:19 [INFO] Cluster: starting thread for peer 192.168.111.112:6032
2021-08-31 10:16:19 ProxySQL_Cluster.cpp:251:ProxySQL_Cluster_Monitor_thread(): [WARNING] Cluster: unable to connect to peer 192.168.111.110:6032 . Error: Can't connect to MySQL server on '192.168.111.110' (115)
In memory Standard Query Cache (SQC) rev. 1.2.0905 -- Query_Cache.cpp -- Fri Jun  4 09:46:06 2021
2021-08-31 10:16:19 [INFO] Cluster: clustering with peer 192.168.111.111:6032 . Remote version: 2.2.0-72-ge14accd . Self version: 2.2.0-72-ge14accd
2021-08-31 10:16:19 [INFO] Cluster: clustering with peer 192.168.111.112:6032 . Remote version: 2.2.0-72-ge14accd . Self version: 2.2.0-72-ge14accd
2021-08-31 10:16:19 [INFO] Cluster: detected a new checksum for admin_variables from peer 192.168.111.111:6032, version 1, epoch 1630397630, checksum 0xD0DD4CB73BA81F0F . Not syncing yet ...
2021-08-31 10:16:19 [INFO] Cluster: detected a new checksum for mysql_query_rules from peer 192.168.111.111:6032, version 1, epoch 1630397630, checksum 0x0000000000000000 . Not syncing yet ...
2021-08-31 10:16:19 [INFO] Cluster: checksum for mysql_query_rules from peer 192.168.111.111:6032 matches with local checksum 0x0000000000000000 , we won't sync.
2021-08-31 10:16:19 [INFO] Cluster: detected a new checksum for mysql_servers from peer 192.168.111.111:6032, version 1, epoch 1630397630, checksum 0xABE7AC481A93C2A1 . Not syncing yet ...
2021-08-31 10:16:19 [INFO] Cluster: checksum for mysql_servers from peer 192.168.111.111:6032 matches with local checksum 0xABE7AC481A93C2A1 , we won't sync.
2021-08-31 10:16:19 [INFO] Cluster: detected a new checksum for mysql_users from peer 192.168.111.111:6032, version 1, epoch 1630397630, checksum 0x7136A19C9114F4C6 . Not syncing yet ...
2021-08-31 10:16:19 [INFO] Cluster: checksum for mysql_users from peer 192.168.111.111:6032 matches with local checksum 0x7136A19C9114F4C6 , we won't sync.
2021-08-31 10:16:19 [INFO] Cluster: detected a new checksum for mysql_variables from peer 192.168.111.111:6032, version 1, epoch 1630397630, checksum 0x72B3C8FF90325600 . Not syncing yet ...
2021-08-31 10:16:19 [INFO] Cluster: checksum for mysql_variables from peer 192.168.111.111:6032 matches with local checksum 0x72B3C8FF90325600 , we won't sync.
2021-08-31 10:16:19 [INFO] Cluster: detected a new checksum for proxysql_servers from peer 192.168.111.111:6032, version 1, epoch 1630397630, checksum 0xDA544307A3A1AE9C . Not syncing yet ...
2021-08-31 10:16:19 [INFO] Cluster: checksum for proxysql_servers from peer 192.168.111.111:6032 matches with local checksum 0xDA544307A3A1AE9C , we won't sync.
2021-08-31 10:16:19 [INFO] Cluster: detected a new checksum for admin_variables from peer 192.168.111.112:6032, version 1, epoch 1629902602, checksum 0xD0DD4CB73BA81F0F . Not syncing yet ...
2021-08-31 10:16:19 [INFO] Cluster: detected a new checksum for mysql_query_rules from peer 192.168.111.112:6032, version 1, epoch 1629902602, checksum 0x0000000000000000 . Not syncing yet ...
2021-08-31 10:16:19 [INFO] Cluster: checksum for mysql_query_rules from peer 192.168.111.112:6032 matches with local checksum 0x0000000000000000 , we won't sync.
2021-08-31 10:16:19 [INFO] Cluster: detected a new checksum for mysql_servers from peer 192.168.111.112:6032, version 1, epoch 1629902602, checksum 0xABE7AC481A93C2A1 . Not syncing yet ...
2021-08-31 10:16:19 [INFO] Cluster: checksum for mysql_servers from peer 192.168.111.112:6032 matches with local checksum 0xABE7AC481A93C2A1 , we won't sync.
2021-08-31 10:16:19 [INFO] Cluster: detected a new checksum for mysql_users from peer 192.168.111.112:6032, version 1, epoch 1629902602, checksum 0x7136A19C9114F4C6 . Not syncing yet ...
2021-08-31 10:16:19 [INFO] Cluster: checksum for mysql_users from peer 192.168.111.112:6032 matches with local checksum 0x7136A19C9114F4C6 , we won't sync.
2021-08-31 10:16:19 [INFO] Cluster: detected a new checksum for mysql_variables from peer 192.168.111.112:6032, version 1, epoch 1629902602, checksum 0x72B3C8FF90325600 . Not syncing yet ...
2021-08-31 10:16:19 [INFO] Cluster: checksum for mysql_variables from peer 192.168.111.112:6032 matches with local checksum 0x72B3C8FF90325600 , we won't sync.
2021-08-31 10:16:19 [INFO] Cluster: detected a new checksum for proxysql_servers from peer 192.168.111.112:6032, version 1, epoch 1629902602, checksum 0xDA544307A3A1AE9C . Not syncing yet ...
2021-08-31 10:16:19 [INFO] Cluster: checksum for proxysql_servers from peer 192.168.111.112:6032 matches with local checksum 0xDA544307A3A1AE9C , we won't sync.
2021-08-31 10:16:20 [INFO] Cluster: clustering with peer 192.168.111.110:6032 . Remote version: 2.2.0-72-ge14accd . Self version: 2.2.0-72-ge14accd
2021-08-31 10:16:20 [INFO] Cluster: detected a new checksum for admin_variables from peer 192.168.111.110:6032, version 1, epoch 1630397779, checksum 0xD0DD4CB73BA81F0F . Not syncing yet ...
2021-08-31 10:16:20 [INFO] Cluster: detected a new checksum for mysql_query_rules from peer 192.168.111.110:6032, version 1, epoch 1630397779, checksum 0x0000000000000000 . Not syncing yet ...
2021-08-31 10:16:20 [INFO] Cluster: checksum for mysql_query_rules from peer 192.168.111.110:6032 matches with local checksum 0x0000000000000000 , we won't sync.
2021-08-31 10:16:20 [INFO] Cluster: detected a new checksum for mysql_servers from peer 192.168.111.110:6032, version 1, epoch 1630397779, checksum 0xABE7AC481A93C2A1 . Not syncing yet ...
2021-08-31 10:16:20 [INFO] Cluster: checksum for mysql_servers from peer 192.168.111.110:6032 matches with local checksum 0xABE7AC481A93C2A1 , we won't sync.
2021-08-31 10:16:20 [INFO] Cluster: detected a new checksum for mysql_users from peer 192.168.111.110:6032, version 1, epoch 1630397779, checksum 0x7136A19C9114F4C6 . Not syncing yet ...
2021-08-31 10:16:20 [INFO] Cluster: checksum for mysql_users from peer 192.168.111.110:6032 matches with local checksum 0x7136A19C9114F4C6 , we won't sync.
2021-08-31 10:16:20 [INFO] Cluster: detected a new checksum for mysql_variables from peer 192.168.111.110:6032, version 1, epoch 1630397779, checksum 0x72B3C8FF90325600 . Not syncing yet ...
2021-08-31 10:16:20 [INFO] Cluster: checksum for mysql_variables from peer 192.168.111.110:6032 matches with local checksum 0x72B3C8FF90325600 , we won't sync.
2021-08-31 10:16:20 [INFO] Cluster: detected a new checksum for proxysql_servers from peer 192.168.111.110:6032, version 1, epoch 1630397779, checksum 0xDA544307A3A1AE9C . Not syncing yet ...
2021-08-31 10:16:20 [INFO] Cluster: checksum for proxysql_servers from peer 192.168.111.110:6032 matches with local checksum 0xDA544307A3A1AE9C , we won't sync.
Standard MySQL Monitor (StdMyMon) rev. 2.0.1226 -- MySQL_Monitor.cpp -- Fri Jun  4 09:46:06 2021
2021-08-31 10:16:22 [INFO] Latest ProxySQL version available: 2.2.0-72-ge14accd


snip

  • The package used to install ProxySQL - proxysql/unknown,now 2.2.0 amd64 [installed] from proxysql repository
  • The compressed core dump (the last one)
(gdb) bt full
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:50
        set = {__val = {0, 94286696071280, 139921372053504, 139919563751808, 139919563751909, 139919563751808, 139919563751808, 139919563751929, 139919563752108, 139919563751808, 139919563752108, 0, 0, 0, 0, 0}}
        pid = <optimized out>
        tid = <optimized out>
        ret = <optimized out>
#1  0x00007f4196550859 in __GI_abort () at abort.c:79
        save_stage = 1
        act = {__sigaction_handler = {sa_handler = 0x7f4195e008c0, sa_sigaction = 0x7f4195e008c0}, sa_mask = {__val = {320, 4, 53953990656, 0, 0, 139919673402373, 0, 21474836480, 139919578080832, 9040, 139919673434128, 0, 94286697066325, 139919673402373, 139919673619904, 139919673623712}}, sa_flags = -1772419770,
          sa_restorer = 0x55c0d5282368}
        sigs = {__val = {32, 0 <repeats 15 times>}}
#2  0x00007f4196550729 in __assert_fail_base (fmt=0x7f41966e6588 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=0x55c0d5282285 "rc==Z_OK", file=0x55c0d5282261 "mysql_data_stream.cpp", line=1106, function=<optimized out>) at assert.c:92
        str = 0x7f4187623a00 "proxysql: mysql_data_stream.cpp:1106: void MySQL_Data_Stream::generate_compressed_packet(): Assertion `rc==Z_OK' failed.\n"
        total = 4096
#3  0x00007f4196561f36 in __GI___assert_fail (assertion=assertion@entry=0x55c0d5282285 "rc==Z_OK", file=file@entry=0x55c0d5282261 "mysql_data_stream.cpp", line=line@entry=1106, function=function@entry=0x55c0d5282368 "void MySQL_Data_Stream::generate_compressed_packet()") at assert.c:101
No locals.
#4  0x000055c0d4cbf85d in MySQL_Data_Stream::generate_compressed_packet (this=this@entry=0x7f4187649b80) at mysql_data_stream.cpp:1098
        destLen = 88881
        dest = 0x0
        sourceLen = <optimized out>
        source = 0x7f41843b5a00 "\001"
        rc = <optimized out>
        hdr = {pkt_length = 6091273, pkt_id = 150}
        total_size = <optimized out>
        i = 0
        p = <optimized out>
        __PRETTY_FUNCTION__ = "void MySQL_Data_Stream::generate_compressed_packet()"
#5  0x000055c0d4cbf8f7 in MySQL_Data_Stream::array2buffer (this=this@entry=0x7f4187649b80) at mysql_data_stream.cpp:1190
        b = <optimized out>
        ret = <optimized out>
        idx = <optimized out>
        cont = <optimized out>
#6  0x000055c0d4cbfc93 in MySQL_Data_Stream::array2buffer_full (this=0x7f4187649b80) at mysql_data_stream.cpp:1307
        rc = 0
        r = <optimized out>
#7  0x000055c0d4cd79c4 in MySQL_Session::writeout (this=this@entry=0x7f41875b4400) at MySQL_Session.cpp:665
        total_written = 0
        last_sent_ = 0
        disable_throttle = true
        mwpl = 0
        __PRETTY_FUNCTION__ = "void MySQL_Session::writeout()"
#8  0x000055c0d4cf1dbc in MySQL_Session::handler (this=this@entry=0x7f41875b4400) at MySQL_Session.cpp:4703
        handler_ret = 0
        prepared_stmt_with_no_params = false
        wrong_pass = false
        pkt = {ptr = 0x7f4187545a80, size = 19}
        __PRETTY_FUNCTION__ = "int MySQL_Session::handler()"
        __func__ = "handler"
#9  0x000055c0d4cc52ec in MySQL_Thread::process_all_sessions (this=this@entry=0x7f418fe00000) at MySQL_Thread.cpp:3433
        sess = 0x7f41875b4400
        n = 51
        total_active_transactions_ = 0
        idle_maintenance_thread = false
        rc = <optimized out>
        sess_sort = <optimized out>
        __func__ = "process_all_sessions"
#10 0x000055c0d4cd3242 in MySQL_Thread::run (this=0x7f418fe00000) at MySQL_Thread.cpp:2951
        num_idles = 0
        ttw = <optimized out>
        maintenance_interval = <optimized out>
        n = <optimized out>
        rc = <optimized out>
        idle_maintenance_thread = <optimized out>
        __PRETTY_FUNCTION__ = "void MySQL_Thread::run()"
#11 0x000055c0d4c67704 in mysql_worker_thread_func (arg=0x7f4195cdac60) at main.cpp:789
        thread_attr = {__size = '\000' <repeats 17 times>, "\020", '\000' <repeats 37 times>, __align = 0}
        tmp_stack_size = 8388608
        mysql_thread = 0x7f4195cdac60
        worker = 0x7f418fe00000
#12 0x00007f4196a7a609 in start_thread (arg=<optimized out>) at pthread_create.c:477
        ret = <optimized out>
        pd = <optimized out>
        unwind_buf = {cancel_jmp_buf = {{jmp_buf = {139919578093312, 339346931040459892, 140725914326526, 140725914326527, 139919663040016, 139919578083392, -416940017986233228, -416944210211824524}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}}
        not_first_call = 0
#13 0x00007f419664d293 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
No locals.

Thanks,
Robert

@renecannao
Copy link
Contributor

Hi Robert,

Can you please share the core dump, publicly or privately?

Thanks

@GROpten
Copy link
Author

GROpten commented Aug 31, 2021

Hi,

Sure, I would prefer the private way.

Thanks

@GROpten
Copy link
Author

GROpten commented Sep 1, 2021

Hi,

Rene, i will upload the logs/core files, but could you give me an email address, it will be easier.

Robert

@JavierJF
Copy link
Collaborator

Hi @GROpten,

could you please share the logs/coredumps with me at the following email address? javier@proxysql.com.

Thanks you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants