521 Commits (bddf376f160ffec3c2e7fdfce3b10c2bc0660435)

Author	SHA1	Message	Date
René Cannaò	dcf9a4a362	mysql_hostgroup_attributes.throttle_connections_per_sec ... Implementation of mysql_hostgroup_attributes.throttle_connections_per_sec If mysql_hostgroup_attributes is configured, mysql_hostgroup_attributes.throttle_connections_per_sec has higher priority than global variable mysql-throttle_connections_per_sec_to_hostgroup	3 years ago
René Cannaò	7b00d05233	mysql_hostgroup_attributes free_connections_pct and connection_warming ... Implementation of mysql_hostgroup_attributes.free_connections_pct and mysql_hostgroup_attributes.connection_warming If mysql_hostgroup_attributes is configured: - mysql_hostgroup_attributes.free_connections_pct has higher priority than global variable mysql-free_connections_pct - mysql_hostgroup_attributes.connection_warming has higher priority than global variable mysql-connection_warming	3 years ago
René Cannaò	f3c604eb84	Implemented mysql_hostgroup_attributes.multiplex ... If mysql_hostgroup_attributes.multiplex: - 0 : multiplexing is always disabled - 1 : multiplexing is enabled for the hostgroup, but other criteria can disable multiplexing (transaction, temp tables, query rules, etc)	3 years ago
René Cannaò	9235fbf887	Added 1st testing for mysql_hostgroup_attributes ... This commit adds some minimal testing for mysql_hostgroup_attributes . It helped detecting some bugs.	3 years ago
René Cannaò	5788b9ba80	Avoid duplicate entries in Galera_Hosts_resultset ... Galera_Hosts_resultset is populated by a query on mysql_servers JOIN mysql_galera_hostgroups . An incorrect GROUP BY could have caused some servers to be present more than once.	3 years ago
René Cannaò	d61c043bdc	Drafting mysql_hostgroup_attributes table	3 years ago
René Cannaò	23a36eea00	Fixing 2 typos	3 years ago
Javier Jaramago Fernández	02d6e58d68	Fix GR constant servers reconfig when available writers exceeds 'max_writers' ... Since servers present in 'backup_writer_hostgroup' where not considered as previously configured writers, everytime the number of available writers exceeded 'max_writers' an unwanted server reconfiguration was triggered for each of these servers at every monitoring action.	3 years ago
Javier Jaramago Fernández	3c086fe95b	Fix GR servers reconfiguration due to SHUNNED writer ... When writer was set as SHUNNED due to replication lag, and 'mysql_servers' table was regenerated (via servers reconfiguration or other action). SHUNNED writer wasn't considered a found writer, triggering an unwanted server reconfiguration.	3 years ago
René Cannaò	36575d273a	Several code improvements ... In Admin: - replaced a lot of flush_[...]__from_memory_to_disk() and flush_[...]__from_disk_to_memory() with a generic flush_GENERIC__from_to() - several commands like "LOAD MYSQL SERVERS FROM DISK" and similar are automatically generated for various modules (not all) and saved/map in a map load_save_disk_commands - FlushCommandWrapper() is able to map the various LOAD/SAVE from/to DISK into commands to run on SQLite	3 years ago
Javier Jaramago Fernández	51c723f6fc	DRAFT: Monitor 'Group replication' rework ... This is a draft of a rework for Monitor 'Group Replication', this reworks reuses the Monitoring model already taken for AWS Aurora for 'Group Replication'.	3 years ago
René Cannaò	71e2510ef6	Code cleanup on MySQL_HostGroups_Manager ... Some rework to try to reduce duplicated code	3 years ago
René Cannaò	5fc840b990	Removing commented code	3 years ago
René Cannaò	90670b4572	Do not shun servers with max_replication_lag = 0 #4018 ... If max_replication_lag is 0 and mysql-monitor_replication_lag_group_by_host='true', a replica was incorrectly shunned because of replication lag	3 years ago
Javier Jaramago Fernández	1abb4d7605	Comment out several currently unused variables	3 years ago
Javier Jaramago Fernández	300532d6e2	Fix multiple warnings in logging function calls	3 years ago
Rahim Kanji	c552fdb111	* Added DNS cache monitoring for ProxySQL servers. ... * Added forced triggering of DNS Cache Update on MySQL Servers and ProxySQL Servers table update. * Direct DNS cache update via socket (connected peer ip) if record is not available in cache. * Used strdup instead of realloc. * DNS lookup only once for ProxySQL Cluster Nodes.	3 years ago
René Cannaò	8a44ce155d	Merge pull request #3988 from sysown/v2.x-fix_server_metrics_update ... Fix server counter metrics not being properly updated after hostgroup changes	3 years ago
Javier Jaramago Fernández	25cc58a50d	Fix 'connect_retries_on_failure' and 'connect_timeout' logic for 'fast_forward' sessions ... - Correct the behavior for 'connect_retries_on_failure' for 'fast_forward' sessions to match regular sessions, reusing the same implementation based on 'MySQL_Data_Stream::max_connect_time'. - Change 'connect_timeout' for 'fast_forward' sessions to be the highest of 'connect_timeout_server' and 'connect_timeout_server_max'. - Add handling for 'COM_QUIT' packets for 'fast_forward' sessions which have not yet received a backend connection.	3 years ago
Javier Jaramago Fernández	2b75cc3325	Fix server counter metrics not being properly updated after hostgroup changes	4 years ago
René Cannaò	83ffb729bb	Merge pull request #3946 from sysown/v2.x-3923 ... WIP: Fix 'mysql-auto_increment_delay_multiplex_timeout_ms' - Closes #3923	4 years ago
Javier Jaramago Fernández	bcc6532d66	Modify previous impl for 'auto_increment_delay_multiplex_timeout_ms' and fix 'connection_delay_multiplex_ms' ... This commit contains an implementation rework and a fix: - Impl for 'auto_increment_delay_multiplex_timeout_ms' has been reworked in favor of reusing 'wait_until' to share logic with previous 'connection_delay_multiplex_ms' variable. - Fix previous 'connection_delay_multiplex_ms' behavior preventing connection retaining when traffic unrelated to target hostgroup is being received by the session.	4 years ago
René Cannaò	301bb09a4d	Merge pull request #3921 from sysown/v2.x-cluster_cmp_checksums ... WIP: Add checksum computation after fetch to multiple cluster modules	4 years ago
Javier Jaramago Fernández	fbd6312239	Filter 'OFFLINE_HARD' servers for stored 'runtime_mysql_servers' resultset	4 years ago
Javier Jaramago Fernández	d8429ca71c	Replace resultset for Cluster request fetching 'runtime_mysql_servers' ... Query 'CLUSTER_QUERY_MYSQL_SERVERS' is now responded by 'runtime_mysql_servers' as it previously was. Documentation reasoning about the change has been added to 'MySQL_HostGroups_Manager::runtime_mysql_servers'.	4 years ago
Javier Jaramago Fernández	099c2a5f06	Cluster: Speedup of processing of MySQL Users and MySQL Servers ... - Cluster now syncs the server tables via 'incoming_*' tables generated during 'load_mysql_servers_to_runtime'. - Cluster now syncs 'mysql_users' table via a resultset generated via '__refresh_users'.	4 years ago
Javier Jaramago Fernández	3dacb77321	Perform atomic update of Cluster fetched module checksum epochs	4 years ago
Javier Jaramago Fernández	e6083250b5	Merge branch 'v2.x' of github.com:sysown/proxysql into v2.x-cluster_cmp_checksums	4 years ago
René Cannaò	4ae5a44db1	Workaround for Galera bug 613 ... if: mysql-reset_connection_algorithm=1 and mysql-connpoll_reset_queue_length=0 we will not return a connection with connection_quality_level == 1 because we want to run COM_CHANGE_USER This change was introduced to work around Galera bug https://github.com/codership/galera/issues/613	4 years ago
Javier Jaramago Fernández	4119c44160	Fix potential race conditions while generating 'gtid_executed_tables'	4 years ago
Javier Jaramago Fernández	4c4346a710	Add checksum computation after fetch to multiple cluster modules ... The following cluster modules now compute their expected checksums after fetch: - mysql_query_rules - mysql_users - mysql_servers - mysql_global_variables	4 years ago
root	e47cb3fb8f	Upgraded clickhouse-cpp to 2.1.0 ... Clickhouse build are using C++17	4 years ago
René Cannaò	8730fcd350	Merge branch 'v2.x' into v2.x_generate_multi_rows	4 years ago
René Cannaò	c0fdf02b78	Fixed various compiler warnings	4 years ago
René Cannaò	4bfe3e5878	Added mysql-monitor_replication_lag_group_by_host ... If variable mysql-monitor_replication_lag_group_by_host=false: (default) Monitor will perform 1 replication lag check per server per hostgroup. If variable mysql-monitor_replication_lag_group_by_host=true: Monitor will perform 1 replication lag check per server. This variable need to be set only in setups in which the same server is configured in many hostgroups, thus reducing the number of checks	4 years ago
René Cannaò	f8a0934c13	Added new function to create multirows statements for SQLite ... This is now used in ProxySQL_Admin and MySQL_HostGroups_Manager. It improves readibility and it makes the code less error prone. Drawback: queries are generated at runtime. It is possible that in future we will replace this with some strings initialization during bootstrap.	4 years ago
René Cannaò	af2660c48d	Merge pull request #3836 from sysown/v2.x-backend_conn_ping ... Fix idle backend connections not getting properly pinged	4 years ago
Javier Jaramago Fernández	b5f92fd0d9	Optimize 'oldest_idle_connections' map insert/erase operations	4 years ago
René Cannaò	6ea642fc55	Merge pull request #3798 from sysown/v2.x-3797 ... Closes #3797: Monitoring not working properly for AWS aurora auto-discovered servers	4 years ago
René Cannaò	308626ff30	Merge pull request #3817 from sysown/v2.x-binlog_ci_changes ... Add 'proxysql_mysqlbinlog' test and fixes	4 years ago
Javier Jaramago Fernández	1bbe0698d2	Fix idle backend connection ordering and selection for keep-alive ping	4 years ago
René Cannaò	b9c6f6e33b	Merge pull request #3790 from sysown/v2.x-prom_cluster_metrics ... Add new metrics exporting several cluster tables	4 years ago
Javier Jaramago Fernández	198dee43b9	Improve error message when no viable server is found due to GTID waiting	4 years ago
Javier Jaramago Fernández	199ec5bc0a	Prevent GTID connector creation for 'OFFLINE_HARD' servers	4 years ago
Javier Jaramago Fernández	b2cfb4eea9	Fix crash when 'gtid_executed' is empty	4 years ago
Javier Jaramago Fernández	712c081640	Add extra logging when no servers are available in hostgroup	4 years ago
Javier Jaramago Fernández	c7eda1d49d	Add missing delete when updating 'mysql_servers_to_monitor' resulset #3797	4 years ago
Javier Jaramago Fernández	c50a7053ad	Fix monitoring not working for AWS Aurora auto-discovered instances #3797 ... - Monitoring actions 'ping' and 'connect' now make use of a new introduced table 'monitor.mysql_servers' instead of 'mysql_servers' table from Admin. - This table is kept in sync via a shared resulset in 'MySQL_HostGroups_Manager'.	4 years ago
Javier Jaramago Fernández	0e0cacddf6	Improve missings servers keys filtering for 'p_update_connection_pool'	4 years ago
Javier Jaramago Fernández	6d59956b5f	Change conn_pool metrics update functions to use 'const refs'	4 years ago
Javier Jaramago Fernández	b24459cd9a	Remove extra logging info for troubleshooting SHUNNING errors	4 years ago
Javier Jaramago Fernández	c3c1a50d91	Add extra logging info for troubleshooting SHUNNING errors	4 years ago
René Cannaò	3ae299cb97	Add more verbosity for TAP test_unshun_algorithm-t	4 years ago
Javier Jaramago Fernández	bcb009fc24	Revert "Merge pull request #3645 from sysown/v2.x-2021" ... This reverts commit 9561cb3ef2, reversing changes made to 7edfec6f3f.	4 years ago
René Cannaò	a6edd02a9b	Revert "Merge branch 'v2.x' into v2.x-2021" ... This reverts commit 3a3931f2d4, reversing changes made to 4694ab775e.	4 years ago
René Cannaò	8cea730de0	Merge pull request #3661 from sysown/v2.x-3649 ... Allow to unshun a server from all hostgroups	4 years ago
René Cannaò	79d1d8742c	Testing unbalanced weight	4 years ago
René Cannaò	9293dea199	Do not shun backend for error 3118 ... Error: Access denied for user '%s'. Account is locked..	4 years ago
Javier Jaramago Fernández	6a92cc9238	Added new command 'PROXYSQL_SIMULATOR' with support for simulating connection errors #3649	4 years ago
Javier Jaramago Fernández	4838d75cd3	Added new mysql variable 'mysql-unshun_algorithm' #3649	4 years ago
René Cannaò	4b04332473	Add optional mutex in MySrvC::connect_error()	4 years ago
René Cannaò	a752292b9e	Added function unshun_server_all_hostgroups() ... MySQL_HostGroups_Manager::unshun_server_all_hostgroups() scans all hostgroups looking for a specific server, and if shunned it will bring it back online	4 years ago
René Cannaò	fb8857f1fe	Fix a bug in get_multiple_idle_connections() #3628 ... 2.3.0 introduces a bug that prevents proxysql to run ping on backend connections to keep them alive.	5 years ago
Javier Jaramago Fernández	4f94fd3d0f	Merge pull request #3533 from sysown/v2.x-gr_replication_lag_action ... Changes current handling for replication lag in favor of setting lagging servers to SHUNNED state	5 years ago
René Cannaò	38c5a76d0e	Use Aurora writer for reads if max_lag_ms isn't specified ... This solves the issue described in issue #3522 It is a side effect of a mistake in commit 5336e72f1c	5 years ago
René Cannaò	dd71fcd81f	Shun "soft" and "hard" in group replication lag ... When shunning a node due to replication lag in a group replication cluster, we first shun the node as MYSQL_SERVER_STATUS_SHUNNED , then we shun it as MYSQL_SERVER_STATUS_SHUNNED_REPLICATION_LAG . In this way we prevent (for a short time) to kill connections on that backend. This backing off from that server can give the server enough time to sync up. See discussion in comments in https://github.com/sysown/proxysql/pull/3533	5 years ago
Javier Jaramago Fernández	fce6cfb8a0	Improved preservation of 'OFFLINE_SOFT' server state during 'group_replication' update actions	5 years ago
Javier Jaramago Fernández	9f2c8836bc	Fixed removal of servers not belonging to cluster hostgroups by 'group_replication' actions 'set_read_only/set_offline/set_writer'	5 years ago
René Cannaò	3de13665e8	Merge pull request #3557 from sysown/v2.x-ccov2 ... More code coverage	5 years ago
René Cannaò	194243503a	Adding LCOV_EXCL_START around assert(0) ... LCOV_EXCL_START and LCOV_EXCL_STOP around assert(0) will improve code coverage	5 years ago
Javier Jaramago Fernández	459a3f12c2	Added nullity checks for params for 'lag_action_set_server_status'	5 years ago
Javier Jaramago Fernández	38b44781e7	Replaced manual search for 'MyGHC' in favor of optimized 'MyHGC_find' #3539	5 years ago
Javier Jaramago Fernández	edc631ba6c	Added missing parameter 'lag_count' to 'proxy_warning' from 'lag_action_set_server_status'	5 years ago
Javier Jaramago Fernández	b929758a87	Several improvements to 'group_replication_lag_action' ... 1. Introduced new global variable: 'monitor_groupreplication_max_transaction_behind_for_read_only', that modifies the behavior of 'group_replication_lag'. 2. Improved logic making use of 'MyHGC_find' instead of directly searching 'MyHostGroups' structure. 3. Improved 'group_replication_lag' documentation with new implementation updates. 4. Introduced changes to 'update_group_replication_set_writer' preserving writters placed in 'OFFLINE_SOFT' state.	5 years ago
Javier Jaramago Fernández	0850c4d596	Improved the documentation for 'group_replication_lag_action'	5 years ago
Javier Jaramago Fernández	33aa80c265	Prevent servers that has been placed as 'OFFLINE_SOFT' of becoming writers	5 years ago
Javier Jaramago Fernández	53bf18b428	Changed setting readonly servers 'OFFLINE' due to replication lag behavior in favor of general server 'SHUNNING'	5 years ago
Javier Jaramago Fernández	e538e0b04e	Added locking of 'ProxySQL_Admin::sql_query_global_mutex' during 'read_only_action'	5 years ago
René Cannaò	257949f623	Removing MySQL_HostGroups_Manager::server_add() ... This function was deprecated in 2016	5 years ago
René Cannaò	6c7503f85f	Improve debugging when unable to reach hostgroup ... When we generate an error "Max connect timeout reached while reaching hostgroup" for the client, now the error log is more verbose.	5 years ago
René Cannaò	eac6e75dad	Adding a simulator for read_only test ... This commit introduces a first simulator for read_only monitoring ProxySQL itself will simulate hundreds of backends across hundreds of hostgroups, all configured in hundreds of clusters, and return read_only values for each of the simulated backend. The read_only value can be configured in table READONLY_STATUS available in the SQLite3Server module. If a backend isn't configured in table READONLY_STATUS , its default read_only value is 1. It is possible to simulate a lot of simultaneous failover running queries like the following: UPDATE READONLY_STATUS SET read_only=1; CREATE TABLE t1 AS SELECT hostname FROM READONLY_STATUS ORDER BY RANDOM() LIMIT 50; UPDATE READONLY_STATUS SET read_only=0 WHERE hostname IN (SELECT hostname FROM t1); DROP TABLE t1;	5 years ago
René Cannaò	8c05d8907c	Merge pull request #3422 from sysown/v2.2.0-3376 ... Closes #3376: Invalid timestamps reported for 'first_seen' and 'last_seen' fields from 'stats_mysql_errors'	5 years ago
peter	11f46609e1	Fix two print debug logs in commit func ... Fix two print debug logs in MySQL_HostGroups_Manager::commit func.	5 years ago
Javier Jaramago Fernández	85c2187884	Closes #3376: Removed unnecessary operations to compute 'first_seen' and 'last_seen' timestamps for 'stats_mysql_errors'	5 years ago
Javier Jaramago Fernández	938306f5d7	Closes #3182: 'update_galera_set_offline' soft now also sets readers as SHUNNED	5 years ago
René Cannaò	26790c3679	Merge pull request #3349 from sysown/v2.1.1-MonRo ... Optimizations for instances with a lot of hostgroups	5 years ago
René Cannaò	5af9885e90	Do not exit read_only_action() if no server is found	5 years ago
René Cannaò	f7754a5e00	HostGroups lookup using unordered_map ... HostGroups are stored in an array of pointers. This commit allows the lookup using an unordered_map if the number of Hostgroups is greater than 100. For less number of hostgroups, a sequential scan seems more efficient. This also introduce a test for micro benchmark.	5 years ago
René Cannaò	532a0397f7	Faster MySQL_HostGroups_Manager::read_only_action ... This commit rewrites MySQL_HostGroups_Manager::read_only_action() in way to reduce the calls to SQLite. It relies on two new std::set() : - read_only_set1: if the server is already in a writer hostgroup - read_only_set2: a cache to track the first time that a server has RO=0 Added also an index on MySQL_HostGroups_Manager, ON mysql_servers (hostname,port)	5 years ago
Javier Jaramago Fernández	ddf7ad95b7	Added default initialization for 'auto_increment_delay_multiplex' metric	5 years ago
Javier Jaramago Fernández	d507880cbb	Added new metric 'proxysql_myhgm_auto_increment_multiplex_total' tracking the number of times that 'auto_increment_delay_multiplex' is triggered	5 years ago
Javier Jaramago Fernández	fc2b53845f	Fixes #3265: 'update_group_replication_set_writer' now checks found 'writer' status	5 years ago
Javier Jaramago Fernández	23843ed6ee	Fixed invalid writes/reads in 'update_group_replication_set_writer' due to query not fitting allocated buffer	5 years ago
René Cannaò	598331cff9	When calling mysql_change_user set collation to default for the given charset if collation ID is greater or equal than 255 (utf8mb4_0900_ai_ci) ... We call mysql_options with MYSQL_SET_CHARSET_NAME if collation ID >= 255 . This to solve the problem of MySQL server returning an Access denied if the backend doesn't support a collation during mysql_change_user	5 years ago
René Cannaò	f3dba4dcae	Do ot use charset_name if not available in SQL3_Free_Connections() ... This fix a crashing bug	5 years ago
René Cannaò	651f969e1c	Merge pull request #3203 from sysown/v2.1.0-3201 ... Closes #3201: Connections not being cleanup in case of 'match_tracked_options' always failing	5 years ago
Javier Jaramago Fernández	60b6fd0222	Simplified and improved logic for connection cleanup and creation when a matching connection isn't found	5 years ago
René Cannaò	79298ac6f5	Merge pull request #3217 from sysown/v2.1.0-3216 ... Closes #3216: Galera node wrongly purged after placed 'OFFLINE HARD' in the 'offline_hostgroup'	5 years ago
Javier Jaramago Fernández	16bdd45bcc	Always cleanup readers present in the 'writer_hostgroup' for 'writer_is_also_reader=2' ... Servers have no reason to be present in the reader hostgroup for 'writer_is_also_reader=2' when they are present in any other hostgroup that is not 'backup_writer'.	5 years ago
Javier Jaramago Fernández	b402479e50	Enforce nodes to be 'REPLACED' with ONLINE status when placed in the offline hostgroup by 'update_galera_set_offline'	5 years ago