46 Commits (458ff77846e654475bb39e06bb99fb383523b351)

Author	SHA1	Message	Date
René Cannaò	04abd43a57	Initial commit with PostgreSQL support	1 year ago
Rahim Kanji	c5bc9ed2c6	DNS Cache Fixes ... * If a MySQL connection fails or times out for a specific hostname, the corresponding DNS record will be removed from DNS Cache. This ensures that outdated DNS records are not retained. (Rest of the DNS resolution process remains unchanged) * DNS cache functionality will automatically be disabled when ProxySQL is run with the -M or --no-monitor option.	1 year ago
Miro Stauder	8394fd444e	use local includes - prometheus	2 years ago
Javier Jaramago Fernández	cf7da4e9a2	Fix memory leak in 'pull_mysql_query_rules_from_peer' ... - Simplified memory managament in Cluster credentials API. - Moved several variables into local scopes.	2 years ago
René Cannaò	8a4246d1e9	Merge pull request #4458 from sysown/v2.x_Servers_SSL_Params ... Introducing mysql_servers_ssl_params	2 years ago
René Cannaò	9a7c3e8196	Introducing mysql_servers_ssl_params ... First commit to introduce table mysql_servers_ssl_params . This allows to configure per host SSL parameters.	2 years ago
Rahim Kanji	b2549127ee	Resolving node's hostname in the event of a connection error and when executing the "LOAD PROXYSQL SERVERS TO RUNTIME" command	2 years ago
Javier Jaramago Fernández	e8d2254689	Merge branch 'v2.x' of github.com:sysown/proxysql into v2.x-aurora_autodiscovery-refactor_cluster_mysql_servers-gr_bootstrap_mode	2 years ago
Rahim Kanji	ade6fb0e2b	* Added 'hostgroup_settings' column (JSON-Formatted) to 'mysql_hostgroup_attributes' and it's counterpart 'runtime_mysql_hostgroup_attributes' table to accommodate new hostgroup attributes. ... * Added missing 'servers_defaults' column in ProxySQL cluster syncing.	2 years ago
Javier Jaramago Fernández	fa71a5cce3	Improve doc for 'mysql_servers_sync_algorithm'	3 years ago
Rahim Kanji	063af84f7f	Merge remote-tracking branch 'Master/v2.x' into v2.x_refactor_cluster_mysql_servers_final ... # Conflicts: # lib/MySQL_HostGroups_Manager.cpp # lib/ProxySQL_Cluster.cpp	3 years ago
Rahim Kanji	3865c81873	DNS Cache module has been updated so that it no longer regards the UNIX socket path as a hostname.	3 years ago
Rahim Kanji	feeb74756d	Merge remote-tracking branch 'Master/v2.x' into v2.x_refactor_cluster_mysql_servers ... # Conflicts: # include/ProxySQL_Cluster.hpp # include/proxysql_admin.h # lib/MySQL_HostGroups_Manager.cpp # lib/ProxySQL_Admin.cpp # lib/ProxySQL_Cluster.cpp	3 years ago
René Cannaò	4f7859ba3f	Remove unnecessary call to ProxySQL_Checksum_Value constructor in ProxySQL_Checksum_Value_2 constructor	3 years ago
Rahim Kanji	11229888b4	* Rename mysql_servers_incoming to mysql_servers_v2 ... * Fetching mysql_servers_v2 records from admin * Added comments.	3 years ago
Rahim Kanji	12d830cb35	Refactoring ProxySQL Cluster ... * Added separate fetching of mysql_server_incoming and runtime_mysql_server records based on algorithm selection. * Few memory leaks fix * Code refactoring	3 years ago
Javier Jaramago Fernández	3507506150	Reset global checksums when variable 'admin-checksum_mysql_servers' is re-enabled ... Also introduces the function 'Reset_Global_Checksums' that allows to reset the global checksums for all the cluster nodes.	3 years ago
René Cannaò	d61c043bdc	Drafting mysql_hostgroup_attributes table	3 years ago
Rahim Kanji	c552fdb111	* Added DNS cache monitoring for ProxySQL servers. ... * Added forced triggering of DNS Cache Update on MySQL Servers and ProxySQL Servers table update. * Direct DNS cache update via socket (connected peer ip) if record is not available in cache. * Used strdup instead of realloc. * DNS lookup only once for ProxySQL Cluster Nodes.	3 years ago
Javier Jaramago Fernández	f880338477	Fix typos in some cluster queries definitions doc	4 years ago
Javier Jaramago Fernández	099c2a5f06	Cluster: Speedup of processing of MySQL Users and MySQL Servers ... - Cluster now syncs the server tables via 'incoming_*' tables generated during 'load_mysql_servers_to_runtime'. - Cluster now syncs 'mysql_users' table via a resultset generated via '__refresh_users'.	4 years ago
Javier Jaramago Fernández	3dacb77321	Perform atomic update of Cluster fetched module checksum epochs	4 years ago
Javier Jaramago Fernández	e6083250b5	Merge branch 'v2.x' of github.com:sysown/proxysql into v2.x-cluster_cmp_checksums	4 years ago
René Cannaò	5e68075edf	Cluster: Speed up processing of MySQL Query Rules ... Multiple changes: - Query_Processor stored the resultset of query rules loaded to runtime (previously this was only for query rules fast routing) - Admin returns the stored resultset (query rules and fast routing) when queries by Cluster - In khash replaced the hashing function from the built-in __ac_X31_hash_string to CityHash32 - When Cluster is used, it calls load_mysql_query_rules_to_runtime() passing the resultsets retrieved by the remote peer - Increased SQLite cache_size to ~50MB: this seems to be a very small optimization and probably it will be reverted - pull_mysql_query_rules_from_peer() uses transactions to write to mysql_query_rules_fast_routing - (important change) pull_mysql_query_rules_from_peer() verifies the checksum of MySQL Query ules before loading them to runtime	4 years ago
Javier Jaramago Fernández	4c4346a710	Add checksum computation after fetch to multiple cluster modules ... The following cluster modules now compute their expected checksums after fetch: - mysql_query_rules - mysql_users - mysql_servers - mysql_global_variables	4 years ago
Javier Jaramago Fernández	5ed8bd5517	Add new metrics for 'proxysql_servers_checksum' and 'proxysql_servers_metrics'	4 years ago
René Cannaò	2ae218f7ed	Cluster: sync of proxysql_servers ensures that checksum is correct	5 years ago
René Cannaò	af27c0b108	Merge branch 'v2.x' into v2.1.2-cluster	5 years ago
Javier Jaramago Fernández	04d3947212	Implemented sync support for 'mysql_ldap_mapping' table	5 years ago
Javier Jaramago Fernández	ba1762bc3e	Implemented sync support for 'ldap-%' global variables	5 years ago
René Cannaò	86c95dbb18	Cluster node exports admin-mysql_ifaces ... When a cluster node (client) connects to another cluster node, it advertises its UUID but also exports its `admin-mysql_ifaces` . The receiving cluster can use this information to try to guess how to connect to the node that initialized the connection, for example to collect metrics. This is visible in table `stats_proxysql_servers_clients_status` .	5 years ago
René Cannaò	69fb384deb	Replacing struct proxy_node_address_t with class ProxySQL_Node_Address	5 years ago
Javier Jaramago Fernández	05a005f9fb	Add support for syncing 'mysql-variables' and 'admin-variables' #2820 (#2856) ... * Added forgotten metric increase in case of 'sync conflict' on proxysql_servers * Added support for 'global_variables' sync in proxysql_cluster - Added several for getting the peers to be sync. - Added function to pull the target 'global_variables' to sync. - Added metrics for 'global_variables' sync: + Number of syncs done / failed. + Sync conflicts. + Sync warnings. * Removed unnecesary escaping for '%' char * Fixed issue due to 'flush_mysql_variables___runtime_to_database' being called without proper locking * Added simple helper function to get the output from a command execution * Multiple changes to 'cluster_synct' test + Spawned proxysql instance now runs inside a docker container. + Simplified launching and logging of spawned proxysql instance. + Added more verbose logging about the tables state. + Added new tests for 'global_variables' synchronization. * Commented several variables known to not-sync and fixed port for replica 'proxysql_server' * Removed deprecated and non-syncable variables from 'test_cluster_sync-t' * Added extra logging for variables sync for 'test_cluster_sync-t'	5 years ago
Javier Jaramago Fernández	486a12e2ae	Added new metrics for the 'wont sync' conditions and fixed some other metrics descriptions	6 years ago
Javier Jaramago Fernández	a213cf8cd7	Added new logging messages for same epoch 'WONT SYNC' conflict using 'diff_check' for intervals	6 years ago
Javier Jaramago Fernández	977c094a0f	Added new prometheus metrics for synchronization fetching events	6 years ago
Javier Jaramago Fernández	651014a0b9	Added extra logging for two different situations: ... - When configuration rules specify NOT to save the config to disk. - When synchronization isn't going to happen because both servers hold the same epoch values for two configurations with different checksums.	6 years ago
René Cannaò	03bf53aec8	Preparing the cluster module to sync variables ... Added admin variables: * cluster_mysql_variables_save_to_disk * cluster_admin_variables_save_to_disk * cluster_mysql_variables_diffs_before_sync * cluster_admin_variables_diffs_before_sync When flush_admin_variables___database_to_runtime() is executed, flush_admin_variables___runtime_to_database() is also called to update admin variable checksum. When flush_mysql_variables___database_to_runtime() is executed, flush_mysql_variables___runtime_to_database() is also called to update mysql variable checksum. flush_mysql_variables___runtime_to_database() was also modified to avoid locking twice.	6 years ago
Nikolaos Vyzas	ddd8f7b67f	Resolving conflicts for 'Add gtid_port to mysql_servers'	8 years ago
René Cannaò	c94fbe7f20	Fixed bug #1304 ... * change datatype mysql_replication_hostgroups.comment to be VARCHAR NOT NULL DEFAULT '' instead of VARCHAR * handle cases in which mysql_replication_hostgroups.comment is NULL	8 years ago
René Cannaò	7dbcbc3e7a	Bug fix for #1188 ... * all commands expected in Admin are serialized * Cluster get mysql servers information directly from MyHGM * Before applying MySQL servers changes, Cluster fetch again the checksum to verify it didn't change	8 years ago
René Cannaò	e3c4cb9964	A lot of changes all related to Cluster ... In `MySQL_Cluster` class added functions to sync with remote node, like: - `pull_mysql_query_rules_from_peer()` - `pull_mysql_servers_from_peer()` - `pull_mysql_users_from_peer()` - `pull_proxysql_servers_from_peer()` Added 8 new global variables in Admin. 4 variables determine after how many different checks the remote configuration will be synced: - cluster_mysql_query_rules_diffs_before_sync - cluster_mysql_servers_diffs_before_sync - cluster_mysql_users_diffs_before_sync - cluster_proxysql_servers_diffs_before_sync 4 variables determine if after a remote sync the changes need to be written to disk: - cluster_mysql_query_rules_save_to_disk - cluster_mysql_servers_save_to_disk - cluster_mysql_users_save_to_disk - cluster_proxysql_servers_save_to_disk Table `proxysql_servers` is now automatically loaded from disk to memory and into runtime at startup. Added new Admin's command `LOAD PROXYSQL SERVERS FROM CONFIG` to load `proxysql_servers` from config file to memory (not runtime). Internal structures with credentials in MySQL_Authentication moved from `unsorted_map` to `map` : this to ensure the right order when generating the checksum. Config file supports both `address` and `hostname` for `mysql_servers` and `proxysql_servers` , #1091 `ProxySQL_Admin::load_proxysql_servers_to_runtime()` now has a lock or no lock option, to avoid deadlock For now, Cluster module is quite verbose.	9 years ago
René Cannaò	2a76f95e31	Further enhancement on Cluster ... Extended class ProxySQL_Checksum_Value() in ProxySQL_Cluster module to support further metrics Implemeted `SELECT GLOBAL_CHECKSUM()` and relative tracking of global checksums Added variable `admin-cluster_check_status_frequency` to check peer's global status at regular intervals	9 years ago
René Cannaò	ee8110a515	Enhancement on Cluster solution ... This commit introduces: 2 new tables: * `runtime_checksums_values` : stores checksums of configurations in runtime. For now for `mysql_query_rules`, `mysql_servers` and `mysql_users` * `stats_proxysql_servers_checksums` : when clustering is enabled, it collects all metrics from `runtime_checksums_values` from all its peers 3 new global variables that defines it checksum needs to be generated during `LOAD ... TO RUNTIME` * `admin-checksum_mysql_query_rules` * `admin-checksum_mysql_servers` * `admin-checksum_mysql_users` ProxySQL Cluster connections now have timeouts: * 1 second timeout for CONNECT and WRITE * 60 seconds timeout for READ (useful for long poll)	9 years ago
René Cannaò	ab4e6eeecf	Adding missing include	9 years ago
René Cannaò	f583982ace	Drafting support for ProxySQL Cluster	9 years ago