proxysql

Commit Graph

Author	SHA1	Message	Date
Javier Jaramago Fernández	099c2a5f06	Cluster: Speedup of processing of MySQL Users and MySQL Servers - Cluster now syncs the server tables via 'incoming_*' tables generated during 'load_mysql_servers_to_runtime'. - Cluster now syncs 'mysql_users' table via a resultset generated via '__refresh_users'.	4 years ago
Javier Jaramago Fernández	3dacb77321	Perform atomic update of Cluster fetched module checksum epochs	4 years ago
Javier Jaramago Fernández	e6083250b5	Merge branch 'v2.x' of github.com:sysown/proxysql into v2.x-cluster_cmp_checksums	4 years ago
René Cannaò	5e68075edf	Cluster: Speed up processing of MySQL Query Rules Multiple changes: - Query_Processor stored the resultset of query rules loaded to runtime (previously this was only for query rules fast routing) - Admin returns the stored resultset (query rules and fast routing) when queries by Cluster - In khash replaced the hashing function from the built-in __ac_X31_hash_string to CityHash32 - When Cluster is used, it calls load_mysql_query_rules_to_runtime() passing the resultsets retrieved by the remote peer - Increased SQLite cache_size to ~50MB: this seems to be a very small optimization and probably it will be reverted - pull_mysql_query_rules_from_peer() uses transactions to write to mysql_query_rules_fast_routing - (important change) pull_mysql_query_rules_from_peer() verifies the checksum of MySQL Query ules before loading them to runtime	4 years ago
Javier Jaramago Fernández	4c4346a710	Add checksum computation after fetch to multiple cluster modules The following cluster modules now compute their expected checksums after fetch: - mysql_query_rules - mysql_users - mysql_servers - mysql_global_variables	4 years ago
Javier Jaramago Fernández	5ed8bd5517	Add new metrics for 'proxysql_servers_checksum' and 'proxysql_servers_metrics'	4 years ago
René Cannaò	2ae218f7ed	Cluster: sync of proxysql_servers ensures that checksum is correct	5 years ago
René Cannaò	af27c0b108	Merge branch 'v2.x' into v2.1.2-cluster	5 years ago
Javier Jaramago Fernández	04d3947212	Implemented sync support for 'mysql_ldap_mapping' table	5 years ago
Javier Jaramago Fernández	ba1762bc3e	Implemented sync support for 'ldap-%' global variables	5 years ago
René Cannaò	86c95dbb18	Cluster node exports admin-mysql_ifaces When a cluster node (client) connects to another cluster node, it advertises its UUID but also exports its `admin-mysql_ifaces` . The receiving cluster can use this information to try to guess how to connect to the node that initialized the connection, for example to collect metrics. This is visible in table `stats_proxysql_servers_clients_status` .	5 years ago
René Cannaò	69fb384deb	Replacing struct proxy_node_address_t with class ProxySQL_Node_Address	5 years ago
Javier Jaramago Fernández	05a005f9fb	Add support for syncing 'mysql-variables' and 'admin-variables' #2820 (#2856 ) * Added forgotten metric increase in case of 'sync conflict' on proxysql_servers * Added support for 'global_variables' sync in proxysql_cluster - Added several for getting the peers to be sync. - Added function to pull the target 'global_variables' to sync. - Added metrics for 'global_variables' sync: + Number of syncs done / failed. + Sync conflicts. + Sync warnings. * Removed unnecesary escaping for '%' char * Fixed issue due to 'flush_mysql_variables___runtime_to_database' being called without proper locking * Added simple helper function to get the output from a command execution * Multiple changes to 'cluster_synct' test + Spawned proxysql instance now runs inside a docker container. + Simplified launching and logging of spawned proxysql instance. + Added more verbose logging about the tables state. + Added new tests for 'global_variables' synchronization. * Commented several variables known to not-sync and fixed port for replica 'proxysql_server' * Removed deprecated and non-syncable variables from 'test_cluster_sync-t' * Added extra logging for variables sync for 'test_cluster_sync-t'	5 years ago
Javier Jaramago Fernández	486a12e2ae	Added new metrics for the 'wont sync' conditions and fixed some other metrics descriptions	6 years ago
Javier Jaramago Fernández	a213cf8cd7	Added new logging messages for same epoch 'WONT SYNC' conflict using 'diff_check' for intervals	6 years ago
Javier Jaramago Fernández	977c094a0f	Added new prometheus metrics for synchronization fetching events	6 years ago
Javier Jaramago Fernández	651014a0b9	Added extra logging for two different situations: - When configuration rules specify NOT to save the config to disk. - When synchronization isn't going to happen because both servers hold the same epoch values for two configurations with different checksums.	6 years ago
René Cannaò	03bf53aec8	Preparing the cluster module to sync variables Added admin variables: * cluster_mysql_variables_save_to_disk * cluster_admin_variables_save_to_disk * cluster_mysql_variables_diffs_before_sync * cluster_admin_variables_diffs_before_sync When flush_admin_variables___database_to_runtime() is executed, flush_admin_variables___runtime_to_database() is also called to update admin variable checksum. When flush_mysql_variables___database_to_runtime() is executed, flush_mysql_variables___runtime_to_database() is also called to update mysql variable checksum. flush_mysql_variables___runtime_to_database() was also modified to avoid locking twice.	6 years ago
Nikolaos Vyzas	ddd8f7b67f	Resolving conflicts for 'Add gtid_port to mysql_servers'	8 years ago
René Cannaò	c94fbe7f20	Fixed bug #1304 * change datatype mysql_replication_hostgroups.comment to be VARCHAR NOT NULL DEFAULT '' instead of VARCHAR * handle cases in which mysql_replication_hostgroups.comment is NULL	8 years ago
René Cannaò	7dbcbc3e7a	Bug fix for #1188 * all commands expected in Admin are serialized * Cluster get mysql servers information directly from MyHGM * Before applying MySQL servers changes, Cluster fetch again the checksum to verify it didn't change	8 years ago
René Cannaò	e3c4cb9964	A lot of changes all related to Cluster In `MySQL_Cluster` class added functions to sync with remote node, like: - `pull_mysql_query_rules_from_peer()` - `pull_mysql_servers_from_peer()` - `pull_mysql_users_from_peer()` - `pull_proxysql_servers_from_peer()` Added 8 new global variables in Admin. 4 variables determine after how many different checks the remote configuration will be synced: - cluster_mysql_query_rules_diffs_before_sync - cluster_mysql_servers_diffs_before_sync - cluster_mysql_users_diffs_before_sync - cluster_proxysql_servers_diffs_before_sync 4 variables determine if after a remote sync the changes need to be written to disk: - cluster_mysql_query_rules_save_to_disk - cluster_mysql_servers_save_to_disk - cluster_mysql_users_save_to_disk - cluster_proxysql_servers_save_to_disk Table `proxysql_servers` is now automatically loaded from disk to memory and into runtime at startup. Added new Admin's command `LOAD PROXYSQL SERVERS FROM CONFIG` to load `proxysql_servers` from config file to memory (not runtime). Internal structures with credentials in MySQL_Authentication moved from `unsorted_map` to `map` : this to ensure the right order when generating the checksum. Config file supports both `address` and `hostname` for `mysql_servers` and `proxysql_servers` , #1091 `ProxySQL_Admin::load_proxysql_servers_to_runtime()` now has a lock or no lock option, to avoid deadlock For now, Cluster module is quite verbose.	9 years ago
René Cannaò	2a76f95e31	Further enhancement on Cluster Extended class ProxySQL_Checksum_Value() in ProxySQL_Cluster module to support further metrics Implemeted `SELECT GLOBAL_CHECKSUM()` and relative tracking of global checksums Added variable `admin-cluster_check_status_frequency` to check peer's global status at regular intervals	9 years ago
René Cannaò	ee8110a515	Enhancement on Cluster solution This commit introduces: 2 new tables: * `runtime_checksums_values` : stores checksums of configurations in runtime. For now for `mysql_query_rules`, `mysql_servers` and `mysql_users` * `stats_proxysql_servers_checksums` : when clustering is enabled, it collects all metrics from `runtime_checksums_values` from all its peers 3 new global variables that defines it checksum needs to be generated during `LOAD ... TO RUNTIME` * `admin-checksum_mysql_query_rules` * `admin-checksum_mysql_servers` * `admin-checksum_mysql_users` ProxySQL Cluster connections now have timeouts: * 1 second timeout for CONNECT and WRITE * 60 seconds timeout for READ (useful for long poll)	9 years ago
René Cannaò	ab4e6eeecf	Adding missing include	9 years ago
René Cannaò	f583982ace	Drafting support for ProxySQL Cluster	9 years ago

26 Commits (099c2a5f064dd2375df4e2d5238ffc4f1b60b46b)