176 Commits (9ffc3f8d711d2f1d3373c91a135d40cbea202841)

Author	SHA1	Message	Date
Rahim Kanji	12d830cb35	Refactoring ProxySQL Cluster ... * Added separate fetching of mysql_server_incoming and runtime_mysql_server records based on algorithm selection. * Few memory leaks fix * Code refactoring	3 years ago
Javier Jaramago Fernández	43ec5745d7	Fix extra non-required 'diff_check' before sync for Cluster	3 years ago
Javier Jaramago Fernández	555a91d8bb	Fix 'proxy_info' line style to fit in 'max-line-width'	3 years ago
Javier Jaramago Fernández	d61d989249	Deprecate 'admin-checksum_*' variables ... Checksums are now always computed for each module. Enabling/Disabling modules synchronization for Cluster is now only dependent of 'cluster_*_diffs_before_sync' variables.	3 years ago
Javier Jaramago Fernández	e65854c2c8	Remove incorrectly ported checks over checksums 'diff_check' from previous impl	3 years ago
Javier Jaramago Fernández	446783432a	Avoid modules cluster sync when 'admin-checksum_%' variables are disable	3 years ago
Javier Jaramago Fernández	f0d022adb8	Rework impl avoiding cluster sync for 'mysql_servers' for 'admin-checksum_mysql_servers=0'	3 years ago
Javier Jaramago Fernández	3507506150	Reset global checksums when variable 'admin-checksum_mysql_servers' is re-enabled ... Also introduces the function 'Reset_Global_Checksums' that allows to reset the global checksums for all the cluster nodes.	3 years ago
Javier Jaramago Fernández	6132aa9de9	Avoid cluster sync for 'mysql_servers' for 'admin-checksum_mysql_servers=0'	3 years ago
René Cannaò	d4d2298a6f	Debug logging to disk ... Introduced new schema debugdb_disk (on disk) and table debug_log . Debug entries will now go to this new table based on the value of variable admin-debug_output . If: 1) default behavior: write to stderr 2) write only to debugdb_disk.debug_log 3) 3 = 1+2 = write to stderr and to debugdb_disk.debug_log All these functionalities exist only on debug build. Table debugdb_disk.debug_log has also a column named "note" that can be used to write user notes during debugging.	3 years ago
René Cannaò	9235fbf887	Added 1st testing for mysql_hostgroup_attributes ... This commit adds some minimal testing for mysql_hostgroup_attributes . It helped detecting some bugs.	3 years ago
René Cannaò	d61c043bdc	Drafting mysql_hostgroup_attributes table	3 years ago
René Cannaò	36575d273a	Several code improvements ... In Admin: - replaced a lot of flush_[...]__from_memory_to_disk() and flush_[...]__from_disk_to_memory() with a generic flush_GENERIC__from_to() - several commands like "LOAD MYSQL SERVERS FROM DISK" and similar are automatically generated for various modules (not all) and saved/map in a map load_save_disk_commands - FlushCommandWrapper() is able to map the various LOAD/SAVE from/to DISK into commands to run on SQLite	3 years ago
René Cannaò	71e2510ef6	Code cleanup on MySQL_HostGroups_Manager ... Some rework to try to reduce duplicated code	3 years ago
Javier Jaramago Fernández	1abb4d7605	Comment out several currently unused variables	3 years ago
Javier Jaramago Fernández	300532d6e2	Fix multiple warnings in logging function calls	3 years ago
René Cannaò	6ef97fb102	Replaced an error with a warning ... In ProxySQL_Node_Entry::ProxySQL_Node_Entry() replaced a proxy_error with a proxy_warning, and more verbose message	3 years ago
Rahim Kanji	9e218b2716	Code cleanup	3 years ago
Rahim Kanji	c552fdb111	* Added DNS cache monitoring for ProxySQL servers. ... * Added forced triggering of DNS Cache Update on MySQL Servers and ProxySQL Servers table update. * Direct DNS cache update via socket (connected peer ip) if record is not available in cache. * Used strdup instead of realloc. * DNS lookup only once for ProxySQL Cluster Nodes.	3 years ago
Rahim Kanji	7805924779	Feature: ProxySQL local DNS Cache	3 years ago
Javier Jaramago Fernández	7a0a83bb20	Fix compilation adding constructor for 'incoming_servers_t' ... A constructor is required to overcome C++11 limitation of type no longer being an aggregate due to default member initialization.	4 years ago
Javier Jaramago Fernández	b2cf36429a	Add 'computed checksum' info messages before performing pulling actions in Cluster	4 years ago
Javier Jaramago Fernández	2e594bd6b1	Replace space in ProxySQL version Enterprise identifier in favor of dash	4 years ago
Javier Jaramago Fernández	b34100ceec	Fix memory leaks for 'username' and 'password' credentials in cluster 'pull' actions	4 years ago
Javier Jaramago Fernández	099c2a5f06	Cluster: Speedup of processing of MySQL Users and MySQL Servers ... - Cluster now syncs the server tables via 'incoming_*' tables generated during 'load_mysql_servers_to_runtime'. - Cluster now syncs 'mysql_users' table via a resultset generated via '__refresh_users'.	4 years ago
Javier Jaramago Fernández	3dacb77321	Perform atomic update of Cluster fetched module checksum epochs	4 years ago
Javier Jaramago Fernández	e6083250b5	Merge branch 'v2.x' of github.com:sysown/proxysql into v2.x-cluster_cmp_checksums	4 years ago
René Cannaò	5e68075edf	Cluster: Speed up processing of MySQL Query Rules ... Multiple changes: - Query_Processor stored the resultset of query rules loaded to runtime (previously this was only for query rules fast routing) - Admin returns the stored resultset (query rules and fast routing) when queries by Cluster - In khash replaced the hashing function from the built-in __ac_X31_hash_string to CityHash32 - When Cluster is used, it calls load_mysql_query_rules_to_runtime() passing the resultsets retrieved by the remote peer - Increased SQLite cache_size to ~50MB: this seems to be a very small optimization and probably it will be reverted - pull_mysql_query_rules_from_peer() uses transactions to write to mysql_query_rules_fast_routing - (important change) pull_mysql_query_rules_from_peer() verifies the checksum of MySQL Query ules before loading them to runtime	4 years ago
Javier Jaramago Fernández	a03bf7c58d	Add LDAP support for 'mysql_users' Cluster checksum computation	4 years ago
Javier Jaramago Fernández	fa887b2dc9	Prevent Cluster sync between nodes with/without 'ldap_auth' plugin loaded	4 years ago
Javier Jaramago Fernández	4c4346a710	Add checksum computation after fetch to multiple cluster modules ... The following cluster modules now compute their expected checksums after fetch: - mysql_query_rules - mysql_users - mysql_servers - mysql_global_variables	4 years ago
René Cannaò	542b207611	Added new function to create multirows statements for SQLite also for MySQL_Monitor and ProxySQL_Cluster	4 years ago
René Cannaò	27b89b441b	Merge pull request #3857 from sysown/v2.x-compilation_fixes ... Fix compilation in older GCC versions removing 'auto' usage	4 years ago
Javier Jaramago Fernández	55fbef61fa	Fix compilation in older GCC versions removing 'auto' usage	4 years ago
Javier Jaramago Fernández	080a84a9c5	Dump 'proxysql_servers' after fetch from peer Cluster node #3847	4 years ago
Javier Jaramago Fernández	b776304ed7	Fix invalid memory accesses by 'ProxySQL_Node_Entry::set_checksums' #3847	4 years ago
Javier Jaramago Fernández	f2590ff15c	Fix 'proxysql_servers' failing to sync due to mismatching checksums #3847	4 years ago
Javier Jaramago Fernández	5ed8bd5517	Add new metrics for 'proxysql_servers_checksum' and 'proxysql_servers_metrics'	4 years ago
René Cannaò	9f264fcf1d	In Cluster pull_mysql_servers_from_peer() lock mysql_servers only if mysql servers tables are going to be written. ... Before this commit we were calling GloAdmin->mysql_servers_wrlock() at the beginning of the synchronization. This was not ideal as we should call GloAdmin->mysql_servers_wrlock() only if we are really going to write the tables. In other words, only if the resultsets are fetched from the remote peer, and if their checksums didn't change in the meantime.	4 years ago
René Cannaò	ca10cf0631	Temporary removing all read/write timeout from Cluster	5 years ago
René Cannaò	2ae218f7ed	Cluster: sync of proxysql_servers ensures that checksum is correct	5 years ago
René Cannaò	0c711e1a32	Prevent a crash while syncing proxysql_servers in Cluster	5 years ago
René Cannaò	5bfbca7f2d	Preserve epoch when synching with ProxySQL Cluster ... On a large ProxySQL Cluster it was possible that an old configuration reaches a node (nodeA) later than a new configuration is applied to another node (nodeB). This has the side affect that nodeB will then believe that nodeA has a newer configuration, while in reality is an old configuration applied later. This commit preverves epoch, thus should avoid this problem	5 years ago
René Cannaò	894e72041d	Adding a mutex when Cluster is syncing mysql query rules	5 years ago
René Cannaò	254ee51e8a	Temporary commit for debugging	5 years ago
René Cannaò	bc6d4f2aba	Improve error verbosity in ProxySQL Cluster	5 years ago
René Cannaò	fcfcb3cac0	Improve error verbosity in ProxySQL Cluster	5 years ago
René Cannaò	5e422668c8	Removing mysql-threads from cluster sync ... It also enables monitoring for cluster test	5 years ago
René Cannaò	af27c0b108	Merge branch 'v2.x' into v2.1.2-cluster	5 years ago
René Cannaò	194243503a	Adding LCOV_EXCL_START around assert(0) ... LCOV_EXCL_START and LCOV_EXCL_STOP around assert(0) will improve code coverage	5 years ago
Javier Jaramago Fernández	0e377c2622	Fixed typo specifying to load 'MYSQL VARIABLES' instead of correct 'LDAP VARIABLES' to runtime #3419	5 years ago
Javier Jaramago Fernández	519105bb32	Fixed retrieving 'mysql_ldap_mapping' from peer 'runtime' instead of 'memory' #3419	5 years ago
Javier Jaramago Fernández	f1b3687f5d	Fixed typo using 'cluster_mysql_query_rules_save_to_disk' instead of 'cluster_mysql_users_save_to_disk' in 'pull_mysql_users_from_peer'	5 years ago
Javier Jaramago Fernández	04d3947212	Implemented sync support for 'mysql_ldap_mapping' table	5 years ago
Javier Jaramago Fernández	ba1762bc3e	Implemented sync support for 'ldap-%' global variables	5 years ago
René Cannaò	86c95dbb18	Cluster node exports admin-mysql_ifaces ... When a cluster node (client) connects to another cluster node, it advertises its UUID but also exports its `admin-mysql_ifaces` . The receiving cluster can use this information to try to guess how to connect to the node that initialized the connection, for example to collect metrics. This is visible in table `stats_proxysql_servers_clients_status` .	5 years ago
René Cannaò	4f3c133cd0	Implemented variable cluster_sync_interfaces	5 years ago
René Cannaò	a592402902	Implementation of table stats_proxysql_servers_clients_status and PROXYSQL CLUSTER_NODE_UUID command	5 years ago
René Cannaò	69fb384deb	Replacing struct proxy_node_address_t with class ProxySQL_Node_Address	5 years ago
Javier Jaramago Fernández	39131a956e	Fixed several prometheus metrics names and tags to follow the latest convention	5 years ago
René Cannaò	b8220382d9	Merge pull request #3100 from sysown/v2.1.0-3088 ... Closes #3088: Added new json 'attributes' column to 'mysql_query_rules' table	5 years ago
René Cannaò	43624ac63e	Merge pull request #3086 from sysown/v2.1.0-3083 ... Added new column 'attributes' to 'mysql_users' table	5 years ago
Javier Jaramago Fernández	05a005f9fb	Add support for syncing 'mysql-variables' and 'admin-variables' #2820 (#2856) ... * Added forgotten metric increase in case of 'sync conflict' on proxysql_servers * Added support for 'global_variables' sync in proxysql_cluster - Added several for getting the peers to be sync. - Added function to pull the target 'global_variables' to sync. - Added metrics for 'global_variables' sync: + Number of syncs done / failed. + Sync conflicts. + Sync warnings. * Removed unnecesary escaping for '%' char * Fixed issue due to 'flush_mysql_variables___runtime_to_database' being called without proper locking * Added simple helper function to get the output from a command execution * Multiple changes to 'cluster_synct' test + Spawned proxysql instance now runs inside a docker container. + Simplified launching and logging of spawned proxysql instance. + Added more verbose logging about the tables state. + Added new tests for 'global_variables' synchronization. * Commented several variables known to not-sync and fixed port for replica 'proxysql_server' * Removed deprecated and non-syncable variables from 'test_cluster_sync-t' * Added extra logging for variables sync for 'test_cluster_sync-t'	5 years ago
Javier Jaramago Fernández	9a24849244	Improved cluster 'pulled_mysql_' prometheus metrics naming and labelling	5 years ago
Javier Jaramago Fernández	6a56e02dd7	Fixed typo in 'proxysql_cluster_syn_conflict_total' metric labels	5 years ago
Javier Jaramago Fernández	2d60b06f55	Improved several prometheus metrics labelling and simplified some non-grouping ones	5 years ago
Javier Jaramago Fernández	f6e0e64f42	"Changed prometheus counter naming convention to include '_total' suffix" ... - Other metrics names has also be changed due to this global change.	5 years ago
Javier Jaramago Fernández	84f4c96afa	Multiple changes to multiple metrics definitions ... - Labelling has been simplified to group metrics which are part of a common group. - Help has been fixed to reflect this labelling change. - Doxygen doc and comment marks has been added to signal metrics grouping.	5 years ago
Javier Jaramago Fernández	622a763920	Added new column 'attributes' to 'mysql_query_rules' table	5 years ago
Javier Jaramago Fernández	42fa0f7945	Added new column 'attributes' to 'mysql_users' table	5 years ago
René Cannaò	bc0963e3f4	Merge pull request #2833 from sysown/v2.1.0-2687 ... Sync support for 'mysql_galera_hostgroups', 'mysql_group_replication_hostgroups' and 'mysql_aws_aurora_hostgroups' #2687	6 years ago
Javier Jaramago Fernández	02d74d0d1a	Reworked cluster sync impl properly handling NULL values for comments	6 years ago
Javier Jaramago Fernández	d3a5dae321	Removed unused variable from proposed timeout based loging	6 years ago
Javier Jaramago Fernández	047bdc6b72	Removed introduced helper function 'proxy_info_' and macros in favor of old 'proxy_info'	6 years ago
Javier Jaramago Fernández	486a12e2ae	Added new metrics for the 'wont sync' conditions and fixed some other metrics descriptions	6 years ago
Javier Jaramago Fernández	a213cf8cd7	Added new logging messages for same epoch 'WONT SYNC' conflict using 'diff_check' for intervals	6 years ago
Javier Jaramago Fernández	977c094a0f	Added new prometheus metrics for synchronization fetching events	6 years ago
Javier Jaramago Fernández	651014a0b9	Added extra logging for two different situations: ... - When configuration rules specify NOT to save the config to disk. - When synchronization isn't going to happen because both servers hold the same epoch values for two configurations with different checksums.	6 years ago
René Cannaò	2bbd84d2c9	Support for SQLite3 plugin ... This commit prepares proxysql for further development related to SQLite3. Specifically, it allows to either use built-in SQLite3 library, or to load it from a plugin.	6 years ago
Javier Jaramago Fernández	7661d989ec	Added extra logging info for the new hostgroup tables synchronization	6 years ago
Javier Jaramago Fernández	88c6924e79	Fixed support for NULL comments in new added hostgroup tables fetching	6 years ago
Javier Jaramago Fernández	0ac939dd69	Fixed 'hostgroups' table fetching retriving 'runtime' table versions	6 years ago
Javier Jaramago Fernández	55d6368b40	Added incorrectly deleted 'mysql_servers' mutex locking	6 years ago
Javier Jaramago Fernández	e6907127a3	Implements synchronization of: 'mysql_galera_hostgroups', 'group_replication_hostgroups' and 'mysql_aws_aurora_hostgroups' ... - Implements synchronization for the mentioned tables. - Creates new version of 'proxy_info' that accepts a 'const char*' as a parameter, instead of a 'string literal'.	6 years ago
René Cannaò	2e60432466	Fixed typo in previous commit	6 years ago
René Cannaò	b6164b0d0a	Permit ProxySQL Cluster peering same version only ... Since ProxySQL 2.1.0 , ProxySQL Cluster is allowed only between peers of the same, identical version	6 years ago
René Cannaò	5bb3b1fb04	Enable SSL for ProxySQL Cluster #2748	6 years ago
René Cannaò	80e92b144d	[WIP] Second commit for mysql firewall whitelist ... Improved also compiling time	6 years ago
Valentin Rakush	440851ec6b	Update all assertions to check SQLITE_OK	6 years ago
René Cannaò	ee5b54d983	Create a wrapper around sqlite3_prepare_v2 ... This should fix several crashes if the internal db is locked or busy	7 years ago
René Cannaò	76cf36c2ce	Merge pull request #1766 from sysown/v2.0.0-cache_wait_1 ... Preparing for support of cache_timeout	7 years ago
René Cannaò	2bd4961b06	Abort if pthread_create fails #1768	7 years ago
René Cannaò	72724b22e0	Preparing for support of cache_timeout ... Adding column mysql_query_rules.cache_timeout . Functionality is not implemented yet, only the column is added.	7 years ago
Nick Vyzas	42e1802c16	Removing X perms	8 years ago
Nick Vyzas	e3b4551292	Adding fix to support 2.0 query rule columns	8 years ago
Nick Vyzas	da99ec0a7e	Enable mysql_query_rules_fast_routing in ProxySQL Cluster ... https://github.com/sysown/proxysql/issues/1675	8 years ago
René Cannaò	73f73b6c0a	Add column comment in mysql_users table #1633 ... Added online migration from previous table definition (1.3.0 and 1.4.0). LOAD MYSQL USERS TO RUNTIME and SAVE MYSQL USERS TO MEMORY handle the new field comment can be read also from config file ProxySQL Cluster reads comment from remote node	8 years ago
René Cannaò	36db9fe20d	Fix for bug #1541	8 years ago
Nikolaos Vyzas	9f3c265fd9	Resolving conflicts for "Add support for GTID consistent reads"	8 years ago
Nikolaos Vyzas	ddd8f7b67f	Resolving conflicts for 'Add gtid_port to mysql_servers'	8 years ago