567 Commits (8a0e326ce54c26fa86ec1035c6eefa6b1069cb10)

Author	SHA1	Message	Date
René Cannaò	35705f769a	Adding variable aurora_only_read_from_replicas ... If AWS Aurora is used and max_lag_ms , send traffic only to replicas if at least N replicas are good candidates.	6 years ago
Valentin Rakush	440851ec6b	Update all assertions to check SQLITE_OK	6 years ago
Adrián del Campo	f9e19ba03e	Ported back the galera support fix to v2.0.7	7 years ago
René Cannaò	85f425af86	Do not disable backend for some errors codes #2261 ... Codes: From 1048 to 1052 From 1054 to 1075	7 years ago
René Cannaò	99b4dd4bbd	Merge pull request #2243 from sysown/v2.0.7.2 ... V2.0.7.2	7 years ago
René Cannaò	aaf83eec78	Finalizing the support for more session variables ... Initial support for `SET SESSION TRANSACTION READ ONLY` or `READ WRITE`. Extended `SET` parser to support also `SET SESSION TRANSACTION`. Hostgroup Manager doesn't kill backend connections in case of error 1231. `autocommit` is set at session level but also on MySQL client connection. Added several debugging entries. Several `handler_again___verify_backend_*` functions are disabled if `locked_on_hostgroup` is enabled.	7 years ago
René Cannaò	d02c854e9b	Implement auto discovery for Aurora writer too	7 years ago
René Cannaò	48ab04f5dc	Merge branch 'v2.0.6-aurora_discovery' into v2.0.7.4	7 years ago
René Cannaò	5336e72f1c	For Aurora, do not use the writer if there are good readers candidates	7 years ago
René Cannaò	b2975490c5	Implementation and simulation of AWS Aurora auto-discovery	7 years ago
René Cannaò	495278c76b	MySQL_HostGroups_Manager::commit() reports for how long it locked	7 years ago
René Cannaò	2d3aaf79e5	Replace endpoint_address with domain_name	7 years ago
René Cannaò	ee5b54d983	Create a wrapper around sqlite3_prepare_v2 ... This should fix several crashes if the internal db is locked or busy	7 years ago
René Cannaò	590a24c8c6	Tracking `CLIENT_MULTI_RESULTS` ... This commit also fixes several mistakes in handling bitwise operations	7 years ago
René Cannaò	30b4b34c81	Use 32 bits for capabilities flags	7 years ago
René Cannaò	6691a867fa	Fix issues/FR #2120 , #2121 and #2125 ... Issue #2120 : Send SESSION_TRACK_GTIDS to client Issue #2121 : Track CLIENT_FOUND_ROWS required by the client Issue #2125 : Track CLIENT_MULTI_STATEMENTS required by the client	7 years ago
René Cannaò	9ed7094cfe	Implemeting of more locking in SELECT statements ... SELECT ... FOR SHARE SELECT ... LOCK IN SHARE MODE SELECT ... FOR (UPDATE|SHARE) [OF ...] (NOWAIT|SKIP LOCKED)	7 years ago
René Cannaò	9604e9fbfb	Adding age of sessions and connections #2055	7 years ago
René Cannaò	a6897eaa0d	Adding more internal info in JSON format #2055 ... In `stats_mysql_free_connections`, exported: * address of connection * address of mysql struct * mysql thread_id In `stats_mysql_processlist`, exported: * address of session * address of data stream * address of connection * address of mysql struct * mysql thread_id * removed password from non-debug built	7 years ago
René Cannaò	88c2c6e3d4	Merge pull request #2044 from sysown/v2.0.1-aurora ... V2.0.1 aurora	7 years ago
René Cannaò	817e20c222	Improvement on Galera and HGM ... - generate_mysql_servers_table() is now less verbose - update_galera_set_writer() is protected by a mutex - update_galera_set_writer() set status to online - fixed wording in monitor_galera_thread() - corrected the computing of consecutive timeout in monitor_galera_thread()	7 years ago
René Cannaò	059579f5a2	Fix some compiler warnings	7 years ago
René Cannaò	2df11ec320	If max_replication_lag is changed to 0, immediately unshun the server shunned because of replication lag	7 years ago
René Cannaò	58ff4ff892	Merge branch 'v2.0.4' into v2.0.1-aurora	7 years ago
René Cannaò	495c933624	Adding table stats.stats_mysql_free_connections ... This table exports metrics about connections in connection pool	7 years ago
René Cannaò	006c042c0b	Adding more protection in monitoring	7 years ago
René Cannaò	01023d6856	Merge branch 'v2.0.4' into v2.0.1-aurora	7 years ago
René Cannaò	8469801e74	Implemented first prototype of latency awareness ... Configurable using mysql-min_num_servers_lantency_awareness	7 years ago
René Cannaò	16913fdd78	Optimizing get_random_MySrvC()	7 years ago
René Cannaò	b74181eeea	Added aws_aurora_replicas_skipped_during_query ... aws_aurora_replicas_skipped_during_query is a status variable for better monitoring behavior due to replication lag in AWS Aurora Also fixed lag computing in connection pool	7 years ago
René Cannaò	af0a7100e2	Adding support for max_lag_ms in query	7 years ago
René Cannaò	b36f5d785a	Second commit to support Aurora ... It adds port and endpoint_address in mysql_aws_aurora_hostgroups	7 years ago
René Cannaò	abd2b4c70c	Fix bug #1927	7 years ago
René Cannaò	2e20854684	Second commit (not complete) to support Aurora	7 years ago
René Cannaò	a35917c346	First commit (not complete) to support Aurora	7 years ago
René Cannaò	11924ca129	Optimize connection pool to find matching username ... Try to get from connection pool and connections cache, a connection with the same schemaname	7 years ago
René Cannaò	ef49b2570e	Removing some complaints from Valgrind	7 years ago
René Cannaò	0a60cfda11	Merge branch 'v2.0.0-tb' into v2.0.0-merge-tb	7 years ago
René Cannaò	49a4dd5fc5	Merge branch 'v2.0.0' into v2.0.0_merge_ldap	7 years ago
René Cannaò	e2874e4d2a	Merge branch 'v2.0.0' of https://github.com/sysown/proxysql into v2.0.0	7 years ago
René Cannaò	6cec5078ec	Tune shun time if ping interval is too low #1883 ... When shunning a node, evaluate the different between `mysql-monitor_ping_interval` and `mysql-shun_recovery_time_sec`, and postpone in the future when the server needs to be recovered	7 years ago
René Cannaò	10f38d4e2f	Various code cleanup	7 years ago
Adrián del Campo	f762929c94	Fixed query to get available galera nodes in a hostgroup	7 years ago
René Cannaò	883d66a71f	Inlining some functions related to connection pool	7 years ago
Adrián del Campo	83310e33a6	Fixed shun recovery time calculation ... If shun recovery time >= max_connection timeout, the desperate attempt of recovering a node currently gets multiplied by 9 instead of reduced to a 10%	7 years ago
René Cannaò	52b0c7784f	Added 3 new global status variables ... - Access_Denied_Wrong_Password - Access_Denied_Max_Connections - Access_Denied_Max_User_Connections	7 years ago
René Cannaò	5a7c4b00e2	Fixing various compiler warnings	7 years ago
René Cannaò	6a9655082b	Specify HG when shunning or resuming nodes due to replication lag	7 years ago
René Cannaò	0f56d576d1	Completed implementation of stats_mysql_errors	7 years ago
René Cannaò	bbe9dd7ace	Adding class HGM_query_errors_stats()	7 years ago
René Cannaò	0aeb622793	Merge pull request #1765 from sysown/v2.0.0-wr2 ... Add support for writer_is_also_reader=2	7 years ago
René Cannaò	2bd4961b06	Abort if pthread_create fails #1768	7 years ago
René Cannaò	37f316e940	Add support for writer_is_also_reader=2 ... This functionality is enabled for: - mysql_galera_hostgroups - mysql_group_replication_hostgroups If writer_is_also_reader=2 and there are servers in backup_writer_hostgroup, only these servers will be used in reader_hostgroup	7 years ago
René Cannaò	f5a82235d9	Added more status variables to improve troubleshooting	8 years ago
René Cannaò	44d810fbd2	Reduce lo verbosity for Galera checks	8 years ago
René Cannaò	7f6205bb5d	Increase upper limit of mysql-hostgroup_manager_verbose from 1 to 2 ... With a value of 2 less debug information are displayed about Galera and Group Replication	8 years ago
René Cannaò	f51aa84f46	Reduce verbosity for Galera checks that won't result in any change ... Galera checks may first detect the status of a node and then decide if an action is needed. This commit reduces the amount of messages logged in error log is no action will be performed.	8 years ago
René Cannaò	d694d2942e	Fxied a crashing bug caused by a buffer overflow	8 years ago
René Cannaò	0573c5118e	Add global variable mysql-kill_backend_connection_when_disconnect	8 years ago
René Cannaò	8876e5e784	Kill backend connections using KILL when a client disconnects	8 years ago
René Cannaò	0fdd52b46d	Minor memory leak fix	8 years ago
René Cannaò	3e4583cdcc	DELETE FROM mysql_servers_incoming during LOAD TO RUNTIME	8 years ago
René Cannaò	9c62cc749e	Several memory sanitizer	8 years ago
René Cannaò	8756d37bfc	Galera: try to bring a node online if there are no writers	8 years ago
René Cannaò	f795b16445	Galera: removed wrong check that prevents converge	8 years ago
René Cannaò	11caed7d7a	Galera: do not convert when updating writers if leads to no changes	8 years ago
René Cannaò	a03604d555	Prevent a loop in GTID reader	8 years ago
René Cannaò	291becdb20	Galera: force converge if max_writers is exceeded	8 years ago
René Cannaò	26065f30ba	Fixing bugs from previous commit	8 years ago
René Cannaò	e5cfc25701	Prevent loading new Galera configuration if leading to a no-op ... This is to prevent cases in which only one node is left, but from its status it should be offline. ProxySQL would normally set it offline and then back online. This commit prevents it to change status twice.	8 years ago
René Cannaò	b1eef9950b	Wrong number of arguments in converge_galera_config()	8 years ago
René Cannaò	7db8f24b8b	For Galera cluster, try to find the most appropriate node if none seems healthy	8 years ago
René Cannaò	45a136a88b	Fix bug #1536	8 years ago
René Cannaò	9038e6a7c9	Fix bug #1473	8 years ago
René Cannaò	1bd36b8d8f	Do not dump on error log runtime mysql servers tables when running queries against runtime_mysql_servers ... The same applies also for: - runtime_mysql_replication_hostgroups - runtime_mysql_group_replication_hostgroups - runtime_mysql_galera_hostgroups Close #1435 and #1436	8 years ago
René Cannaò	efb716b048	Disable monitoring of servers not responding to ping ... This commit also prevents shunned nodes to come back online if they are missing pings. Related to #1416 Because it reduces the number of checks, it may also be relevant to #1417	8 years ago
René Cannaò	2461b837e7	Missing argument in previous commit	8 years ago
René Cannaò	be3d1600fa	Evaluate writer_is_also_reader from within converge_galera_config() in case if only one node exists	8 years ago
René Cannaò	353d2a49a5	Try to use the last node in a Galera Cluster	8 years ago
René Cannaò	18ac68dbb0	Fixed typo s/Group Replication/Galera/	8 years ago
René Cannaò	6908f491a7	Fixed typo	8 years ago
René Cannaò	083319ed7e	First commit to track MySQL errors	8 years ago
René Cannaò	1c8c08fe9e	Fixing typo Group Replication => Galera	8 years ago
René Cannaò	62d8407cdb	Merge branch 'v2.0-Galera' into v2.0.0	8 years ago
René Cannaò	528a3477ed	Allow hostname for GTID	8 years ago
René Cannaò	df651b45f3	Fix typo	8 years ago
René Cannaò	9175e5f426	Fix typo	8 years ago
René Cannaò	ffffd1324e	Added missing mutex initialization for Galera	8 years ago
René Cannaò	133a690e8d	Reduce memory allocation	8 years ago
René Cannaò	ce815a5a72	Initial commit to natively support Galera	8 years ago
René Cannaò	2bb322db6f	Several fixed in Prepared statements ... * is STMT_PREPARE failed when there is a previous status (maybe STMT_EXECUTE) disconnect the client immediately. Maybe this is related to #1366 , but I can't reproduce it yet * purge prepared statements is also their server reference counter is 0 * initialize connections queue for purging connections	8 years ago
René Cannaò	28b9fc1f33	Bug fix for memory leak in LOAD MYSQL SERVERS TO RUNTIME #1425	8 years ago
René Cannaò	e949e7a569	Try to get from connection pool and connections cache, a connection with the same schemaname ... This is ported from 1.4.7 , and modified to work with GTID support in 2.0	8 years ago
René Cannaò	ac81c25ce2	Server disappearing when RO=1 becomes RO=0 ... This issue is similar to #1039	8 years ago
René Cannaò	5a554a36f6	Variable mysql-binlog_reader_connect_retry_msec ... This variable control the retry interval to connect to binlog reader	8 years ago
René Cannaò	6b8a82e3e9	Added retry mechanism for missing binlog reader	8 years ago
René Cannaò	a6291f1693	Further improvement for handling GTID ... Statistics collected aboout GTID queries Statistics displayed on HTTP server Count number of GTID events per server Online upgrade of all mysql_connections tables Fixed path for libev	8 years ago
René Cannaò	3e59bdef2a	Expanding stats_mysql_connection_pool ... Added counters of queries using gtid sync Added PR #1343 for FR #1207	8 years ago
Nikolaos Vyzas	9f3c265fd9	Resolving conflicts for "Add support for GTID consistent reads"	8 years ago
Nikolaos Vyzas	c61a6d619a	Resolving conflicts for "Fixing bug on loading mysql servers to runtime"	8 years ago
Nikolaos Vyzas	9938ec24b5	Resolved conflicts for "ProxySQL reads GTID information from proxysql_mysqlbinlog"	8 years ago
René Cannaò	99be80f90e	Update mysql_servers in HostgroupsManager	8 years ago
Nikolaos Vyzas	ddd8f7b67f	Resolving conflicts for 'Add gtid_port to mysql_servers'	8 years ago
Nikolaos Vyzas	1b7b6f08fd	Resolving conflict for 2.0 ProxySQL admin migration	8 years ago
Nikolaos Vyzas	7228f4e0de	Merging changes and resolving conflicts related to MariaDB connector upgrade	8 years ago
René Cannaò	be0843c051	Fix integer overflow on connection_max_age_ms #1393	8 years ago
René Cannaò	e8de8ee2c8	Added new metrics ... * MyHGM_myconnpoll_destroy * MyHGM_myconnpoll_get * MyHGM_myconnpoll_get_ok * MyHGM_myconnpoll_push * MyHGM_myconnpoll_reset * Queries_frontends_bytes_recv * Queries_frontends_bytes_sent	8 years ago
pondix	9b3fffdf49	Removing SQLLite lock assertion	8 years ago
René Cannaò	3520dbbacc	Remove all references to PS handling before 1.4 ... Handling of prepared statements changed a lot in 1.4 , as a lot of code was rewritten. Old code was still present, and was possible to toggle it on and off based on PROXYSQL_STMT_V14 . Because only the new code is maintained, all references to old code are now removed, including PROXYSQL_STMT_V14	8 years ago
René Cannaò	232bec9ad4	Fix minor bugs	8 years ago
René Cannaò	b3de6f7ae6	Stop HGCU_thread_run as the first task of MySQL_HostGroups_Manager destructor #1299	8 years ago
René Cannaò	c6d01ccf7f	Merge branch 'v1.4.4-ps_memleak' into v1.4.4	8 years ago
René Cannaò	7eccd347e3	Add support for Percona Heartbeat #1248 ... This commits adds a new variable: mysql-monitor_replication_lag_use_percona_heartbeat This variable defines the percona heartbeat table used to check replication lag. If set, replication lag is checked against the defined table, otherwise `SHOW SLAVE STATUS` is used. To be set, the value should match the following regex: ``` `?([a-z\d_]+)`?\.`?([a-z\d_]+)`? ```	8 years ago
Nick Vyzas	ab87981484	Adding optional lock option to destroy_MyConn_from_pool	8 years ago
René Cannaò	703ee8ef0f	Reset connections instead of dropping them when mysql-max_stmts_per_connection is reached ... Also fixed a memory leak associate with this feature. Cleaned up a bit of code.	8 years ago
René Cannaò	69654afa17	Do not dump replication hostgroups if hostgroup_manager_verbose=0 #1204	8 years ago
René Cannaò	4fb9e3f88b	Dump in error log status of mysql_servers during reconfiguration ... Close issue #1255	8 years ago
René Cannaò	ded88b1f2d	Merge branch 'v1.4.4-connthr' into v1.4.4	8 years ago
René Cannaò	e75d474878	Added mutex in replication_lag_action()	9 years ago
René Cannaò	18f6826ef7	Added new variable to limit the number of backend connections per second ... Variable name is `mysql-throttle_connections_per_sec_to_hostgroup` . Curently it is a global variable and limits the number of new connections per hostgroup, and not per specific node. For example, if mysql-throttle_connections_per_sec_to_hostgroup=100, no more than 100 new connections can be created on any hostgroup no matter the number of servers in that hostgroup. The default is very high (1000000) thus not changing default behaviour. Tuning this variable allows to control and throttle connections spikes to the backend servers. Added also new status variable `Server_Connections_delayed`. This is a counter of how many times Hostgroup Manager didn't return a connection because the limit was reached. It is worth to note that a single client request could make multiple requests, therefore this variable counts the number of time a new connection wasn't created and not how many requests were delayed.	9 years ago
René Cannaò	ec4049ac1e	Optimization on connections reset ... Limit the size of the queue #1185 Reuse the same user #1186	9 years ago
René Cannaò	b688120b25	Memory corruption on STMT resetted twice ... Bug #1197. Caused by PS resetted during change user, and then again when resetting the connection	9 years ago
René Cannaò	c9d3d03f32	Cluster: better handling of mysql_servers.status	9 years ago
René Cannaò	ed802e9f5d	Cluster: typo prevents checksum on mysql_servers	9 years ago
René Cannaò	a22eb8b395	No connection from pool for fast_forward #1157 ... If a user is configured with fast_forward, no connection should be taken from the connection pool. Yet the Hostgroup Manager should know about such connection.	9 years ago
René Cannaò	e3c4cb9964	A lot of changes all related to Cluster ... In `MySQL_Cluster` class added functions to sync with remote node, like: - `pull_mysql_query_rules_from_peer()` - `pull_mysql_servers_from_peer()` - `pull_mysql_users_from_peer()` - `pull_proxysql_servers_from_peer()` Added 8 new global variables in Admin. 4 variables determine after how many different checks the remote configuration will be synced: - cluster_mysql_query_rules_diffs_before_sync - cluster_mysql_servers_diffs_before_sync - cluster_mysql_users_diffs_before_sync - cluster_proxysql_servers_diffs_before_sync 4 variables determine if after a remote sync the changes need to be written to disk: - cluster_mysql_query_rules_save_to_disk - cluster_mysql_servers_save_to_disk - cluster_mysql_users_save_to_disk - cluster_proxysql_servers_save_to_disk Table `proxysql_servers` is now automatically loaded from disk to memory and into runtime at startup. Added new Admin's command `LOAD PROXYSQL SERVERS FROM CONFIG` to load `proxysql_servers` from config file to memory (not runtime). Internal structures with credentials in MySQL_Authentication moved from `unsorted_map` to `map` : this to ensure the right order when generating the checksum. Config file supports both `address` and `hostname` for `mysql_servers` and `proxysql_servers` , #1091 `ProxySQL_Admin::load_proxysql_servers_to_runtime()` now has a lock or no lock option, to avoid deadlock For now, Cluster module is quite verbose.	9 years ago
René Cannaò	2a76f95e31	Further enhancement on Cluster ... Extended class ProxySQL_Checksum_Value() in ProxySQL_Cluster module to support further metrics Implemeted `SELECT GLOBAL_CHECKSUM()` and relative tracking of global checksums Added variable `admin-cluster_check_status_frequency` to check peer's global status at regular intervals	9 years ago
René Cannaò	ee8110a515	Enhancement on Cluster solution ... This commit introduces: 2 new tables: * `runtime_checksums_values` : stores checksums of configurations in runtime. For now for `mysql_query_rules`, `mysql_servers` and `mysql_users` * `stats_proxysql_servers_checksums` : when clustering is enabled, it collects all metrics from `runtime_checksums_values` from all its peers 3 new global variables that defines it checksum needs to be generated during `LOAD ... TO RUNTIME` * `admin-checksum_mysql_query_rules` * `admin-checksum_mysql_servers` * `admin-checksum_mysql_users` ProxySQL Cluster connections now have timeouts: * 1 second timeout for CONNECT and WRITE * 60 seconds timeout for READ (useful for long poll)	9 years ago
René Cannaò	1c1faf210f	Some clean up	9 years ago
René Cannaò	dc3664ac33	Adding command PULL VERSION MYSQL SERVERS ... Experimental feature	9 years ago
René Cannaò	4149a5eff1	HGCU_thread_run() using password as username #1079 ... HGCU_thread_run() was incorrectly using monitor's password as username	9 years ago
René Cannaò	7ad078aebf	Final fix for #1061	9 years ago
René Cannaò	b78b687f46	Bug fix for #1061 ... Adding error handling in HGCU_thread_run() for `change_user_start()` and `change_user_cont()`	9 years ago
René Cannaò	27e28a53ad	Servers did not recover from RO=1 to RO=0 #1039 ... Status of the server was not changed if: * was OFFLINE_HARD * was incorrectly present in myhgm.mysql_servers Added also a mutex to serialize the read_only actions	9 years ago
René Cannaò	fc5a56eec3	Fix bug #1054, MySQL error 1203 ... Do not shun for error 1203: User %s already has more than 'max_user_connections' active connections	9 years ago
René Cannaò	080bb3d471	Big change to imporve how prepared statements work	9 years ago
René Cannaò	7823072dad	Unbalanced traffic with high weights #975 ... If total mysql_servers.weight per hostgroup was higher than 64K, traffic was unbalanced Conflicts: include/gen_utils.h lib/MySQL_HostGroups_Manager.cpp	9 years ago
René Cannaò	817cda3f12	New table stats_mysql_connection_pool_reset #753	9 years ago
René Cannaò	384c91b7ed	Merge branch 'v1.4.0-GR' into v1.4.0 ... Conflicts: src/main.cpp	9 years ago
René Cannaò	50e010bc54	Fix edge case during promotion #959 ... If a slave was shunned because replication was broken, when it becomes a master it was staying shunned	9 years ago
René Cannaò	2403b177ef	More support for Group Replication ... Enforced max_writers Enforced writer_is_also_reader Increased the number of entries in mysql_server_group_replication_log to 100 per node Lowered the minimum value for mysql-monitor_groupreplication_healthcheck_interval to 50ms Lowered the minimum value for mysql-monitor_groupreplication_healthcheck_timeout to 50ms	9 years ago
René Cannaò	752e3fd61e	Further improvement on forwarding #927 ... Introduced a timeout in HGCU_thread_run() Fixed a logical bug in MySQL_Protocol::process_pkt_COM_CHANGE_USER() that was causing to not authenticate user The absence of the timeout and the logicl bug was causing a lot of connections to be dropped and not really reused. But as now the connections are reused, they may present further bugs	9 years ago
René Cannaò	1259fb84e0	HGCU_thread_run corrupts connections #927	9 years ago
René Cannaò	c7cffc9ea7	More support for group replication	9 years ago
René Cannaò	63e86039e6	Added writer_hostgroup for GR	9 years ago
René Cannaò	669e6d3a20	Minor fixes for GR	9 years ago
René Cannaò	5817905df2	Merge branch 'v1.4.0' into v1.4.0-GR ... Conflicts: lib/MySQL_HostGroups_Manager.cpp lib/MySQL_Monitor.cpp lib/ProxySQL_Admin.cpp	9 years ago
René Cannaò	a6c53d0d12	Revert "Refactor header includes."	9 years ago
René Cannaò	8768acf5a5	Third commit for GR support	9 years ago
Maxim Bublis	30dbcc21a8	Refactor header includes. ... * reduce build time by 25%; * remove circular dependency on `cpp.h` and other headers. * fixes issue with `my_global.h` from mariadbclient which redefines `__attribute__`, that leads to broken STL and GCC intrinsics if `<algorithm>` wasn't included prior including this header; * fixes another issue with redefined `__attribute__` which leads to `_conn_exchange_t` not being aligned to cache line size; * removes `pthread_setstacksize` calls as `my_global.h` redefines `pthread_setstacksize` to be `pthread_dummy(0)` which led to stack size being never adjusted; * add missing include guards to some headers; * remove unused proxysql_hash.h header.	9 years ago
Maxim Bublis	043a321e55	Cleanup legacy codebase.	9 years ago
René Cannaò	7ea78394f0	Second commit for GR support	9 years ago
René Cannaò	3c2ced2a7d	Drafting GR support	9 years ago
René Cannaò	53d24f4e53	Speed up LOAD/SAVE mysql_servers #829 ... A further optimization in `MySQL_HostGroups_Manager::generate_mysql_servers_table()` makes `LOAD MYSQL SERVERS TO RUNTIME` around 35 times faster than original implementation. `SAVE MYSQL SERVERS TO MEMORY` is now over 10 times faster than the original implementation.	9 years ago
René Cannaò	ba7e37091b	Speed up LOAD MYSQL SERVERS TO RUNTIME #829 ... This commit is able to speed up LOAD MYSQL SERVERS TO RUNTIME up to 10x for very large mysql_servers table with tens of thousands of servers. Main improvements: * removed 1 unnecessary call to `generate_mysql_servers_table()` * replaced 1 call to `generate_mysql_servers_table()` with UPDATE statements when necessary * implemented new function `servers_add()` that replaces `server_add()` to perform bulk operation * replaced calls to `sqlite3_exec()` with proper parameters bindings * use of multirows INSERT statements (32 rows at the time) Miror improvements: * added new variable mysql-hostgroup_manager_verbose , 1 by default for backward compatibility and debugging * in not debug mode, access to HGM db has no shared cache * in not debug mode, tables in HGM have checks disabled Further note: * Once issue #797 is completed, `mysql_servers` in MyHGM can be simplified further	9 years ago
René Cannaò	86718882e0	Added 6 new status variables , #818 and #821 ... Added status variables: * Com_backend_change_user * Com_backend_init_db * Com_backend_set_names * Com_frontend_init_db * Com_frontend_set_names * Com_frontend_use_db	9 years ago
René Cannaò	de4f71bffa	Merge branch 'v1.3.0' into v1.3.1-dev ... Conflicts: deps/Makefile include/thread.h lib/MySQL_Monitor.cpp lib/thread.cpp src/main.cpp	9 years ago
René Cannaò	7680b8f752	Avoid double delete in read_only check	9 years ago
René Cannaò	e5531843ef	Fixed 2 memory leaks ... This should be the root cause of #766 and #796 This patch will be applied to v1.2.x , v1.3.0 and v1.3.1	9 years ago
René Cannaò	221e47315f	mysql_servers.comment not loaded at runtime #787 ... See also #782	9 years ago
René Cannaò	d0d764533d	Specify when a mysql_users.max_connections is reached #794 ... It also fixes: * bug in deps/Makefile related to cleanall * crashing bug in HGCU_thread_run()	9 years ago
René Cannaò	226f71d4c3	Connections are sent to purge thread if queue<100	9 years ago
René Cannaò	159176627d	Thread to reset connections	9 years ago
René Cannaò	799c7d411a	Merge pull request #737 from ton31337/feature/do_not_shunn_on_few_error_codes ... Do not shunt the server if max_user_connections is reached for user	10 years ago
Donatas Abraitis	0e062058e6	Do not shunt the server if max_user_connections is reached for user	10 years ago
René Cannaò	01395f93f2	Merge branch 'v1.2.3-644' into 1.3.0-alpha	10 years ago
René Cannaò	5330000348	Added variables to control prepared statements ... - mysql-max_stmts_per_connection - mysql-max_stmts_cache	10 years ago
René Cannaò	c987da5b03	Various changes ... - "Prepare" wasn't listed in SHOW PROCESSLIST - during ~MySQL_Connection(), all	10 years ago
René Cannaò	8ce083fb20	Testing pthread mutex for MHM #644 ... If MHM_PTHREAD_MUTEX is defined MySQL_HostGroups_Manager.h , MySQL_HostGroups_Manager() is compiled using pthread mutex instead od spin loop. As a lot of computation is protected by mutex, maybe it is better not to use spin loop.	10 years ago
René Cannaò	861b12fe52	Minor performance improvements ... PtrArray is now header only Moved some function of MySrvConnList() into header	10 years ago
René Cannaò	be063707e9	MySrvConnList::conns is now private ... This commit is a preparation to convert conns from an array to a map	10 years ago
René Cannaò	7d3814e5b9	Scalability improvements #644 ... Some minor yet important tweak to spinloop Replaced rand() with fastrand()	10 years ago
René Cannaò	f27734390e	Merge branch 'v1.2.2-RO-loop' into v1.2.2	10 years ago
René Cannaò	d214e2f60b	Fix bug #667	10 years ago
René Cannaò	12e1223125	Local connection cache #644 ... This is an attempt to improve scalability adding a local connection cache per thread	10 years ago
René Cannaò	79d82929a5	Changed severity of messages when node is shunned ... When a server is shunned because of errors, it is now logged as error When a server is shunned because of replication lag, it is now logged as warning	10 years ago
René Cannaò	e6621ef5b3	Fix bug in read_only_action due to comment #643	10 years ago
René Cannaò	54c13e1dc1	Copy comment in read_only_action ... Issue #643	10 years ago
René Cannaò	a9395cd087	Adding comment field per issue #643 ... Added: * mysql_query_rules.comment VARCHAR * mysql_replication_hostgroups.comment VARCHAR * mysql_servers.comment VARCHAR NOT NULL DEFAULT '' All these tables support online upgrade from previous version (without such fields) at startup. Introduced also a parser for escaping strings with single quotes: double quotes are allowed without extra escaping	10 years ago
René Cannaò	95948d7eb0	Fix for bug #641 ... A server is copied from reader hostgroup to writer hostgroup only if absent or OFFLINE_HARD in writer hostgroup	10 years ago
René Cannaò	e94df8264a	Revert last commit, and added comment	10 years ago
René Cannaò	dc804eccea	Fix bug in read_only_action()	10 years ago
René Cannaò	b8d3bd884c	Added more memory metrics #634 ... * mysql_backend_buffers_bytes * mysql_frontend_buffers_bytes * mysql_session_internal_bytes * ConnPool_memory_bytes	10 years ago
René Cannaò	a0c994ea43	Server was incorrectly set to SHUNNED ... Server was incorrectly set to SHUNNED without checking previous status See #627	10 years ago
René Cannaò	8c342ddf18	Incorrect status in shun_and_killall() ... MySQL_HostGroups_Manager::shun_and_killall() incorrectly set status=SHUNNED for server in OFFLINE_SOFT	10 years ago
René Cannaò	1126001dd8	Return SHUNNED if status=4 ... If status=4 , MySQL_HostGroups_Manager::dump_table_mysql_servers() should return SHUNNED Previous nothing was returned for status=4 (MYSQL_SERVER_STATUS_SHUNNED_REPLICATION_LAG) , caausing the crashing bug #619 dump_table_mysql_servers()	10 years ago
René Cannaò	77d2a9c1ad	Removed a compiler warning	10 years ago
René Cannaò	c11303b117	Servers were incorrectly brought back online ... Fix issue #566 Regression introducted in #531	10 years ago
René Cannaò	b19b21bb56	Fixed minor typo	10 years ago
René Cannaò	510dde94a6	Merge branch 'max_latency_ms' into v1.2.0	10 years ago
René Cannaò	0f70d24b13	Merge branch 'ssl' into v1.2.0	10 years ago
René Cannaò	fe12d26fe4	Implementation of mysql-connection_max_age_ms ... If a connection has a lifetime greated than mysql-connection_max_age_ms , it is dropped See #563	10 years ago
René Cannaò	f27bb873f0	MySQL_Monitor call to set_server_current_latency_us ... Fixed a wrong implementation in previous commit This commit also updates stats_mysql_connection_pool	10 years ago
René Cannaò	517c35f25f	Renamed function ... Renamed MySQL_HostGroups_Manager::set_server_current_latency_ms() to MySQL_HostGroups_Manager::set_server_current_latency_us()	10 years ago
René Cannaò	81e8239917	Connection pool considers current_latency_us ... When evaluating if a host can be used, current_latency_us is taken into consideration	10 years ago
René Cannaò	0fef6b544c	Added global variables mysql-default_max_latency_ms	10 years ago
René Cannaò	41ee4e5b85	Fixed typo in previous commit related to SSL and latency ... Also testing SSL connection with hardcoded certificates	10 years ago
René Cannaò	9019c6b3d5	Added columns use_ssl and max_latency_ms to mysql_servers ... These two new columns will be used to: - enable SSL on a per server basis - define maximum latency for a server to be consider usable: this will be a key element for multi DC support	10 years ago
René Cannaò	820dd6357e	Fixed major bug introduced in #545 ... The math was balancing connections was incorrect	10 years ago
René Cannaò	00caba00fc	Minor bug fixes on #544 and #545	10 years ago
René Cannaò	db33ee961e	Balance connections usage based on weight and used connections #545 ... First implementation	10 years ago
René Cannaò	fc9ab855da	First draft for bugs #543 ... When a server isn't responding to ping, it is flagged as shunned and all the connections need to be dropped. All the connections must be dropped before the server is brought back online	10 years ago
René Cannaò	751ba624a3	Auto tuning shun_recovery_time_sec ... See issues #530 and #531 Closes #530 Closes #531	10 years ago
René Cannaò	66280b1bd3	Fixed a race condition in LOAD/SAVE MYSQL SERVERS	10 years ago
René Cannaò	c6b7f6db52	Merge branch 'servers_version' into beta7	10 years ago
René Cannaò	a3dafd830e	Added status variable Servers_table_version ... This status variable is incremented every time mysql_servers table is reloaded	10 years ago
René Cannaò	eb012cb782	Removed a not relevant verbose line	10 years ago
René Cannaò	376b037585	Added support for runtime mysql servers tables ... Issue #488 - runtime_mysql_replication_hostgroups - runtime_mysql_servers	10 years ago
René Cannaò	dca5dd7e8f	Do not shun for error in replication lag ... error in retrieving replication lag does not shun a slave. See #479	10 years ago
René Cannaò	2ea4149b0b	Fixed accounting of Server_Connections_connected	10 years ago
René Cannaò	efbdf3b617	Try to free mysql buffers when possible ... Free mysql->net.buff when beyond 64KB	10 years ago
René Cannaò	89c7fad16e	Fixed bug in accounting Server_Connections ... Server_Connections_connected and Server_Connections_created were inverted	10 years ago
René Cannaò	abef155790	Prevent "Unknown database" to shun backends ... Issue #464 Attempt to connect to a not existing schema caused the backend to be shunned. This patch fix this issue. Closes #464	10 years ago
René Cannaò	6b1a449260	Fix for bug #461 ... MySQL_Connection::~MySQL_Connection() now only attempts to send the QUIT command The connection is closed no matter if the server is present or not	10 years ago
René Cannaò	ab3b737df1	Extending global mysql status ... In order to understand the performance improvement related to how ProxySQL filters autocommit/commit/rollback, the follows variables were added in GLOBAL MYSQL STATUS - Com_autocommit - Com_autocommit_filtered - Com_commit - Com_commit_filtered - Com_rollback - Com_rollback_filtered	10 years ago
René Cannaò	87845f7e2b	Implement compression on backend (#363) ... For compatibility reason, compression flag on mysql_servers table is not changed: values greater than 1 are accepted, but handled as 1 Closes #363	10 years ago
Andrei-Adnan Ismail	1bdfdd448d	#428 Delete merge conflict markers	11 years ago
Andrei-Adnan Ismail	b6f0b2710c	Merge with master #428	11 years ago
René Cannaò	a9dd642a47	Improving variables name (#420) ... Renamed mysql-shun_recovery_time to mysql-shun_recovery_time_sec	11 years ago
René Cannaò	3ce2c25292	More verbose output in case of broken connections	11 years ago
René Cannaò	27ad3e6b6b	Improved handling of idle connections ... Idle connections are dropped more aggressively	11 years ago
Andrei-Adnan Ismail	12ba711d8d	#428 Fix incrementing/decrementing patterns of the server global metrics	11 years ago
Andrei-Adnan Ismail	c4ff716e69	#428 Increment global server-related metrics	11 years ago
Andrei-Adnan Ismail	ce8fd30fc2	#428 Add new variables in MyHGM->status to track server metrics	11 years ago
Andrei-Adnan Ismail	1180e60a8c	Merge pull request #401 from aismail/388-document-global-variables ... 388 document global variables	11 years ago
René Cannaò	0e1db43273	More on bug #417	11 years ago
René Cannaò	2ab0ce82bf	Fix bug #417 ... Closes #417 Closes #418	11 years ago
René Cannaò	e6dd56cf07	Added global variable mysql-monitor_writer_is_also_reader , #395 ... When this variable is set, a promoted master is also marked as slave	11 years ago
René Cannaò	c3c7be32b2	Removed read_only_action(SQLite3_result *) #395	11 years ago
René Cannaò	13ce24f17b	read_only_action() triggers a switch (#395) ... class MySQL_HostGroups_Manager() has now also access to admindb added function MySQL_HostGroups_Manager::purge_mysql_servers_table() to remove entries from mysql_servers table from within MyHGM purge_mysql_servers_table() and generate_mysql_servers_table() are called in multiple part of the code to get consistent view of mysql backends added function MySQL_HostGroups_Manager::read_only_action(char*,int,int) responsible for triggering a traffic switch	11 years ago
René Cannaò	ee9b62c9de	Further work on #395 ... - implemented table monitor.mysql_server_read_only_log - implemented code to monitor and log read_only values - implemented new thread MySQL_Monitor::monitor_read_only() - skeleton for read_only_action()	11 years ago
René Cannaò	f129db3d1f	Dump mysql_replication_hostgroups in error log (#395) ... This is done in MySQL_HostGroups_Manager::generate_mysql_servers_table()	11 years ago
René Cannaò	e2a457777f	Extended SAVE MYSQL SERVERS FROM RUNTIME (#395) ... ProxySQL_Admin::save_mysql_servers_runtime_to_database() now also calls MySQL_HostGroups_Manager::dump_table_mysql_replication_hostgroups()	11 years ago
René Cannaò	379424d099	More on mysql_replication_hostgroups (#395)	11 years ago
Andrei Ismail	9254cd6ee0	#388 Document get_multiple_idle_connections	11 years ago
René Cannaò	34e83e342c	More verbose when shunning servers	11 years ago
René Cannaò	4bf5fda572	Implemented variable threshold_query_length , #366	11 years ago
René Cannaò	f7b87116e0	Extended stats_mysql_connection_pool per #342 ... Added columns Bytes_data_sent and Bytes_data_recv These columns counts only data, not metadata	11 years ago
René Cannaò	95b971a660	More development on #358 ... Added status MYSQL_SERVER_STATUS_SHUNNED_REPLICATION_LAG as internal only (not configurable) Added MySQL_HostGroups_Manager::replication_lag_action() to communicate replication lag to connection pool and take action	11 years ago
René Cannaò	ea880ffaf3	More development on #358 ... Logging on table mysql_server_replication_lag_log List of servers is retrieved from MyHGM	11 years ago
René Cannaò	71b26a7ae0	More development on #358 ... Added MySQL_HostGroups_Manager::execute_query() to query directly MyHGM's db Bug fixes	11 years ago
René Cannaò	315e2f2f66	Bugfix: as precaution, MySQL_HostGroups_Manager::push_MyConn_to_pool() checks that the connection is idle (ASYNC_IDLE) before pushing it back in the connection pool. If not, the connection is deleted.	11 years ago
René Cannaò	6d496d46ee	Implementation of Automatic shun failing backends (issue #339)	11 years ago
René Cannaò	cdffa376ca	Added ConnOK and ConnERR in stats_mysql_connection_pool , per issue #338	11 years ago
René Cannaò	b9c4548ab7	Implementation of mysql status table named stats_mysql_global (issue #328) ... Status variables implemented so far: - Client_Connections_aborted - Client_Connections_connected - Client_Connections_created - Questions - Slow_queries Also created alias command SHOW MYSQL STATUS	11 years ago
René Cannaò	e7b3abedd0	Dump mysql_servers information on error log	11 years ago
René Cannaò	42b0e6f54a	Implemented KILL CONNECTION ... Also replaced some proxy_error() with proxy_warning()	11 years ago
René Cannaò	e065fa5055	Changes in mysql_servers will automatically trigger a signal_all_threads()	11 years ago
René Cannaò	0507bf7bfd	Added new variable free_connections_pct ... If the number of free connections is greater than free_connections_pct percentage of max_connections for that specific host, all connections idle for longer than ping_interval_server are closed instead of sending PING	11 years ago
René Cannaò	046ed74274	Introduced table stats_mysql_connection_pool with connection pool statistics	11 years ago
René Cannaò	96c0904281	Handling removal of servers from mysql_servers	11 years ago
René Cannaò	304bd220ad	Added counters to connection pool	11 years ago
René Cannaò	ce63fd9a58	Implemented CHANGE_USER	11 years ago
René Cannaò	76edfb126f	Further implementation of libmariadb client	11 years ago
René Cannaò	29e19b78f1	Added max_connections (issue #250)	11 years ago
René Cannaò	c1678558c1	Further development to support compression: Issue #219 ... Added functions: MySQL_Data_Stream::generate_compressed_packet() Extended changes in: MySQL_Data_Stream::array2buffer() MySQL_Data_Stream::buffer2array() Further improvements: Added global variables mysql-have_compress : issue #225 MySQL_Protocol::process_pkt_initial_handshake() support upper and lower capabilities Added timestamp and timediff in proxy_debug_func() : issue #228	11 years ago
René Cannaò	94c38a41cd	Improving support for compression (issue #220) ... Small bug fix	11 years ago
René Cannaò	6ba6c52826	Added compression field in mysql_servers table ... Issue #220	11 years ago
René Cannaò	568ef1b5d1	Bulk delete of connections when server status is not online ... Used by issue #218	11 years ago
René Cannaò	e8d50d9f0a	Improvement on connection pool ... Issues #215 , #216 and #217 215 : Connection pool should not return connections if server status is not ONLINE 216 : Connection pool should return connections based on weight 217 : Crash if no backend	11 years ago
René Cannaò	308f3a8a90	Further development on MySQL Hostgroups Manager ... Implemented functions: - MySQL_HostGroups_Manager::dump_table_mysql_servers() - MySQL_HostGroups_Manager::generate_mysql_servers_table() - Standard_ProxySQL_Admin::save_mysql_servers_runtime_to_database() (issue #17) Improved Standard_ProxySQL_Admin::load_mysql_servers_to_runtime() to process also status Improved MySQL_HostGroups_Manager::commit() to modified MySrvCs Database in MyHGM is accessible via Admin (issue #212) Enforced debugging if specified at the command line (issue #213)	11 years ago
René Cannaò	2709cc369f	Improvements on backend management ... Issues #208 and #209	11 years ago
René Cannaò	01834ee2f3	Adding some proxy_debug()	11 years ago
René Cannaò	21b20c0257	Connection pool improvements , in beta ... Developed class StatCounters to keep time series counters Added 2 new instances of StatCounters: - MySQL_Session::command_counters; - ProxySQL_Poll::loop_counters; Counters are dispayed in "dbg thread status" Defined new variables mysql-connect_timeout_server_error and mysql-connect_timeout_server (issue #202 and #203) . They are defined but not implemented yet. Fixed two crashing bug when "gdb command" was trying to access: - its own Query_Info if this one was not initialized - Query_Info of another thread if this one was not initialized Introduced new variable ProxySQL_Poll:poll_timeout that Session can overwrite to apply a timeout different than mysql_thread___poll_timeout Added variable MySQL_Connection::last_time_used , updated at creation time and when calling push_MyConn_to_pool(). for each Connection add a "last_time_used" Added function get_multiple_idle_connections() Implementing Standard_MySQL_Threads_Handler::connection_manager_thread() , but doesn't seems to be a good idea ==== New attempt for connection handling MySQL_Session has a new bool variable : connections_handler Standard_MySQL_Thread has a new variable PtrArray : mysql_sessions_connections_handler Added new function Standard_MySQL_Thread::register_session_connection_handler SESSIONS_FOR_CONNECTIONS_HANDLER sessions are created in Standard_MySQL_Thread::init() Added new function Standard_MySQL_Thread::process_all_sessions_connections_handler() New variables in Standard_MySQL_Thread: MySQL_Connection **my_idle_conns; bool processing_idles; unsigned long long last_processing_idles; Added DSS STATE_PING_SENT MySQL_Session::handler___status_WAITING_SERVER_DATA___STATE_PING_SENT	11 years ago
René Cannaò	cf0aabe7dd	Bug fix for issue #179	11 years ago
René Cannaò	181ed20bd3	Development on Connection Pool and Multiplexing ... In MySQL_HostGroups_Manager: - added function add() for MySrvC - fixed few typos : poll => pool - added locking in several functions First cleanup of MySQL_Hostgroup_Entry In MySQL_Protocol: - added variable prot_status - added variable fd - added function process_pkt_EOF() - variable parent is a MySrvC * - extended functions pkt_ok() , pkt_end() and pkt_handshake_server() to update prot_status - added function process_pkt_EOF() - fixed warns to be uint16_t instead of uint64_t In MySQL_Data_Stream: - fixed bug on read_from_net() - added function unplug_backend() In MySQL_Session: - attempting multiplexing if the connection has no active transactions and in case of SELECT statements - destination_hostgroup returned in qpo is applied	11 years ago
René Cannaò	bc8fc47ed6	Introducing MySQL_HostGroups_Manager ... MySQL_HostGroups_Manager merges the best of: - MySQL_HostGroups_Handler - MySQL_Connection_Pool Still in development: will be shadowing the original Handler and ConnPool	11 years ago