240 Commits (48ba491cb7464656cf2cc86b82c19a97c042f923)

Author	SHA1	Message	Date
René Cannaò	58ff4ff892	Merge branch 'v2.0.4' into v2.0.1-aurora	7 years ago
René Cannaò	495c933624	Adding table stats.stats_mysql_free_connections ... This table exports metrics about connections in connection pool	7 years ago
René Cannaò	b74181eeea	Added aws_aurora_replicas_skipped_during_query ... aws_aurora_replicas_skipped_during_query is a status variable for better monitoring behavior due to replication lag in AWS Aurora Also fixed lag computing in connection pool	7 years ago
René Cannaò	af0a7100e2	Adding support for max_lag_ms in query	7 years ago
René Cannaò	b36f5d785a	Second commit to support Aurora ... It adds port and endpoint_address in mysql_aws_aurora_hostgroups	7 years ago
René Cannaò	2e20854684	Second commit (not complete) to support Aurora	7 years ago
René Cannaò	a35917c346	First commit (not complete) to support Aurora	7 years ago
René Cannaò	0a60cfda11	Merge branch 'v2.0.0-tb' into v2.0.0-merge-tb	7 years ago
René Cannaò	953bbac09f	Support writer_is_also_reader=2 in Hostgroup Manager	7 years ago
René Cannaò	883d66a71f	Inlining some functions related to connection pool	7 years ago
René Cannaò	52b0c7784f	Added 3 new global status variables ... - Access_Denied_Wrong_Password - Access_Denied_Max_Connections - Access_Denied_Max_User_Connections	8 years ago
René Cannaò	0f56d576d1	Completed implementation of stats_mysql_errors	8 years ago
René Cannaò	37f316e940	Add support for writer_is_also_reader=2 ... This functionality is enabled for: - mysql_galera_hostgroups - mysql_group_replication_hostgroups If writer_is_also_reader=2 and there are servers in backup_writer_hostgroup, only these servers will be used in reader_hostgroup	8 years ago
René Cannaò	efb716b048	Disable monitoring of servers not responding to ping ... This commit also prevents shunned nodes to come back online if they are missing pings. Related to #1416 Because it reduces the number of checks, it may also be relevant to #1417	8 years ago
René Cannaò	083319ed7e	First commit to track MySQL errors	8 years ago
René Cannaò	62d8407cdb	Merge branch 'v2.0-Galera' into v2.0.0	8 years ago
René Cannaò	133a690e8d	Reduce memory allocation	8 years ago
René Cannaò	ce815a5a72	Initial commit to natively support Galera	8 years ago
René Cannaò	e949e7a569	Try to get from connection pool and connections cache, a connection with the same schemaname ... This is ported from 1.4.7 , and modified to work with GTID support in 2.0	8 years ago
Nikolaos Vyzas	7a2e27c361	Adding minor conflict resolution fixes	8 years ago
Nikolaos Vyzas	e1652bf7e6	Fixing MHGM header file	8 years ago
René Cannaò	6b8a82e3e9	Added retry mechanism for missing binlog reader	8 years ago
René Cannaò	a6291f1693	Further improvement for handling GTID ... Statistics collected aboout GTID queries Statistics displayed on HTTP server Count number of GTID events per server Online upgrade of all mysql_connections tables Fixed path for libev	8 years ago
René Cannaò	3e59bdef2a	Expanding stats_mysql_connection_pool ... Added counters of queries using gtid sync Added PR #1343 for FR #1207	8 years ago
Nikolaos Vyzas	9f3c265fd9	Resolving conflicts for "Add support for GTID consistent reads"	8 years ago
Nikolaos Vyzas	9938ec24b5	Resolved conflicts for "ProxySQL reads GTID information from proxysql_mysqlbinlog"	8 years ago
René Cannaò	e51cb81a08	Drafting tracking of GTID	8 years ago
Nikolaos Vyzas	ddd8f7b67f	Resolving conflicts for 'Add gtid_port to mysql_servers'	8 years ago
Nikolaos Vyzas	1b7b6f08fd	Resolving conflict for 2.0 ProxySQL admin migration	8 years ago
René Cannaò	e8de8ee2c8	Added new metrics ... * MyHGM_myconnpoll_destroy * MyHGM_myconnpoll_get * MyHGM_myconnpoll_get_ok * MyHGM_myconnpoll_push * MyHGM_myconnpoll_reset * Queries_frontends_bytes_recv * Queries_frontends_bytes_sent	8 years ago
Nick Vyzas	ab87981484	Adding optional lock option to destroy_MyConn_from_pool	8 years ago
René Cannaò	703ee8ef0f	Reset connections instead of dropping them when mysql-max_stmts_per_connection is reached ... Also fixed a memory leak associate with this feature. Cleaned up a bit of code.	8 years ago
René Cannaò	18f6826ef7	Added new variable to limit the number of backend connections per second ... Variable name is `mysql-throttle_connections_per_sec_to_hostgroup` . Curently it is a global variable and limits the number of new connections per hostgroup, and not per specific node. For example, if mysql-throttle_connections_per_sec_to_hostgroup=100, no more than 100 new connections can be created on any hostgroup no matter the number of servers in that hostgroup. The default is very high (1000000) thus not changing default behaviour. Tuning this variable allows to control and throttle connections spikes to the backend servers. Added also new status variable `Server_Connections_delayed`. This is a counter of how many times Hostgroup Manager didn't return a connection because the limit was reached. It is worth to note that a single client request could make multiple requests, therefore this variable counts the number of time a new connection wasn't created and not how many requests were delayed.	9 years ago
René Cannaò	a22eb8b395	No connection from pool for fast_forward #1157 ... If a user is configured with fast_forward, no connection should be taken from the connection pool. Yet the Hostgroup Manager should know about such connection.	9 years ago
René Cannaò	dc3664ac33	Adding command PULL VERSION MYSQL SERVERS ... Experimental feature	9 years ago
René Cannaò	27e28a53ad	Servers did not recover from RO=1 to RO=0 #1039 ... Status of the server was not changed if: * was OFFLINE_HARD * was incorrectly present in myhgm.mysql_servers Added also a mutex to serialize the read_only actions	9 years ago
René Cannaò	817cda3f12	New table stats_mysql_connection_pool_reset #753	9 years ago
René Cannaò	2403b177ef	More support for Group Replication ... Enforced max_writers Enforced writer_is_also_reader Increased the number of entries in mysql_server_group_replication_log to 100 per node Lowered the minimum value for mysql-monitor_groupreplication_healthcheck_interval to 50ms Lowered the minimum value for mysql-monitor_groupreplication_healthcheck_timeout to 50ms	9 years ago
René Cannaò	c7cffc9ea7	More support for group replication	9 years ago
René Cannaò	5817905df2	Merge branch 'v1.4.0' into v1.4.0-GR ... Conflicts: lib/MySQL_HostGroups_Manager.cpp lib/MySQL_Monitor.cpp lib/ProxySQL_Admin.cpp	9 years ago
René Cannaò	a6c53d0d12	Revert "Refactor header includes."	9 years ago
Maxim Bublis	30dbcc21a8	Refactor header includes. ... * reduce build time by 25%; * remove circular dependency on `cpp.h` and other headers. * fixes issue with `my_global.h` from mariadbclient which redefines `__attribute__`, that leads to broken STL and GCC intrinsics if `<algorithm>` wasn't included prior including this header; * fixes another issue with redefined `__attribute__` which leads to `_conn_exchange_t` not being aligned to cache line size; * removes `pthread_setstacksize` calls as `my_global.h` redefines `pthread_setstacksize` to be `pthread_dummy(0)` which led to stack size being never adjusted; * add missing include guards to some headers; * remove unused proxysql_hash.h header.	9 years ago
Maxim Bublis	043a321e55	Cleanup legacy codebase.	9 years ago
René Cannaò	7ea78394f0	Second commit for GR support	9 years ago
René Cannaò	3c2ced2a7d	Drafting GR support	9 years ago
René Cannaò	ba7e37091b	Speed up LOAD MYSQL SERVERS TO RUNTIME #829 ... This commit is able to speed up LOAD MYSQL SERVERS TO RUNTIME up to 10x for very large mysql_servers table with tens of thousands of servers. Main improvements: * removed 1 unnecessary call to `generate_mysql_servers_table()` * replaced 1 call to `generate_mysql_servers_table()` with UPDATE statements when necessary * implemented new function `servers_add()` that replaces `server_add()` to perform bulk operation * replaced calls to `sqlite3_exec()` with proper parameters bindings * use of multirows INSERT statements (32 rows at the time) Miror improvements: * added new variable mysql-hostgroup_manager_verbose , 1 by default for backward compatibility and debugging * in not debug mode, access to HGM db has no shared cache * in not debug mode, tables in HGM have checks disabled Further note: * Once issue #797 is completed, `mysql_servers` in MyHGM can be simplified further	10 years ago
René Cannaò	86718882e0	Added 6 new status variables , #818 and #821 ... Added status variables: * Com_backend_change_user * Com_backend_init_db * Com_backend_set_names * Com_frontend_init_db * Com_frontend_set_names * Com_frontend_use_db	10 years ago
René Cannaò	159176627d	Thread to reset connections	10 years ago
René Cannaò	8ce083fb20	Testing pthread mutex for MHM #644 ... If MHM_PTHREAD_MUTEX is defined MySQL_HostGroups_Manager.h , MySQL_HostGroups_Manager() is compiled using pthread mutex instead od spin loop. As a lot of computation is protected by mutex, maybe it is better not to use spin loop.	10 years ago
René Cannaò	74c4bf3210	Added STRESSTEST_POOL ... Enabling STRESSTEST_POOL ProxySQL will do a lot of loops in the connection pool This is for internal testing ONLY!!!! DO NOT ENABLE IT	10 years ago
René Cannaò	861b12fe52	Minor performance improvements ... PtrArray is now header only Moved some function of MySrvConnList() into header	10 years ago
René Cannaò	be063707e9	MySrvConnList::conns is now private ... This commit is a preparation to convert conns from an array to a map	10 years ago
René Cannaò	12e1223125	Local connection cache #644 ... This is an attempt to improve scalability adding a local connection cache per thread	10 years ago
René Cannaò	a9395cd087	Adding comment field per issue #643 ... Added: * mysql_query_rules.comment VARCHAR * mysql_replication_hostgroups.comment VARCHAR * mysql_servers.comment VARCHAR NOT NULL DEFAULT '' All these tables support online upgrade from previous version (without such fields) at startup. Introduced also a parser for escaping strings with single quotes: double quotes are allowed without extra escaping	10 years ago
René Cannaò	b8d3bd884c	Added more memory metrics #634 ... * mysql_backend_buffers_bytes * mysql_frontend_buffers_bytes * mysql_session_internal_bytes * ConnPool_memory_bytes	10 years ago
René Cannaò	517c35f25f	Renamed function ... Renamed MySQL_HostGroups_Manager::set_server_current_latency_ms() to MySQL_HostGroups_Manager::set_server_current_latency_us()	10 years ago
René Cannaò	0fef6b544c	Added global variables mysql-default_max_latency_ms	10 years ago
René Cannaò	9019c6b3d5	Added columns use_ssl and max_latency_ms to mysql_servers ... These two new columns will be used to: - enable SSL on a per server basis - define maximum latency for a server to be consider usable: this will be a key element for multi DC support	10 years ago
René Cannaò	fc9ab855da	First draft for bugs #543 ... When a server isn't responding to ping, it is flagged as shunned and all the connections need to be dropped. All the connections must be dropped before the server is brought back online	10 years ago
René Cannaò	a3dafd830e	Added status variable Servers_table_version ... This status variable is incremented every time mysql_servers table is reloaded	10 years ago
René Cannaò	79ab0221fc	mysql_servers supports status=4 ... This is MYSQL_SERVER_STATUS_SHUNNED_REPLICATION_LAG Should fix issue #475	10 years ago
René Cannaò	ab3b737df1	Extending global mysql status ... In order to understand the performance improvement related to how ProxySQL filters autocommit/commit/rollback, the follows variables were added in GLOBAL MYSQL STATUS - Com_autocommit - Com_autocommit_filtered - Com_commit - Com_commit_filtered - Com_rollback - Com_rollback_filtered	10 years ago
Andrei-Adnan Ismail	b6f0b2710c	Merge with master #428	11 years ago
René Cannaò	27ad3e6b6b	Improved handling of idle connections ... Idle connections are dropped more aggressively	11 years ago
Andrei-Adnan Ismail	ce8fd30fc2	#428 Add new variables in MyHGM->status to track server metrics	11 years ago
René Cannaò	2ab0ce82bf	Fix bug #417 ... Closes #417 Closes #418	11 years ago
René Cannaò	c3c7be32b2	Removed read_only_action(SQLite3_result *) #395	11 years ago
René Cannaò	13ce24f17b	read_only_action() triggers a switch (#395) ... class MySQL_HostGroups_Manager() has now also access to admindb added function MySQL_HostGroups_Manager::purge_mysql_servers_table() to remove entries from mysql_servers table from within MyHGM purge_mysql_servers_table() and generate_mysql_servers_table() are called in multiple part of the code to get consistent view of mysql backends added function MySQL_HostGroups_Manager::read_only_action(char*,int,int) responsible for triggering a traffic switch	11 years ago
René Cannaò	ee9b62c9de	Further work on #395 ... - implemented table monitor.mysql_server_read_only_log - implemented code to monitor and log read_only values - implemented new thread MySQL_Monitor::monitor_read_only() - skeleton for read_only_action()	11 years ago
René Cannaò	e2a457777f	Extended SAVE MYSQL SERVERS FROM RUNTIME (#395) ... ProxySQL_Admin::save_mysql_servers_runtime_to_database() now also calls MySQL_HostGroups_Manager::dump_table_mysql_replication_hostgroups()	11 years ago
René Cannaò	94fc45f9a7	MYHGM_MYSQL_REPLICATION_HOSTGROUPS (#396)	11 years ago
René Cannaò	f7b87116e0	Extended stats_mysql_connection_pool per #342 ... Added columns Bytes_data_sent and Bytes_data_recv These columns counts only data, not metadata	11 years ago
René Cannaò	95b971a660	More development on #358 ... Added status MYSQL_SERVER_STATUS_SHUNNED_REPLICATION_LAG as internal only (not configurable) Added MySQL_HostGroups_Manager::replication_lag_action() to communicate replication lag to connection pool and take action	11 years ago
René Cannaò	ea880ffaf3	More development on #358 ... Logging on table mysql_server_replication_lag_log List of servers is retrieved from MyHGM	11 years ago
René Cannaò	71b26a7ae0	More development on #358 ... Added MySQL_HostGroups_Manager::execute_query() to query directly MyHGM's db Bug fixes	11 years ago
René Cannaò	6d496d46ee	Implementation of Automatic shun failing backends (issue #339)	11 years ago
René Cannaò	cdffa376ca	Added ConnOK and ConnERR in stats_mysql_connection_pool , per issue #338	11 years ago
René Cannaò	b9c4548ab7	Implementation of mysql status table named stats_mysql_global (issue #328) ... Status variables implemented so far: - Client_Connections_aborted - Client_Connections_connected - Client_Connections_created - Questions - Slow_queries Also created alias command SHOW MYSQL STATUS	11 years ago
René Cannaò	d4a520acae	visual improvement of SHOW CREATE TABLE	11 years ago
René Cannaò	046ed74274	Introduced table stats_mysql_connection_pool with connection pool statistics	11 years ago
René Cannaò	304bd220ad	Added counters to connection pool	11 years ago
René Cannaò	76edfb126f	Further implementation of libmariadb client	11 years ago
René Cannaò	29e19b78f1	Added max_connections (issue #250)	11 years ago
René Cannaò	94c38a41cd	Improving support for compression (issue #220) ... Small bug fix	11 years ago
René Cannaò	6ba6c52826	Added compression field in mysql_servers table ... Issue #220	11 years ago
René Cannaò	568ef1b5d1	Bulk delete of connections when server status is not online ... Used by issue #218	11 years ago
René Cannaò	308f3a8a90	Further development on MySQL Hostgroups Manager ... Implemented functions: - MySQL_HostGroups_Manager::dump_table_mysql_servers() - MySQL_HostGroups_Manager::generate_mysql_servers_table() - Standard_ProxySQL_Admin::save_mysql_servers_runtime_to_database() (issue #17) Improved Standard_ProxySQL_Admin::load_mysql_servers_to_runtime() to process also status Improved MySQL_HostGroups_Manager::commit() to modified MySrvCs Database in MyHGM is accessible via Admin (issue #212) Enforced debugging if specified at the command line (issue #213)	11 years ago
René Cannaò	21b20c0257	Connection pool improvements , in beta ... Developed class StatCounters to keep time series counters Added 2 new instances of StatCounters: - MySQL_Session::command_counters; - ProxySQL_Poll::loop_counters; Counters are dispayed in "dbg thread status" Defined new variables mysql-connect_timeout_server_error and mysql-connect_timeout_server (issue #202 and #203) . They are defined but not implemented yet. Fixed two crashing bug when "gdb command" was trying to access: - its own Query_Info if this one was not initialized - Query_Info of another thread if this one was not initialized Introduced new variable ProxySQL_Poll:poll_timeout that Session can overwrite to apply a timeout different than mysql_thread___poll_timeout Added variable MySQL_Connection::last_time_used , updated at creation time and when calling push_MyConn_to_pool(). for each Connection add a "last_time_used" Added function get_multiple_idle_connections() Implementing Standard_MySQL_Threads_Handler::connection_manager_thread() , but doesn't seems to be a good idea ==== New attempt for connection handling MySQL_Session has a new bool variable : connections_handler Standard_MySQL_Thread has a new variable PtrArray : mysql_sessions_connections_handler Added new function Standard_MySQL_Thread::register_session_connection_handler SESSIONS_FOR_CONNECTIONS_HANDLER sessions are created in Standard_MySQL_Thread::init() Added new function Standard_MySQL_Thread::process_all_sessions_connections_handler() New variables in Standard_MySQL_Thread: MySQL_Connection **my_idle_conns; bool processing_idles; unsigned long long last_processing_idles; Added DSS STATE_PING_SENT MySQL_Session::handler___status_WAITING_SERVER_DATA___STATE_PING_SENT	11 years ago
René Cannaò	181ed20bd3	Development on Connection Pool and Multiplexing ... In MySQL_HostGroups_Manager: - added function add() for MySrvC - fixed few typos : poll => pool - added locking in several functions First cleanup of MySQL_Hostgroup_Entry In MySQL_Protocol: - added variable prot_status - added variable fd - added function process_pkt_EOF() - variable parent is a MySrvC * - extended functions pkt_ok() , pkt_end() and pkt_handshake_server() to update prot_status - added function process_pkt_EOF() - fixed warns to be uint16_t instead of uint64_t In MySQL_Data_Stream: - fixed bug on read_from_net() - added function unplug_backend() In MySQL_Session: - attempting multiplexing if the connection has no active transactions and in case of SELECT statements - destination_hostgroup returned in qpo is applied	11 years ago
René Cannaò	bc8fc47ed6	Introducing MySQL_HostGroups_Manager ... MySQL_HostGroups_Manager merges the best of: - MySQL_HostGroups_Handler - MySQL_Connection_Pool Still in development: will be shadowing the original Handler and ConnPool	11 years ago