256 Commits (a1f39bf784dbbb6facd8abef44aa7626bdf41585)

Author	SHA1	Message	Date
René Cannaò	226f71d4c3	Connections are sent to purge thread if queue<100	9 years ago
René Cannaò	159176627d	Thread to reset connections	9 years ago
René Cannaò	799c7d411a	Merge pull request #737 from ton31337/feature/do_not_shunn_on_few_error_codes ... Do not shunt the server if max_user_connections is reached for user	10 years ago
Donatas Abraitis	0e062058e6	Do not shunt the server if max_user_connections is reached for user	10 years ago
René Cannaò	01395f93f2	Merge branch 'v1.2.3-644' into 1.3.0-alpha	10 years ago
René Cannaò	5330000348	Added variables to control prepared statements ... - mysql-max_stmts_per_connection - mysql-max_stmts_cache	10 years ago
René Cannaò	c987da5b03	Various changes ... - "Prepare" wasn't listed in SHOW PROCESSLIST - during ~MySQL_Connection(), all	10 years ago
René Cannaò	8ce083fb20	Testing pthread mutex for MHM #644 ... If MHM_PTHREAD_MUTEX is defined MySQL_HostGroups_Manager.h , MySQL_HostGroups_Manager() is compiled using pthread mutex instead od spin loop. As a lot of computation is protected by mutex, maybe it is better not to use spin loop.	10 years ago
René Cannaò	861b12fe52	Minor performance improvements ... PtrArray is now header only Moved some function of MySrvConnList() into header	10 years ago
René Cannaò	be063707e9	MySrvConnList::conns is now private ... This commit is a preparation to convert conns from an array to a map	10 years ago
René Cannaò	7d3814e5b9	Scalability improvements #644 ... Some minor yet important tweak to spinloop Replaced rand() with fastrand()	10 years ago
René Cannaò	f27734390e	Merge branch 'v1.2.2-RO-loop' into v1.2.2	10 years ago
René Cannaò	d214e2f60b	Fix bug #667	10 years ago
René Cannaò	12e1223125	Local connection cache #644 ... This is an attempt to improve scalability adding a local connection cache per thread	10 years ago
René Cannaò	79d82929a5	Changed severity of messages when node is shunned ... When a server is shunned because of errors, it is now logged as error When a server is shunned because of replication lag, it is now logged as warning	10 years ago
René Cannaò	e6621ef5b3	Fix bug in read_only_action due to comment #643	10 years ago
René Cannaò	54c13e1dc1	Copy comment in read_only_action ... Issue #643	10 years ago
René Cannaò	a9395cd087	Adding comment field per issue #643 ... Added: * mysql_query_rules.comment VARCHAR * mysql_replication_hostgroups.comment VARCHAR * mysql_servers.comment VARCHAR NOT NULL DEFAULT '' All these tables support online upgrade from previous version (without such fields) at startup. Introduced also a parser for escaping strings with single quotes: double quotes are allowed without extra escaping	10 years ago
René Cannaò	95948d7eb0	Fix for bug #641 ... A server is copied from reader hostgroup to writer hostgroup only if absent or OFFLINE_HARD in writer hostgroup	10 years ago
René Cannaò	e94df8264a	Revert last commit, and added comment	10 years ago
René Cannaò	dc804eccea	Fix bug in read_only_action()	10 years ago
René Cannaò	b8d3bd884c	Added more memory metrics #634 ... * mysql_backend_buffers_bytes * mysql_frontend_buffers_bytes * mysql_session_internal_bytes * ConnPool_memory_bytes	10 years ago
René Cannaò	a0c994ea43	Server was incorrectly set to SHUNNED ... Server was incorrectly set to SHUNNED without checking previous status See #627	10 years ago
René Cannaò	8c342ddf18	Incorrect status in shun_and_killall() ... MySQL_HostGroups_Manager::shun_and_killall() incorrectly set status=SHUNNED for server in OFFLINE_SOFT	10 years ago
René Cannaò	1126001dd8	Return SHUNNED if status=4 ... If status=4 , MySQL_HostGroups_Manager::dump_table_mysql_servers() should return SHUNNED Previous nothing was returned for status=4 (MYSQL_SERVER_STATUS_SHUNNED_REPLICATION_LAG) , caausing the crashing bug #619 dump_table_mysql_servers()	10 years ago
René Cannaò	77d2a9c1ad	Removed a compiler warning	10 years ago
René Cannaò	c11303b117	Servers were incorrectly brought back online ... Fix issue #566 Regression introducted in #531	10 years ago
René Cannaò	b19b21bb56	Fixed minor typo	10 years ago
René Cannaò	510dde94a6	Merge branch 'max_latency_ms' into v1.2.0	10 years ago
René Cannaò	0f70d24b13	Merge branch 'ssl' into v1.2.0	10 years ago
René Cannaò	fe12d26fe4	Implementation of mysql-connection_max_age_ms ... If a connection has a lifetime greated than mysql-connection_max_age_ms , it is dropped See #563	10 years ago
René Cannaò	f27bb873f0	MySQL_Monitor call to set_server_current_latency_us ... Fixed a wrong implementation in previous commit This commit also updates stats_mysql_connection_pool	10 years ago
René Cannaò	517c35f25f	Renamed function ... Renamed MySQL_HostGroups_Manager::set_server_current_latency_ms() to MySQL_HostGroups_Manager::set_server_current_latency_us()	10 years ago
René Cannaò	81e8239917	Connection pool considers current_latency_us ... When evaluating if a host can be used, current_latency_us is taken into consideration	10 years ago
René Cannaò	0fef6b544c	Added global variables mysql-default_max_latency_ms	10 years ago
René Cannaò	41ee4e5b85	Fixed typo in previous commit related to SSL and latency ... Also testing SSL connection with hardcoded certificates	10 years ago
René Cannaò	9019c6b3d5	Added columns use_ssl and max_latency_ms to mysql_servers ... These two new columns will be used to: - enable SSL on a per server basis - define maximum latency for a server to be consider usable: this will be a key element for multi DC support	10 years ago
René Cannaò	820dd6357e	Fixed major bug introduced in #545 ... The math was balancing connections was incorrect	10 years ago
René Cannaò	00caba00fc	Minor bug fixes on #544 and #545	10 years ago
René Cannaò	db33ee961e	Balance connections usage based on weight and used connections #545 ... First implementation	10 years ago
René Cannaò	fc9ab855da	First draft for bugs #543 ... When a server isn't responding to ping, it is flagged as shunned and all the connections need to be dropped. All the connections must be dropped before the server is brought back online	10 years ago
René Cannaò	751ba624a3	Auto tuning shun_recovery_time_sec ... See issues #530 and #531 Closes #530 Closes #531	10 years ago
René Cannaò	66280b1bd3	Fixed a race condition in LOAD/SAVE MYSQL SERVERS	10 years ago
René Cannaò	c6b7f6db52	Merge branch 'servers_version' into beta7	10 years ago
René Cannaò	a3dafd830e	Added status variable Servers_table_version ... This status variable is incremented every time mysql_servers table is reloaded	10 years ago
René Cannaò	eb012cb782	Removed a not relevant verbose line	10 years ago
René Cannaò	376b037585	Added support for runtime mysql servers tables ... Issue #488 - runtime_mysql_replication_hostgroups - runtime_mysql_servers	10 years ago
René Cannaò	dca5dd7e8f	Do not shun for error in replication lag ... error in retrieving replication lag does not shun a slave. See #479	10 years ago
René Cannaò	2ea4149b0b	Fixed accounting of Server_Connections_connected	10 years ago
René Cannaò	efbdf3b617	Try to free mysql buffers when possible ... Free mysql->net.buff when beyond 64KB	10 years ago
René Cannaò	89c7fad16e	Fixed bug in accounting Server_Connections ... Server_Connections_connected and Server_Connections_created were inverted	10 years ago
René Cannaò	abef155790	Prevent "Unknown database" to shun backends ... Issue #464 Attempt to connect to a not existing schema caused the backend to be shunned. This patch fix this issue. Closes #464	10 years ago
René Cannaò	6b1a449260	Fix for bug #461 ... MySQL_Connection::~MySQL_Connection() now only attempts to send the QUIT command The connection is closed no matter if the server is present or not	10 years ago
René Cannaò	ab3b737df1	Extending global mysql status ... In order to understand the performance improvement related to how ProxySQL filters autocommit/commit/rollback, the follows variables were added in GLOBAL MYSQL STATUS - Com_autocommit - Com_autocommit_filtered - Com_commit - Com_commit_filtered - Com_rollback - Com_rollback_filtered	10 years ago
René Cannaò	87845f7e2b	Implement compression on backend (#363) ... For compatibility reason, compression flag on mysql_servers table is not changed: values greater than 1 are accepted, but handled as 1 Closes #363	10 years ago
Andrei-Adnan Ismail	1bdfdd448d	#428 Delete merge conflict markers	11 years ago
Andrei-Adnan Ismail	b6f0b2710c	Merge with master #428	11 years ago
René Cannaò	a9dd642a47	Improving variables name (#420) ... Renamed mysql-shun_recovery_time to mysql-shun_recovery_time_sec	11 years ago
René Cannaò	3ce2c25292	More verbose output in case of broken connections	11 years ago
René Cannaò	27ad3e6b6b	Improved handling of idle connections ... Idle connections are dropped more aggressively	11 years ago
Andrei-Adnan Ismail	12ba711d8d	#428 Fix incrementing/decrementing patterns of the server global metrics	11 years ago
Andrei-Adnan Ismail	c4ff716e69	#428 Increment global server-related metrics	11 years ago
Andrei-Adnan Ismail	ce8fd30fc2	#428 Add new variables in MyHGM->status to track server metrics	11 years ago
Andrei-Adnan Ismail	1180e60a8c	Merge pull request #401 from aismail/388-document-global-variables ... 388 document global variables	11 years ago
René Cannaò	0e1db43273	More on bug #417	11 years ago
René Cannaò	2ab0ce82bf	Fix bug #417 ... Closes #417 Closes #418	11 years ago
René Cannaò	e6dd56cf07	Added global variable mysql-monitor_writer_is_also_reader , #395 ... When this variable is set, a promoted master is also marked as slave	11 years ago
René Cannaò	c3c7be32b2	Removed read_only_action(SQLite3_result *) #395	11 years ago
René Cannaò	13ce24f17b	read_only_action() triggers a switch (#395) ... class MySQL_HostGroups_Manager() has now also access to admindb added function MySQL_HostGroups_Manager::purge_mysql_servers_table() to remove entries from mysql_servers table from within MyHGM purge_mysql_servers_table() and generate_mysql_servers_table() are called in multiple part of the code to get consistent view of mysql backends added function MySQL_HostGroups_Manager::read_only_action(char*,int,int) responsible for triggering a traffic switch	11 years ago
René Cannaò	ee9b62c9de	Further work on #395 ... - implemented table monitor.mysql_server_read_only_log - implemented code to monitor and log read_only values - implemented new thread MySQL_Monitor::monitor_read_only() - skeleton for read_only_action()	11 years ago
René Cannaò	f129db3d1f	Dump mysql_replication_hostgroups in error log (#395) ... This is done in MySQL_HostGroups_Manager::generate_mysql_servers_table()	11 years ago
René Cannaò	e2a457777f	Extended SAVE MYSQL SERVERS FROM RUNTIME (#395) ... ProxySQL_Admin::save_mysql_servers_runtime_to_database() now also calls MySQL_HostGroups_Manager::dump_table_mysql_replication_hostgroups()	11 years ago
René Cannaò	379424d099	More on mysql_replication_hostgroups (#395)	11 years ago
Andrei Ismail	9254cd6ee0	#388 Document get_multiple_idle_connections	11 years ago
René Cannaò	34e83e342c	More verbose when shunning servers	11 years ago
René Cannaò	4bf5fda572	Implemented variable threshold_query_length , #366	11 years ago
René Cannaò	f7b87116e0	Extended stats_mysql_connection_pool per #342 ... Added columns Bytes_data_sent and Bytes_data_recv These columns counts only data, not metadata	11 years ago
René Cannaò	95b971a660	More development on #358 ... Added status MYSQL_SERVER_STATUS_SHUNNED_REPLICATION_LAG as internal only (not configurable) Added MySQL_HostGroups_Manager::replication_lag_action() to communicate replication lag to connection pool and take action	11 years ago
René Cannaò	ea880ffaf3	More development on #358 ... Logging on table mysql_server_replication_lag_log List of servers is retrieved from MyHGM	11 years ago
René Cannaò	71b26a7ae0	More development on #358 ... Added MySQL_HostGroups_Manager::execute_query() to query directly MyHGM's db Bug fixes	11 years ago
René Cannaò	315e2f2f66	Bugfix: as precaution, MySQL_HostGroups_Manager::push_MyConn_to_pool() checks that the connection is idle (ASYNC_IDLE) before pushing it back in the connection pool. If not, the connection is deleted.	11 years ago
René Cannaò	6d496d46ee	Implementation of Automatic shun failing backends (issue #339)	11 years ago
René Cannaò	cdffa376ca	Added ConnOK and ConnERR in stats_mysql_connection_pool , per issue #338	11 years ago
René Cannaò	b9c4548ab7	Implementation of mysql status table named stats_mysql_global (issue #328) ... Status variables implemented so far: - Client_Connections_aborted - Client_Connections_connected - Client_Connections_created - Questions - Slow_queries Also created alias command SHOW MYSQL STATUS	11 years ago
René Cannaò	e7b3abedd0	Dump mysql_servers information on error log	11 years ago
René Cannaò	42b0e6f54a	Implemented KILL CONNECTION ... Also replaced some proxy_error() with proxy_warning()	11 years ago
René Cannaò	e065fa5055	Changes in mysql_servers will automatically trigger a signal_all_threads()	11 years ago
René Cannaò	0507bf7bfd	Added new variable free_connections_pct ... If the number of free connections is greater than free_connections_pct percentage of max_connections for that specific host, all connections idle for longer than ping_interval_server are closed instead of sending PING	11 years ago
René Cannaò	046ed74274	Introduced table stats_mysql_connection_pool with connection pool statistics	11 years ago
René Cannaò	96c0904281	Handling removal of servers from mysql_servers	11 years ago
René Cannaò	304bd220ad	Added counters to connection pool	11 years ago
René Cannaò	ce63fd9a58	Implemented CHANGE_USER	11 years ago
René Cannaò	76edfb126f	Further implementation of libmariadb client	11 years ago
René Cannaò	29e19b78f1	Added max_connections (issue #250)	11 years ago
René Cannaò	c1678558c1	Further development to support compression: Issue #219 ... Added functions: MySQL_Data_Stream::generate_compressed_packet() Extended changes in: MySQL_Data_Stream::array2buffer() MySQL_Data_Stream::buffer2array() Further improvements: Added global variables mysql-have_compress : issue #225 MySQL_Protocol::process_pkt_initial_handshake() support upper and lower capabilities Added timestamp and timediff in proxy_debug_func() : issue #228	11 years ago
René Cannaò	94c38a41cd	Improving support for compression (issue #220) ... Small bug fix	11 years ago
René Cannaò	6ba6c52826	Added compression field in mysql_servers table ... Issue #220	11 years ago
René Cannaò	568ef1b5d1	Bulk delete of connections when server status is not online ... Used by issue #218	11 years ago
René Cannaò	e8d50d9f0a	Improvement on connection pool ... Issues #215 , #216 and #217 215 : Connection pool should not return connections if server status is not ONLINE 216 : Connection pool should return connections based on weight 217 : Crash if no backend	11 years ago
René Cannaò	308f3a8a90	Further development on MySQL Hostgroups Manager ... Implemented functions: - MySQL_HostGroups_Manager::dump_table_mysql_servers() - MySQL_HostGroups_Manager::generate_mysql_servers_table() - Standard_ProxySQL_Admin::save_mysql_servers_runtime_to_database() (issue #17) Improved Standard_ProxySQL_Admin::load_mysql_servers_to_runtime() to process also status Improved MySQL_HostGroups_Manager::commit() to modified MySrvCs Database in MyHGM is accessible via Admin (issue #212) Enforced debugging if specified at the command line (issue #213)	11 years ago
René Cannaò	2709cc369f	Improvements on backend management ... Issues #208 and #209	11 years ago
René Cannaò	01834ee2f3	Adding some proxy_debug()	11 years ago
René Cannaò	21b20c0257	Connection pool improvements , in beta ... Developed class StatCounters to keep time series counters Added 2 new instances of StatCounters: - MySQL_Session::command_counters; - ProxySQL_Poll::loop_counters; Counters are dispayed in "dbg thread status" Defined new variables mysql-connect_timeout_server_error and mysql-connect_timeout_server (issue #202 and #203) . They are defined but not implemented yet. Fixed two crashing bug when "gdb command" was trying to access: - its own Query_Info if this one was not initialized - Query_Info of another thread if this one was not initialized Introduced new variable ProxySQL_Poll:poll_timeout that Session can overwrite to apply a timeout different than mysql_thread___poll_timeout Added variable MySQL_Connection::last_time_used , updated at creation time and when calling push_MyConn_to_pool(). for each Connection add a "last_time_used" Added function get_multiple_idle_connections() Implementing Standard_MySQL_Threads_Handler::connection_manager_thread() , but doesn't seems to be a good idea ==== New attempt for connection handling MySQL_Session has a new bool variable : connections_handler Standard_MySQL_Thread has a new variable PtrArray : mysql_sessions_connections_handler Added new function Standard_MySQL_Thread::register_session_connection_handler SESSIONS_FOR_CONNECTIONS_HANDLER sessions are created in Standard_MySQL_Thread::init() Added new function Standard_MySQL_Thread::process_all_sessions_connections_handler() New variables in Standard_MySQL_Thread: MySQL_Connection **my_idle_conns; bool processing_idles; unsigned long long last_processing_idles; Added DSS STATE_PING_SENT MySQL_Session::handler___status_WAITING_SERVER_DATA___STATE_PING_SENT	11 years ago
René Cannaò	cf0aabe7dd	Bug fix for issue #179	11 years ago
René Cannaò	181ed20bd3	Development on Connection Pool and Multiplexing ... In MySQL_HostGroups_Manager: - added function add() for MySrvC - fixed few typos : poll => pool - added locking in several functions First cleanup of MySQL_Hostgroup_Entry In MySQL_Protocol: - added variable prot_status - added variable fd - added function process_pkt_EOF() - variable parent is a MySrvC * - extended functions pkt_ok() , pkt_end() and pkt_handshake_server() to update prot_status - added function process_pkt_EOF() - fixed warns to be uint16_t instead of uint64_t In MySQL_Data_Stream: - fixed bug on read_from_net() - added function unplug_backend() In MySQL_Session: - attempting multiplexing if the connection has no active transactions and in case of SELECT statements - destination_hostgroup returned in qpo is applied	11 years ago
René Cannaò	bc8fc47ed6	Introducing MySQL_HostGroups_Manager ... MySQL_HostGroups_Manager merges the best of: - MySQL_HostGroups_Handler - MySQL_Connection_Pool Still in development: will be shadowing the original Handler and ConnPool	11 years ago