proxysql

Commit Graph

Author	SHA1	Message	Date
René Cannaò	df698870ea	Call of fnctl() with FD_CLOEXEC on frontend When a frontend connection is created. This to prevent excessive FDs when forking	10 years ago
René Cannaò	d885d4a737	Implementation of max retries Added global variables mysql-query_retries_on_failure (default 1) Added new field mysql_query_rules.retries (default NULL)	10 years ago
René Cannaò	9318d1a815	More matching criteria Issue #537 mysql_query_rules now matches also on : - client_addr - proxy_addr - proxy_port - digest	10 years ago
René Cannaò	8e81495bee	Improved logging Added logging information for: - client - server - hostgroup_id - digest - duration	10 years ago
René Cannaò	fe12d26fe4	Implementation of mysql-connection_max_age_ms If a connection has a lifetime greated than mysql-connection_max_age_ms , it is dropped See #563	10 years ago
René Cannaò	c1a18aa2eb	Cleaned unused code Some legacy code is not currently used: - removed reference to MySQL_Data_Stream::move_from_OUT_to_OUTpending() - removed reference to MySQL_Data_Stream::PSarrayOUTpending	10 years ago
René Cannaò	53bc17092c	New implementation of fast forward , #528	10 years ago
René Cannaò	c101fad268	First draft on mirroring feature Add new variable MySQL_Session::mirror (false by default) Add new struct MySQL_Session::mirrorPkt (false by default) These functions return immediately if this is a mirror session: * MySQL_Protocol::generate_pkt_EOF() * MySQL_Protocol::generate_pkt_ERR() * MySQL_Protocol::generate_pkt_OK() * MySQL_Protocol::generate_pkt_column_count() * MySQL_Protocol::generate_pkt_field() * MySQL_Protocol::generate_pkt_row3() MySQL_ResultSet::MySQL_ResultSet() exits almost immediately if this is a mirror session Most of the code of these functions is not executed if this is a mirror session: * MySQL_ResultSet::add_eof() * MySQL_ResultSet::get_resultset() In MySQL_Session::writeout() : * `client_myds->write_to_net_poll()` is called only if this is not a mirror session In MySQL_Session::handler(): * if query is a `SELECT` (hardcoded for now) : create a new session and mark it as `mirror=true` duplicate the query and send it to the new session * if `mirror==true` : pretend to read a new query from c`lient_myds` proceed normally (with the only exception that no data can be sent to a client) In MySQL_Thread::process_all_sessions() : * if `mirror==true` and `status==WAITING_CLIENT_DATA` it means the session is "completed" so it get destroyed Limitations: * it currently doesn't support large packets * doesn't support different charset * doesn't support transactions	10 years ago
René Cannaò	5a54234364	Removed reference to query_SQL	10 years ago
René Cannaò	60ddf5d8e4	Changes on QC removed KV_Btree_Array.cpp removed query_SQL from MySQL_Data_Stream added some documentation for QC_entry_t Query_Cache::get() and Query_Cache::set() now requires also the length of the key Query_Cache::get() and Query_Cache::set() now process hk (the hash key) using the length of the key	10 years ago
René Cannaò	f85ca85b4e	Fix bug #449 Closes 449	10 years ago
René Cannaò	52f0d3fbe1	Fixing memory overcommitting , see #431 Also some code clean up	10 years ago
René Cannaò	556ff9f733	Bug fixes and performance improvement Bug fixes: Fixed a bug introduced by `414588e` Removed a setting in MySQL_Data_Stream::return_MySQL_Connection_To_Pool() Performance improvement for large resultset: Reverted and improved changes in `4a5bb59`	11 years ago
René Cannaò	b2a57d238f	For #343 : removed struct mysql_real_query in MySQL_Data_Stream and replaced with class MyDS_real_query to hold only the packet coming from client Bugfix in Query_Processor::delete_QP_out() : attempt to free unallocated qpo Removed commented code	11 years ago
René Cannaò	84c0964d64	Usabilility improvements: - telnet_admin_ifaces disabled as currently not implemented - telnet_stats_ifaces disabled as currently not implemented - ProxySQL_Admin::get_variable() uses a safer version of strdup() - default config file is, in order: proxysql.cnf , proxysql.cfg , /etc/proxysql.cnf , /etc/proxysql.cfg - default datadir moved from /var/run/proxysql to current working directory Minor bug fixes	11 years ago
René Cannaò	c5935bb8d5	Improvement on MySQL protocol with regards to compressed connections and large packets (>16MB)	11 years ago
René Cannaò	9ca3bdf7e6	Handle large packets from client	11 years ago
René Cannaò	85078fec07	Configurable MySQL Query Rules in config file Implemented LOAD MYSQL QUERY RULES FROM CONFIG via ProxySQL_Admin::Read_MySQL_Query_Rules_from_configfile() Fixed bug in ProxySQL_Admin::save_mysql_query_rules_from_runtime()	11 years ago
René Cannaò	fa881667e9	processlist shows client info	11 years ago
René Cannaò	752e653791	Connection timeout and small improvements To handle connect timeout: - added MySQL_Data_Stream::destroy_MySQL_Connection() - new async status: ASYNC_CONNECT_TIMEOUT - "select @@version_comment limit 1" is answered by proxysql and not forwarded to any backend - added MySQL_Data_Stream variables connect_retries_on_failure and max_connect_time - added global variables mysql-connect_timeout_server_max and mysql-connect_retries_on_failure Improvement: proxysql returns more info in COM_STATISTICS: clients connected and uptime	11 years ago
René Cannaò	1a43eb0aea	Bugfixes - memory leak - other errors as reported by valgrind	11 years ago
René Cannaò	76edfb126f	Further implementation of libmariadb client	11 years ago
René Cannaò	6c44e9d96f	Further attempt to use MariaDB Client Library	11 years ago
René Cannaò	10b5f6da6d	Backend are now pinged using MariaDB Client Library	11 years ago
René Cannaò	b8d6fe838b	Drafting session_fast_forward (issue #36 )	11 years ago
René Cannaò	414588e046	Reducing number of poll() (issue #247 )	11 years ago
René Cannaò	ebf72f6682	Improved support for compression, issue #219 Now compression on backend seems working Fixed issue #209	11 years ago
René Cannaò	c1678558c1	Further development to support compression: Issue #219 Added functions: MySQL_Data_Stream::generate_compressed_packet() Extended changes in: MySQL_Data_Stream::array2buffer() MySQL_Data_Stream::buffer2array() Further improvements: Added global variables mysql-have_compress : issue #225 MySQL_Protocol::process_pkt_initial_handshake() support upper and lower capabilities Added timestamp and timediff in proxy_debug_func() : issue #228	11 years ago
René Cannaò	6ba6c52826	Added compression field in mysql_servers table Issue #220	11 years ago
René Cannaò	17ddec943e	Added variables ping_timout_server and ping_interval_server Issues #205 and #206	11 years ago
René Cannaò	9cdebef9ca	Bug fix and improved debugging For better debugging, added functions: MySQL_Data_Stream::clean_net_failure() MySQL_Data_Stream::set_net_failure() MySQL_Data_Stream::setDSS_STATE_QUERY_SENT_NET() MySQL_Session::set_unhealthy() Added condition mybe->server_myds->PSarrayOUTpending->len==0 to determine if DSS can be STATE_QUERY_SENT_NET	11 years ago
René Cannaò	21b20c0257	Connection pool improvements , in beta Developed class StatCounters to keep time series counters Added 2 new instances of StatCounters: - MySQL_Session::command_counters; - ProxySQL_Poll::loop_counters; Counters are dispayed in "dbg thread status" Defined new variables mysql-connect_timeout_server_error and mysql-connect_timeout_server (issue #202 and #203) . They are defined but not implemented yet. Fixed two crashing bug when "gdb command" was trying to access: - its own Query_Info if this one was not initialized - Query_Info of another thread if this one was not initialized Introduced new variable ProxySQL_Poll:poll_timeout that Session can overwrite to apply a timeout different than mysql_thread___poll_timeout Added variable MySQL_Connection::last_time_used , updated at creation time and when calling push_MyConn_to_pool(). for each Connection add a "last_time_used" Added function get_multiple_idle_connections() Implementing Standard_MySQL_Threads_Handler::connection_manager_thread() , but doesn't seems to be a good idea ==== New attempt for connection handling MySQL_Session has a new bool variable : connections_handler Standard_MySQL_Thread has a new variable PtrArray : mysql_sessions_connections_handler Added new function Standard_MySQL_Thread::register_session_connection_handler SESSIONS_FOR_CONNECTIONS_HANDLER sessions are created in Standard_MySQL_Thread::init() Added new function Standard_MySQL_Thread::process_all_sessions_connections_handler() New variables in Standard_MySQL_Thread: MySQL_Connection **my_idle_conns; bool processing_idles; unsigned long long last_processing_idles; Added DSS STATE_PING_SENT MySQL_Session::handler___status_WAITING_SERVER_DATA___STATE_PING_SENT	11 years ago
René Cannaò	663a1b5630	Further simplification of connection management. Removed MySQL_Connection *myconn from MySQL Backend Removed server_myds and server_myds from MySQL_Session Fixed a bug that caused an infinite loop in case the backed was not able to create new connection	11 years ago
René Cannaò	209d784397	Drafting auto-reconnect Issue #195 and relative subtickets: - issue #191 - issue #192 - issue #194	11 years ago
René Cannaò	b46fa7c5f2	Fix on bug #193	11 years ago
René Cannaò	5619f1293b	Fix broken pipe (SIGPIPE) when backend connections is closed Fix for bug #183	11 years ago
René Cannaò	71ca1453fc	Fix some memory issues detected by valgrind	11 years ago
René Cannaò	5851693505	Removed "MYSQL myconn" from MySQL_Connection	11 years ago
René Cannaò	181ed20bd3	Development on Connection Pool and Multiplexing In MySQL_HostGroups_Manager: - added function add() for MySrvC - fixed few typos : poll => pool - added locking in several functions First cleanup of MySQL_Hostgroup_Entry In MySQL_Protocol: - added variable prot_status - added variable fd - added function process_pkt_EOF() - variable parent is a MySrvC * - extended functions pkt_ok() , pkt_end() and pkt_handshake_server() to update prot_status - added function process_pkt_EOF() - fixed warns to be uint16_t instead of uint64_t In MySQL_Data_Stream: - fixed bug on read_from_net() - added function unplug_backend() In MySQL_Session: - attempting multiplexing if the connection has no active transactions and in case of SELECT statements - destination_hostgroup returned in qpo is applied	11 years ago
René Cannaò	9b452dfa0d	Splitting MySQL_Session:handler() in many many smaller functions	11 years ago
René Cannaò	5a3f95eb19	MySQL Backends can now be available via Unix Socket Domain: issue #161	11 years ago
René Cannaò	13eb687335	More work on issue #168 Implemented new class Query_Info used in MySQL_Session Added MYSQL_COM_QUERY_command MYSQL_COM_QUERY_COMMIT Added virtual function Query_Processor::query_parser_update_counters() curtime moved from local variable in Standard_MySQL_Thread::run() to public variable in MySQL_Thread , so accessible by other classes Extended stats_mysql_commands_counters from 2 columns to 15 columns!! It nows have betters statistics on timing and distribution Added command MYSQL_COM_QUERY___NONE as a marker . It also have the special meaning that Query_Info is not a query. commands_counters is now an array of pointers to Command_Counter objects MySQL_Data_Stream::read_from_net() updates mypolls->last_recv[] with curtime if mypolls is active (MySQL_Thread) MySQL_Data_Stream::write_to_net() updates mypolls->last_sent[] with curtime if mypolls is active (MySQL_Thread) For MySQL queries (_MYSQL_COM_QUERY) queries statistics are updated via CurrentQuery, an instance of Query_Info	11 years ago
René Cannaò	b1a22a38e7	Fixed bug #167	11 years ago
René Cannaò	8f9193a8ce	Fixed issues #159 and #160	11 years ago
René Cannaò	4702dc340b	Fix bug #155	11 years ago
René Cannaò	4a5bb59f4a	Fixed bug #111 . array2buffer had an optimization for small packets, but it break for large packets. Moved away the optimization	11 years ago
René Cannaò	bb1958a23f	Reformatting MySQL_Data_Stream::buffer2array()	11 years ago
René Cannaò	fb2e8735e4	first bug fix for issue #111	11 years ago
René Cannaò	2ce3ef03f8	Fixing indentation in MySQL_Data_Stream::array2buffer()	11 years ago
René Cannaò	454aa00f0f	Issue #123 and more Issue #123: - in case of backend authentication failure the client is disconnected and MySQL_Connection on backend marked not reausable Bug fixes: - fixed a bug in MySQL_Protocol::process_pkt_OK() - increased DEBUG_MSG_MAXSIZE : long debugging messages were causing crash Added few more debugging entries Issue #114 : marked with perror() + assert() Marked with assert another not handled scenario	11 years ago

1 2

55 Commits (32163bf892d33a5ee032adc8bb2a69bb7b331e30)