proxysql

Commit Graph

Author	SHA1	Message	Date
vegaicm	535874292e	More work on bug #207 Class Standard_MySQL_Thread was restructured mysql_thread___ thread variables are moved out to global variables Standard_Proxy_Admin calls Standard_MySQL_Thread::refresh_variables after initializing the thread structure	11 years ago
vegaicm	d315650f2c	More work on bug #207 . Class Standard_MySQL_Thread needs some review	11 years ago
René Cannaò	17ddec943e	Added variables ping_timout_server and ping_interval_server Issues #205 and #206	11 years ago
René Cannaò	9cdebef9ca	Bug fix and improved debugging For better debugging, added functions: MySQL_Data_Stream::clean_net_failure() MySQL_Data_Stream::set_net_failure() MySQL_Data_Stream::setDSS_STATE_QUERY_SENT_NET() MySQL_Session::set_unhealthy() Added condition mybe->server_myds->PSarrayOUTpending->len==0 to determine if DSS can be STATE_QUERY_SENT_NET	11 years ago
René Cannaò	24db7ed825	Removing the idle connection handler thread introduced in previous commit `21b20c0257`	11 years ago
René Cannaò	21b20c0257	Connection pool improvements , in beta Developed class StatCounters to keep time series counters Added 2 new instances of StatCounters: - MySQL_Session::command_counters; - ProxySQL_Poll::loop_counters; Counters are dispayed in "dbg thread status" Defined new variables mysql-connect_timeout_server_error and mysql-connect_timeout_server (issue #202 and #203) . They are defined but not implemented yet. Fixed two crashing bug when "gdb command" was trying to access: - its own Query_Info if this one was not initialized - Query_Info of another thread if this one was not initialized Introduced new variable ProxySQL_Poll:poll_timeout that Session can overwrite to apply a timeout different than mysql_thread___poll_timeout Added variable MySQL_Connection::last_time_used , updated at creation time and when calling push_MyConn_to_pool(). for each Connection add a "last_time_used" Added function get_multiple_idle_connections() Implementing Standard_MySQL_Threads_Handler::connection_manager_thread() , but doesn't seems to be a good idea ==== New attempt for connection handling MySQL_Session has a new bool variable : connections_handler Standard_MySQL_Thread has a new variable PtrArray : mysql_sessions_connections_handler Added new function Standard_MySQL_Thread::register_session_connection_handler SESSIONS_FOR_CONNECTIONS_HANDLER sessions are created in Standard_MySQL_Thread::init() Added new function Standard_MySQL_Thread::process_all_sessions_connections_handler() New variables in Standard_MySQL_Thread: MySQL_Connection **my_idle_conns; bool processing_idles; unsigned long long last_processing_idles; Added DSS STATE_PING_SENT MySQL_Session::handler___status_WAITING_SERVER_DATA___STATE_PING_SENT	11 years ago
René Cannaò	663a1b5630	Further simplification of connection management. Removed MySQL_Connection *myconn from MySQL Backend Removed server_myds and server_myds from MySQL_Session Fixed a bug that caused an infinite loop in case the backed was not able to create new connection	11 years ago
René Cannaò	cc9eb4d807	Removed client_fd and server_fd from MySQL_Session	11 years ago
René Cannaò	6cc87cb931	Remove MySQL_Protocol instances from MySQL_Session and moved into MySQL_Data_Stream	11 years ago
René Cannaò	24ab9f4398	More work for facilitate debug in MySQL Thread (issue #198 ) Standard_MySQL_Threads_Handler::SQL3_Threads_status() (still not completed) now locks the MySQL Threads Some functions of Standard_MySQL_Threads_Handler and Standard_MySQL_Thread are taken out from the class definition	11 years ago
René Cannaò	125114b0d5	Work for facilitate debug in MySQL Thread (issue #198 ) In order to facilitate the reuse of code in Standard_ProxySQL_Admin.cpp : - moved remove_spaces() from Standard_ProxySQL_Admin.cpp to gen_utils.cpp - moved Standard_ProxySQL_Admin::SQLite3_to_MySQL() to MySQL_Session::SQLite3_to_MySQL() Moved few macros from Standard_Query_Processor.cpp to proxysql_macros.h Added functions: - MySQL_Session::SQL3_Session_status() - MySQL_Session::handler___status_WAITING_CLIENT_DATA___STATE_SLEEP___MYSQL_COM_QUERY_debug() - Standard_MySQL_Thread::SQL3_Thread_status() - MySQL_Threads_Handler::SQL3_Threads_status() (not completed) Modified class Query_Info to copy queries : this can be a small performance penalty, but can improve functionalities Added mysql commands: - DBG SESSION STATUS - DBG THREAD STATUS - DBG THREADS STATUS Added variable MySQL_Thread::thread_mutex , a mutex to protect the thread: this will be used to implement access to MySQL Thread via Admin MySQL_Thread now have a new per thread variable updated via Admin Interface : - mysql_thread___session_debug ProxySQL_Poll now counts number of poll() in variable "loops" If mysql_thread___session_debug is enabled and a query starts with "dbg " it is interpreted as a command for proxysql. In Standard_ProxySQL_Admin added a variable admin_mutex to protect the update of statistics. Fixed minor bugs.	11 years ago
Rene Cannao	ea46b285c7	Merge pull request #190 from jesmarcannao/last FIX ISSUE #174	11 years ago
René Cannaò	209d784397	Drafting auto-reconnect Issue #195 and relative subtickets: - issue #191 - issue #192 - issue #194	11 years ago
Jesmar Cannaò	d4f9c49e1b	Fix Issue #182 Prevent loading modules compiled for a different version	11 years ago
René Cannaò	df0b81ddea	More improvements on Connection Pool For issue #187: Introduced the follow functions: - MySQL_Session::handler___status_CHANGING_USER_SERVER() - MySQL_Session::handler___client_DSS_QUERY_SENT___send_CHANGE_USER_to_backend - MySQL_Protocol::generate_COM_CHANGE_USER() Modified MySQL_Session::handler___status_CHANGING_SCHEMA() to return a boolean to handle failures Connections where INIT_DB or COM_CHANGE_USER fails are not reusable Added session_statuses CHANGING_USER_SERVER and CHANGING_USER_CLIENT (currently not used, but needed for issue #187) For issue #188: Added variable MySQL_Connection_userinfo::hash : this is compared into MySQL_Session Added function MySQL_Connection_userinfo::compute_hash() to automatically compute MySQL_Connection_userinfo::hash when a variable is changed hash is compute with SpookyHash::Hash64() Fixed bug #189: removed an parameters incorrectly passed to fprintf	11 years ago
Jesmar Cannaò	0717312c50	Fix Issue #175 Print "DEBUG" in version if compiled with DEBUG option : main process	11 years ago
René Cannaò	2401b12803	Custom memory allocator is optional, and disabled by default Used new variable GloVars.global.use_proxysql_mem Issue #184	11 years ago
René Cannaò	b84960da67	Draft on Handle missing backends , issue #181 Introduced MySQL_Session variable "pause_until" Simulated random missing backend	11 years ago
René Cannaò	5851693505	Removed "MYSQL myconn" from MySQL_Connection	11 years ago
René Cannaò	bcc19d619f	Removed classes MySQL_Server MySQL_Hostgroup MySQL_Hostgroup_Entry MySQL_HostGroups_Handler	11 years ago
René Cannaò	9fbce31593	Attempt to remove references to MyHGH	11 years ago
René Cannaò	44f433c260	Replaced MySQL_Session_userinfo with MySQL_Connection_userinfo Due the change in Connection Pool, user information need to be stored at Connection level and not at Session level	11 years ago
René Cannaò	181ed20bd3	Development on Connection Pool and Multiplexing In MySQL_HostGroups_Manager: - added function add() for MySrvC - fixed few typos : poll => pool - added locking in several functions First cleanup of MySQL_Hostgroup_Entry In MySQL_Protocol: - added variable prot_status - added variable fd - added function process_pkt_EOF() - variable parent is a MySrvC * - extended functions pkt_ok() , pkt_end() and pkt_handshake_server() to update prot_status - added function process_pkt_EOF() - fixed warns to be uint16_t instead of uint64_t In MySQL_Data_Stream: - fixed bug on read_from_net() - added function unplug_backend() In MySQL_Session: - attempting multiplexing if the connection has no active transactions and in case of SELECT statements - destination_hostgroup returned in qpo is applied	11 years ago
René Cannaò	a34798dbbf	Broken file	11 years ago
René Cannaò	9b452dfa0d	Splitting MySQL_Session:handler() in many many smaller functions	11 years ago
René Cannaò	bc8fc47ed6	Introducing MySQL_HostGroups_Manager MySQL_HostGroups_Manager merges the best of: - MySQL_HostGroups_Handler - MySQL_Connection_Pool Still in development: will be shadowing the original Handler and ConnPool	11 years ago
René Cannaò	13eb687335	More work on issue #168 Implemented new class Query_Info used in MySQL_Session Added MYSQL_COM_QUERY_command MYSQL_COM_QUERY_COMMIT Added virtual function Query_Processor::query_parser_update_counters() curtime moved from local variable in Standard_MySQL_Thread::run() to public variable in MySQL_Thread , so accessible by other classes Extended stats_mysql_commands_counters from 2 columns to 15 columns!! It nows have betters statistics on timing and distribution Added command MYSQL_COM_QUERY___NONE as a marker . It also have the special meaning that Query_Info is not a query. commands_counters is now an array of pointers to Command_Counter objects MySQL_Data_Stream::read_from_net() updates mypolls->last_recv[] with curtime if mypolls is active (MySQL_Thread) MySQL_Data_Stream::write_to_net() updates mypolls->last_sent[] with curtime if mypolls is active (MySQL_Thread) For MySQL queries (_MYSQL_COM_QUERY) queries statistics are updated via CurrentQuery, an instance of Query_Info	11 years ago
René Cannaò	a85bc44715	Implemented table stats_mysql_commands_counters : issue #168 Implemented get_stats_commands_counters() in Query_Processor Implemented stats___mysql_commands_counters() in ProxySQL_Admin Added table mysql_commands_counters Added MYSQL_COM_QUERY_SHOW_TABLE_STATUS in MYSQL_COM_QUERY_command Standard_Query_Processor has the commands description in commands_counters_desc Introduced per thread storage variable _thr_commands_counters query_parser_command_type() is now a wrapper to __query_parser_command_type() so to update counters based on its return value Bug fixed: Added transactions in Standard_ProxySQL_Admin::stats___mysql_query_rules() Added SHOW command in libinjection	11 years ago
René Cannaò	848b15f149	More work on parser : Issue #158 Implemented query_parser_command_type() to at least recognize queries from sysbench Currently commands supported: - ALTER [ONLINE \| OFFLINE] [IGNORE] TABLE - ANALYZE [NO_WRITE_TO_BINLOG \| LOCAL] TABLE - BEGIN - COMMIT - DELETE - INSERT - SELECT (not for update) - SET - UPDATE Small change on libinjection : Issue 152 Added COMMIT	11 years ago
René Cannaò	5f179eca36	Started working on query parsing. Issues #158 and #152 Per issue #158: - Created 4 new functions in class Query_Processor. - See doc/internal/query_parser.txt Per issue #152: - Patched deps/libinjection/Makefile to compile with -fPIC - Standard_MySQL_Thread is linked against libinjection	11 years ago
René Cannaò	923720bfbb	Implemented global variable mysql-servers_stats (issue #148 )	11 years ago
René Cannaò	62e2e78736	Issue #146 - created Query_Processor::update_query_processor_stats() - every mysql_thread___poll_timeout millisecond MySQL_Threads call GloQPro->update_query_processor_stats() to update global statistics update_query_processor_stats can be extended to load more type of queries	11 years ago
René Cannaò	322a4f021f	Enhancement on Query Processor and draft statistics interface - changed hits from uint64_t to int; - QP_rule_t has a pointer to its parent : this is done to speed up lookup - implemented get_current_query_rules() to execute SAVE MYSQL QUERY RULES FROM RUNTIME (issue #93) - implemented get_stats_query_rules() to save statistics on stats_mysql_query_rules (issue #139) - created 2 new classes to easily process statistics in Query Processor : QP_rule_text and QP_rule_text_hitsonly - extended classes SQLite3_row and SQLite3_result - every __admin_refresh_interval milliseconds Admin refreshes statistics - defined table stats_mysql_query_rules - deprecated __attach_configdb_to_admindb() , replaced with __attach_db_to_admindb (used in issue #142) - to admindb are now attached both configdb and statsdb (issue #142) - drafted a way to update hits on Query Processor . This method will go away when issue #146 will be implemented - fixed crashing bug in issue #145	11 years ago
René Cannaò	b01ab34e49	Issue #138	11 years ago
René Cannaò	aaba85fe00	Implemented feature in issue #131 Adding support for Monitor Interface (issue #130)	11 years ago
René Cannaò	3485228b71	Many changes - added some doc about global_variables - added c_tokenizer to tokenize C strings. Its first use is to split user/pass via c_split_2() Issue #127 - extensive work here , now Admin support its own global variables - commands available are: LOAD\|SAVE ADMIN VARIABLES FROM\|TO DISK\|MEMORY\|RUNTIME Issue #126 - username and password to access admin interface are now configurable in global_variables Issue #129 - started deprecating add_default_user(), deprecated by #126 Drafting Monitor interface : issue #130 Bug fixes: - fixed typo in SAVE MYSQL VARIABLES TO DISK;	11 years ago
René Cannaò	7a177ac934	Issue #121 Calls from Standard_ProxySQL_Admin to MySQL_Threads_Handler are wrapped by lock LOAD MYSQL VARIABLES TO RUNTIME (or equivalent) calls commit() so that other threads will update	11 years ago
René Cannaò	ef6b174ca3	Completed issue #120 Implemented issue #119 , and created default also for stacksize	11 years ago
René Cannaò	4d6ef8686c	Start work on issue #113	11 years ago
René Cannaò	886744fe5c	More work on issue #112	11 years ago
René Cannaò	f814966675	Issue #112 Created virtual class MySQL_Threads_Handler Implemented MySQL_Threads_Handler as Standard_MySQL_Threads_Handler	11 years ago
René Cannaò	7b7b872c98	Drafted connection pool: issue #109 Added additional debug for issue #108	11 years ago
René Cannaò	ccc40a0b2a	Work in issues #91 , #92 and #93	11 years ago
René Cannaò	a49e991fea	Better handle of NULL value returned by SQLite3	11 years ago
René Cannaò	6e0eaab56e	More development for issue #89 First hot fix for issue #94	11 years ago
René Cannaò	b205afec3f	Issue #25 . Deleted include/old/shared_query_cache.h	11 years ago
René Cannaò	8ce555b613	Deleted several files per issue #25 : rm lib/Standard_Query_Cache.cpp_string rm lib/Shared_Query_Cache.cpp_ rm lib/mysql_thread.cpp_ rm lib/mysql_protocol.c rm lib/query_cache.cpp rm include/query_cache.h____ rm include/CMakeLists.txt rm include/mysql_thread.h_ rm include/shared_query_cache.h	11 years ago
René Cannaò	4e62707844	Added debug mobule debug_mysql_query_processor (PROXY_DEBUG_MYSQL_QUERY_PROCESSOR) per issue #88	11 years ago
René Cannaò	637a3b0548	Initial work on issues #84 and #85	11 years ago
René Cannaò	51aec603da	Preparation work for issue #83	11 years ago
René Cannaò	caea6d3cb0	A lot of code change for issue #79 . Still experimental	11 years ago
René Cannaò	33421ca997	Initial work on issue #78 Removed 127.0.0.1 from mysql_connection.cpp (issue #70)	11 years ago
René Cannaò	f79a0c2a1f	More work on issue #71 Converted MySQL_Hostgroup::MSHGEs from vector to PtrArray	11 years ago
René Cannaò	b5299701bf	Fixed bug #76 and issue #77	11 years ago
René Cannaò	23fcc3d017	Fixed bug #75 Fixed bug #74 Started working on issue #71 In class MySQL_HostGroups_Handler, MyHostGroups and Servers were converted from vectors to PtrArray	11 years ago
René Cannaò	4a0ea32e3d	Fixed small bug introduced in issue #69	12 years ago
René Cannaò	3fe8a97cec	For issue #66 : New commands implemented: SAVE MYSQL SERVERS TO MEMORY SAVE MYSQL SERVERS TO MEM SAVE MYSQL SERVERS FROM RUNTIME SAVE MYSQL SERVERS FROM RUN LOAD MYSQL SERVERS FROM MEMORY LOAD MYSQL SERVERS FROM MEM LOAD MYSQL SERVERS TO RUNTIME LOAD MYSQL SERVERS TO RUN LOAD MYSQL SERVERS TO MEMORY LOAD MYSQL SERVERS TO MEM LOAD MYSQL SERVERS FROM DISK For issue #18: Implemented functions: Standard_ProxySQL_Admin::flush_mysql_servers__from_disk_to_memory() Standard_ProxySQL_Admin::flush_mysql_servers__from_memory_to_disk() Standard_ProxySQL_Admin::load_mysql_servers_to_runtime() For issue #70: Removed any 127.0.0.1 from main()	12 years ago
René Cannaò	c9279086b7	Adding weight for issue #69	12 years ago
René Cannaò	42c27e3575	Implemented features in issues #57 and #59 Cleanup for issue #58	12 years ago
René Cannaò	67f2f6524f	Issue #58 Probably completed Moved around some code in main (it needs a lot of clean up, it is all test code) Modules shutdown is performed only if they are active If GloVars.global.nostart==true , ProxySQL doesn't fully restart even after a PROXYSQL RESTART, it will wait PROXYSQL START Various bugs/improvements: - in class MySQL_HostGroups_Handler, use of clear() for vectors MyHostGroups and Servers - Better implementation of PROXYSQL START (issue #14)	12 years ago
René Cannaò	a55daf3e61	Issue #14 Added pthread_mutex_t GloVars.global.start_mutex mutex locked by Admin module if nostart is on mutex released by Admin when issued PROXYSQL START main() blocks until the mutex is locked Issue #23 Fixed a bug that was always assigning GloVars.global.gdbg=true Issue #53 Drafted a basic Standard_ProxySQL_Admin::send_MySQL_OK(MySQL_Protocol *myprot) Issue #56 If verbosity is greater than 10 , proxy_debug_func() prints backtrace calling: - backtrace - backtrace_symbols - abi::__cxa_demangle	12 years ago
René Cannaò	6dccae424f	Issue #23 Added more debug lines Added debugging type PROXY_DEBUG_MYSQL_CONNPOOL Flag -d can accept a integer value that become the default logging verbosity using init_debug_struct_from_cmdline()	12 years ago
René Cannaò	9de08dd9a2	Issue #51	12 years ago
René Cannaò	886cc02c63	First draft for issue #45	12 years ago
René Cannaò	d34e202fe4	Fix issue #44	12 years ago
René Cannaò	c7fc81fa4b	Solved issue #43	12 years ago
René Cannaò	2d2399a880	Solved issue #39	12 years ago
René Cannaò	9e6ce50739	Issue #28 , #29 and #30 in class MySQL_Connection_Pool: - shared converted from int to bool - added 2 functions MySQL_Connection_lookup() in class MyConnArray: - match() and add() are not private - class MySQL_Connection_Pool is a friend class - added function MyConn_find() in class MySQL_Connection: - class MyConnArray is a friend class - MCA is private - removed custom operator new() and delete() because MySQL_Connection_Pool can be shared - all members don't use the custom memory allocator - added private function is_expired . See issue #30 - member expire removed, and replaced with inserted_into_pool	12 years ago
René Cannaò	bd7a5d1795	Issue #26 Renamed MyHostGroups to MyHGH (short for MySQL Host Groups Handler): name was conflicting with MyHostGroups in class MySQL_HostGroups Renamed class MySQL_HostGroups to MySQL_HostGroups_Handler	12 years ago
René Cannaò	ee34919f9f	Issues #19 and #23 For issue #19: - create MySQL_Protocol::get_myds() - create MySQL_Protocol::generate_pkt_row() - modified MySQL_Session::(admin_func)(MySQL_Session ) to MySQL_Session::(admin_func)(MySQL_Session ,ProxySQL_Admin ,PtrSize_t ) so it can access more data - fixed an invalid strdup in SQLite3_row::add_fields() - added SQLite3_result::rows_count - SQLite3DB instances in Standard_ProxySQL_Admin are now public - create Standard_ProxySQL_Admin::SQLite3_to_MySQL() For issue #23 : - added __dump_pkt() in mysql_data_stream.cpp Bug fix: Added a missing pthread_mutex_unlock() in Admin/child_mysql() Minor clean-ups	12 years ago
René Cannaò	eeabdd7257	Cleanup Modified Makefile to generate my_config.h Removed dependency from libevent headers (still needed for memcached, to be removed) Removed linking against libevent library	12 years ago
René Cannaò	aece688d03	Issue #14 Added function init_users() to be called after GloMyAuth is initialized	12 years ago
René Cannaò	dbae40a9a9	Issue #16 Added functions: - Standard_ProxySQL_Admin::flush_debug_levels_mem_to_db - Standard_ProxySQL_Admin::flush_debug_levels_db_to_mem debug_levels is populated at start up	12 years ago
René Cannaò	43a82215b0	Issue #12 Added functions: - __add_active_users - __delete_inactive_users - __refresh_users Fixed small bug in SQLite3_result::add_column_definition() MySQL Authentication module is now loaded before the Admin module	12 years ago
René Cannaò	b0b8de6c88	Issue #6 : basic handler of SSL	12 years ago
René Cannaò	93bc73c50d	Issue #3 and #7 For issue #3: - fixed serious bug For issue #7: - most of the functions in MySQL_Authentication rewritten to accept an extra argument of type enum cred_username_type - Standard_MySQL_Authentication stores username/password in 2 structures (creds_group_t) for backend and frontend	12 years ago
René Cannaò	eeca279349	Issue #10 , removed support for domains	12 years ago
René Cannaò	5ffd3c8924	Issue #4 , #5 , #6 and #7 For issue #4: - removed fill_table__server_status() - removed ADMIN_SQLITE_TABLE_MYSQL_SERVER_STATUS - fixed ADMIN_SQLITE_TABLE_MYSQL_SERVER For issue #5: - created functions __insert_or_ignore_maintable_select_disktable() , __delete_disktable() , __insert_or_replace_disktable_select_maintable() and __attach_configdb_to_admindb() For issue #6 and #7: - table ADMIN_SQLITE_TABLE_MYSQL_USERS has fields use_ssl, backend and frontend	12 years ago
René Cannaò	3ce36e4eff	Issue #3 Use of __builtin_ffs and __builtin_clz for __l_alloc and __l_free when __GNUC__ is defined Increased L_SFC_MAX_ELEM_SIZE from 512 to 2048	12 years ago
René Cannaò	de7803370f	Fixed issue #2 Improved performance in MySQL_Data_Stream::array2buffer() Optimized class PtrSizeArray	12 years ago
René Cannaò	c6b0545401	Solved issue #1	12 years ago
René Cannaò	68d6786320	first commit	12 years ago

... 13 14 15 16 17

832 Commits (7f6d64c3db2af3ca4e5c4e14ef79e55aa094ab4b)