750 Commits (e762f91cda174ea3e6ab85bbcbdbc457280edf7f)

Author	SHA1	Message	Date
Rahim Kanji	e723082a1b	Refactored Query Processor Architecture ... - Introduced separate query processors for MySQL and PostgreSQL. - Removed unnecessary GTID logic from `PgSQL_Session`. - Added a command counter for PostgreSQL queries. - Refactored `Query_Processor` to serve as a base class containing core functionalities applicable to both MySQL and PostgreSQL. Changes: - Removed GTID-related code from `PgSQL_Logger` and `PgSQL_Session`: - bool with_gtid; - char gtid_buf[128]; - int gtid_hid; - Added new PostgreSQL-specific tables: - `pgsql_query_rules`, `pgsql_firewall_whitelist_rules`, `pgsql_query_rules_fast_routing` - `runtime_pgsql_query_rules`, `runtime_pgsql_firewall_whitelist_rules`, `runtime_pgsql_query_rules_fast_routing` - Added PostgreSQL-related variables: pgsql_thread___commands_stats pgsql_thread___query_digests pgsql_thread___query_digests_lowercase pgsql_thread___query_digests_no_digits pgsql_thread___query_digests_replace_null pgsql_thread___query_digests_normalize_digest_text pgsql_thread___query_digests_track_hostname pgsql_thread___query_digests_keep_comment pgsql_thread___query_digests_max_digest_length pgsql_thread___query_digests_max_query_length pgsql_thread___query_digests_grouping_limit pgsql_thread___query_digests_groups_grouping_limit pgsql_thread___enable_load_data_local_infile pgsql_thread___auditlog_filename pgsql_thread___auditlog_filesize pgsql_thread___eventslog_filename pgsql_thread___eventslog_filesize pgsql_thread___eventslog_default_log pgsql_thread___eventslog_format pgsql_thread___firewall_whitelist_errormsg pgsql_thread___firewall_whitelist_enabled pgsql_thread___query_processor_iterations pgsql_thread___query_processor_regex	2 years ago
René Cannaò	cbf4628ea3	Merge remote-tracking branch 'proxysql27/v2.7' into v2.x_postgres_merge27_20240917	2 years ago
René Cannaò	38350292e2	Merge pull request #4600 from sysown/v2.x_proxy ... Implementation of PROXY protocol V1	2 years ago
René Cannaò	cf9d5fe21a	Merge pull request #4574 from sysown/set-thread-names ... Set thread names	2 years ago
Javier Jaramago Fernández	bbda0a86eb	Add initial impl for dual-password support	2 years ago
René Cannaò	94b0da1768	In SQL3_Processlist() use saved IP/port	2 years ago
Rene Cannao	7fe013fac2	Merge branch 'proxysql_v2.x_240813' into v2.x_postgres_merge_v2.x_240813 ... This merges ProxySQL v2.x up to 2024-08-13	2 years ago
Rene Cannao	d85430b709	Implementation of PROXY protocol V1 ... This commit introduces: - class ProxyProtocolInfo() , that: - performs parsing - validates subnet - run automated tests in DEBUG build - variable mysql-proxy_protocol_networks . Accepted values: - empty string: disables PROXY protocol - '*' : allows connections from any IP - comma separated list of subnets - automated testing in DEBUG build during start - export of PROXY protocol information in internal session, using PROXY_V1 - a TAP test to verify various connections	2 years ago
Niels Vogell	7290f0bfb2	Fix a mixup in the default value of monitoring_read_only_interval	2 years ago
Niels Vogell	8154f4b330	Disable AWS RDS topology discovery by default with 0 as special value for the discovery interval	2 years ago
Andriy Utkin	5e79afa8e0	Set thread names	2 years ago
Rahim Kanji	d3e9c9c85a	Merge remote-tracking branch 'remotes/Master/v2.x' into v2.x_proxysql_postgres_merge	2 years ago
René Cannaò	2d7806c325	Moved run_SetAllSession_ToProcess0 to Base_Thread	2 years ago
René Cannaò	fde8ace076	Removed json.hpp from include files ... This seems to speedup compile time, and also lead to smaller binary	2 years ago
René Cannaò	483b8335d3	More functions moved to Base_Thread ... * move_session_to_idle_mysql_sessions * find_session_idx_in_mysql_sessions * ProcessAllMyDS_BeforePoll	2 years ago
René Cannaò	a881936cad	More functions moved to Base_Thread ... * ProcessAllMyDS_AfterPoll * read_one_byte_from_pipe * tune_timeout_for_myds_needs_pause * tune_timeout_for_session_needs_pause * configure_pollout * set_backend_to_be_skipped_if_frontend_is_slow	2 years ago
René Cannaò	db6cb93fb9	Moved ProcessAllSessions_SortingSessions to Base_Thread	2 years ago
René Cannaò	8389f76413	More functions moved to Base_Thread() ... * check_timing_out_session() * check_for_invalid_fd()	2 years ago
Rahim Kanji	ca93da5857	Resolved conflicts	2 years ago
René Cannaò	c9326564c0	Minor changes to try to optimize compiling	2 years ago
René Cannaò	c903a45633	Second attempt to use Base_Thread ... Moved register_session() into Base_Thread. Moved Session_Regex() from Client_Session() to Base_Session() just to fix some compiler issue. Also removed some dead code from previous commit.	2 years ago
René Cannaò	0cfab2616f	First attempt to use Base_Thread and Base_Session	2 years ago
René Cannaò	de345ecaed	Merge remote-tracking branch 'public/v2.x' into v2.x_postgres_240422	2 years ago
René Cannaò	9283cd2e9b	Code cleanup in MySQL_Thread::refresh_variables() ... Use macros to avoid repeating variable name and strings with the variable name. Because this commit avoids duplications of name and literals, this commit also renames: mysql_thread___monitor_groupreplication_max_transaction_behind_for_read_only to: mysql_thread___monitor_groupreplication_max_transactions_behind_for_read_only	2 years ago
René Cannaò	6020216dd2	Various refactoring in MySQL_Thread.cpp	2 years ago
Rahim Kanji	c7cf5ba344	Removed MySrvStatus class	2 years ago
Rahim Kanji	936e27139b	Merge branch 'v2.x_PostgreSQL_Merge' into v2.x_postgres ... # Conflicts: # include/MySQL_Session.h # lib/Makefile # lib/MySQL_Session.cpp # lib/MySQL_Thread.cpp # lib/ProxySQL_Admin.cpp # lib/ProxySQL_Poll.cpp	2 years ago
Rahim Kanji	ebf20b6a60	* Added PostgreSQL configuration (port: 6034 Admin and 6035: PostgreSQL client connections) ... * Fixed few bugs * Added Load and Save commands for PostgreSQL tables	2 years ago
Javier Jaramago Fernández	5d7e5d9e00	Merge pull request #4406 from anphucbui/v2.x ... Add support for AWS RDS MySQL Multi-AZ Cluster auto-discovery	2 years ago
Rahim Kanji	e029d39007	Initial PostgreSQL commit ... * Added plain text and SCRAM authentication	2 years ago
René Cannaò	1bc9d9e5f4	Several code documentation	2 years ago
Anphuc Bui	e0db02df27	Merge branch 'v2.x' into v2.x	2 years ago
Javier Jaramago Fernández	caed360eeb	Merge branch 'v2.x' of github.com:sysown/proxysql into v2.x_sha2pass_draft3	2 years ago
René Cannaò	6e18b04290	Merge pull request #4450 from sysown/v2.x_shun_replication_lag ... Restore shunned server (due to replication lag) state on commit, provided that the replication lag is below the maximum threshold.	2 years ago
René Cannaò	984582eaae	Renamed variable evaluate_replication_lag_on_servers_load ... Renamed variable from: mysql-recover_replication_lag_shunned_servers_on_comit to: mysql-evaluate_replication_lag_on_servers_load	2 years ago
Rahim Kanji	3f7a90ce97	Fixed heap use after free issue.	2 years ago
Rahim Kanji	b75b05c392	Restore servers that are in a shunned state due to replication lag only upon commit (triggered by the command LOAD MYSQL SERVERS TO RUNTIME), provided that the replication lag is below the maximum threshold.	2 years ago
Anphuc Bui	0bcddd0002	Merge branch 'v2.x' into v2.x	2 years ago
anphucbui	bb35b20719	Moving core discovery logic to fit into read_only framework as a new task type	2 years ago
René Cannaò	06844eda3f	Merge pull request #4429 from sysown/v2.x-4335 ... Deprecate mysql-default_tx_isolation #4335	2 years ago
René Cannaò	d2c8d655a8	Deprecate mysql-default_tx_isolation #4335 ... Variable mysql-default_tx_isolation is unused.	2 years ago
René Cannaò	496ee02cae	Input validation for mysql-server_capabilities ... Input validation on mysql-server_capabilities assumed that it was 16 bits (for historical reasons). This has now improved and supports up to 32 bits. Notes: - some capabilities are changed at runtime while performing the handshake with the client - even if we support 32 bits capabilities, many of them do not have any real meaning for proxysql (not supported) Closes #2091	2 years ago
anphucbui	5a3037785f	Add support for AWS RDS MySQL Multi-AZ Cluster auto-discovery	2 years ago
René Cannaò	3c2418246c	Merge branch 'v2.x' into v2.x_sha2pass_draft3	2 years ago
René Cannaò	bd7846f430	Move ProxySQL_Poll() to its own source file	2 years ago
René Cannaò	5181812065	Removed redundant near_pow_2()	2 years ago
René Cannaò	699fe7efcd	Moved proxysql_find_charset_* functions out of MySQL_Thread.cpp	2 years ago
René Cannaò	1e98de78af	Merge pull request #4365 from sysown/v2.x_warning_support ... Added warnings handling	2 years ago
René Cannaò	8fdc7f010e	Merge pull request #4340 from sysown/v2.x-2.6_new_defaults_2 ... V2.x new default for mysql-set_parser_algorithm	2 years ago
Rahim Kanji	8606742583	Merge remote-tracking branch 'Master/v2.x' into v2.x_warning_support_final ... # Conflicts: # test/tap/tests/set_testing-240-t.cpp	2 years ago
René Cannaò	b6deb15ec3	Merge pull request #4372 from sysown/v2.x_prep_stmt_mem_usage ... Added memory usage monitoring for the prepared statement cache.	2 years ago
Rahim Kanji	743cd502a5	* Updated variable name from 'mysql-query_cache_with_warnings_support' to 'mysql-query_cache_handle_warnings' ... * Introduced global variable 'mysql-handle_warnings' to control warning support in ProxySQL * Included 'handling_warnings' flag in the 'mysql_hostgroup_attributes' table (hostgroup_settings). This flag holds top priority and can override the value of the global variable 'mysql_handle_warnings'.	2 years ago
René Cannaò	f16290d78d	Prevent assert after fcntl() for O_NONBLOCK ... There are several asserts after fcntl() in MySQL_Thread::create_new_session_and_client_data_stream() . This commit removes the assert after F_SETFL with O_NONBLOCK. This because it is possible that proxysql is already shutting down. The entry in the error log is kept.	2 years ago
Rahim Kanji	989687c68a	Implemented memory usage monitoring for the prepared statement cache with the following changes: ... * Added two new variables to the 'stats_memory_metrics' table: prepare_statement_metadata_memory prepare_statement_backend_memory * Introduced corresponding variables in the Prometheus exporter to measure memory usage of prepare statement metadata and prepare statement backend.	2 years ago
Rahim Kanji	6b295477d6	Enhanced Warnings handling in ProxySQL: ... * Implemented 'SHOW WARNINGS' and 'SHOW COUNT(*) FROM WARNINGS' query handling. * When a query produces warnings, the warning count is now included in the query response. Additionally, a new variable 'mysql-query_cache_with_warnings_support' has been introduced for the query cache feature: * A value of '0' means that if a query execution produces warnings, the resultset will not be saved in the query cache. * A value of '1' indicates that if a query produces warnings, the resultset will be saved in the query cache, but the warning count in that resultset will be set to '0'. ** Note: * Warning handling is dependent on the query digest and 'mysql-query_digests' must be enabled for it to work. * Warnings saved in logfile ['mysql-log_mysql_warnings_enabled'] and the current feature can work in conjunction with each other.	2 years ago
René Cannaò	18d8e69b19	Changing default for set_parser_algorithm	3 years ago
René Cannaò	97b49849b8	Change default query_digests_groups_grouping_limit	3 years ago
René Cannaò	6b84b42a68	Note on set_parser_algorithm ... A commit just to trigger CI	3 years ago
René Cannaò	dc364eb254	Temporary reverse set_parser_algorithm to 1	3 years ago
René Cannaò	b93df2e958	Changing several defaults ... * monitor_history from 600000 to 7200000 (from 10 minutes to 2 hours) * use_tcp_keepalive from false to true * tcp_keepalive_time from 0 to 120 * set_parser_algorithm from 1 to 2 * server_version from 5.5.30 to 8.0.11 * have_ssl from false to true	3 years ago
Rahim Kanji	a908f2a17b	Added transaction_isolation_level and transaction_read_only variable support.	3 years ago
René Cannaò	9ede04de52	Merge branch 'v2.x' into v2.x_sha2pass_draft3	3 years ago
René Cannaò	fb53926cf5	Merge pull request #4274 from sysown/v2.x-4268 ... Reworking of SET parser	3 years ago
René Cannaò	a6ff9e33ba	Initialize thr_SetParser	3 years ago
René Cannaò	37f8a50b90	Adding variable mysql-set_parser_algorithm ... Variable mysql-set_parser_algorithm defines which algorithm is used by SetParser for the parsing of SET statements. If value is 1: parse1() is used If value is 2: parse1v2() is used parse1v2() allows also the using a single SetParser per MySQL_Thread to process all SET statements. Regex is compiled only once. set_testing-240-t was also modified to test both algorithms	3 years ago
René Cannaò	5443b45f2e	Handle utf8mb3 as an alias for utf8 ... Fixes issue #4269 proxysql_find_charset_name() converts "utf8mb3" to "utf8". proxysql_find_charset_collate_names() also remove "mb3" from collation names.	3 years ago
René Cannaò	8106ae5ee3	Merge branch 'v2.x' into v2.x_sha2pass_draft3	3 years ago
René Cannaò	86fc8ab564	Minor optimizations ... Inspired by 33fba7641a	3 years ago
Rahim Kanji	fb7edb578d	Implemented data packet history queue for storing packets sent/received by frontend and backend.	3 years ago
René Cannaò	e7745feef2	First implementation of caching_sha2_password ... Implementation not completed yet, but functional. It allows connections in which the user password is saved in clear password.	3 years ago
René Cannaò	76bb204f14	New variable mysql-default_authentication_plugin ... New MySQL variable default_authentication_plugin accepting two possible values: * mysql_native_password * caching_sha2_password	3 years ago
René Cannaò	f50c26b460	Merge pull request #4182 from sysown/v2.x-query_rules_fast_routing_algorithm ... Add new variable 'mysql-query_rules_fast_routing_algorithm'	3 years ago
Javier Jaramago Fernández	36e5a13b8a	Lock 'Query_Processor' for 'query_rules_fast_routing_algorithm' variable update	3 years ago
Javier Jaramago Fernández	8331858179	Remove thread variable for 'mysql-query_rules_fast_routing_algorithm' ... - Thread variable has been replaced for new variable in 'Query_Processor'. - Computation for 'mysql_query_rules_memory' is now performed by Admin during 'load_mysql_query_rules_to_runtime' instead of lazily by the MySQL_Threads.	3 years ago
Javier Jaramago Fernández	abccb39201	Add new variable 'mysql-query_rules_fast_routing_algorithm' ... - Implemented new variable 'query_rules_fast_routing_algorithm' that allows choosing between the classic per-thread hashmaps for 'query_rules_fast_routing' searches (1), and a new unique global hashmap (2). - Improved locking time on 'QueryProcessor::rwlock' during 'load_mysql_query_rules_to_runtime'. - Changed computation of 'mysql_query_rules_memory' to be lazily updated by threads themselves while building the per-threads maps. - Fixed 'ProxySQL_Admin::stats___memory_metrics' report of the memory metrics. - Improved 'PROXYSQLTEST 17' command, for being able to micro-benchmark and check 'query_rules_fast_routing_algorithm'.	3 years ago
Thomas Saunders	e252e22972	remove redundant client_connections metrics from MySQL_Thread	3 years ago
Javier Sánchez Parra	b2312c07ff	Fix max_transaction_time boundaries between transactions ... Fixes issue #3957	3 years ago
René Cannaò	23603e535d	Merge pull request #4090 from sysown/v2.x-log_close_fast_forward ... Log 'fast_forward' conns close due to 'log_unhealthy_connections'	3 years ago
René Cannaò	cfe5c0bcf0	Merge pull request #4091 from sysown/v2.x-HGMimpr01_mysql_hostgroup_attributes ... Drafting mysql_hostgroup_attributes	3 years ago
René Cannaò	3837de61e2	Various minor fixes ... Fixes: * minor memory leak when running CHECKSUM command * minor memory leak in load_mysql_servers_to_runtime() * not initialized json in MySQL_Event (valgrind doesn't like it) * not initialized variable MySQL_Thread::shutdown in the constructor	3 years ago
René Cannaò	62182da20b	Merge pull request #4086 from sysown/v2.x-1486 ... Add soft TTL to Query Cache entries	3 years ago
Javier Jaramago Fernández	530353bea0	Log 'fast_forward' conns close due to 'log_unhealthy_connections' ... This is an improvement over commit '5751d71d'. Instead of avoiding to log when closing 'fast_forward' connections, now we log a dedicated message.	3 years ago
René Cannaò	51df157f3b	Rename query_cache_soft_ttl_percentage to query_cache_soft_ttl_pct	3 years ago
Javier Sánchez Parra	f5281b236b	Add soft TTL to Query Cache entries ... When Query Cache entries reach the soft ttl, the next query hit the backend and refresh the entry. While the refresh happens, other queries keeps getting the "old" Query Cache entry. Soft ttl is a percentage of the cache ttl and is defined by a global variable for all the entries. If the value is 0, soft ttl is disabled and no used.	3 years ago
René Cannaò	d33c5587e2	Assert on fcntl() only if not during shutdown	3 years ago
René Cannaò	b375151e13	Some debugging code to troubleshoot a crash	3 years ago
René Cannaò	b1a14bd303	If SSL is used for frontend connections or fast_forward , try to consume all the bytes on the network buffer	3 years ago
René Cannaò	71e2510ef6	Code cleanup on MySQL_HostGroups_Manager ... Some rework to try to reduce duplicated code	3 years ago
René Cannaò	d836b0b032	More bugfixes and testing on SSL and fast_forward ... This commit is related to the previous one: 4c21a6d8c7 OpenSSL handles data in blocks of 16KB. If more than 16KB of data was sent to Admin, SQLite3 Server or Clickhouse Server, no further data was detected, thus blocking. Added test_ssl_fast_forward-2-t.cpp for further testing. Also added marker PMC-10004	3 years ago
René Cannaò	43d65cae60	SSL and fast_forward : handling of SSL_ERROR_SYSCALL	3 years ago
René Cannaò	4c21a6d8c7	Add support for SSL and fast_forward with more than 16KB of data ... OpenSSL handles data in blocks of 16KB. If more than 16KB of data was sent fast_forward was not detecting further data and therefore blocking. This commit fixes this bug.	3 years ago
Javier Jaramago Fernández	300532d6e2	Fix multiple warnings in logging function calls	3 years ago
René Cannaò	6bbed9683e	Merge pull request #4045 from sysown/v2.x-4000 ... Add new variable 'mysql-parse_failure_logs_digest'	3 years ago
René Cannaò	ec93211d02	Merge pull request #4024 from sysown/v2.x_LocalDNSCache ... Feature: ProxySQL local DNS Cache	3 years ago
Javier Sánchez Parra	23cab574ac	Add new variable 'mysql-parse_failure_logs_digest' ... If the variable is 'true', ProxySQL prints the digest instead of the query when it has a parse failure.	3 years ago
Rahim Kanji	dbfb99ce71	* Added hostname and ip information in mysql_connection ... * Added multiple IP support with load balancing (Round Robin Scheduling) * Added DNS resolver request max queue size * Added AI_ADDRCONFIG flag * Exception handling	3 years ago
Rahim Kanji	2bbb6305b5	Added DNS Cache enable/disable flag handling.	3 years ago
Rahim Kanji	7805924779	Feature: ProxySQL local DNS Cache	3 years ago
Rahim Kanji	8ebb990002	Resolves Issue 3991 ... * Added support for @@local * Added support for optimizer_use_condition_selectivity * Updated test cases	3 years ago
René Cannaò	83ffb729bb	Merge pull request #3946 from sysown/v2.x-3923 ... WIP: Fix 'mysql-auto_increment_delay_multiplex_timeout_ms' - Closes #3923	4 years ago