220 Commits (6d6015a2034dbee2ea4eb50d2e84381df008fa46)

Author	SHA1	Message	Date
Rahim Kanji	87ad15b01c	* Removed autocommit_on_hostgroup from PostgreSQL modules ... * Introduced an error generator method to reduce code duplication * Added several comments for clarity * Addressed edge cases related to libpq limitations	9 months ago
Rahim Kanji	48ba491cb7	Add support for unnamed Describe Portal and improve extended query handling ... - Always send Describe Portal to the backend - Enforce check for unnamed portals in Bind, Describe, Close, and Execute; raise errors for named portals - Improve error handling for extended query flow - Introduce Extended_Query_Info struct to unify extended query-related members and reduce redundancy	9 months ago
Rahim Kanji	7cde1dcad6	Added comments	9 months ago
Rahim Kanji	d3592020ac	* Created a separate file for Extended Query messages to reduce clutter in PgSQL_Protocol. ... * Moved get_uint32be() and get_uint16be() to gen_utils.h * Split PgSQL_*_Message into distinct Message and Data components.	9 months ago
Rahim Kanji	3cff4f9dca	* Added sticky backend support for extended query frames: all messages in a single frame will now use the same backend connection. ... * Fixed few compilation warnings. * Removed AutoCommit relate code from PostgreSQL session.	9 months ago
Rahim Kanji	d5fc1fefff	Renamed pending_query to extended_query_frame ... Improved extended query frame handling	9 months ago
Rahim Kanji	f350102f72	Code cleanup	9 months ago
Rahim Kanji	8bb248cef5	Added Bind and Execute support	9 months ago
Rahim Kanji	4d0618c296	Added Close statement handling	9 months ago
Rahim Kanji	a741598a8d	Added Describe message handling	10 months ago
Rahim Kanji	97b3bb16e3	Fixed RequestEnd	10 months ago
Rahim Kanji	24fecc1f6e	Add PostgreSQL extended query (prepared statement) support in ProxySQL ... This commit lays the groundwork for handling PostgreSQL’s extended query protocol (prepared statements) by introducing parsing, it's caching and execution framework stubs. - Implement Parse handling - Implement caching of parse (reuse) - Introduce Execute framework stub for future binding and execution logic.	10 months ago
Rahim Kanji	026f458f7c	Removed last_insert_id from PostgreSQL modules	10 months ago
Rahim Kanji	c71aa550df	Added names (alias of client_encoding)	11 months ago
Rahim Kanji	979b3a81f4	Added PgSQL_ExplicitTxnStateMgr in session ... Dump transaction state in proxysql internal session output	11 months ago
Rahim Kanji	4969bd8301	PQconnectPoll can file descriptor (FD) during the connection process. We need to check whether FD has changed and, if so, update it in the thread's poll array.	12 months ago
René Cannaò	6df3d6b84b	Merge pull request #4899 from sysown/v3.0_refactor_connection_info_param ... Refactor PostgreSQL Connection-Level Parameters Handling	1 year ago
Rahim Kanji	c2f2ae5aa4	* Updated code to use pgsql_tracked_variables[idx] consistently, removing ... direct usage of pgsql_tracked_variables[idx].idx. This change improves consistency and reduces potential human error. * Fixed some warning	1 year ago
Rahim Kanji	db442ba8cf	Treat client_encoding as normal server parameter/variable. ... Optimized RESET ALL command handling. Few optimizations. Code cleanup	1 year ago
Rahim Kanji	fbb9500cb9	Refactored connection parameters ... * Accept all parameters sent by the client, mirroring PostgreSQL's permissive handling. * Validate and apply parameters only after successful authentication. This avoids wasting resources on invalid connections.	1 year ago
René Cannaò	e17477e297	Merge pull request #4871 from sysown/v3.0-4803_20250313 ... Port to 3.0 of in-memory query logging	1 year ago
Rahim Kanji	fa220398f6	Moved dynamic fast-forward logic (used for COPY ... FROM STDIN) to execute after session variables are set on the backend connection	1 year ago
René Cannaò	2551d350e9	Port to 3.0 of in-memory query logging ... See #4713 for further details	1 year ago
Rahim Kanji	055e748673	Fixed DateStyle Validator ... If the provided datestyle includes both style and order, ensure both values are valid.	1 year ago
Rahim Kanji	6603d48bb0	Optimized and simplified PostgreSQL variable Validator	1 year ago
Rahim Kanji	a5b7063cf3	Add validation for PostgreSQL patameters/variables and default PostgreSQL variables ... * Added validation checks when setting PostgreSQL variables to prevent invalid configurations. * Applied the same validation to default PostgreSQL variables to maintain consistency.	1 year ago
Rahim Kanji	41206d2ee7	Added enable_nestloop parameter	1 year ago
Rahim Kanji	e0ced2e14c	Fixed extra_float_digits variable position	1 year ago
Rahim Kanji	427f20072b	Tracking new variables ... allow_in_place_tablespaces enable_sort extra_float_digits synchronous_commit	1 year ago
Rahim Kanji	40be1158c2	Finally removed PgSQL_Connection_Placeholder class	1 year ago
Rahim Kanji	570e62b618	Removed MySQL Prepare Statement residual code	1 year ago
Rahim Kanji	ac64bd5d21	Removed leftover MySQL prepared statement code	1 year ago
Rahim Kanji	a22936164b	Removed psql from PgSQL_Connection_Placeholder ... Removed dead code Removed MySQL Prepare Statement related code lib/PgSQL_Session.cpp # # Untracked files: # .gitattributes # .vs/ # PR_proxysql_postg.txt # include/query_cache - Copy.hpp # lib/Query_Cache - Copy.cpp # tash qqq # test/tap/tests/pgsql-basic_tests-t - Copy.cpp # test/tap/tests/pgsql-connection_test-t.cpp # test/tap/tests/pgsql-set_parameter_test-t.cpp #	1 year ago
Rahim Kanji	bcc20f8214	Moved few members and methods to PgSQL_Connection ... Removed deadcode	1 year ago
Rahim Kanji	99d9708eeb	Removed dead code	1 year ago
Rahim Kanji	87838bec14	Refactored get_default_session_variable	1 year ago
Rahim Kanji	e6ddae643b	Now, default variables are set for all tracked variables ... Improved error handling	1 year ago
Rahim Kanji	5fb518dc90	Added some more variables ... enable_bitmapscan enable_indexscan enable_seqscan maintenance_work_mem	1 year ago
Rahim Kanji	65ec341b39	Added support for COPY ... FROM STDOUT	1 year ago
Rahim Kanji	d2c333dcfd	Special handling of PostgreSQL DateStyle in ProxySQL ... - DateStyle consists of two values: a format and an order (e.g., ISO, MDY). Unlike other parameters, DateStyle can be set with one or both values, and the missing value retains its previous setting. Examples: SET DateStyle TO 'ISO, MDY' → Format: ISO, Order: MDY SET DateStyle TO 'ISO' → Format: ISO, Order remains unchanged i.e MDY SET DateStyle TO 'DMY' → Format remains unchanged i,e ISO, Order: DMY SET DateStyle TO 'Postgres' → Format: Postgres, Order remains unchanged i.e DMY Improved RESET statements and DEFAULT parameter values handling - Enhance RESET and DEFAULT value handling: • When a parameter is RESET or set to DEFAULT, ProxySQL now first checks if a value is provided in the connection options. • If a connection value is specified, it is applied; otherwise, the parameter falls back to the value defined by the corresponding pgsql-default_* variable.	1 year ago
Rahim Kanji	35b2dd593d	Separate implementation of SET statement parser for MySQL and PostgreSQL	1 year ago
Rahim Kanji	0e1392322f	RESET oaramter and DEFAULT parameter value handling (not fully tested yet) ... * New tracked variables added: - bytea_output - client_min_messages - escape_string_warning Few optimizations Code cleanup	1 year ago
Rahim Kanji	06e496b7c3	Added tracking of parameters: ... * client_encoding/names * datestyle * timezone/time zone * standard_conforming_strings	1 year ago
Rahim Kanji	b4e9060f71	Modified Set Parser	1 year ago
Rahim Kanji	f0316c7d50	Since notices can reorder packets, it is important to account for this when calculating the result set size	1 year ago
Rahim Kanji	abbe02d99f	Implemented logic to store results with notices in the Query Cache	1 year ago
Rahim Kanji	395a977e68	Merge branch 'v3.0'	1 year ago
Rahim Kanji	f33fd02c37	Add COPY ... FROM STDIN detection regex	1 year ago
Rahim Kanji	b906c08992	Added dynamic fast forward support	1 year ago
Rahim Kanji	c4a8b0ec9b	Added FAST FORWARD support for PostgreSQL	1 year ago
Rahim Kanji	e64a4349d4	Few fixes	1 year ago
Rahim Kanji	967386d7d3	Added the SESSION_FORWARD_TYPE enum to define the type of session forwarding	1 year ago
Rahim Kanji	79c7f13768	Clean up	1 year ago
Rahim Kanji	6d614a4b99	Merge branch 'v3.0'	1 year ago
René Cannaò	85d8445b1a	Merge pull request #4726 from sysown/v3.0-postgres_read_only ... Second iteration on PostgreSQL monitoring POC - Read-Only Support	1 year ago
Rahim Kanji	616a8e0e23	Implemented handling of COPY OUT ... Added threshold checks to manage result size	1 year ago
Javier Jaramago Fernández	100630fba5	Second iteration on PostgreSQL monitoring POC ... This commit packs multiple fixes/improvements: - Added READONLY support for PostgreSQL. - Major rework for queries and statements used on monitoring checks: + Checks/Actions rewrote for single instance checks. + Reuse of prepared statements instance of re-preparation. - Fixed missing error handling in connection creation state machine. - Fixed connection rotation in connection pool (now FIFO). - Added support for configurable batching in scheduler thread, via '*_interval_window' variables. These variables allows to define the burstiness of the scheduling within the processing interval. - Added new config variable 'pgsql-monitor_dbname'. Allows to control which 'db' will be target by monitoring connections. - Several fixes for 'poll' timeout computation for worker threads. - Fixed edge cases for current interval detection. - Reduced deviation in scheduling intervals computation. - Refactored and simplified connection event handling. - Improved error messages for monitoring actions. - Replaced several invalid uses of 'mysql_thread___monitor_*' in favor or new 'mysql_thread___monitor_*' variables. - Honor '-M' argument for disabling monitoring support.	1 year ago
Rahim Kanji	5206747a7d	Fixed warning	1 year ago
Rahim Kanji	851a573f30	If query results needs to be cached, the pgsql_thread___query_cache_size_MB setting takes precedence over pgsql_thread___threshold_resultset_size	1 year ago
Rahim Kanji	720441af20	Refactored and Optimized Query Cache with PgSQL Support ... * Added Query Cache Support for PgSQL: * Introduced new variables for PgSQL Query Cache management: * pgsql-query_cache_size_MB * pgsql-query_cache_soft_ttl_pct * pgsql-query_cache_stores_empty_result * pgsql-query_cache_handle_warnings (not yet utilized) * Overwriting Transaction Status: * Sending current transaction state to the client when a result is returned from the query cache. * This currently does not differentiate between normal and error transaction states—both are treated as active transaction states. * Cache Lifetime Management: Replaced manual reference counting with std::shared_ptr to efficiently manage the lifecycle of cache entries, ensuring proper memory deallocation and reducing complexity. * Unified Purging Logic: Refactored the query cache purging logic to use a single thread for both MySQL and PgSQL cache entries. * Code Cleanup: Removed unnecessary methods and data members to streamline the codebase and improve maintainability. * Performance Optimization: Improved memory management, reducing memory footprint and enhancing performance.	2 years ago
Rahim Kanji	20bc367a7a	Fixed PgSQL Query Rewrite, Error message and Ok message	2 years ago
Rahim Kanji	ea3ce3c75c	Commenting Query Cache code for PgSQL Session	2 years ago
Rahim Kanji	8d62aae2f6	Merge branch 'v3.0' into v3.0_unsupported_features_error	2 years ago
Rahim Kanji	1d217455f9	Merge branch 'v3.0' into v3.0_md5_auth_support	2 years ago
Rahim Kanji	5f218441a3	Return an error if feature is not supported, instead of crashing (assert)	2 years ago
Rahim Kanji	a520a15537	Added MD5 authentication method	2 years ago
René Cannaò	dd67530af4	Adding some documentation	2 years ago
René Cannaò	04abd43a57	Initial commit with PostgreSQL support	2 years ago
René Cannaò	d4bd93672e	Merge pull request #79 from sysown/v2.x_refactore_query_processor ... Refactored Query Processor [WIP]	2 years ago
Rahim Kanji	e723082a1b	Refactored Query Processor Architecture ... - Introduced separate query processors for MySQL and PostgreSQL. - Removed unnecessary GTID logic from `PgSQL_Session`. - Added a command counter for PostgreSQL queries. - Refactored `Query_Processor` to serve as a base class containing core functionalities applicable to both MySQL and PostgreSQL. Changes: - Removed GTID-related code from `PgSQL_Logger` and `PgSQL_Session`: - bool with_gtid; - char gtid_buf[128]; - int gtid_hid; - Added new PostgreSQL-specific tables: - `pgsql_query_rules`, `pgsql_firewall_whitelist_rules`, `pgsql_query_rules_fast_routing` - `runtime_pgsql_query_rules`, `runtime_pgsql_firewall_whitelist_rules`, `runtime_pgsql_query_rules_fast_routing` - Added PostgreSQL-related variables: pgsql_thread___commands_stats pgsql_thread___query_digests pgsql_thread___query_digests_lowercase pgsql_thread___query_digests_no_digits pgsql_thread___query_digests_replace_null pgsql_thread___query_digests_normalize_digest_text pgsql_thread___query_digests_track_hostname pgsql_thread___query_digests_keep_comment pgsql_thread___query_digests_max_digest_length pgsql_thread___query_digests_max_query_length pgsql_thread___query_digests_grouping_limit pgsql_thread___query_digests_groups_grouping_limit pgsql_thread___enable_load_data_local_infile pgsql_thread___auditlog_filename pgsql_thread___auditlog_filesize pgsql_thread___eventslog_filename pgsql_thread___eventslog_filesize pgsql_thread___eventslog_default_log pgsql_thread___eventslog_format pgsql_thread___firewall_whitelist_errormsg pgsql_thread___firewall_whitelist_enabled pgsql_thread___query_processor_iterations pgsql_thread___query_processor_regex	2 years ago
René Cannaò	b64b087aab	Some code cleanup	2 years ago
René Cannaò	115eef2ea3	Some code cleanup	2 years ago
Rahim Kanji	672e7a5ac5	Fixed num_rows count ... Added affected_rows in PgSQL_Query_Result	2 years ago
Rahim Kanji	5bf827d8e4	Removed type selector	2 years ago
Rahim Kanji	3112a56da4	Added 'stats_pgsql_client_host_cache' and ... 'stats_pgsql_client_host_cache_reset' tables.	2 years ago
Rahim Kanji	2525f6df18	Added transaction status in write_ReadyForQuery	2 years ago
Rahim Kanji	e939cf088e	Added 'stats_pgsql_errors' and 'stats_pgsql_errors_reset' tables	2 years ago
Rahim Kanji	43d3ec82c8	Added stats_pgsql_processlist table ... * Implemented 'SHOW FULL PGSQL PROCESSLIST' command. * Implemented 'SHOW PGSQL PROCESSLIST' command.	2 years ago
Rahim Kanji	380651128a	Merge remote-tracking branch 'Master_POSTGRES/v2.x_proxysql_internal_session' into v2.x_stats_table	2 years ago
Rahim Kanji	e46b8a8dde	Handled commit and rollback command with and without semicolon	2 years ago
Rahim Kanji	c35a6a24cf	Added stats_pgsql_global table	2 years ago
Rahim Kanji	f9ed50650f	Updated set_dbname implementation for PostgreSQL	2 years ago
Rahim Kanji	2020b3f0be	Handled 'PROXYSQL INTERNAL SESSION' command for PostgreSQL session	2 years ago
Rahim Kanji	991031c938	Increased resultset buffer size to exact 16K	2 years ago
Rahim Kanji	fb0d8c0b69	Merge remote-tracking branch 'remotes/Master_POSTGRES/v2.x_postgres' into v2.x_postgres_backend ... Conflicts: lib/PgSQL_HostGroups_Manager.cpp lib/PgSQL_Thread.cpp	2 years ago
Rahim Kanji	db3fe26590	PgSQL_Thread will now reset connections independently, eliminating the ... need for connections purger HGCU_thread_run(). Changes made: Removed pgsql-reset_connection_algorithm Removed pgsql-connpoll_reset_queue_length Removed HGCU_thread_run()	2 years ago
Rahim Kanji	880d654011	Changing database on the same connection is not supported in PostgreSQL. If a connection with a different database is needed, a new connection will be created; otherwise, a connection with the same database (and username) will be selected from the connection pool.	2 years ago
Rahim Kanji	d01e883638	Renamed 'schemaname' to 'dbname' in PgSQL_Connection_userinfo	2 years ago
Rahim Kanji	058be0d9ae	* Reset the connection if there is a mismatch between client and server ... session variables. * Changing the user on the same connection is not supported in PostgreSQL. If a connection with a different username is needed, a new connection will be created; otherwise, a connection with the same username will be selected from the connection pool. * Added RESET SESSION timeout.	2 years ago
Rahim Kanji	a22aeca394	Reset Session Implementation ... * Added Reset Session support * Removed dead code	2 years ago
Rahim Kanji	0331ca7ff7	Merge remote-tracking branch 'Master_POSTGRES/v2.x_postgres' into v2.x_postgres_backend	2 years ago
Rene Cannao	cbc50d4494	More template for Session	2 years ago
Rene Cannao	43a2c526e6	Remove dead code	2 years ago
Rene Cannao	982ad5be0c	Template of Session::update_expired_conns()	2 years ago
Rahim Kanji	bd842d4f76	Ensure writeout is called only after all multi-statement results are fetched and processed	2 years ago
Rahim Kanji	3e90cccb7d	Merge remote-tracking branch 'Master_POSTGRES/v2.x_postgres' into v2.x_postgres_backend	2 years ago
Rene Cannao	0481ab5936	Adding some timers for debugging purposes ... Adding Timers in Base_Thread to count the number of time and elapsed time of when Session::handler() and Connection::handler() are called. This feature is disabled by default. Timers are enabled only if in proxysql_macros.h the following is defined: #define ENABLE_TIMER true The default: #define ENABLE_TIMER false	2 years ago
Rahim Kanji	b01792cae9	Added multi-statement support	2 years ago
Rene Cannao	8c09f3caec	Code cleanup after use of template in Base_Session	2 years ago
Rene Cannao	f7e923bfe6	Template for housekeeping_before_pkts()	2 years ago
Rene Cannao	48eff16cdc	Template for handler_special_queries_STATUS()	2 years ago
Rene Cannao	80928395cc	Template for reset_all_backends()	2 years ago
Rene Cannao	7563659198	Template for has_any_backend()	2 years ago
Rene Cannao	14c0ee023b	Disable autocommit from PgSQL_Session() ... Removed functions: * handler_again___verify_backend_autocommit() * handler_again___status_CHANGING_AUTOCOMMIT()	2 years ago
Rene Cannao	63573e3ca3	Removed handler_SetAutocommit from PgSQL_Session() ... PostgreSQL has no autocommit	2 years ago
Rene Cannao	66b7c103af	Moving return_proxysql_internal() to Base_Session	2 years ago
Rene Cannao	649c985384	Using template for writeout()	2 years ago
Rene Cannao	ae1e088d82	Initial work to write Base_Session	2 years ago
Rahim Kanji	27e1e4fb7a	Many improvements and bug fixes ... * Fixed OpenSSL includes and linking for LibPQ building. * Handled Empty query response. * Improve transaction status detection. * Implemented detection for unusable connections and fixed query retry mechanism. * Resolved Heap overflow issue. * Forward non-FATAL errors to client. * Added duplicate error detection to avoid adding multiple error packets in query result.	2 years ago
Rahim Kanji	65fc633cf5	Generic error handling, transaction detection and handling, bug fixes ... * Implemented generic error handling to cover all the scenarios. * Extraction of results from PGconn in case of connection errors. Introduced a patch to facilitate this. * Added transaction handling. * Ready packet now includes transaction status. * Split command completion and ready packet to increase flexibility. * Resolved multiple bugs to enhance stability.	2 years ago
Rahim Kanji	ef61c367a3	Added support for handling commands and errors ... * Renamed PgSQL_ResultSet to PgSQL_Query_Result to better represent its role in processing various result types, including command results, result sets, and errors. * Renamed PGUser to PGCredentials. * Added support for handling queries that produce commands and improved error handling. * Enhanced buffer functionality in PgSQL_Query_Result.	2 years ago
Rahim Kanji	a2516654cf	Added PgSQL Thread variables. ... Using a few MySQL thread variables, particularly for query digest, query processor, and query cache. In the future, we plan to create a global variable for modules that are common to both MySQL and PGSQL	2 years ago
Rahim Kanji	06a32365cc	Merge remote-tracking branch 'Master_POSTGRES/v2.x_postgres' into v2.x_postgres_backend	2 years ago
Rahim Kanji	dcbe140199	Route query to PostgreSQL backend server	2 years ago
René Cannaò	fde8ace076	Removed json.hpp from include files ... This seems to speedup compile time, and also lead to smaller binary	2 years ago
René Cannaò	c903a45633	Second attempt to use Base_Thread ... Moved register_session() into Base_Thread. Moved Session_Regex() from Client_Session() to Base_Session() just to fix some compiler issue. Also removed some dead code from previous commit.	2 years ago
René Cannaò	5f9ec09b21	Set fileeconding on PgSQL_Session.cpp ... Using vim: :set fileencoding=utf-8 on PgSQL_Session.cpp	2 years ago
Rahim Kanji	962e8c03e9	Added SSL connection support for PostgreSQL connection. ... * Added pgsql-have_ssl variable Note: There is a retrying mechanism when authentication fails if sslmode is prefer which seems incorrect. Need to investigate it.	2 years ago
Rahim Kanji	ebf20b6a60	* Added PostgreSQL configuration (port: 6034 Admin and 6035: PostgreSQL client connections) ... * Fixed few bugs * Added Load and Save commands for PostgreSQL tables	2 years ago
Rahim Kanji	e029d39007	Initial PostgreSQL commit ... * Added plain text and SCRAM authentication	2 years ago