47 Commits (fa74de3cf257dfd7c14c17403928d8b785c43df6)

Author	SHA1	Message	Date
Rahim Kanji	818025a3b3	Separate query cache metrics for MySQL and PostgreSQL ... Previously, query cache metrics were shared between MySQL and PostgreSQL, causing both to reflect the same values when performing cache operations. This change isolates the metrics for each database type.	4 months ago
Rahim Kanji	32dacf8e68	Handled case where pgsql_thread___query_cache_size_MB and mysql_thread___query_cache_size_MB value is zero '0'	1 year ago
Rahim Kanji	e74daa405d	Added documentation	1 year ago
Rahim Kanji	720441af20	Refactored and Optimized Query Cache with PgSQL Support ... * Added Query Cache Support for PgSQL: * Introduced new variables for PgSQL Query Cache management: * pgsql-query_cache_size_MB * pgsql-query_cache_soft_ttl_pct * pgsql-query_cache_stores_empty_result * pgsql-query_cache_handle_warnings (not yet utilized) * Overwriting Transaction Status: * Sending current transaction state to the client when a result is returned from the query cache. * This currently does not differentiate between normal and error transaction states—both are treated as active transaction states. * Cache Lifetime Management: Replaced manual reference counting with std::shared_ptr to efficiently manage the lifecycle of cache entries, ensuring proper memory deallocation and reducing complexity. * Unified Purging Logic: Refactored the query cache purging logic to use a single thread for both MySQL and PgSQL cache entries. * Code Cleanup: Removed unnecessary methods and data members to streamline the codebase and improve maintainability. * Performance Optimization: Improved memory management, reducing memory footprint and enhancing performance.	1 year ago
Andriy Utkin	5e79afa8e0	Set thread names	2 years ago
Miro Stauder	8394fd444e	use local includes - prometheus	2 years ago
Rahim Kanji	6b295477d6	Enhanced Warnings handling in ProxySQL: ... * Implemented 'SHOW WARNINGS' and 'SHOW COUNT(*) FROM WARNINGS' query handling. * When a query produces warnings, the warning count is now included in the query response. Additionally, a new variable 'mysql-query_cache_with_warnings_support' has been introduced for the query cache feature: * A value of '0' means that if a query execution produces warnings, the resultset will not be saved in the query cache. * A value of '1' indicates that if a query produces warnings, the resultset will be saved in the query cache, but the warning count in that resultset will be set to '0'. ** Note: * Warning handling is dependent on the query digest and 'mysql-query_digests' must be enabled for it to work. * Warnings saved in logfile ['mysql-log_mysql_warnings_enabled'] and the current feature can work in conjunction with each other.	2 years ago
René Cannaò	cfe5c0bcf0	Merge pull request #4091 from sysown/v2.x-HGMimpr01_mysql_hostgroup_attributes ... Drafting mysql_hostgroup_attributes	3 years ago
René Cannaò	51df157f3b	Rename query_cache_soft_ttl_percentage to query_cache_soft_ttl_pct	3 years ago
Javier Sánchez Parra	f5281b236b	Add soft TTL to Query Cache entries ... When Query Cache entries reach the soft ttl, the next query hit the backend and refresh the entry. While the refresh happens, other queries keeps getting the "old" Query Cache entry. Soft ttl is a percentage of the cache ttl and is defined by a global variable for all the entries. If the value is 0, soft ttl is disabled and no used.	3 years ago
René Cannaò	71e2510ef6	Code cleanup on MySQL_HostGroups_Manager ... Some rework to try to reduce duplicated code	3 years ago
Javier Jaramago Fernández	300532d6e2	Fix multiple warnings in logging function calls	3 years ago
Javier Sánchez Parra	e4b349cf8e	Fix unaligned memory access in OK to EOF package conversion ... Fix unaligned memory access in ok_to_eof_packet() when copying warnings and status flags from OK to EOF packages.	3 years ago
Javier Sánchez Parra	ef3478c5c2	Fix warnings and status position in EOF to OK package conversion ... If a client connects to ProxySQL not using CLIENT_DEPRECATE_EOF and it caches a resultset, when a client using CLIENT_DEPRECATE_EOF executes the same query it will get a resultset with wrong warnings and status flags. This is because warnings and status flags position must be swapped when converting an EOF packet to an OK packet. More info about warnings and status flags position in EOF and OK packets: https://dev.mysql.com/doc/dev/mysql-server/latest/page_protocol_basic_eof_packet.html https://dev.mysql.com/doc/dev/mysql-server/latest/page_protocol_basic_ok_packet.html	3 years ago
Javier Sánchez Parra	6a3a824a18	Fix sequence id in EOF to OK packet conversion #3698 ... Fix invalid resultset when using query cache and mixing clients using and not using CLIENT_DEPRECATE_EOF. If a client connects to ProxySQL not using CLIENT_DEPRECATE_EOF and it caches a resultset, when a client using CLIENT_DEPRECATE_EOF executes the same query it will get an invalid resultset and the client will disconnect. The data in the resultset is correct, but proxysql skips a sequence id thus the client assumes it is corrupted.	3 years ago
Javier Sánchez Parra	1d20198ac7	Fix status flag read from ok packet using 'CLIENT_DEPRECATE_EOF' ... Fix wrong offset when reading status flag from ok packet when converting from ok to eof.	3 years ago
Javier Jaramago Fernández	79e3d7a1b7	Added support to convert EOF packets into OK packets for 'Query_Cache' entries	5 years ago
Javier Jaramago Fernández	7150c7d8ed	Added metadata to 'Query_Cache' entries for supporting EOF deprecation	5 years ago
Javier Jaramago Fernández	2d60b06f55	Improved several prometheus metrics labelling and simplified some non-grouping ones	5 years ago
Javier Jaramago Fernández	f6e0e64f42	"Changed prometheus counter naming convention to include '_total' suffix" ... - Other metrics names has also be changed due to this global change.	5 years ago
Javier Jaramago Fernández	84f4c96afa	Multiple changes to multiple metrics definitions ... - Labelling has been simplified to group metrics which are part of a common group. - Help has been fixed to reflect this labelling change. - Doxygen doc and comment marks has been added to signal metrics grouping.	5 years ago
Javier Jaramago Fernández	ebedd5e37b	Several improvements to prometheus metrics definitions ... - Metrics now follow prometheus base unit convention. - Many metrics now make use of labels instead of enconding the info in the metric name. - Almost all metrics now have a meaningful 'help' message.	5 years ago
Mark Knapp	460d75efc8	Fix cache size calculation integer overflow ... Signed-off-by: Mark Knapp <mknapp@hudson-trading.com>	6 years ago
Javier Jaramago Fernández	dbbfc397a6	"Added helper function and uniformed 'hostgroup_manager' metrics update" ... - Added new helper function to simplify ''prometheus::counters' update and removed code duplication using it. - 'hostgroup_manager' now exposes the same method 'p_update_metrics' as the other modules.	6 years ago
Javier Jaramago Fernández	a4e4e57343	Moved all 'metrics_maps' to source files	6 years ago
Javier Jaramago Fernández	864535d3f9	Added support for GCC 4.8 and removed per-module metrics initialization functions ... - GCC 4.8 and 5 have issues with uniform initialization syntax, for this reason, all it's uses have been replaced with assignements. - Per-module metrics initialization functions are no longer required, they have been replaced with the new generic ones.	6 years ago
Javier Jaramago Fernández	4d961542b2	Added metrics help and replaced metrics impl with new array based one for 'query_cache' module	6 years ago
Javier Jaramago Fernández	026b083f69	Added new prometheus 'query_cache' metrics	6 years ago
René Cannaò	b8f6e0ff80	Fix integer overflow in Query Cache size #2040	7 years ago
Carson Ip	1232a6382e	Fix minor typos	7 years ago
Steven Shi	5b76f9c1fe	cache purging request on query rule basis, issue #1013	8 years ago
René Cannaò	a0bdae67d1	Remove spinlock from Query Cache #977	9 years ago
René Cannaò	a6c53d0d12	Revert "Refactor header includes."	9 years ago
Maxim Bublis	30dbcc21a8	Refactor header includes. ... * reduce build time by 25%; * remove circular dependency on `cpp.h` and other headers. * fixes issue with `my_global.h` from mariadbclient which redefines `__attribute__`, that leads to broken STL and GCC intrinsics if `<algorithm>` wasn't included prior including this header; * fixes another issue with redefined `__attribute__` which leads to `_conn_exchange_t` not being aligned to cache line size; * removes `pthread_setstacksize` calls as `my_global.h` redefines `pthread_setstacksize` to be `pthread_dummy(0)` which led to stack size being never adjusted; * add missing include guards to some headers; * remove unused proxysql_hash.h header.	9 years ago
Maxim Bublis	043a321e55	Cleanup legacy codebase.	9 years ago
René Cannaò	e29f70976a	Implemented aggressive query cache purging #690 ... Aggressive purging is triggered when 90% of the memory limit is reached Fixed also a bug in the computation of memory used	10 years ago
René Cannaò	b151da0971	Further metrics for Query Cache #140 ... * Query_Cache_Entries : number of entries currently in the cache (including inactive) * Query_Cache_Purged : number of entries removed from the cache	10 years ago
René Cannaò	6563ae3d22	Export Query Cache metrics , #140 ... New available metrics: * Query_Cache_Memory_bytes : memory allocated in QC * Query_Cache_bytes_IN : amount of data inserted into QC * Query_Cache_bytes_OUT : amount of data retrieved from QC * Query_Cache_count_GET : total GET from QC * Query_Cache_count_GET_OK : successful GET from QC * Query_Cache_count_SET : total SET into QC Important note on `Query_Cache_Memory_bytes` : Query Cache thread purge doesn't initialize any purging if memory allocated in QC is below 3% of maximum memory.	10 years ago
René Cannaò	b5fb363d1c	Merge branch 'v1.2.2-issue140' into v1.2.2	10 years ago
René Cannaò	f50e95f1f1	Exporting QC metrics via SQL3_getStats , #140 ... Still a draft	10 years ago
René Cannaò	41acb178ee	mysql_thread___query_cache_size_MB refreshed in QC ... Issue #171	10 years ago
René Cannaò	c710f54987	Compiling optimization ... * converted MySQL_Authentication to use unsorted_map instead of btree_map * Query_Cache now uses pointers to KV_BtreeArray * removed some unnecesary headers	10 years ago
René Cannaò	4c937fa1bf	Query Cache timeout in milliseconds ... Issue #452 Closes #452	10 years ago
René Cannaò	5eff88f24f	Changes on QC ... Summary: removed KV_Btree_Array.cpp removed query_SQL from MySQL_Data_Stream added some documentation for QC_entry_t Query_Cache::get() and Query_Cache::set() now requires also the length of the key Query_Cache::get() and Query_Cache::set() now process hk (the hash key) using the length of the key Query Cache enhancement on user/schema Query Cache now supports distinct entries based on user/schema . This is achieved passing to Query_Cache::set() and Query_Cache::get() the hash that identifies user and schema Test Plan: None Reviewers: rene Differential Revision: http://phab.sysown.com/D3	10 years ago
René Cannaò	60ddf5d8e4	Changes on QC ... removed KV_Btree_Array.cpp removed query_SQL from MySQL_Data_Stream added some documentation for QC_entry_t Query_Cache::get() and Query_Cache::set() now requires also the length of the key Query_Cache::get() and Query_Cache::set() now process hk (the hash key) using the length of the key	10 years ago
René Cannaò	b596350c06	Modified version: 0.2.0902 , 20150902 , Kleon ... Closes #379	11 years ago
René Cannaò	d9a2df7039	Query Cache is not a plugin anymore	11 years ago