proxysql

Commit Graph

Author	SHA1	Message	Date
Javier Jaramago Fernández	bcb009fc24	Revert "Merge pull request #3645 from sysown/v2.x-2021" This reverts commit `9561cb3ef2`, reversing changes made to `7edfec6f3f`.	4 years ago
René Cannaò	e892413d1a	Merge branch 'v2.x' into v2.x-2021	4 years ago
René Cannaò	698031eb7a	Merge pull request #3676 from sysown/v2.x-3592 Added new metric 'proxysql_fds_in_use' exposing number of file descriptors in use - Closes #3592	4 years ago
René Cannaò	a6edd02a9b	Revert "Merge branch 'v2.x' into v2.x-2021" This reverts commit `3a3931f2d4`, reversing changes made to `4694ab775e`.	4 years ago
René Cannaò	79d1d8742c	Testing unbalanced weight	4 years ago
Javier Jaramago Fernández	71a1f64f2d	Added new metric 'proxysql_fds_in_use' reporting the current number of file descriptors in use #3592	5 years ago
Javier Jaramago Fernández	416a0470a5	Added tables 'stats_mysql_client_host_cache' and 'stats_mysql_client_host_cache_reset' exposing entries in 'client_host_cache'	5 years ago
René Cannaò	538feddc87	Code cleanup Commenting out ProxySQL_Admin::__insert_or_ignore_maintable_select_disktable()	5 years ago
René Cannaò	78f8821215	More code coverage mostly related to Admin	5 years ago
Javier Jaramago Fernández	ba1762bc3e	Implemented sync support for 'ldap-%' global variables	5 years ago
René Cannaò	f7754a5e00	HostGroups lookup using unordered_map HostGroups are stored in an array of pointers. This commit allows the lookup using an unordered_map if the number of Hostgroups is greater than 100. For less number of hostgroups, a sequential scan seems more efficient. This also introduce a test for micro benchmark.	5 years ago
René Cannaò	532a0397f7	Faster MySQL_HostGroups_Manager::read_only_action This commit rewrites MySQL_HostGroups_Manager::read_only_action() in way to reduce the calls to SQLite. It relies on two new std::set() : - read_only_set1: if the server is already in a writer hostgroup - read_only_set2: a cache to track the first time that a server has RO=0 Added also an index on MySQL_HostGroups_Manager, ON mysql_servers (hostname,port)	5 years ago
Javier Jaramago Fernández	d2a566901e	Added support for 'SHOW PROMETHEUS METRICS' command	6 years ago
Javier Jaramago Fernández	6a1d616396	Renamed 'interval_ms' from 'restapi_routes' table into 'timeout_ms'	6 years ago
Javier Jaramago Fernández	05a005f9fb	Add support for syncing 'mysql-variables' and 'admin-variables' #2820 (#2856 ) * Added forgotten metric increase in case of 'sync conflict' on proxysql_servers * Added support for 'global_variables' sync in proxysql_cluster - Added several for getting the peers to be sync. - Added function to pull the target 'global_variables' to sync. - Added metrics for 'global_variables' sync: + Number of syncs done / failed. + Sync conflicts. + Sync warnings. * Removed unnecesary escaping for '%' char * Fixed issue due to 'flush_mysql_variables___runtime_to_database' being called without proper locking * Added simple helper function to get the output from a command execution * Multiple changes to 'cluster_synct' test + Spawned proxysql instance now runs inside a docker container. + Simplified launching and logging of spawned proxysql instance. + Added more verbose logging about the tables state. + Added new tests for 'global_variables' synchronization. * Commented several variables known to not-sync and fixed port for replica 'proxysql_server' * Removed deprecated and non-syncable variables from 'test_cluster_sync-t' * Added extra logging for variables sync for 'test_cluster_sync-t'	6 years ago
Javier Jaramago Fernández	80e9b4c0d8	Changed new variable name to 'admin___web_verbosity' for being compliant with current 'thread' naming convention	6 years ago
Javier Jaramago Fernández	576e735d14	Added new variable 'web_verbosity' to control web verbosity	6 years ago
René Cannaò	449f4eb659	Adding debug_filters	6 years ago
René Cannaò	03bf53aec8	Preparing the cluster module to sync variables Added admin variables: * cluster_mysql_variables_save_to_disk * cluster_admin_variables_save_to_disk * cluster_mysql_variables_diffs_before_sync * cluster_admin_variables_diffs_before_sync When flush_admin_variables___database_to_runtime() is executed, flush_admin_variables___runtime_to_database() is also called to update admin variable checksum. When flush_mysql_variables___database_to_runtime() is executed, flush_mysql_variables___runtime_to_database() is also called to update mysql variable checksum. flush_mysql_variables___runtime_to_database() was also modified to avoid locking twice.	6 years ago
Javier Jaramago Fernández	225c253607	Added new 'prometheus_memory_metrics_interval' admin variable	6 years ago
Javier Jaramago Fernández	a4e4e57343	Moved all 'metrics_maps' to source files	6 years ago
Javier Jaramago Fernández	864535d3f9	Added support for GCC 4.8 and removed per-module metrics initialization functions - GCC 4.8 and 5 have issues with uniform initialization syntax, for this reason, all it's uses have been replaced with assignements. - Per-module metrics initialization functions are no longer required, they have been replaced with the new generic ones.	6 years ago
Javier Jaramago Fernández	d07c95b2e9	Added metrics help and replaced metrics impl with new array based one for 'proxysql_admin' module	6 years ago
Javier Jaramago Fernández	c6f75ea454	Added more metrics, fixed some invalid updated ones and standarized the 'update_modules_metrics' callback	6 years ago
Javier Jaramago Fernández	472207b951	Added new 'stmt', 'memory' prometheus metrics and callback with new metrics updates	6 years ago
Javier Jaramago Fernández	621332d423	Added new prometheus exposer to ProxySQL_Admin	6 years ago
René Cannaò	9c2f0bf3ac	Adding tests to benchmark multiple lookups in mysql_query_rules_fast_routing	6 years ago
Valentin Rakush	f0687f3688	Implement restapi functionality - restapi_routes table in admin module - calling python script (json validation, error handling) - scripts: metrics, export_users - tests adjusted	6 years ago
René Cannaò	b59fad2d42	Merge pull request #2413 from val214/v2.0.9-select-config-file V2.0.9 select config file [FR]	6 years ago
René Cannaò	e9dc7a9b60	Implementation of SQLI fingerprints whitelist libsqlinjection generates a lot of false positives. This commit introduces a new table: mysql_firewall_whitelist_sqli_fingerprints This table can list fingerprints generated by libsqlinjection: if the fingerprint is listed in this table, proxysql will consider it as a false positive. This commit also enables SQLi algorithm only if the query is not already explicitly whitelisted.	6 years ago
Valentin Rakush	6bd6c0a34b	Move config file read/write functions to separate file.	6 years ago
Valentin Rakush	52b5ee9486	export proxysql configuration to resultset	6 years ago
Valentin Rakush	9430cabee3	SELECT CONFIG FILE implementation	6 years ago
René Cannaò	9afe6824ff	Merge pull request #2407 from sysown/v2.0.9-libmicrohttpd-0.9.68 V2.0.9 libmicrohttpd 0.9.68	6 years ago
René Cannaò	485d313514	Further development of firewall whitelist. * introduced 2 new variables: - mysql-firewall_whitelist_enabled : defines if the firewall with whitelist algorithm is enabled or not - firewall_whitelist_errormsg : error message returned to the client if an error message is not already set * Query_Processor returns firewall_whitelist_mode to the calling MySQL_Session, but the logging on error log currently happens within the Query_Processor itself * if mysql-firewall_whitelist_enabled is turned on and a user it is not found in mysql_firewall_whitelist_users , the default behavior is that query is rejected * lookup on mysql_firewall_whitelist_users happens for username@ip (specific IP) and username@'' (all IPs) . Match on network subnet is currently not implemented * implemented SAVE MYSQL FIREWALL FROM RUNTIME * fixed implementation of SAVE MYSQL FIREWALL TO DISK * runtime configuration can be viewed in runtime_mysql_firewall_whitelist_rules and runtime_mysql_firewall_whitelist_users	6 years ago
René Cannaò	1673249da4	Adding libhttpserver , and a simple "Hello World" libhttpserver will take care of REST API. The feature is currently disabled.	6 years ago
René Cannaò	80e92b144d	[WIP] Second commit for mysql firewall whitelist Improved also compiling time	7 years ago
René Cannaò	5023f2d430	Expending tests for firewall whitelist On a normal laptop, the lookup for one entry in a hash table with 39k keys and a total of 980k entries, takes around 1.1us	7 years ago
René Cannaò	7f6d64c3db	First commit for firewall whitelist	7 years ago
René Cannaò	6bed334db1	stats_history.history_mysql_query_digest #2368 Implementation of new table stats_history.history_mysql_query_digest #2368 Implemented command `SAVE MYSQL DIGEST TO DISK`. Save to disk with really minimal memory footprint compared to querying `stats_mysql_query_digest` or `stats_mysql_query_digest_reset` . Implemented new admin variable `admin-stats_mysql_query_digest_to_disk` to automatically save to disk.	7 years ago
René Cannaò	a0ea0c118c	V2.0.8 fast routing (#2309 ) * Implementation of unit tests related to mysql_query_rules_fast_routing * Implementation of rules_fast_routing with khash * Adding memory usage for new fast routing algo	7 years ago
Valentin Rakush	757684c6d9	[FR] Group Replication Timeout count	7 years ago
René Cannaò	2fec51c0a9	A lot of changes to make query digest map faster Extended SQLite3_result to support a mutex for concurrent rows insert. Extensively rewritten get_query_digests() and get_query_digests_reset() to support multiple threads, and concurrently generate a resultset. Function get_query_digests_reset() defer the deletion of objects from query digest map after generating the resultset for Admin. This drastically reduce the amount of time that query digest map is locked. Rewritten get_query_digests_total_size() to make it multi-threaded. Added 3 new functions for purging: - purge_query_digests() : wrapper - purge_query_digests_sync() : synchronous purge of query digest map, either single-threaded or multi-threaded - purge_query_digests_async() : asynchronous purge of query digest map, single-threaded only If table `stats_mysql_query_digest_reset` is queried but not `stats_mysql_query_digest`, only the first one is populated. If table `stats_mysql_query_digest_reset` is queried and also `stats_mysql_query_digest`, the second one is populated as a copy from the first. Implemented new SQL `TRUNCATE [TABLE]` for `[stats.]stats_mysql_query_digest[_reset]`: this will purge the query digest map as fast as possible without creating any table in SQLite. For testing/benchmark: - modified ProxySQL_Test___GenerateRandomQueryInDigestTable() to generate more random data and randomly switch `mysql_thread___query_digests_normalize_digest_text` Extended command `PROXYSQLTEST` with the following tests: - 1 : generates entries in digest map - 2 : gets all the entries from the digest map, but without writing to DB, with multiple threads - 3 : gets all the entries from the digest map and reset, but without writing to DB, with multiple threads - 4 : purges the digest map, synchronously, in single thread - 5 : purges the digest map, synchronously, in multiple threads - 6 : purges the digest map, asynchronously, in single thread (this seems the faster) Replaced some sprintf() with new function my_itoa() . Modified class QP_query_digest_stats() to include username, schemaname and client_address if no longer than 24 bytes. This makes storage requirement for QP_query_digest_stats() bigger, but reduces a lot of calls to memory management. Modified QP_query_digest_stats::get_row() to drastically reduce the number of malloc/free and string copy. Overall, this commit has the following effects: - it increases the memory usage for query digest map. On test workload, this results in 10% more memory usage - drastically reduces the calls to memory management - populating `stats_mysql_query_digest_reset` is 3 times faster - the amount of time in which query digest map is locked is reduced by 95%	7 years ago
René Cannaò	b12caa1d8c	Adding support for automated testing of Galera Using SQLite3 Server as backend	7 years ago
René Cannaò	58ff4ff892	Merge branch 'v2.0.4' into v2.0.1-aurora	7 years ago
René Cannaò	495c933624	Adding table stats.stats_mysql_free_connections This table exports metrics about connections in connection pool	7 years ago
René Cannaò	528d8cac38	Improved debugging Added new command `PROXYSQL INTERNAL SESSION` that clients can execute to receive internal information about their own connection in JSON format. Added JSON library. Recompiled SQLite3 to support JSON. Added new column `extended_info` in `stats_mysql_processlist`. Added new mysql variable `mysql-show_processlist_extended` that determine the content of `stats_mysql_processlist.extended_info`: - 0 : no info - 1 : JSON format - 2 : JSON format with pretty printing	7 years ago
René Cannaò	2e20854684	Second commit (not complete) to support Aurora	7 years ago
René Cannaò	b82a1c18ac	Merge pull request #1857 from sysown/v2.0.0-digestSplit V2.0.0 digest split	7 years ago
René Cannaò	782aae072e	Implement automatic vacuum of stats schema #1011	7 years ago

1 2 3

129 Commits (fbd3eade83dad67bafe8f32dbe9b29b227ce9d4c)