84 Commits (803115f5045f1ca03bbd8b65d313bdffde6f1c21)

Author	SHA1	Message	Date
Rene Cannao	4491f3ce0b	Add debug logging to MCP bridge for troubleshooting ... Add PROXYSQL_MCP_DEBUG environment variable to enable verbose logging of all stdio communication and ProxySQL HTTP requests/responses.	3 months ago
Rene Cannao	01c182ccac	Add stdio MCP bridge for Claude Code integration ... Add a Python stdio-based MCP server that bridges to ProxySQL's HTTPS MCP endpoint, enabling Claude Code to use ProxySQL MCP tools directly. The bridge: - Implements stdio MCP server protocol (for Claude Code) - Acts as MCP client to ProxySQL's HTTPS endpoint - Supports initialize, tools/list, tools/call methods - Handles authentication via Bearer tokens - Configurable via environment variables Usage: - Configure in Claude Code MCP settings - Set PROXYSQL_MCP_ENDPOINT environment variable - Optional: PROXYSQL_MCP_TOKEN for auth	3 months ago
Rene Cannao	9d6a2173bf	Enhance Rich CLI with configurable LLM chat path and better tracing ... LLM improvements: - Add configurable chat path (LLM_CHAT_PATH or --llm-chat-path) to support non-standard endpoints like Z.ai's /api/coding/paas/v4 - Add optional JSON mode (LLM_JSON_MODE or --llm-json-mode) for models that support native JSON output - Enhanced tracing: log HTTP status and response body snippet on every request - Safer JSON parsing: treat empty content as error with helpful message - Better error messages with diagnostic hints Code cleanup: - Remove intent command (simplify CLI) - Remove user_intent reading and passing - Simplify stopping logic (just run max_iterations) - Clean up formatting and remove unused code	3 months ago
Rene Cannao	f2ca750c05	Add MCP Database Discovery Agent (initial commit) ... Add a database discovery agent prototype that uses LLMs to explore databases through the MCP Query endpoint. Includes: - Rich CLI (discover_cli.py): Working async CLI with Rich TUI, proper MCP tools/call JSON-RPC method, and full tracing support - FastAPI_deprecated_POC: Early prototype with incorrect MCP protocol, kept for reference only The Rich CLI version implements a multi-expert agent architecture: - Planner: Chooses next tasks based on state - Structural Expert: Analyzes table structure and relationships - Statistical Expert: Profiles tables and columns - Semantic Expert: Infers domain meaning - Query Expert: Validates access patterns	3 months ago
Rene Cannao	ef5b99edbf	Fix MCP tool bugs: NULL value handling and query validation ... - Fixed NULL value handling in execute_query: use empty string instead of nullptr to avoid "basic_string: construction from null" errors - Fixed validate_readonly_query: corrected substring length check from substr(0,6)!="SELECT " to substr(0,6)!="SELECT" - Fixed test script: added proper variable_name parameter for get_config/set_config tools Query endpoint tools now pass all tests.	3 months ago
Rene Cannao	de33d177be	Fix verbose mode in test_mcp_tools.sh ... Verbose output was being printed to stdout, contaminating the captured response value and causing tool discovery to fail. Redirect debug output to stderr instead.	3 months ago
Rene Cannao	25cda31f08	Update test_mcp_tools.sh with dynamic tool discovery ... - Add discover_tools() function that calls tools/list on each endpoint - Store discovered tools in temp file to avoid bash associative array issues - Define all expected tools with test configurations - Only test tools that are discovered via tools/list - Add support for all 5 endpoints: config, query, admin, cache, observe - Add --list-only flag to show discovered tools without testing - Add --endpoint flag to test specific endpoint - Improve help output with endpoint descriptions	3 months ago
Rene Cannao	093511920f	Add environment variable printing to MCP scripts ... Print environment variables at the start of each script when they are set: - setup_test_db.sh: Shows MYSQL_HOST, MYSQL_PORT, MYSQL_USER, MYSQL_PASSWORD, TEST_DB_NAME - configure_mcp.sh: Shows MYSQL_HOST, MYSQL_PORT, MYSQL_USER, MYSQL_PASSWORD, TEST_DB_NAME, MCP_PORT - test_mcp_tools.sh: Shows MCP_HOST, MCP_PORT This helps users verify that the correct environment variables are being used.	3 months ago
Rene Cannao	7f957088ee	Fix configure_mcp.sh to allow empty MySQL passwords ... Change MYSQL_PASSWORD from using :- to = for default value. This allows setting an empty password via environment variable: - MYSQL_PASSWORD="" will now use empty password - Previously, empty string was treated as unset, forcing the default	3 months ago
Rene Cannao	49e6ac5bc6	Revert configure_mcp.sh to respect environment variables ... The script correctly uses ${VAR:-default} syntax, so it already respects environment variables. The issue was with the MCP server not reinitializing when MySQL configuration changes, which is a separate issue.	3 months ago
Rene Cannao	40cff23c3b	Initialize MySQL Tool Handler and fix default MySQL port ... - Initialize MySQL_Tool_Handler in ProxySQL_MCP_Server constructor with MySQL configuration from MCP variables - Use GloVars.get_SSL_pem_mem() to get SSL certificates correctly - Add MySQL_Tool_Handler cleanup in destructor - Change configure_mcp.sh default MySQL port from 3307 to 3306 - Change configure_mcp.sh default password from test123 to empty - Update help text and examples to match new defaults	3 months ago
Rene Cannao	aeafa61a11	Fix test_mcp_tools.sh to use correct MCP endpoint paths ... - Change /config to /mcp/config - Change /query to /mcp/query	3 months ago
Rene Cannao	d17fe1dba8	Fix configure_mcp.sh error handling and endpoint paths ... - Split exec_admin into exec_admin (shows errors) and exec_admin_silent - Execute each SET command individually to catch specific failures - Add proper error checking and early exit on configuration failures - Fix MCP endpoint test URL from /config to /mcp/config - Update displayed endpoint URLs to include /mcp/ prefix and all 5 endpoints	3 months ago
Rene Cannao	60d4a7378c	Implement automatic MCP server start/stop and add environment variable support ... - Add automatic MCP HTTPS server start/stop based on mcp-enabled flag - Server starts when mcp-enabled=true and LOAD MCP VARIABLES TO RUNTIME - Server stops when mcp-enabled=false and LOAD MCP VARIABLES TO RUNTIME - Validates SSL certificates before starting - Added to both flush_mcp_variables___database_to_runtime() and flush_mcp_variables___runtime_to_database() functions - Update configure_mcp.sh to respect environment variables - MYSQL_HOST, MYSQL_PORT, MYSQL_USER, MYSQL_PASSWORD - TEST_DB_NAME (mapped to MYSQL_DATABASE) - MCP_PORT - Updated --help documentation with all supported variables	3 months ago
Rene Cannao	28742554b5	Use relative catalog path instead of absolute path ... - Change mcp-catalog_path default from /var/lib/proxysql/mcp_catalog.db to mcp_catalog.db - SQLite accepts relative paths, which are resolved relative to the process working directory - ProxySQL's working directory is its datadir, so the catalog will be stored there - Update configure_mcp.sh to set mcp-catalog_path='mcp_catalog.db' - Update lib/MCP_Thread.cpp default to "mcp_catalog.db" - Update README.md to document relative path behavior	3 months ago
Rene Cannao	c53b28e42a	Add comprehensive documentation to MCP README ... - Add architecture overview with ASCII diagram showing all components - Add detailed component explanations (ProxySQL MCP Module, Connection Pool, Catalog, Test Scripts) - Add testing flow diagram with 4-step process - Add Quick Start section with copy/paste commands for native and Docker modes - Add detailed documentation for each script explaining what they do and why - Add troubleshooting section for common issues - Add default configuration reference table - Add environment variables reference This allows users to understand the architecture and run tests without needing to understand implementation details.	3 months ago
Rene Cannao	b3646b4798	Fix argument parsing and documentation in setup_test_db.sh ... Fixed critical issues with argument parsing that prevented the script from working correctly: 1. Fixed argument order - script now supports both: - ./setup_test_db.sh <command> [options] - ./setup_test_db.sh [options] <command> 2. Fixed --help option - now shows help instead of running commands 3. Updated README.md examples with correct syntax: - OLD: ./setup_test_db.sh --mode native start (wrong) - NEW: ./setup_test_db.sh start --mode native (correct) The script now properly: - Parses -h/--help anywhere and shows usage - Handles options before or after the command - Auto-detects mode when not specified - Shows helpful connection info after setup All examples in README.md updated with correct command syntax.	3 months ago
Rene Cannao	3d827144e8	Add required environment variables section to README ... Added comprehensive environment variable documentation to the README Prerequisites section to make it clear what needs to be configured before running the test scripts. Changes: - Added "Required Environment Variables" subsection under Prerequisites - Listed all ProxySQL Admin, MySQL, and MCP server environment variables - Added quick setup example for adding variables to ~/.bashrc - Made it clear that PROXYSQL_ADMIN_PASSWORD and MYSQL_PASSWORD need to be set Users now have clear guidance on required configuration before testing.	3 months ago
Rene Cannao	ad2e2a24d1	Add native MySQL mode support to test database setup ... Updated setup_test_db.sh to support both Docker and native MySQL modes. Changes: - Added --mode option: docker, native, or auto (default: auto-detect) - Auto-detect: tries Docker first, then falls back to native MySQL - Native mode functions: start_native, status_native, connect_native, reset_native - Native mode connects to existing MySQL server (no Docker required) - Added --host, --port, --user, --password, --database options - Environment variable support: MYSQL_HOST, MYSQL_PORT, MYSQL_USER, MYSQL_PASSWORD Updated README.md with: - Native mode quick start guide - Docker mode quick start guide - Auto-detect mode documentation - Comprehensive setup_test_db.sh usage examples - Environment variable documentation Usage examples: # Auto-detect mode ./setup_test_db.sh start # Native MySQL mode ./setup_test_db.sh --mode native --host localhost --port 3306 start # Docker mode ./setup_test_db.sh --mode docker start	3 months ago
Rene Cannao	e9a6dd0b3e	Add comprehensive MCP testing suite in scripts/mcp/ ... Created a complete testing suite for the MCP module with MySQL connection pool and exploration tools. Files added: - README.md: Comprehensive testing documentation - setup_test_db.sh: Docker-based test MySQL database setup - Start/stop/status/connect commands - Creates sample schema (customers, orders, products, order_items) - Includes views and stored procedures for testing - configure_mcp.sh: ProxySQL MCP module configuration - Configures MySQL connection parameters - Enables/disables MCP server - Shows current configuration status - test_mcp_tools.sh: Main MCP tools test suite - Tests all 15 MCP tools (list_schemas, list_tables, etc.) - Includes catalog tests (upsert, get, search, delete) - Reports pass/fail statistics - stress_test.sh: Concurrent connection stress testing - Configurable number of concurrent requests - Response time measurement - Success rate calculation - test_catalog.sh: Catalog/LLM memory specific tests - 12 catalog operation tests - FTS search testing - CRUD verification All scripts are executable and include: - Command-line argument parsing - Colored output for readability - Error handling and validation - Usage/help documentation - Environment variable support	3 months ago
Rene Cannao	62cbd6c71e	Fix issues identified in AI code review ... - Fix combined_search: Build SQL query dynamically based on search_term - Only include MATCH relevance when search_term is provided - Fix parameter binding (fulltext_params vs params) - Fix search_term/query parameter mismatch in run_demo - combined_search mode now correctly receives query from kwargs - Add environment variable support for database credentials - nlp_search_demo.py: DB_HOST, DB_PORT, DB_USER, DB_PASSWORD, DB_NAME - stackexchange_posts.py: SOURCE_DB_* and TARGET_DB_* variables - Fix README CreationDate SQL example to use JSON_EXTRACT - Add zero division checks in get_table_stats and similarity_search_preparation	3 months ago
Rene Cannao	ecfff09633	Add NLP search demo script with comprehensive search capabilities ... - Create nlp_search_demo.py with full-text, boolean, tag-based, and combined search - Include statistics and similarity search preparation modes - Add proper error handling with MySQL fallback mechanisms - Fix syntax errors and indentation issues - Update README.md with correct command usage examples - Support --mode parameter with appropriate sub-parameters - Demonstrate various search techniques on processed StackExchange posts	3 months ago
Rene Cannao	d37d291488	Implement comprehensive StackExchange posts processing with search capabilities ... - Unified script that creates target table with search-optimized schema - Adds full-text search indexes and text processing for better search results - Implements duplicate detection and prevention - Fixed MySQL functional index compatibility issue (removed problematic Tags index) - Added support for --limit 0 to process all posts - Added --warning-large-batches flag for batch size > 1000 - Improved text cleaning and normalization for search optimization - Enhanced progress tracking and batch processing efficiency Removes separate scripts (populate_search_columns.py, nlp_search_demo.py) and consolidates all functionality into unified solution.	4 months ago
Rene Cannao	d94dc036e8	Add StackExchange posts processing script with JSON storage ... - Retrieves parent posts (PostTypeId=1) and their replies (PostTypeId=2) from MySQL - Combines posts and tags into structured JSON format - Supports batch processing with memory-efficient chunking - Includes duplicate checking to avoid reprocessing - Creates target table automatically with JSON storage and BLOB for embeddings - Handles large datasets with offset-based pagination - Optimized to skip duplicate processing work - Includes verification and progress tracking Files: - scripts/stackexchange_posts.py: Main processing script	4 months ago
Rene Cannao	221831afc1	Add usage examples to script documentation and help output ... Changes: 1. Add comprehensive usage examples to script docstring with: - Remote API example (requires API_KEY environment variable) - Local Ollama example (uses --local-ollama flag) - Both examples show all common command line options 2. Add epilog to argparse help with concise examples: - Shows minimal command line for both modes - Points to docstring for full examples - Uses RawDescriptionHelpFormatter for proper formatting Users now have multiple ways to access usage information: - Read script header with `head -50 scripts/process_posts_embeddings.py` - Run `python3 scripts/process_posts_embeddings.py --help` - Both show appropriate examples for remote API and local Ollama modes	4 months ago
Rene Cannao	4aba7137b4	Add --local-ollama option for local Ollama server support ... New option: --local-ollama - Uses Ollama format with localhost:11434 API endpoint - Model: nomic-embed-text-v1.5 (without hf: prefix) - No API_KEY environment variable required - Overrides api-format, api-url, and api-model flags Changes: 1. Add --local-ollama boolean flag to parse_args() 2. Modify check_env() to skip API_KEY check when local-ollama is set 3. Update configure_client() to generate Ollama-specific SQL without 'key' parameter 4. Update main() to display correct configuration based on mode 5. Update documentation with local Ollama usage Behavior: - Without --local-ollama: Requires API_KEY, uses remote API with configurable format/url/model - With --local-ollama: No API_KEY needed, uses fixed local Ollama configuration	4 months ago
Rene Cannao	ffdb334dc3	Add WHERE filters to prevent empty input errors and fix SQL syntax ... Changes: - Filter Posts by PostTypeId IN (1,2) (Questions and Answers) - Filter by minimum text length > 30 characters (Title + Body) - Update get_total_posts to count only eligible posts for accurate progress - Fix SQL syntax error in process_batch WHERE clause - Update documentation with filter details Rationale: - Empty or very short text causes embedding generation failures - PostTypeId 1,2 are most relevant content (Questions and Answers) - Ensures consistent counting between total, remaining, and processed	4 months ago
Rene Cannao	36a59f3f56	Add Posts embeddings processing script with exponential backoff ... New script: scripts/process_posts_embeddings.py Features: - Connects to SQLite3 server via MySQL connector with configurable credentials - Configures API client using API_KEY environment variable (fails if not set) - Processes unembedded Posts rows in configurable batch sizes (default: 10) - Uses LEFT JOIN WHERE IS NULL pattern to track unprocessed rows - Implements exponential backoff for retry failures with 5-minute maximum cap - Shows progress: remaining rows, processed count, percentage complete - Fails if Posts_embeddings table doesn't exist (no automatic creation) - Handles concurrent processing race conditions with small delays Script prerequisites: 1. Posts table must exist (copied from MySQL) 2. Posts_embeddings virtual table must exist: CREATE VIRTUAL TABLE Posts_embeddings USING vec0(embedding float[768]); Backoff behavior: - Default retry delay: 5 seconds - Exponential increase: 5s, 10s, 20s, 40s, ... up to 300s maximum - Resets on any successful operation (even if 0 rows processed)	4 months ago
Rene Cannao	95a95cb479	Add script to copy StackExchange Posts table from MySQL to SQLite3 server ... This Python script uses mysql.connector to copy the entire Posts table (248,905 rows) from MySQL to the ProxySQL SQLite3 server. The script handles schema conversion, proper escaping, and provides progress reporting. Tested with full copy taking 30 seconds at ~8,300 rows/sec.	4 months ago
Javier Jaramago Fernández	a443e3ded0	Improve RESTAPI example scripts 'kill_idle_backend_conns.py' and doc	4 years ago
Javier Jaramago Fernández	691c19a0b1	Fix 'change_host_status' README example for RESTAPI example scripts	4 years ago
Javier Jaramago Fernández	d6a753d0f6	Update 'scripts' folder with several RESTAPI example scripts	4 years ago
Valentin Rakush	66400a35c7	Implementation of the GET and POST methods	6 years ago
Valentin Rakush	f0687f3688	Implement restapi functionality ... - restapi_routes table in admin module - calling python script (json validation, error handling) - scripts: metrics, export_users - tests adjusted	6 years ago