20 Commits (28742554b5ec3aa92e69e81b6e8bf047e2cbbfae)

Author	SHA1	Message	Date
Rene Cannao	28742554b5	Use relative catalog path instead of absolute path ... - Change mcp-catalog_path default from /var/lib/proxysql/mcp_catalog.db to mcp_catalog.db - SQLite accepts relative paths, which are resolved relative to the process working directory - ProxySQL's working directory is its datadir, so the catalog will be stored there - Update configure_mcp.sh to set mcp-catalog_path='mcp_catalog.db' - Update lib/MCP_Thread.cpp default to "mcp_catalog.db" - Update README.md to document relative path behavior	3 months ago
Rene Cannao	c53b28e42a	Add comprehensive documentation to MCP README ... - Add architecture overview with ASCII diagram showing all components - Add detailed component explanations (ProxySQL MCP Module, Connection Pool, Catalog, Test Scripts) - Add testing flow diagram with 4-step process - Add Quick Start section with copy/paste commands for native and Docker modes - Add detailed documentation for each script explaining what they do and why - Add troubleshooting section for common issues - Add default configuration reference table - Add environment variables reference This allows users to understand the architecture and run tests without needing to understand implementation details.	3 months ago
Rene Cannao	b3646b4798	Fix argument parsing and documentation in setup_test_db.sh ... Fixed critical issues with argument parsing that prevented the script from working correctly: 1. Fixed argument order - script now supports both: - ./setup_test_db.sh <command> [options] - ./setup_test_db.sh [options] <command> 2. Fixed --help option - now shows help instead of running commands 3. Updated README.md examples with correct syntax: - OLD: ./setup_test_db.sh --mode native start (wrong) - NEW: ./setup_test_db.sh start --mode native (correct) The script now properly: - Parses -h/--help anywhere and shows usage - Handles options before or after the command - Auto-detects mode when not specified - Shows helpful connection info after setup All examples in README.md updated with correct command syntax.	3 months ago
Rene Cannao	3d827144e8	Add required environment variables section to README ... Added comprehensive environment variable documentation to the README Prerequisites section to make it clear what needs to be configured before running the test scripts. Changes: - Added "Required Environment Variables" subsection under Prerequisites - Listed all ProxySQL Admin, MySQL, and MCP server environment variables - Added quick setup example for adding variables to ~/.bashrc - Made it clear that PROXYSQL_ADMIN_PASSWORD and MYSQL_PASSWORD need to be set Users now have clear guidance on required configuration before testing.	3 months ago
Rene Cannao	ad2e2a24d1	Add native MySQL mode support to test database setup ... Updated setup_test_db.sh to support both Docker and native MySQL modes. Changes: - Added --mode option: docker, native, or auto (default: auto-detect) - Auto-detect: tries Docker first, then falls back to native MySQL - Native mode functions: start_native, status_native, connect_native, reset_native - Native mode connects to existing MySQL server (no Docker required) - Added --host, --port, --user, --password, --database options - Environment variable support: MYSQL_HOST, MYSQL_PORT, MYSQL_USER, MYSQL_PASSWORD Updated README.md with: - Native mode quick start guide - Docker mode quick start guide - Auto-detect mode documentation - Comprehensive setup_test_db.sh usage examples - Environment variable documentation Usage examples: # Auto-detect mode ./setup_test_db.sh start # Native MySQL mode ./setup_test_db.sh --mode native --host localhost --port 3306 start # Docker mode ./setup_test_db.sh --mode docker start	3 months ago
Rene Cannao	e9a6dd0b3e	Add comprehensive MCP testing suite in scripts/mcp/ ... Created a complete testing suite for the MCP module with MySQL connection pool and exploration tools. Files added: - README.md: Comprehensive testing documentation - setup_test_db.sh: Docker-based test MySQL database setup - Start/stop/status/connect commands - Creates sample schema (customers, orders, products, order_items) - Includes views and stored procedures for testing - configure_mcp.sh: ProxySQL MCP module configuration - Configures MySQL connection parameters - Enables/disables MCP server - Shows current configuration status - test_mcp_tools.sh: Main MCP tools test suite - Tests all 15 MCP tools (list_schemas, list_tables, etc.) - Includes catalog tests (upsert, get, search, delete) - Reports pass/fail statistics - stress_test.sh: Concurrent connection stress testing - Configurable number of concurrent requests - Response time measurement - Success rate calculation - test_catalog.sh: Catalog/LLM memory specific tests - 12 catalog operation tests - FTS search testing - CRUD verification All scripts are executable and include: - Command-line argument parsing - Colored output for readability - Error handling and validation - Usage/help documentation - Environment variable support	3 months ago
Rene Cannao	62cbd6c71e	Fix issues identified in AI code review ... - Fix combined_search: Build SQL query dynamically based on search_term - Only include MATCH relevance when search_term is provided - Fix parameter binding (fulltext_params vs params) - Fix search_term/query parameter mismatch in run_demo - combined_search mode now correctly receives query from kwargs - Add environment variable support for database credentials - nlp_search_demo.py: DB_HOST, DB_PORT, DB_USER, DB_PASSWORD, DB_NAME - stackexchange_posts.py: SOURCE_DB_* and TARGET_DB_* variables - Fix README CreationDate SQL example to use JSON_EXTRACT - Add zero division checks in get_table_stats and similarity_search_preparation	3 months ago
Rene Cannao	ecfff09633	Add NLP search demo script with comprehensive search capabilities ... - Create nlp_search_demo.py with full-text, boolean, tag-based, and combined search - Include statistics and similarity search preparation modes - Add proper error handling with MySQL fallback mechanisms - Fix syntax errors and indentation issues - Update README.md with correct command usage examples - Support --mode parameter with appropriate sub-parameters - Demonstrate various search techniques on processed StackExchange posts	3 months ago
Rene Cannao	d37d291488	Implement comprehensive StackExchange posts processing with search capabilities ... - Unified script that creates target table with search-optimized schema - Adds full-text search indexes and text processing for better search results - Implements duplicate detection and prevention - Fixed MySQL functional index compatibility issue (removed problematic Tags index) - Added support for --limit 0 to process all posts - Added --warning-large-batches flag for batch size > 1000 - Improved text cleaning and normalization for search optimization - Enhanced progress tracking and batch processing efficiency Removes separate scripts (populate_search_columns.py, nlp_search_demo.py) and consolidates all functionality into unified solution.	4 months ago
Rene Cannao	d94dc036e8	Add StackExchange posts processing script with JSON storage ... - Retrieves parent posts (PostTypeId=1) and their replies (PostTypeId=2) from MySQL - Combines posts and tags into structured JSON format - Supports batch processing with memory-efficient chunking - Includes duplicate checking to avoid reprocessing - Creates target table automatically with JSON storage and BLOB for embeddings - Handles large datasets with offset-based pagination - Optimized to skip duplicate processing work - Includes verification and progress tracking Files: - scripts/stackexchange_posts.py: Main processing script	4 months ago
Rene Cannao	221831afc1	Add usage examples to script documentation and help output ... Changes: 1. Add comprehensive usage examples to script docstring with: - Remote API example (requires API_KEY environment variable) - Local Ollama example (uses --local-ollama flag) - Both examples show all common command line options 2. Add epilog to argparse help with concise examples: - Shows minimal command line for both modes - Points to docstring for full examples - Uses RawDescriptionHelpFormatter for proper formatting Users now have multiple ways to access usage information: - Read script header with `head -50 scripts/process_posts_embeddings.py` - Run `python3 scripts/process_posts_embeddings.py --help` - Both show appropriate examples for remote API and local Ollama modes	4 months ago
Rene Cannao	4aba7137b4	Add --local-ollama option for local Ollama server support ... New option: --local-ollama - Uses Ollama format with localhost:11434 API endpoint - Model: nomic-embed-text-v1.5 (without hf: prefix) - No API_KEY environment variable required - Overrides api-format, api-url, and api-model flags Changes: 1. Add --local-ollama boolean flag to parse_args() 2. Modify check_env() to skip API_KEY check when local-ollama is set 3. Update configure_client() to generate Ollama-specific SQL without 'key' parameter 4. Update main() to display correct configuration based on mode 5. Update documentation with local Ollama usage Behavior: - Without --local-ollama: Requires API_KEY, uses remote API with configurable format/url/model - With --local-ollama: No API_KEY needed, uses fixed local Ollama configuration	4 months ago
Rene Cannao	ffdb334dc3	Add WHERE filters to prevent empty input errors and fix SQL syntax ... Changes: - Filter Posts by PostTypeId IN (1,2) (Questions and Answers) - Filter by minimum text length > 30 characters (Title + Body) - Update get_total_posts to count only eligible posts for accurate progress - Fix SQL syntax error in process_batch WHERE clause - Update documentation with filter details Rationale: - Empty or very short text causes embedding generation failures - PostTypeId 1,2 are most relevant content (Questions and Answers) - Ensures consistent counting between total, remaining, and processed	4 months ago
Rene Cannao	36a59f3f56	Add Posts embeddings processing script with exponential backoff ... New script: scripts/process_posts_embeddings.py Features: - Connects to SQLite3 server via MySQL connector with configurable credentials - Configures API client using API_KEY environment variable (fails if not set) - Processes unembedded Posts rows in configurable batch sizes (default: 10) - Uses LEFT JOIN WHERE IS NULL pattern to track unprocessed rows - Implements exponential backoff for retry failures with 5-minute maximum cap - Shows progress: remaining rows, processed count, percentage complete - Fails if Posts_embeddings table doesn't exist (no automatic creation) - Handles concurrent processing race conditions with small delays Script prerequisites: 1. Posts table must exist (copied from MySQL) 2. Posts_embeddings virtual table must exist: CREATE VIRTUAL TABLE Posts_embeddings USING vec0(embedding float[768]); Backoff behavior: - Default retry delay: 5 seconds - Exponential increase: 5s, 10s, 20s, 40s, ... up to 300s maximum - Resets on any successful operation (even if 0 rows processed)	4 months ago
Rene Cannao	95a95cb479	Add script to copy StackExchange Posts table from MySQL to SQLite3 server ... This Python script uses mysql.connector to copy the entire Posts table (248,905 rows) from MySQL to the ProxySQL SQLite3 server. The script handles schema conversion, proper escaping, and provides progress reporting. Tested with full copy taking 30 seconds at ~8,300 rows/sec.	4 months ago
Javier Jaramago Fernández	a443e3ded0	Improve RESTAPI example scripts 'kill_idle_backend_conns.py' and doc	4 years ago
Javier Jaramago Fernández	691c19a0b1	Fix 'change_host_status' README example for RESTAPI example scripts	4 years ago
Javier Jaramago Fernández	d6a753d0f6	Update 'scripts' folder with several RESTAPI example scripts	4 years ago
Valentin Rakush	66400a35c7	Implementation of the GET and POST methods	6 years ago
Valentin Rakush	f0687f3688	Implement restapi functionality ... - restapi_routes table in admin module - calling python script (json validation, error handling) - scripts: metrics, export_users - tests adjusted	6 years ago