proxysql

Commit Graph

Author	SHA1	Message	Date
Rene Cannao	35b0b224ff	refactor: Remove mcp-catalog_path variable and hardcode catalog path Remove the mcp-catalog_path configuration variable and hardcode the catalog database path to datadir/mcp_catalog.db for stability. Rationale: The catalog database is session state, not user configuration. Runtime swapping of the catalog could cause tables to be missed and the catalog to fail even if it was succeeding a second earlier. Changes: - Removed catalog_path from mcp_thread_variables_names array - Removed mcp_catalog_path from MCP_Thread variables struct - Removed getter/setter logic for catalog_path - Hardcoded catalog path to GloVars.datadir/mcp_catalog.db in: - ProxySQL_MCP_Server.cpp (Query_Tool_Handler initialization) - Admin_FlushVariables.cpp (MySQL_Tool_Handler reinitialization) - Updated VARIABLES.md to document the hardcoded path - Updated configure_mcp.sh to remove catalog_path configuration - Updated MCP README to remove catalog_path references	3 months ago
Rene Cannao	1b7335acfe	Fix two-phase discovery documentation and scripts - Add mcp_config.example.json for Claude Code MCP configuration - Fix MCP bridge path in example config (../../proxysql_mcp_stdio_bridge.py) - Update Two_Phase_Discovery_Implementation.md with correct Phase 1/Phase 2 usage - Fix Two_Phase_Discovery_Implementation.md DELETE FROM fts_objects to scope to run_id - Update README.md with two-phase discovery section and multi-agent legacy note - Create static_harvest.sh bash wrapper for Phase 1 - Create two_phase_discovery.py orchestration script with prompts - Add --run-id parameter to skip auto-fetch - Fix RUN_ID placeholder mismatch (<USE_THE_PROVIDED_RUN_ID>) - Fix catalog path default to mcp_catalog.db - Add test_catalog.sh to verify catalog tools work - Fix Discovery_Schema.cpp FTS5 syntax (missing space) - Remove invalid CREATE INDEX on FTS virtual tables - Add MCP tool call logging to track tool usage - Fix Static_Harvester::get_harvest_stats() to accept run_id parameter - Fix DELETE FROM fts_objects to only delete for specific run_id - Update system prompts to say DO NOT call discovery.run_static - Update user prompts to say Phase 1 is already complete - Add --mcp-only flag to restrict Claude Code to MCP tools only - Make FTS table failures non-fatal (check if table exists first) - Add comprehensive documentation for both discovery approaches	3 months ago
Rene Cannao	f9270e6c8b	fix: Correct two_phase_discovery.py usage example in docs Add missing --mcp-config argument which is required by the script. The dry-run example now correctly shows all required parameters.	3 months ago
Rene Cannao	6f23d5bcd0	feat: Implement two-phase schema discovery architecture Phase 1 (Static/Deterministic): - Add Discovery_Schema: SQLite catalog with deterministic and LLM tables - Add Static_Harvester: MySQL INFORMATION_SCHEMA metadata extraction - Harvest schemas, objects, columns, indexes, foreign keys, view definitions - Compute derived hints: is_time, is_id_like, has_pk, has_fks, has_time - Build quick profiles and FTS5 indexes Phase 2 (LLM Agent): - Add 19 new MCP tools for two-phase discovery - discovery.run_static: Trigger ProxySQL's static harvest - Catalog tools: init, search, get_object, list_objects, get_relationships - Agent tools: run_start, run_finish, event_append - LLM tools: summary_upsert, relationship_upsert, domain_upsert, etc. Files: - include/Discovery_Schema.h, lib/Discovery_Schema.cpp - include/Static_Harvester.h, lib/Static_Harvester.cpp - include/Query_Tool_Handler.h, lib/Query_Tool_Handler.cpp (updated) - lib/Makefile (updated) - scripts/mcp/DiscoveryAgent/ClaudeCode_Headless/prompts/ - scripts/mcp/DiscoveryAgent/ClaudeCode_Headless/two_phase_discovery.py	3 months ago
Rene Cannao	1193a55e7b	docs: Remove Version History section from LLM Bridge README	3 months ago
Rene Cannao	5afb71ca90	docs: Rename NL2SQL documentation to LLM Bridge - Rename doc/NL2SQL/ to doc/LLM_Bridge/ - Update README.md for generic LLM bridge functionality - Replace NL2SQL terminology with LLM Bridge - Update variable references from ai_nl2sql_* to genai_llm_* - Add migration guide from NL2SQL to LLM Bridge - Document new use cases (summarization, code generation, etc.)	3 months ago
Rene Cannao	349320a67f	docs: Fix NL2SQL documentation with genai variables and async architecture Updated documentation to reflect the architectural changes: - Changed all ai_* variables to genai-* variables - Changed LOAD MYSQL VARIABLES to LOAD GENAI VARIABLES - Clarified that NL2SQL queries run on MySQL module, not Admin - Updated ARCHITECTURE.md to document async/non-blocking architecture - Added LOAD GENAI VARIABLES TO RUNTIME after variable changes - Changed stats_ai_nl2sql_cache to SHOW STATUS LIKE 'genai-nl2sql%' Key corrections in README.md: - Variables now use genai-* prefix (genai-nl2sql_enabled, etc.) - Commands use LOAD GENAI VARIABLES instead of LOAD MYSQL VARIABLES - Added note that NL2SQL queries are on MySQL module, not Admin interface Key corrections in ARCHITECTURE.md: - Updated system flow diagram to show async socketpair path - Added detailed async flow explanation - Documented that MySQL threads are NOT blocked during LLM calls Related to: https://github.com/ProxySQL/proxysql-vec/pull/13	3 months ago
Rene Cannao	527bfed297	fix: Migrate AI variables to GenAI module for proper architecture This commit fixes a serious design flaw where AI configuration variables were not integrated with the ProxySQL admin interface. All ai_* variables have been migrated to the GenAI module as genai-* variables. Changes: - Added 21 new genai_* variables to GenAI_Thread.h structure - Implemented get/set functions for all new variables in GenAI_Thread.cpp - Removed internal variables struct from AI_Features_Manager - AI_Features_Manager now reads from GloGATH instead of internal state - Updated documentation to reference genai-* variables - Fixed debug.cpp assertion for PROXY_DEBUG_NL2SQL and PROXY_DEBUG_ANOMALY Variable mapping: - ai_nl2sql_enabled → genai-nl2sql_enabled - ai_anomaly_detection_enabled → genai-anomaly_enabled - ai_features_enabled → genai-enabled - All other ai_* variables follow the same pattern The flush functions automatically handle all variables in the genai_thread_variables_names array, so database persistence works correctly without additional changes. Related to: https://github.com/ProxySQL/proxysql-vec/pull/13	3 months ago
Rene Cannao	2888ee3f45	Fix gemini-code-assist recommendations and implement comprehensive anomaly detection tests - Fix retry logic to use is_retryable_error function for proper HTTP error handling - Add exception handling to get_json_int function with try-catch around std::stoi - Improve validate_numeric_range to use strtol instead of atoi for better error reporting - Fix Chinese characters in documentation (non-zero -> non-zero) - Replace placeholder tests with actual comprehensive tests for anomaly detection functionality - Create new standalone unit test anomaly_detector_unit-t.cpp with 29 tests covering: * SQL injection pattern detection (12 tests) * Query normalization (8 tests) * Risk scoring calculations (5 tests) * Configuration validation (4 tests) - All tests pass successfully, providing meaningful validation of core anomaly detection logic Thanks to gemini-code-assist for the thorough code review and recommendations.	3 months ago
Rene Cannao	8a6b7480b6	docs: Update NL2SQL documentation for v0.2.0 features This commit updates the NL2SQL documentation to reflect the new features added in v0.2.0: README.md changes: - Added Request Configuration section with retry parameters - Added Error Handling section with error code table - Added Request Correlation section with log format examples - Updated Results section with error columns - Updated Troubleshooting with retry behavior documentation - Added v0.2.0 to Version History API.md changes: - Updated NL2SQLRequest struct with request_id and retry config fields - Updated NL2SQLResult struct with error details fields - Added NL2SQLErrorCode enum documentation - Updated Result Format with new columns - Expanded Error Codes section with structured error codes TESTING.md changes: - Added Validation Tests to test suite overview - Documented ai_validation-t.cpp test categories - Added instructions for running validation tests - Documented all 61 test cases across 5 categories	3 months ago
Rene Cannao	897d306d2d	Refactor: Simplify NL2SQL to use only generic providers Remove Ollama-specific provider code and use only generic OpenAI-compatible and Anthropic-compatible providers. Ollama is now used via its OpenAI-compatible endpoint at /v1/chat/completions. Changes: - Remove LOCAL_OLLAMA from ModelProvider enum - Remove ai_nl2sql_ollama_model and ai_nl2sql_ollama_url variables - Remove call_ollama() function from LLM_Clients.cpp - Update default configuration to use OpenAI provider with Ollama URL - Update all documentation to reflect generic-only approach Configuration: - ai_nl2sql_provider: 'openai' or 'anthropic' (default: 'openai') - ai_nl2sql_provider_url: endpoint URL (default: Ollama OpenAI-compatible) - ai_nl2sql_provider_model: model name - ai_nl2sql_provider_key: API key (optional for local endpoints) This simplifies the codebase by removing a separate code path for Ollama and aligns with the goal of avoiding provider-specific variables.	3 months ago
Rene Cannao	c5a7fc31f7	Add external LLM setup guide and live testing script - test_external_live.sh: Interactive script for testing with custom LLM - EXTERNAL_LLM_SETUP.md: Complete guide for external model configuration Covers: - Custom LLM endpoint configuration for NL2SQL - llama-server configuration for embeddings - Architecture overview - Configuration variables - Testing procedures - Troubleshooting tips	3 months ago
Rene Cannao	637b2a669c	feat: Implement NL2SQL vector cache and complete Anomaly threat pattern management NL2SQL_Converter improvements: - Implement get_query_embedding() using GenAI module - Implement check_vector_cache() with KNN search via sqlite-vec - Implement store_in_vector_cache() with embedding storage - All stub methods now fully functional Anomaly_Detector improvements: - Implement add_threat_pattern() with embedding generation - Stores patterns in both main table and virtual vec table - Returns pattern ID on success, -1 on error Documentation: - Add comprehensive VECTOR_FEATURES documentation - README.md (471 lines): User guide and quick start - API.md (736 lines): Complete API reference - ARCHITECTURE.md (358 lines): System architecture - TESTING.md (767 lines): Testing guide and procedures This completes the vector features implementation, enabling: - Semantic similarity caching for NL2SQL queries - Embedding-based threat pattern detection - Full CRUD operations for threat patterns	3 months ago
Rene Cannao	0be9715188	test: Add comprehensive tests and documentation for Anomaly Detection Added 95 tests (50 unit + 45 integration) and 4 documentation files: Test Files: - test/tap/tests/anomaly_detection-t.cpp (50 unit tests) * Initialization and configuration tests * SQL injection pattern detection * Query normalization * Rate limiting * Statistical anomaly detection * Integration scenarios * Configuration management * False positive handling - test/tap/tests/anomaly_detection_integration-t.cpp (45 integration tests) * Real SQL injection pattern detection with actual queries * Legitimate query passthrough verification * Multi-user rate limiting scenarios * Statistical anomaly detection * Log-only mode configuration Documentation (doc/ANOMALY_DETECTION/): - README.md: User guide with quick start, configuration, examples - API.md: Complete API reference for Anomaly_Detector class - ARCHITECTURE.md: System architecture and design documentation - TESTING.md: Testing guide with test categories and examples All tests compile successfully and follow the TAP framework pattern used throughout ProxySQL.	3 months ago
Rene Cannao	e2d71ec4a2	docs: Add comprehensive NL2SQL user and developer documentation User Documentation: - README.md: Complete user guide with examples, configuration, troubleshooting Developer Documentation: - ARCHITECTURE.md: System architecture, components, flow diagrams - API.md: Complete API reference for all variables, structures, and methods - TESTING.md: Testing guide with templates and best practices All documentation follows "very very very" thorough standards with comprehensive examples, diagrams, and cross-references.	3 months ago
Rene Cannao	14de472a3b	Add multi-agent database discovery system Implements a 4-agent collaborative system using Claude Code's Task tool and MCP catalog for comprehensive database analysis: - Structural Agent: Maps tables, relationships, indexes, constraints - Statistical Agent: Profiles data distributions, patterns, anomalies - Semantic Agent: Infers business domain and entity types - Query Agent: Analyzes access patterns and optimization Agents collaborate via MCP catalog across 4 rounds: 1. Blind exploration → 2. Pattern recognition → 3. Hypothesis testing → 4. Final synthesis Includes simple_discovery.py demo and comprehensive documentation.	3 months ago
René Cannaò	313f637cf0	Merge branch 'v3.1-vec' into v3.1-MCP1 Signed-off-by: René Cannaò <rene.cannao@gmail.com>	3 months ago
Rene Cannao	2ef44e7c3e	Add MCP implementation plans for FTS and Vector Embeddings Comprehensive implementation documentation for two new search capabilities: FTS (Full Text Search): - 6 tools for lexical search using SQLite FTS5 - Separate mcp_fts.db database - Keyword matching and phrase search - Tools: fts_index_table, fts_search, fts_list_indexes, fts_delete_index, fts_reindex, fts_rebuild_all Vector Embeddings: - 6 tools for semantic search using sqlite-vec - Separate mcp_embeddings.db database - Vector similarity search with sqlite-rembed integration - Placeholder for future GenAI module - Tools: embed_index_table, embed_search, embed_list_indexes, embed_delete_index, embed_reindex, embed_rebuild_all Both systems: - Follow MySQL_Catalog patterns for SQLite management - Integrate with existing MCP Query endpoint - Work alongside Catalog for AI agent memory - 13-step implementation plans with detailed code examples	3 months ago
Rene Cannao	07dc887af2	Add MCP Tool Discovery Guide Comprehensive guide for discovering and using MCP Query endpoint tools: - Tool discovery via tools/list method - Complete list of all Query endpoint tools with parameters - cURL and Python examples for tool discovery and execution - Complete database exploration example - Test script usage guide	3 months ago
Rene Cannao	5846cd8b40	Add Database Discovery Agent architecture documentation Comprehensive architecture for AI-powered database discovery agent: - Mixture-of-experts approach (Structural, Statistical, Semantic, Query) - Orchestrator pattern for coordinated exploration - Four-phase discovery process (Blind → Patterns → Hypotheses → Synthesis) - Domain-agnostic design for any database complexity or type - Catalog as shared memory for collaborative expert findings - Multiple real-world examples (law firm, scientific research, ecommerce)	3 months ago
Rene Cannao	ced10dd054	Implement per-endpoint authentication for MCP endpoints This commit implements Phase 2 of the MCP multi-endpoint architecture: per-endpoint Bearer token authentication. ## Changes ### lib/MCP_Endpoint.cpp - Implemented `authenticate_request()` method with: - Per-endpoint token validation (mcp-{endpoint}_endpoint_auth) - Bearer token support via Authorization header - Query parameter fallback (?token=xxx) for simple testing - No authentication when token is not configured (backward compatible) - Proper 401 Unauthorized response on auth failure - Token whitespace trimming - Debug logging for troubleshooting ### doc/MCP/Architecture.md - Updated Per-Endpoint Authentication section with complete implementation - Marked Phase 3 authentication task as completed (✅) - Added authentication implementation code example ## Authentication Flow 1. Client sends request with Bearer token: - Header: `Authorization: Bearer <token>` - Or query param: `?token=<token>` 2. Server validates against endpoint-specific variable: - `/mcp/config` → `mcp-config_endpoint_auth` - `/mcp/observe` → `mcp-observe_endpoint_auth` - `/mcp/query` → `mcp-query_endpoint_auth` - `/mcp/admin` → `mcp-admin_endpoint_auth` - `/mcp/cache` → `mcp-cache_endpoint_auth` 3. Returns 401 Unauthorized if: - Auth is required but not provided - Token doesn't match expected value 4. Allows request if: - No auth token configured (backward compatible) - Token matches expected value ## Testing ```bash # Set auth token for /mcp/query endpoint mysql -h 127.0.0.1 -P 6032 -u admin -padmin \ -e "SET mcp-query_endpoint_auth='my-secret-token'; LOAD MCP VARIABLES TO RUNTIME;" # Test with Bearer token curl -k -X POST https://127.0.0.1:6071/mcp/query \ -H "Content-Type: application/json" \ -H "Authorization: Bearer my-secret-token" \ -d '{"jsonrpc":"2.0","method":"tools/list","id":1}' # Test with query parameter curl -k -X POST "https://127.0.0.1:6071/mcp/query?token=my-secret-token" \ -H "Content-Type: application/json" \ -d '{"jsonrpc":"2.0","method":"tools/list","id":1}' ``` ## Status ✅ Authentication fully implemented and functional ⚠️ Testing with running ProxySQL instance still needed Co-authored-by: Claude <claude@anthropic.com>	3 months ago
Rene Cannao	c86a048d9c	Implement MCP multi-endpoint architecture with dedicated tool handlers This commit implements Option 1 (Multiple Tool Handlers) for the MCP module, where each of the 5 endpoints has its own dedicated tool handler with specific tools. ## Architecture Changes - Created MCP_Tool_Handler base class interface for all tool handlers - Each endpoint now has its own dedicated tool handler: - /mcp/config → Config_Tool_Handler (configuration management) - /mcp/query → Query_Tool_Handler (database exploration) - /mcp/admin → Admin_Tool_Handler (administrative operations) - /mcp/cache → Cache_Tool_Handler (cache management) - /mcp/observe → Observe_Tool_Handler (monitoring & metrics) ## New Files Base Interface: - include/MCP_Tool_Handler.h - Base class for all tool handlers Tool Handlers: - include/Config_Tool_Handler.h, lib/Config_Tool_Handler.cpp - include/Query_Tool_Handler.h, lib/Query_Tool_Handler.cpp - include/Admin_Tool_Handler.h, lib/Admin_Tool_Handler.cpp - include/Cache_Tool_Handler.h, lib/Cache_Tool_Handler.cpp - include/Observe_Tool_Handler.h, lib/Observe_Tool_Handler.cpp Documentation: - doc/MCP/Architecture.md - Comprehensive architecture documentation ## Modified Files - include/MCP_Thread.h, lib/MCP_Thread.cpp - Added 5 tool handler pointers - include/MCP_Endpoint.h, lib/MCP_Endpoint.cpp - Use tool_handler base class - lib/ProxySQL_MCP_Server.cpp - Create and pass handlers to endpoints - lib/Makefile - Added new source files ## Implementation Status - Config_Tool_Handler: Functional (get_config, set_config, list_variables, get_status) - Query_Tool_Handler: Functional (wraps MySQL_Tool_Handler, all 18 tools) - Admin_Tool_Handler: Stub implementations (TODO: implement) - Cache_Tool_Handler: Stub implementations (TODO: implement) - Observe_Tool_Handler: Stub implementations (TODO: implement) See GitHub Issue #8 for detailed TODO list. Co-authored-by: Claude <claude@anthropic.com>	3 months ago
Rene Cannao	a5f712e7d9	Add MCP variables documentation Added comprehensive documentation for all 14 MCP module configuration variables: Server Configuration: - mcp-enabled (boolean, default: false) - mcp-port (integer, default: 6071) - mcp-timeout_ms (integer, default: 30000) Endpoint Authentication (5 variables): - mcp-config_endpoint_auth (string, default: "") - mcp-observe_endpoint_auth (string, default: "") - mcp-query_endpoint_auth (string, default: "") - mcp-admin_endpoint_auth (string, default: "") - mcp-cache_endpoint_auth (string, default: "") MySQL Tool Handler Configuration (5 variables): - mcp-mysql_hosts (string, default: "127.0.0.1") - mcp-mysql_ports (string, default: "3306") - mcp-mysql_user (string, default: "") - mcp-mysql_password (string, default: "") - mcp-mysql_schema (string, default: "") Catalog Configuration: - mcp-catalog_path (string, default: "mcp_catalog.db") Includes documentation for management commands, variable persistence, status variables, and security considerations.	3 months ago
Rene Cannao	b77d38c2ca	Add comprehensive GenAI module documentation Add doc/GENAI.md documenting the GenAI (Generative AI) module's current state, architecture, configuration, and usage. Documentation includes: - Module overview and version info - Async architecture diagrams (socketpair + epoll) - Communication protocol structures (request/response headers) - Configuration variables (threads, URIs, timeouts) - GENAI: query syntax and examples - Integration with ProxySQL main loop - Backend service integration (llama-server) - Testing guide with TAP test suite - Performance characteristics and resource usage - Error handling and troubleshooting - Platform requirements and limitations - Future enhancements roadmap - Related documentation links	3 months ago
Rene Cannao	cbf27eb607	Add vec0 KNN LIMIT constraint documentation for Posts embeddings Add documentation for common error "A LIMIT or 'k = ?' constraint is required on vec0 knn queries" with corrected query examples. Changes: 1. Add Example 3 showing correct LIMIT placement for "What is ProxySQL?" query 2. Include alternative syntax using 'k = ?' constraint 3. Explain key rules for vec0 KNN queries: - LIMIT or k = ? must be in same query level as MATCH - Cannot use both constraints together - When joining, put MATCH + LIMIT in subquery - Constraint tells sqlite-vec how many similar vectors to return	4 months ago
Rene Cannao	8e83635760	Add Posts embeddings setup documentation with optimized batch processing This documentation provides step-by-step instructions for setting up virtual tables for Posts embeddings using sqlite-rembed and sqlite-vec. Key features: - Virtual table creation for 768-dimensional embeddings - API client configuration for embedding generation - Optimized batch query using LEFT JOIN to process unembedded rows - Batch processing script with progress tracking - Similarity search examples - Performance considerations and troubleshooting The batch query uses a LEFT JOIN pattern to find unprocessed rows: INSERT ... SELECT ... FROM Posts LEFT JOIN Posts_embeddings WHERE Posts_embeddings.rowid IS NULL LIMIT 1000; This approach eliminates the need for tracking rowid ranges and can be run repeatedly until all 248,905 Posts have embeddings generated.	4 months ago
Rene Cannao	612ef326bc	Fix sqlite-rembed demonstration scripts and add environment variable support This commit addresses critical fixes to the sqlite-rembed demonstration scripts and adds environment variable support for API key configuration. Key Changes: 1. Fixed sqlite-rembed-demo.sh similarity search queries: - Changed FROM demo_embeddings e JOIN ... WHERE embedding MATCH pattern - To correct subquery pattern required by sqlite-vec: FROM (SELECT rowid, distance ... LIMIT) e JOIN ... - This resolves "A LIMIT or 'k = ?' constraint is required on vec0 knn queries" error - All three similarity search queries now use proper subquery structure 2. Added comprehensive cleanup at script start: - Added DROP TABLE IF EXISTS for all demo_embeddings related tables - Prevents "UNIQUE constraint failed on demo_embeddings primary key" errors - Uses INSERT OR REPLACE instead of INSERT for embedding storage 3. Added environment variable support for API_KEY: - Updated all demonstration scripts to use API_KEY="${API_KEY:-YOUR_API_KEY}" - Users can now set API_KEY environment variable: export API_KEY="actual_key" - Falls back to YOUR_API_KEY placeholder if environment variable not set - Improves security by avoiding hardcoded keys in scripts 4. Updated documentation: - Modified SQLITE-REMBED-TEST-README.md to document environment variable usage - Updated comments in all scripts to mention environment variable option Files Modified: - doc/sqlite-rembed-demo.sh: Fixed similarity search queries, added cleanup, added environment variable support - doc/sqlite-rembed-examples.sh: Added environment variable support - doc/sqlite-rembed-test.sh: Added environment variable support - doc/SQLITE-REMBED-TEST-README.md: Updated documentation for env var support Verification: - sqlite-rembed-demo.sh now runs successfully end-to-end - All similarity search queries execute without errors - Environment variable fallback works correctly - Scripts maintain backward compatibility with direct key replacement	4 months ago
Rene Cannao	e75bd7c84a	Add comprehensive sqlite-rembed examples and documentation This commit adds a complete set of well-documented examples and test scripts for the sqlite-rembed integration in ProxySQL. The sqlite-rembed extension enables text embedding generation via HTTP API calls directly within SQL queries, complementing the sqlite-vec extension for vector similarity search. Key additions: 1. sqlite-rembed-examples.sql - Primary SQL demonstration file - Standalone SQL file with 8 phases of examples - Demonstrates complete AI pipeline: client config → embedding gen → storage → search - Includes proper subquery pattern for similarity search JOINs (vec0 requirement) - Well-documented with clear explanations for each phase 2. sqlite-rembed-test.sh - Comprehensive test suite - 9-phase test covering all integration aspects - Color-coded output with test result tracking - Error handling and edge case testing 3. SQLITE-REMBED-TEST-README.md - Complete documentation - Detailed test suite documentation - Usage instructions, troubleshooting, CI/CD integration examples 4. Supporting bash scripts for different use cases - sqlite-rembed-examples.sh - Phase-by-phase interactive examples - sqlite-rembed-demo.sh - Single-session demonstration script Security considerations: - All hardcoded API keys replaced with YOUR_API_KEY placeholder - Clear comments instructing users to replace with actual credentials - Synthetic OpenAI endpoint used as example (public test endpoint) Technical details: - Embedding dimensions: 768 (nomic-embed-text-v1.5 model) - Embedding size: 3072 bytes (768 × 4 bytes per float) - Similarity search pattern: Uses subqueries for JOIN compatibility with vec0 - Client configuration: temp.rembed_clients virtual table (per-connection) The examples provide a solid baseline for building applications that leverage sqlite-rembed and sqlite-vec in ProxySQL for AI-powered applications.	4 months ago
Rene Cannao	194b71889b	Update sqlite-rembed integration documentation for tar.gz packaging - Update Integration Architecture section to include source packaging step - Add Packaging subsection detailing tar.gz distribution pattern - Update Build Process to mention tar.gz extraction - Update Code Changes Summary for deps/Makefile tar.gz handling - Update Build Verification instructions to use cleanpart and verify extraction - Add Source Distribution reference section	4 months ago
Rene Cannao	9f30d85e10	Add tar.gz packaging for sqlite-rembed dependency - Download official sqlite-rembed-0.0.1-alpha.9.tar.gz from GitHub - Update deps/Makefile to extract from tar.gz instead of using local source - Add tar.gz to git repository, remove sqlite-rembed-source from git cache - Update documentation to remove ClickHouse troubleshooting reference - Clean targets now remove sqlite-rembed-*/ and sqlite-rembed-source/ Following the pattern of other ProxySQL dependencies, the Rust extension is now packaged as a compressed tarball that gets extracted during build.	4 months ago
Rene Cannao	01d654692d	Integrate sqlite-rembed for text embedding generation Add support for sqlite-rembed Rust SQLite extension to enable text embedding generation from remote AI APIs (OpenAI, Nomic, Ollama, Cohere, etc.) within ProxySQL's SQLite3 Server. Changes: 1. Build system integration for Rust static library compilation - Rust toolchain detection in deps/Makefile - Static library target: sqlite3/libsqlite_rembed.a - Linking integration in lib/Makefile and src/Makefile 2. Extension auto-registration in Admin_Bootstrap.cpp - Declare sqlite3_rembed_init() extern C function - Register via sqlite3_auto_extension() after sqlite-vec 3. Documentation updates - doc/sqlite-rembed-integration.md: comprehensive integration guide - doc/SQLite3-Server.md: usage examples and provider list 4. Source code inclusion - deps/sqlite3/sqlite-rembed-source/: upstream sqlite-rembed v0.0.1-alpha.9 The integration follows the same pattern as sqlite-vec (static linking with auto-registration). Provides rembed() function and temp.rembed_clients virtual table for embedding generation. Build requires Rust toolchain (cargo, rustc) and clang/libclang-dev.	4 months ago
Rene Cannao	ea09e91569	Remove inline vector search testing documentation The previous approach of embedding scripts inline in a large Markdown file has been replaced with a modular file structure for better maintainability. - Removed doc/Vector-Search-Testing-Guide.md (9,718 lines with inline scripts) - Modular approach now uses separate executable scripts in doc/vector-search-test/ - Better separation of concerns and easier script maintenance	4 months ago
Rene Cannao	223dcf51de	Add vector search testing framework with modular scripts Create comprehensive testing guide for ProxySQL vector search capabilities: - Separate test scripts for connectivity, table creation, data insertion, and similarity search - Simplified README.md referencing external script files - Modular structure for easy maintenance and extension - Proper error handling and result tracking - Executable scripts with consistent testing patterns Removes previous inline documentation approach in favor of maintainable file structure.	4 months ago
Rene Cannao	d4f8385197	Add comprehensive vector search testing guide - Complete step-by-step testing procedures for ProxySQL SQLite3 server vector search - Includes connectivity testing, vector table creation, data insertion, and similarity search - Provides practical use case examples (product recommendations, user sessions) - Includes performance testing and error handling scenarios - Contains Python vector generator and shell test scripts - Detailed troubleshooting section and expected results - Suitable for both ProxySQL developers and users - Enables reproducible testing of sqlite-vec integration File: doc/Vector-Search-Testing-Guide.md (9,718 lines)	4 months ago
Rene Cannao	a1dc68833c	Add accurate SQLite3 Server documentation - Clear distinction between Admin Interface (port 6032) and SQLite3 Server (port 6030) - Explanation of MySQL-to-SQLite gateway functionality - Simple usage examples and common operations - Vector search integration with sqlite-vec - Correct authentication using mysql_users table - Removed incorrect assumptions about non-existent configuration options	4 months ago
Rene Cannao	cf8cbfd89a	Document coredump_filters feature (issue #5213 ) Add comprehensive documentation for the on‑demand core dump generation feature introduced in PR #4225. The documentation covers: - coredump_filters and runtime_coredump_filters table definitions - LOAD COREDUMP TO RUNTIME admin command and its aliases - Configuration variables admin‑coredump_generation_threshold and admin‑coredump_generation_interval_ms - Usage examples with INSERT and LOAD commands - Important notes about case‑sensitive filenames, runtime‑only behavior, rate limiting, and platform support - Troubleshooting guidance and best practices The documentation addresses the missing documentation reported in GitHub issue #5213.	4 months ago
Rene Cannao	de214cb558	Add comprehensive documentation for "Closing killed client connection" warnings	4 months ago
Rene Cannao	6966b79db9	Add documentation for query rules capture groups and backreferences	4 months ago
Rene Cannao	291e5f02a9	Add AI disclaimer to ENHANCEMENT-OPPORTUNITIES.md	5 months ago
Rene Cannao	54091905c1	Restructure AI-generated documentation with verification framework - Move AI-generated docs to doc/ai-generated/ folder for clear separation - Add AI disclaimers to all documentation files (Status: NON-VERIFIED) - Create AI-DOCUMENTATION-FRAMEWORK.md explaining the tiered approach - Add doc/README.md as main navigation guide - Maintain transparency about AI documentation limitations - Reduce verification burden while preserving exploration value All AI-generated docs now clearly state they are starting points for exploration and should be verified against actual source code.	5 months ago
René Cannaò	9713f87be7	Merge branch 'v3.0' into v3.0.agentics Signed-off-by: René Cannaò <rene@proxysql.com>	5 months ago
noizu	39f94b0f6f	simplify for pr	5 months ago
Rene Cannao	546c10128c	docs: Add TAP test writing guide for ProxySQL.	5 months ago
noizu	d946b6e3d3	updates from internal docs	7 months ago
noizu	89849d0dc0	patch	7 months ago
noizu	5f15d971fe	patch	7 months ago
noizu	4dad6424ef	doc update	7 months ago
noizu	9e337ce739	TEST-PIPELINE.md doc	7 months ago
noizu	e2e8d8c4d4	doc cleanup - remove agenetic verbage and mermaid patch	7 months ago
noizu	ab2a32924e	Visual Guide v0.1 checkin	7 months ago

1 2 3 4

169 Commits (7faf9932950dcbf8cbfc7e8b0cecba25cdce28f0)