3 Commits (v3.0)

Author	SHA1	Message	Date
Rene Cannao	2c0f3a2e64	Evolve genai_demo_event to working POC with real embeddings ... Transform genai_demo_event.cpp from skeleton to working POC that: - Integrates with real llama-server on port 8013 for embeddings - Uses shared memory (passing pointers, not copying data) - Supports single or multiple documents per request - Properly transfers memory ownership between GenAI and client Architecture changes: - Document struct: passed by pointer from client to GenAI - RequestHeader: includes document_count and operation type - ResponseHeader: includes embedding_size and embedding_ptr - EmbeddingResult: allocated by GenAI, owned by client after response libcurl integration: - HTTP POST to llama-server embedding API - JSON parsing of embedding responses - Error handling for network/API failures Key features: - Clients wait for response before sending next request - (ensures document pointers remain valid) - GenAI workers handle multiple concurrent requests - Embedding dimension: 1023 floats (from llama-server) - Processing time: 30-250ms (real API latency) Results: - 5 clients completed 9 embedding requests - All embeddings successfully retrieved - Zero-copy data transfer via shared memory pointers - Early termination when all work completed Future-ready: - Operation enum (OP_EMBEDDING, OP_COMPLETION, OP_RAG) - Extensible for other GenAI operations - Document count supports batch processing	3 months ago
Rene Cannao	11d183a340	Add event-driven GenAI demo ... Implemented a new event-driven demonstration of the GenAI module that provides better testing isolation and observability. Unlike the thread-based version, this uses a single main event loop with epoll to manage all clients. Key features: - Client class as state machine (NEW → CONNECTED → IDLE → WAITING → DONE) - Single main event loop managing all client I/O via epoll - Random client addition at configurable intervals (probability-based) - Random request sending from idle clients (probability-based) - Periodic statistics printing showing active clients and states - Config struct for tuning behavior (workers, max_clients, probabilities) The demo demonstrates: 1. Multiple concurrent clients connecting to GenAI module 2. Non-blocking async request/response communication 3. Client lifecycle management and cleanup 4. Realistic traffic patterns with randomized behavior Files: - genai_prototype/genai_demo_event.cpp: New event-driven demo - genai_prototype/Makefile: Updated to build both demos	3 months ago
Rene Cannao	5dad6255d2	Add GenAI module prototype ... Create standalone prototype demonstrating the GenAI module architecture with thread pool, epoll-based listener, and async socket communication. Components: - genai_demo.cpp: Full working prototype with: * Thread pool (configurable workers) * epoll-based listener thread * Thread-safe request queue * socketpair communication * Multiple concurrent clients * Simulated async processing - Makefile: Build system with clean, run, debug targets - README.md: Documentation of architecture and enhancement roadmap - .gitignore: Exclude build artifacts This prototype will be enhanced before integration into ProxySQL main codebase, testing real LLM API calls, batching, metrics, and error handling.	3 months ago