proxysql

Commit Graph

Author	SHA1	Message	Date
Rene Cannao	99c86e5759	test: run check_groups.py at start of run-multi-group.bash Abort CI early if any compiled test binaries are missing from groups.json. This prevents silent test omissions — if a developer adds a test but forgets to register it, CI fails immediately with a clear message instead of silently skipping it.	1 month ago
Rene Cannao	39840b5393	Exclude /usr and deps from coverage reports fastcov was including system headers (/usr/include/c++/...) and vendored dependencies (deps/json/json.hpp) in coverage output. Use --exclude instead of --include since project source files have bare filenames in gcov output (no path prefix to match against), while system/deps paths are always absolute.	1 month ago
Rene Cannao	5a8b6e9a89	Fix gcov coverage collection for multi-group CI runs Three problems caused machine stalls and 0% coverage in multi-group runs: 1. All test-runner containers wrote TAP test .gcda files to the shared ${WORKSPACE}, causing concurrent corruption and memory bloat when multiple gcov processes fought over the same files. 2. Each container independently ran fastcov -j$(nproc) in its EXIT trap, spawning hundreds of concurrent gcov processes across all containers. 3. GCOV_PREFIX_STRIP=3 placed .gcda at proxysql/lib/obj/ but .gcno was copied to lib/obj/ — path mismatch meant gcov couldn't correlate them. Additionally, the --include filter expected full workspace paths but gcov records bare filenames, so all results were filtered out. Changes: - Set GCOV_PREFIX=/gcov/tap on test-runner containers so TAP .gcda files go to per-INFRA_ID /gcov/tap/ instead of shared workspace. - Pass MULTI_GROUP=1 from run-multi-group.bash to test-runners. When set, the EXIT trap copies .gcno adjacent to .gcda (handling path offset from GCOV_PREFIX_STRIP) but skips fastcov/genhtml. - Add centralized coverage collection in run-multi-group.bash: processes each group's /gcov directory sequentially with fastcov -j4 after all groups finish, then combines the .info files. - Remove --include filter from fastcov (source paths are bare filenames, not full paths, so the filter rejected everything). - Standalone mode (no MULTI_GROUP) is unchanged.	1 month ago
Rene Cannao	5a868d3366	Default AUTO_CLEANUP=1 in run-multi-group.bash	1 month ago
Rene Cannao	ce92a2a0e4	Redirect coverage generation output to log file in run-multi-group.bash fastcov, lcov, and genhtml produce verbose output that clutters the multi-group summary. Now redirected to coverage-generation.log inside the combined coverage report directory. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>	1 month ago
Rene Cannao	60b5aff5c4	Fix tests not running after infrastructure setup in multi-group runner The heredoc in run-multi-group.bash was causing bash to exit prematurely after ensure-infras.bash completed, without executing the test commands. This was due to shell expansion issues with the heredoc structure. Changes: - Replace heredoc with temp file approach in run-multi-group.bash - Add pre-proxysql hook call to ensure-infras.bash for cluster setup - Create legacy/pre-proxysql.bash for cluster node startup - Update mysql84/pre-proxysql.bash with cluster startup calls - Fix coverage collection to work correctly in parallel execution	1 month ago
Rene Cannao	86e86c8ce3	Fix parallel coverage collection and improve multi-group runner - Fix code coverage race condition: Each ProxySQL instance now writes .gcda files to its own directory using GCOV_PREFIX, preventing parallel groups from overwriting each other's coverage data - Add TAP_USE_NOISE documentation for noise injection testing - Replace random stagger delay with sequential delay (STAGGER_DELAY) to guarantee proper spacing between group startups - Update README with multi-group runner, coverage, and noise injection docs	1 month ago
Rene Cannao	7ee1332633	Add --ignore-errors source and --synthesize-missing to genhtml Fixes HTML generation errors for missing system headers like /usr/include/c++/13/bits/predefined_ops.h	1 month ago
Rene Cannao	20fc53e45c	Fix code coverage collection in multi-group test runner 1. Add set -e to run-multi-group.bash heredoc for proper error handling 2. Add EXIT trap in run-tests-isolated.bash to collect coverage on timeout/failure 3. Pass COVERAGE_MODE, COVERAGE_REPORT_DIR, and SCRIPT_DIR env vars to container 4. Fix fastcov invocation to use -e deps/ instead of restrictive -i filters 5. Add per-group HTML report generation 6. Run coverage combination in container for host without tools Coverage is now collected for: - include/ (189 header files) - lib/ (109 library files) - src/ (4 source files) The EXIT trap ensures coverage is collected even when tests timeout.	1 month ago
Rene Cannao	5f25df6c61	Improve test startup staggering with group-based hash	1 month ago
Rene Cannao	dcef810b99	Fix inner_exit_code unbound variable in run-multi-group.bash	1 month ago
Rene Cannao	9256a4c2f2	Fix heredoc variable expansion in run-multi-group.bash	1 month ago
Rene Cannao	0d891b8941	Fix variable escaping in run-multi-group.bash subshell	1 month ago
Rene Cannao	64d8149a53	Add COVERAGE to run-multi-group.bash configuration summary output	1 month ago
Rene Cannao	9f6ba655bf	Add optional code coverage support for isolated test runs	1 month ago
Rene Cannao	40e5d785a6	Change multi-group startup delay from 0-15 to 1-20 seconds	1 month ago
Rene Cannao	ba7f45474e	Fix run-multi-group.bash bugs and improve robustness Fixes: - Fix array parsing issue with bash arithmetic expansion on group names Changed from 'read -ra GROUPS' to simple for-loop iteration Group names like 'legacy-g1' were being evaluated as arithmetic (1004-114-1=889) - Fix exit code capture from timeout command Changed from 'if ! timeout ...; then exit_code=$?' to proper '\|\| cmd_exit_code=$?' The old code was capturing the if-test exit code (0) instead of the command's - Change PARALLEL_JOBS default from 0 (unlimited) to 2 for resource safety Improvements: - Add random 0-15 second startup delay per group to stagger infrastructure initialization and prevent Docker/resource contention when running multiple groups in parallel - Update header documentation with new default values Tested with RUN_ID="abd123" TAP_GROUPS="legacy-g1 legacy-g2 ai-g1 mysql84-g1" which ran successfully with staggered startup.	1 month ago
Rene Cannao	472e3644f7	Add parallel TAP group execution scripts New scripts for running multiple TAP groups in parallel: - run-multi-group.bash: Orchestrates parallel execution of multiple TAP groups * RUN_ID: Links all groups in a single test run (e.g., commit SHA) * TAP_GROUPS: Space-separated list of groups to run * PARALLEL_JOBS: Limit concurrent groups (default: unlimited) * TIMEOUT_MINUTES: Per-group timeout (default: 60) * EXIT_ON_FIRST_FAIL: Stop on first failure (default: 0) * AUTO_CLEANUP: Destroy successful groups automatically (default: 0) * SKIP_CLUSTER_START: Skip ProxySQL cluster init (default: 0) - destroy-multi-group.bash: Bulk cleanup for a specific RUN_ID * Destroys all infrastructures matching -{RUN_ID} Can target specific groups or auto-discover from log directories Each group gets fully isolated infrastructure: - INFRA_ID: {TAP_GROUP}-{RUN_ID} - Network: {INFRA_ID}_backend - Per-group logs in ci_infra_logs/{INFRA_ID}/ Fixes #5463	1 month ago

18 Commits (dca01d4eaf32c8363ff14fb4f74a46deb73e11c3)