proxysql

Commit Graph

Author	SHA1	Message	Date
Rene Cannao	9ffc3f8d71	mcp tests: add phase-B TAP coverage and optional real Claude CLI E2E runner Add two complementary TAP tests for phase-B validation and an optional real Claude CLI E2E helper, so we can validate both 'without Claude credentials' and 'with real Claude CLI' workflows. What was added: 1) CI-safe deterministic phase-B TAP - New: test/tap/tests/test_mcp_llm_discovery_phaseb-t.sh - Validates MCP phase-B primitives end-to-end without external LLM API: - list_targets - discovery.run_static (target_id-scoped setup) - catalog.list_objects - agent.run_start / agent.run_finish - llm.summary_upsert / llm.summary_get - llm.domain_upsert / llm.domain_set_members - llm.metric_upsert - llm.question_template_add - llm.search - Uses unique per-run markers to assert persisted artifacts are retrievable 2) Claude headless flow TAP smoke - New: test/tap/tests/test_mcp_claude_headless_flow-t.sh - Always validates integration path without external dependencies: - static_harvest.sh wrapper executes and yields run_id - two_phase_discovery.py --dry-run executes with target_id/run_id context - Optional real Claude execution: - enabled via TAP_RUN_REAL_CLAUDE=1 - skipped by default to keep CI deterministic 3) Manual real-CLI E2E runner - New: scripts/mcp/DiscoveryAgent/ClaudeCode_Headless/run_real_claude_e2e.sh - Runs full two-step flow manually when credentials/CLI are available: - phase-A static harvest (or --skip-phase-a + --run-id) - phase-B real Claude run via two_phase_discovery.py 4) Documentation updates - scripts/mcp/DiscoveryAgent/ClaudeCode_Headless/README.md: - documents run_real_claude_e2e.sh usage - test/tap/groups/ai/README.md: - adds manual run instructions for: - phase-A static harvest test - phase-B deterministic TAP test - Claude headless smoke (with optional real mode) Validation run: - bash -n: - test_mcp_llm_discovery_phaseb-t.sh - test_mcp_claude_headless_flow-t.sh - run_real_claude_e2e.sh - static_harvest.sh - python3 -m py_compile: - two_phase_discovery.py	2 months ago

Author

SHA1

Message

Date

Rene Cannao

9ffc3f8d71

mcp tests: add phase-B TAP coverage and optional real Claude CLI E2E runner

Add two complementary TAP tests for phase-B validation and an optional real Claude CLI E2E helper, so we can validate both 'without Claude credentials' and 'with real Claude CLI' workflows.

What was added:

1) CI-safe deterministic phase-B TAP
- New: test/tap/tests/test_mcp_llm_discovery_phaseb-t.sh
- Validates MCP phase-B primitives end-to-end without external LLM API:
  - list_targets
  - discovery.run_static (target_id-scoped setup)
  - catalog.list_objects
  - agent.run_start / agent.run_finish
  - llm.summary_upsert / llm.summary_get
  - llm.domain_upsert / llm.domain_set_members
  - llm.metric_upsert
  - llm.question_template_add
  - llm.search
- Uses unique per-run markers to assert persisted artifacts are retrievable

2) Claude headless flow TAP smoke
- New: test/tap/tests/test_mcp_claude_headless_flow-t.sh
- Always validates integration path without external dependencies:
  - static_harvest.sh wrapper executes and yields run_id
  - two_phase_discovery.py --dry-run executes with target_id/run_id context
- Optional real Claude execution:
  - enabled via TAP_RUN_REAL_CLAUDE=1
  - skipped by default to keep CI deterministic

3) Manual real-CLI E2E runner
- New: scripts/mcp/DiscoveryAgent/ClaudeCode_Headless/run_real_claude_e2e.sh
- Runs full two-step flow manually when credentials/CLI are available:
  - phase-A static harvest (or --skip-phase-a + --run-id)
  - phase-B real Claude run via two_phase_discovery.py

4) Documentation updates
- scripts/mcp/DiscoveryAgent/ClaudeCode_Headless/README.md:
  - documents run_real_claude_e2e.sh usage
- test/tap/groups/ai/README.md:
  - adds manual run instructions for:
    - phase-A static harvest test
    - phase-B deterministic TAP test
    - Claude headless smoke (with optional real mode)

Validation run:
- bash -n:
  - test_mcp_llm_discovery_phaseb-t.sh
  - test_mcp_claude_headless_flow-t.sh
  - run_real_claude_e2e.sh
  - static_harvest.sh
- python3 -m py_compile:
  - two_phase_discovery.py

1 Commits (5810978e4e186c17f09bb38eccbaeb67ad6b59ea)