test-automation

# Test Automation — Test Automation Pipeline

An agent team collaborates to perform test strategy formulation -> test writing -> CI integration -> coverage analysis.

## Execution Mode

**Agent Team** — 5 members communicate directly via SendMessage and cross-validate each other.

## Agent Composition

| Agent | File | Role | Type |
|-------|------|------|------|
| test-strategist | `.claude/agents/test-strategist.md` | Test pyramid, tools, CI design | general-purpose |
| unit-tester | `.claude/agents/unit-tester.md` | Unit test writing, mocking | general-purpose |
| integration-tester | `.claude/agents/integration-tester.md` | API/DB/external service testing | general-purpose |
| coverage-analyst | `.claude/agents/coverage-analyst.md` | Coverage gap analysis, improvement plan | general-purpose |
| qa-reviewer | `.claude/agents/qa-reviewer.md` | Cross-validation, test quality evaluation | general-purpose |

## Workflow

### Phase 1: Preparation (Performed directly by Orchestrator)

1. Extract from user input:
    - **Target Code**: Codebase or module to test
    - **Tech Stack** (optional): Language, framework, existing test tools
    - **Constraints** (optional): Coverage targets, CI platform, time constraints
    - **Existing Tests** (optional): Already written test code
2. Create `_workspace/` directory at the project root
3. Organize input and save to `_workspace/00_input.md`
4. If existing files are available, copy them to `_workspace/` and skip the corresponding Phase
5. Determine **execution mode** based on the scope of the request (see "Modes by Task Scale" below)

### Phase 2: Team Assembly and Execution

| Order | Task | Assignee | Dependencies | Deliverable |
|-------|------|----------|-------------|-------------|
| 1 | Test Strategy | strategist | None | `_workspace/01_test_strategy.md` |
| 2a | Unit Test Writing | unit-tester | Task 1 | `_workspace/02_unit_tests.md` |
| 2b | Integration Test Writing | integration-tester | Task 1 | `_workspace/03_integration_tests.md` |
| 3 | Coverage Analysis | coverage-analyst | Tasks 1, 2a, 2b | `_workspace/04_coverage_report.md` |
| 4 | Final Review | qa-reviewer | Tasks 1-3 | `_workspace/05_review_report.md` |

Tasks 2a (unit) and 2b (integration) can be **executed in parallel**.

**Inter-team Communication Flow:**
- strategist completes -> delivers test scope and mocking strategy to unit-tester; delivers integration test scope and environment strategy to integration-tester
- unit-tester completes -> shares mocked interface list with integration-tester; delivers test list to coverage-analyst
- integration-tester completes -> delivers integration test list to coverage-analyst
- coverage-analyst completes -> requests additional tests from unit-tester/integration-tester when gaps are found
- qa-reviewer cross-validates all deliverables. Requests fixes for RED Must Fix items (up to 2 times)

### Phase 3: Integration and Final Deliverables

1. Check all files in `_workspace/`
2. Verify all RED Must Fix items have been addressed
3. Report the final summary to the user

## Modes by Task Scale

| User Request Pattern | Execution Mode | Deployed Agents |
|---------------------|----------------|-----------------|
| "Automate tests", "Full testing" | **Full Pipeline** | All 5 agents |
| "Write unit tests only" | **Unit Test Mode** | strategist + unit-tester + reviewer |
| "Write integration tests only" | **Integration Test Mode** | strategist + integration-tester + reviewer |
| "Analyze coverage" | **Coverage Mode** | coverage-analyst + reviewer |
| "Create test strategy only" | **Strategy Mode** | strategist + reviewer |

**Leveraging Existing Files**: If the user provides existing test code, coverage reports, etc., copy the files to the appropriate location in `_workspace/` and skip the corresponding agent's step.

## Data Transfer Protocol

| Strategy | Method | Purpose |
|----------|--------|---------|
| File-based | `_workspace/` directory | Store and share main deliverables |
| Message-based | SendMessage | Real-time delivery of key information, fix requests |
| Task-based | TaskCreate/TaskUpdate | Progress tracking, dependency management |

## Error Handling

| Error Type | Strategy |
|-----------|----------|
| Code inaccessible | Write general tests based on user description, note "estimation-based" in report |
| Test framework not installed | Provide test code with installation guide |
| Agent failure | Retry once -> if fails, proceed without that deliverable, note omission in review |
| RED found in review | Request fix from relevant agent -> rework -> re-verify (up to 2 times) |
| Coverage tool cannot run | Substitute with static analysis-based estimated coverage |

## Test Scenarios

### Normal Flow
**Prompt**: "Apply test automation to a REST API built with NestJS. Currently there are no tests at all."
**Expected Result**:
- Strategy: Jest + Supertest selection, risk-based priorities, CI (GitHub Actions) design
- Unit: Service class tests, Repository mocking, DTO validation
- Integration: API endpoint tests, PostgreSQL integration via Testcontainers
- Coverage: Per-module gap analysis, P0/P1 additional test suggestions
- Review: Full consistency verification across all items

### Existing File Utilization Flow
**Prompt**: "Current test coverage is 40% and I want to get it to 80%" + code/tests attached
**Expected Result**:
- Start in coverage mode, analyze current gaps
- Establish additional test plan with risk-based priorities
- Phased improvement roadmap (40% -> 60% -> 80%)

### Error Flow
**Prompt**: "Write test code for this function" (only one function provided)
**Expected Result**:
- Switch to unit test mode
- Write boundary value, normal/abnormal case tests for the function
- Provide tests immediately using basic AAA pattern even without a strategy

## Agent Extension Skills

| Skill | Path | Enhanced Agent | Role |
|-------|------|---------------|------|
| test-design-patterns | `.claude/skills/test-design-patterns/skill.md` | test-strategist, unit-tester | Boundary value analysis, equivalence partitioning, state transition, pairwise, risk-based prioritization |
| mocking-strategy | `.claude/skills/mocking-strategy/skill.md` | unit-tester, integration-tester | Mock/Stub/Spy/Fake selection, per-layer mocking, anti-pattern prevention |