mixed-methods-guide

# Mixed Methods Research Guide

Design, execute, and report mixed methods research that integrates quantitative and qualitative approaches for more comprehensive and rigorous findings.

## What Is Mixed Methods Research?

Mixed methods research (MMR) systematically combines quantitative and qualitative data collection, analysis, and interpretation within a single study or program of inquiry. It goes beyond simply using both numbers and words; the core requirement is purposeful integration of the two strands.

### When to Use Mixed Methods

| Situation | Why MMR Helps |
|-----------|--------------|
| Quantitative results need explanation | Qualitative follow-up explains why and how |
| Need to develop an instrument | Qualitative exploration informs survey items |
| Testing a new intervention | Quantitative outcomes + qualitative experience |
| Complex phenomena | Neither approach alone captures the full picture |
| Conflicting prior findings | Triangulation resolves discrepancies |
| Studying under-researched topics | Exploration (qual) then confirmation (quant) |

## Major Mixed Methods Designs

### Convergent Design (Concurrent)

Both strands are collected simultaneously, analyzed separately, then merged.

```
    QUAN data collection          QUAL data collection
           |                              |
    QUAN data analysis            QUAL data analysis
           |                              |
           +---------- Merge ------------+
                         |
                  Interpretation
```

**Use when**: You want to compare, validate, or triangulate quantitative and qualitative findings on the same phenomenon.

**Example**: Survey 500 teachers on burnout (QUAN) while simultaneously interviewing 20 teachers about their experiences (QUAL). Merge findings to see if themes align with statistical patterns.

### Explanatory Sequential Design

Quantitative phase first, followed by qualitative phase to explain or elaborate on quantitative results.

```
    QUAN data collection & analysis
                |
    Identify results needing explanation
                |
    QUAL data collection & analysis (informed by QUAN results)
                |
           Interpretation
```

**Use when**: You have surprising, confusing, or significant quantitative results that need deeper understanding.

**Example**: Find that 30% of participants show an unexpected improvement pattern. Interview those participants to understand what drove their experience.

### Exploratory Sequential Design

Qualitative phase first to explore, followed by quantitative phase to test or generalize.

```
    QUAL data collection & analysis
                |
    Develop instrument / hypotheses / categories from QUAL findings
                |
    QUAN data collection & analysis (testing QUAL-derived constructs)
                |
           Interpretation
```

**Use when**: You are studying something new and need qualitative exploration to develop measurement instruments or hypotheses.

**Example**: Interview 25 researchers about AI tool adoption (QUAL). Use themes to develop a survey instrument. Administer survey to 400 researchers (QUAN).

### Embedded Design

One strand is embedded within the other, serving a supplementary role.

```
    QUAN experiment
        |-- Embedded QUAL (interviews during intervention)
        |-- QUAN outcome measures
           |
       Interpretation
```

## Integration Strategies

Integration is what distinguishes mixed methods from simply running two separate studies. Key integration strategies:

| Strategy | Description | When in Study |
|----------|-------------|--------------|
| **Merging** | Bring QUAN + QUAL results together for comparison | Analysis/interpretation |
| **Connecting** | One strand's results inform the next strand's design | Between phases |
| **Building** | QUAL results build a QUAN instrument (or vice versa) | Between phases |
| **Embedding** | One strand is nested within the other's framework | Data collection |

### Joint Display Table

A joint display is a table or visualization that explicitly integrates both data types:

```
| Quantitative Finding | Qualitative Theme | Meta-Inference |
|---------------------|-------------------|----------------|
| 78% reported high stress (M=4.2/5) | Theme: "Always-on culture" — participants described checking email at midnight | Convergent: high stress scores align with descriptions of boundary erosion |
| No significant gender difference (p=.34) | Women described unique stressors (caregiving + work), men described different ones (promotion pressure) | Divergent: similar overall levels but different sources of stress |
| Time-management training reduced stress (d=0.45) | Theme: "Tools help but culture doesn't change" | Complementary: training has modest measurable effect but underlying issues persist |
```

## Sample Size Considerations

| Strand | Typical Range | Rationale |
|--------|---------------|-----------|
| Quantitative (survey) | 100-1000+ | Power analysis, see power-analysis-guide |
| Qualitative (interviews) | 12-30 | Saturation (no new themes emerging) |
| Qualitative (focus groups) | 3-6 groups of 6-10 | Diversity of perspectives |
| Qualitative (case study) | 3-10 cases | In-depth understanding |

**For convergent designs**: The QUAN sample is typically much larger than the QUAL sample. This is acceptable because the two strands serve different purposes (generalizability vs. depth).

## Data Analysis

### Quantitative Analysis

Standard statistical methods apply: descriptive statistics, t-tests, ANOVA, regression, SEM, etc. See the relevant analysis skill guides.

### Qualitative Analysis

Common approaches:

```
1. Thematic Analysis (Braun & Clarke, 2006)
   Step 1: Familiarize with data (read transcripts multiple times)
   Step 2: Generate initial codes
   Step 3: Search for themes (group codes into higher-level themes)
   Step 4: Review themes (check against data)
   Step 5: Define and name themes
   Step 6: Write up findings

2. Coding Process:
   - Open coding: label meaningful segments of text
   - Axial coding: identify relationships between codes
   - Selective coding: identify core categories

3. Tools: NVivo, ATLAS.ti, MAXQDA, Dedoose, or manual coding in spreadsheets
```

### Integration Analysis

```python
# Example: Quantifying qualitative themes for integration
import pandas as pd

# After coding interviews, create a themes-by-participant matrix
themes_matrix = pd.DataFrame({
    "participant": ["P01", "P02", "P03", "P04", "P05"],
    "high_stress": [1, 1, 0, 1, 1],      # 1 = theme present
    "boundary_erosion": [1, 0, 0, 1, 1],
    "coping_strategy": [0, 1, 1, 1, 0],
    "quant_stress_score": [4.5, 3.8, 2.1, 4.2, 4.0]
})

# Now examine whether theme presence correlates with quantitative scores
from scipy.stats import pointbiserialr

r, p = pointbiserialr(themes_matrix["high_stress"],
                       themes_matrix["quant_stress_score"])
print(f"Correlation between stress theme and score: r={r:.3f}, p={p:.3f}")
```

## Reporting Mixed Methods Research

### Essential Components

1. **Research questions**: State both QUAN and QUAL questions plus the mixed methods question
2. **Design rationale**: Explain why mixed methods is needed
3. **Design type**: Name the specific design (convergent, explanatory sequential, etc.)
4. **Strand descriptions**: Describe each strand's methods in detail
5. **Integration procedure**: Explain how and when data are integrated
6. **Joint display**: Present integrated findings in a table or figure
7. **Meta-inferences**: Draw conclusions that leverage both data types

### Quality Criteria

| Criterion | Quantitative | Qualitative | Mixed Methods |
|-----------|-------------|-------------|---------------|
| Validity | Internal, external, construct, statistical conclusion | Credibility, transferability, dependability, confirmability | Inference quality, inference transferability |
| Reliability | Cronbach's alpha, test-retest | Intercoder agreement, audit trail | Integration consistency |
| Rigor | Randomization, control, blinding | Prolonged engagement, member checking, triangulation | Design coherence, integrative adequacy |

### Recommended Reporting Guidelines

- **APA JARS-Mixed** (Journal Article Reporting Standards for Mixed Methods)
- **O'Cathain et al. (2008)** Good Reporting of a Mixed Methods Study (GRAMMS)
- **Creswell & Plano Clark (2018)** Designing and Conducting Mixed Methods Research, 3rd Edition (the standard textbook)