forecast-accuracy-analyzer

Forecast accuracy measurement and improvement skill with error decomposition

509 stars

Best use case

forecast-accuracy-analyzer is best used when you need a repeatable AI agent workflow instead of a one-off prompt.

Forecast accuracy measurement and improvement skill with error decomposition

Teams using forecast-accuracy-analyzer should expect a more consistent output, faster repeated execution, less prompt rewriting.

When to use this skill

  • You want a reusable workflow that can be run more than once with consistent structure.

When not to use this skill

  • You only need a quick one-off answer and do not need a reusable workflow.
  • You cannot install or maintain the underlying files, dependencies, or repository context.

Installation

Claude Code / Cursor / Codex

$curl -o ~/.claude/skills/forecast-accuracy-analyzer/SKILL.md --create-dirs "https://raw.githubusercontent.com/a5c-ai/babysitter/main/library/specializations/domains/business/supply-chain/skills/forecast-accuracy-analyzer/SKILL.md"

Manual Installation

  1. Download SKILL.md from GitHub
  2. Place it in .claude/skills/forecast-accuracy-analyzer/SKILL.md inside your project
  3. Restart your AI agent — it will auto-discover the skill

How forecast-accuracy-analyzer Compares

Feature / Agentforecast-accuracy-analyzerStandard Approach
Platform SupportNot specifiedLimited / Varies
Context Awareness High Baseline
Installation ComplexityUnknownN/A

Frequently Asked Questions

What does this skill do?

Forecast accuracy measurement and improvement skill with error decomposition

Where can I find the source code?

You can find the source code on GitHub using the link provided at the top of the page.

SKILL.md Source

# Forecast Accuracy Analyzer

## Overview

The Forecast Accuracy Analyzer provides comprehensive forecast accuracy measurement, error decomposition, and improvement recommendation capabilities. It supports continuous forecast quality improvement through root cause analysis and model performance comparison.

## Capabilities

- **MAPE, WMAPE, Bias Calculation**: Standard accuracy metrics
- **Forecast Error Decomposition**: Breakdown by error source
- **SKU-Level Accuracy Tracking**: Granular accuracy monitoring
- **Forecast Value-Add (FVA) Analysis**: Contribution of forecast steps
- **Root Cause Categorization**: Error driver classification
- **Model Performance Comparison**: Multi-model accuracy benchmarking
- **Improvement Recommendation Generation**: Data-driven suggestions
- **Accuracy Trend Monitoring**: Historical accuracy tracking

## Input Schema

```yaml
forecast_accuracy_request:
  forecast_data:
    forecasts: array
      - sku_id: string
        period: string
        forecast_value: float
        forecast_source: string
    period_range:
      start: date
      end: date
  actual_data:
    actuals: array
      - sku_id: string
        period: string
        actual_value: float
  analysis_parameters:
    metrics: array                # MAPE, WMAPE, Bias, etc.
    aggregation_levels: array     # SKU, category, total
    fva_steps: array              # Statistical, sales input, etc.
  segmentation:
    by_category: boolean
    by_volume: boolean
    by_variability: boolean
```

## Output Schema

```yaml
forecast_accuracy_output:
  accuracy_metrics:
    overall:
      mape: float
      wmape: float
      bias: float
      mpe: float
    by_segment: array
    by_sku: array
  error_decomposition:
    systematic_error: float
    random_error: float
    outlier_impact: float
    by_source: object
  fva_analysis:
    steps: array
      - step_name: string
        value_add: float
        before_accuracy: float
        after_accuracy: float
    recommendations: array
  root_cause_analysis:
    error_categories: array
      - category: string
        frequency: integer
        impact: float
    top_drivers: array
  model_comparison:
    models: array
      - model_name: string
        accuracy: float
        best_for: array
  improvement_recommendations: array
    - recommendation: string
      expected_improvement: float
      implementation_effort: string
  trends:
    accuracy_over_time: object
    bias_trend: object
```

## Usage

### Monthly Accuracy Review

```
Input: Previous month's forecasts and actuals
Process: Calculate accuracy metrics by segment
Output: Accuracy report with performance analysis
```

### Forecast Value-Add Analysis

```
Input: Forecast at each process step (statistical, sales, consensus)
Process: Measure value added at each step
Output: FVA report identifying low-value steps
```

### Root Cause Investigation

```
Input: High-error SKUs, demand patterns
Process: Categorize and analyze error drivers
Output: Root cause report with recommendations
```

## Integration Points

- **Planning Systems**: Forecast and actual data
- **BI Platforms**: Accuracy dashboards
- **Statistical Tools**: Advanced analysis
- **Tools/Libraries**: Statistical analysis, visualization

## Process Dependencies

- Forecast Accuracy Analysis and Improvement
- Demand Forecasting and Planning
- Sales and Operations Planning (S&OP)

## Best Practices

1. Measure accuracy at multiple aggregation levels
2. Use weighted metrics for volume importance
3. Investigate outliers before concluding
4. Compare models on like-for-like basis
5. Set realistic improvement targets
6. Share accuracy results with stakeholders

Related Skills

terraform-analyzer

509
from a5c-ai/babysitter

Specialized skill for analyzing Terraform configurations. Supports parsing, security scanning (tfsec, checkov), cost estimation (infracost), drift detection, and plan visualization across AWS, Azure, and GCP.

db-query-analyzer

509
from a5c-ai/babysitter

Analyze database query performance with execution plans and index recommendations

code-complexity-analyzer

509
from a5c-ai/babysitter

Analyze code complexity metrics including cyclomatic complexity, code smells, and technical debt

cloudformation-analyzer

509
from a5c-ai/babysitter

Validate and analyze AWS CloudFormation templates for security and best practices

semantic-code-analyzer

509
from a5c-ai/babysitter

LLM-powered semantic analysis of code diffs to detect business-logic trojans

sast-analyzer

509
from a5c-ai/babysitter

Static Application Security Testing orchestration and analysis. Execute Semgrep, Bandit, ESLint security plugins, CodeQL, and other SAST tools. Parse, prioritize, and deduplicate findings across multiple tools with remediation guidance.

crypto-analyzer

509
from a5c-ai/babysitter

Cryptographic implementation analysis and validation for encryption algorithms, key sizes, and certificate management

semver-analyzer

509
from a5c-ai/babysitter

Analyze code changes and determine semantic version bumps. Detect breaking changes automatically, suggest version bump (major/minor/patch), generate changelog entries, and validate version consistency.

api-diff-analyzer

509
from a5c-ai/babysitter

Compare API specifications to detect breaking changes. Compare OpenAPI spec versions, categorize changes by severity, generate migration guides, and block breaking changes in CI.

process-analyzer

509
from a5c-ai/babysitter

Analyze processes, identify workflows, define boundaries and scope, and map process requirements for specialization creation.

scope-logic-analyzer

509
from a5c-ai/babysitter

Test equipment integration for signal analysis (oscilloscope and logic analyzer)

protocol-analyzer

509
from a5c-ai/babysitter

Serial protocol analysis and debugging for common embedded interfaces (I2C, SPI, UART)