whetstone_DSL/sprint199_plan.md

Sprint 199 Plan: Long-Range Edit Reliability IV (Benchmarks)

Context

Reliability claims need dedicated benchmark evidence.

Goals

1. Add long-range benchmark corpus
2. Measure success, rollback, and drift rates
3. Gate promotion on benchmark thresholds

Steps

Step 2034: Long-range benchmark corpus setup (10 tests)

Create fixtures for multi-module and cross-file transformations.

Step 2035: Benchmark runner and metrics export (10 tests)

Emit success/rollback/drift metrics per benchmark.

Step 2036: Reliability threshold gate (8 tests)

Block promotion when benchmark thresholds fail.

Step 2037: Benchmark trend regression detector (8 tests)

Detect reliability regressions against baseline runs.

Step 2038: Sprint 199 Integration Summary (8 tests)

Add editor/src/Sprint199IntegrationSummary.h.

Architecture Gate

• Promotion requires passing long-range reliability benchmark thresholds.