Add spec hardener and reusable hard-gate wrapper

This commit is contained in:
Bill
2026-02-26 14:12:33 -07:00
parent ccf8f7a817
commit b68c95e6f4
5 changed files with 177 additions and 1 deletions

View File

@@ -60,3 +60,10 @@
- `WSTONE_SPEC_READINESS_HARD_GATE`
- `WSTONE_SPEC_READINESS_MIN_SCORE`
- Spec readiness is now available in pipeline `00_summary.json` as `planning_readiness`.
- Added auto-hardening utility:
- `tools/mcp/spec_planning_hardener.py`
- Added end-to-end hardening gate wrapper:
- `tools/mcp/run_spec_hardening_gate.sh`
- Demonstrated hard-gate delta on sprint sample:
- original spec blocked (`rc=7`, score `17`)
- hardened spec passed (`rc=0`, score `100`)

View File

@@ -27,11 +27,30 @@ Planned and started:
- `logs/taskitem_runs/spec_planning_baseline_20260226/fullstack_spec_readiness.json`
- `logs/taskitem_runs/spec_planning_baseline_20260226/deterministic_spec_readiness.json`
- `logs/taskitem_runs/spec_planning_hardening_20260226/sprint228_before.json`
- `logs/taskitem_runs/spec_planning_hardening_20260226/sprint228_after.json`
- `logs/taskitem_runs/spec_planning_hardening_20260226/sprint228_hardened.md`
- `logs/taskitem_runs/spec_hardening_gate_20260226_s228_r2/report.json`
Observed baseline:
- both sample docs currently return `needs_spec_hardening`
- low readiness scores indicate missing first-class sections for constraints/acceptance/environment/security/performance.
Hardening delta (sprint228 plan sample):
- before: `score=17`, verdict `needs_spec_hardening`, missing actions `10`
- after auto-hardening scaffold: `score=100`, verdict `execution_ready`, missing actions `0`
Pipeline hard-gate proof:
- original spec run (hard gate on): `rc=7` with explicit readiness failure
- `logs/taskitem_runs/sprint228_plan_20260226_141045/00a_spec_readiness.json`
- hardened spec run (hard gate on): `rc=0` and full pipeline completion
- `logs/taskitem_runs/sprint228_hardened_20260226_141045/00_summary.json`
Reusable flow wrapper:
- `tools/mcp/run_spec_hardening_gate.sh`
- example invocation:
- `tools/mcp/run_spec_hardening_gate.sh sprint228_plan.md logs/taskitem_runs/spec_hardening_gate_20260226_s228_r2`
## Explicit Completion Signal
- Sprint 228: `PARTIAL` (tool implemented, baseline executed, pipeline precheck integrated)
@@ -42,5 +61,5 @@ Observed baseline:
## Next Closure Work
- Enable hard-gate mode for selected sprint ranges and capture pass/fail deltas.
- Add structured spec hardening pass that applies template scaffolds to candidate specs.
- Add reusable wrapper script for readiness->hardening->hard-gate flow across catalogs.
- Re-run benchmarks using hardened specs and measure downstream readiness deltas.