bill/whetstone_DSL
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Add impact-by-impact native decomposition coverage gates (sprint 241)

Browse Source
This commit is contained in:
Bill
2026-02-26 15:05:21 -07:00
parent e9dd06205e
commit 3c04216a54
12 changed files with 559 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

7
docs/constructive_editing_runtime_plan.md
View File

@@ -150,7 +150,7 @@ Parallel planning tranche (active):
- `logs/taskitem_runs/TEST_ONLY_spec_planning_baseline_20260226/deterministic_spec_readiness.json`
Planning runtime controls (active):
- `sprint232_plan.md` to `sprint240_plan.md`
- `sprint232_plan.md` to `sprint241_plan.md`
- semantic bridge + intake augmentation + requirement injection + expansion gating are wired into:
- `tools/mcp/run_sprint_taskitem_pipeline.sh`
- current policy default is native-first semantic fallback:
@@ -169,3 +169,8 @@ Planning runtime controls (active):
- `WSTONE_NATIVE_DECOMP_RETRY`
- `WSTONE_NATIVE_DECOMP_TARGET_MIN_TASKS`
- `native_decomposition_retry`
- impact-specific native decomposition coverage can be enforced:
- `WSTONE_NATIVE_IMPACT_COVERAGE_GATE`
- `WSTONE_NATIVE_IMPACT_COVERAGE_ENFORCE`
- `WSTONE_NATIVE_IMPACT_COVERAGE_PROFILES`
- `native_impact_coverage`

1
docs/generator_readiness_gap_registry_2026-02-26.md
View File

@@ -47,6 +47,7 @@ This is the canonical dated registry for "not production-ready" generator gaps.
| GR-018 | Performance/security/rollout constrained refactor enforcement gap | `docs/gap_hunt_fullstack_multifile_2026-02-26.md`, `logs/taskitem_runs/challenging_fullstack_multifile_20260226_r5/results.jsonl` | `partial` | Hard checks now enforce migration rollback + data-loss policy, security deny-by-default, SLO p95 presence, and rollout staged+abort policy. Enforcement is contract-level; generator capability under these constraints is still weak in C++ AB path. | Constraint-aware generation follow-up |
| GR-019 | Parity-blocked readiness load (gating without capability closure) | `logs/taskitem_runs/challenging_fullstack_multifile_20260226_r7/summary.json`, `logs/taskitem_runs/challenging_subset_prod_20260226_r7/summary.json`, `docs/sprint225_227_execution_tracker_2026-02-26.md` | `partial` | Sprint 225-227 reduced blocked parity load from `6` to `0` on both tracked hard catalogs while keeping unresolved divergence at `0`. This closes immediate safety debt for current corpora, but robustness is still contingent on pattern-driven repair classes. | Generalize repairs beyond queue-shaped transpile outputs |
| GR-020 | Semantic fallback overuse masks weak native decomposition | `logs/taskitem_runs/TEST_ONLY_sprint236_semantic_fallback_audit_20260226/semantic_fallback_summary.json`, `logs/taskitem_runs/TEST_ONLY_sprint237_semantic_fallback_gate_fail_20260226/semantic_fallback_budget_gate.json`, `logs/taskitem_runs/TEST_ONLY_sprint238_native_gate_fail_20260226.json`, `logs/taskitem_runs/TEST_ONLY_sprint239_semantic_fallback_audit_20260226/semantic_fallback_summary.json`, `logs/taskitem_runs/TEST_ONLY_sprint240_retry_20260226_145631/00_summary.json`, `docs/sprint236_execution_tracker_2026-02-26.md`, `docs/sprint237_execution_tracker_2026-02-26.md`, `docs/sprint238_execution_tracker_2026-02-26.md`, `docs/sprint239_execution_tracker_2026-02-26.md`, `docs/sprint240_execution_tracker_2026-02-26.md` | `partial` | Sprint 236 added deterministic fallback-gap auditing with tool + constraint metadata. Sprint 237 added fallback-budget hard gate (`max-fallback-rate`) and produced expected fail/pass artifacts. Sprint 238 added native decomposition hard gate in pipeline (`min task count`, `min semantic signal count`) so weak native generation can be blocked before fallback masking. Sprint 239 added native reason enrichment and improved semantic signal density (`0 -> 6`). Sprint 240 added native decomposition retry with explicit minimum-task policy; on current sample retry attempted but did not improve depth (`2 -> 2`). | Native decomposition task-depth upgrade (increase native task granularity beyond 2) |
| GR-021 | Impact-specific native decomposition coverage not enforced uniformly | `docs/native_decomposition_impact_list_2026-02-26.md`, `tools/mcp/profiles/native_decomposition_impact_profiles.json`, `logs/taskitem_runs/TEST_ONLY_sprint241_fullstack_impact_20260226_150416/00_summary.json`, `logs/taskitem_runs/TEST_ONLY_sprint241_native_impact_aggregate_20260226/native_impact_coverage_aggregate.json` | `partial` | Sprint 241 added one-by-one impact profiles and a pipeline-integrated native impact coverage gate (`native_impact_coverage`). Current fullstack sample activates 7 profiles and all fail, proving enforcement catches shallow coverage but generator closure is still pending. | Implement profile-specific native decomposition expansion to satisfy failing profile constraints |
## What Was Covered Today (Sprints 175-184)

68
docs/native_decomposition_impact_list_2026-02-26.md Normal file
View File

@@ -0,0 +1,68 @@
# Native Decomposition Impact List - 2026-02-26
Status: Active
Purpose: Enumerate all known areas affected by shallow native decomposition and map each to enforceable tooling.
## Impact List (One-by-One)
1. API contract evolution
- Problem: compatibility/versioning work collapses into generic tasks.
- Tooling: `impact_api_contract_evolution` profile in `tools/mcp/profiles/native_decomposition_impact_profiles.json`.
2. State migration and rollback safety
- Problem: migration/backfill/rollback choreography omitted.
- Tooling: `impact_state_migration_rollback` profile.
3. Security policy propagation
- Problem: cross-layer auth/deny-by-default checks missing.
- Tooling: `impact_security_policy_propagation` profile.
4. SLO/latency budget constraints
- Problem: performance requirements missing from decomposition rationale.
- Tooling: `impact_slo_latency_budget` profile.
5. Rollout choreography
- Problem: staged rollout/abort hooks not represented as tasks.
- Tooling: `impact_rollout_choreography` profile.
6. Multi-file transactional edits
- Problem: partial cross-file updates pass as “done”.
- Tooling: `impact_multifile_transactional_edit` profile.
7. Concurrency/locking semantics
- Problem: race/lock/deadlock work under-scoped.
- Tooling: `impact_concurrency_locking` profile.
8. Projection/environment constraints
- Problem: embedded/mobile/serverless constraints ignored.
- Tooling: `impact_projection_environment_constraints` profile.
9. Polyglot boundary changes
- Problem: SDK/client/server coupling not decomposed.
- Tooling: `impact_polyglot_boundary_changes` profile.
10. Observability/telemetry integrity
- Problem: logging/metrics/tracing semantics omitted.
- Tooling: `impact_observability_telemetry_integrity` profile.
11. Data integrity and precision
- Problem: financial/scientific precision risks hidden in generic tasks.
- Tooling: `impact_data_integrity_precision` profile.
12. Recovery/replay-critical flows
- Problem: recovery/rollback/replay pathways not represented.
- Tooling: `impact_disaster_recovery_replay` profile.
## Enforcement Tooling
- Checker:
- `tools/mcp/check_native_decomposition_impact_coverage.py`
- Profiles:
- `tools/mcp/profiles/native_decomposition_impact_profiles.json`
- Standalone gate wrapper:
- `tools/mcp/run_native_impact_coverage_gate.sh`
- Pipeline integration toggles in `tools/mcp/run_sprint_taskitem_pipeline.sh`:
- `WSTONE_NATIVE_IMPACT_COVERAGE_GATE`
- `WSTONE_NATIVE_IMPACT_COVERAGE_ENFORCE`
- `WSTONE_NATIVE_IMPACT_COVERAGE_PROFILES`

19
docs/progress_log_2026-02-26.md
View File

@@ -185,3 +185,22 @@
- `logs/taskitem_runs/TEST_ONLY_sprint240_retry_20260226_145632/00_summary.json`
- Current measured result:
- retry attempted but not applied (`2 -> 2` tasks), confirming remaining native decomposition depth gap.
## Sprint 241 Added (Same Day)
- Added complete dated impact list for shallow native decomposition:
- `docs/native_decomposition_impact_list_2026-02-26.md`
- Added one-by-one profile tooling:
- `tools/mcp/profiles/native_decomposition_impact_profiles.json`
- `tools/mcp/check_native_decomposition_impact_coverage.py`
- `tools/mcp/run_native_impact_coverage_gate.sh`
- `tools/mcp/analyze_native_impact_coverage.py`
- Integrated impact-coverage gate into pipeline with optional enforcement:
- `WSTONE_NATIVE_IMPACT_COVERAGE_GATE`
- `WSTONE_NATIVE_IMPACT_COVERAGE_ENFORCE`
- `WSTONE_NATIVE_IMPACT_COVERAGE_PROFILES`
- Dated artifacts:
- `logs/taskitem_runs/TEST_ONLY_sprint241_impact_gate_20260226_150403/00_summary.json`
- `logs/taskitem_runs/TEST_ONLY_sprint241_impact_gate_20260226_150404/06_native_impact_coverage.json`
- `logs/taskitem_runs/TEST_ONLY_sprint241_fullstack_impact_20260226_150416/00_summary.json`
- `logs/taskitem_runs/TEST_ONLY_sprint241_native_impact_aggregate_20260226/native_impact_coverage_aggregate.json`

55
docs/sprint241_execution_tracker_2026-02-26.md Normal file
View File

@@ -0,0 +1,55 @@
# Sprint 241 Execution Tracker - 2026-02-26
## Scope
- `sprint241_plan.md`
## Implemented
Impact list (dated):
- `docs/native_decomposition_impact_list_2026-02-26.md`
Profile set (one-by-one):
- `tools/mcp/profiles/native_decomposition_impact_profiles.json`
- profiles cover 12 impact surfaces:
- API contract evolution
- state migration/rollback
- security propagation
- SLO/latency budget
- rollout choreography
- multi-file transactional edit
- concurrency/locking
- projection/environment constraints
- polyglot boundary changes
- observability/telemetry integrity
- data integrity/precision
- recovery/replay critical flows
Checker + wrappers:
- `tools/mcp/check_native_decomposition_impact_coverage.py`
- `tools/mcp/run_native_impact_coverage_gate.sh`
- `tools/mcp/analyze_native_impact_coverage.py`
Pipeline integration in `tools/mcp/run_sprint_taskitem_pipeline.sh`:
- `WSTONE_NATIVE_IMPACT_COVERAGE_GATE` (default `0`)
- `WSTONE_NATIVE_IMPACT_COVERAGE_ENFORCE` (default `0`)
- `WSTONE_NATIVE_IMPACT_COVERAGE_PROFILES` (profile path)
- emits `06_native_impact_coverage.json`
- summary includes `native_impact_coverage`
## Baseline Validation Artifacts
- soft-gate run:
- `logs/taskitem_runs/TEST_ONLY_sprint241_impact_gate_20260226_150403/00_summary.json`
- hard-gate run (expected block):
- `logs/taskitem_runs/TEST_ONLY_sprint241_impact_gate_20260226_150404/06_native_impact_coverage.json`
- multi-profile fullstack sample:
- `logs/taskitem_runs/TEST_ONLY_sprint241_fullstack_impact_20260226_150416/00_summary.json`
- aggregate report:
- `logs/taskitem_runs/TEST_ONLY_sprint241_native_impact_aggregate_20260226/native_impact_coverage_aggregate.json`
Observed signal:
- Fullstack sample activated `7` profiles, all failing under current shallow native decomposition.
## Explicit Completion Signal
- Sprint 241: `DONE` (implemented + pipeline-integrated + enforced smoke verified)