Complete sprints 163-165 strict MCP grammar pipeline and enforcement

docs/sprint163_165_taskitem_execution_log_2026-02-26.md

@@ -0,0 +1,84 @@
+# Sprint 163/164/165 Taskitem Execution Log (2026-02-26)
+
+## MCP taskitem runs (training-data artifacts)
+
+- `logs/taskitem_runs/sprint163_plan_20260225_171926`
+- `logs/taskitem_runs/sprint164_plan_20260225_171927`
+- `logs/taskitem_runs/sprint165_plan_20260225_171927`
+
+Run summaries:
+- Sprint 163: 14 normalized requirements, 2 tasks, queue ready, validation average 87.5
+- Sprint 164: 14 normalized requirements, 2 tasks, queue ready, validation average 87.5
+- Sprint 165: 14 normalized requirements, 2 tasks, queue ready, validation average 87.5
+
+## Execution mapping (implemented work)
+
+Completed in tooling/code:
+
+- Step 1859: Added strictness audit utility
+  - `tools/mcp/audit_grammar_strictness.py`
+- Step 1860: Added canonical schema normalizer
+  - `tools/mcp/schema_normalizer.py`
+- Step 1861: Refactored grammar generator to normalized-schema recursive flow
+  - `tools/mcp/generate_tool_grammars.py`
+- Step 1862: Added strictness policy gate
+  - `tools/mcp/grammars/strictness_policy.json`
+  - `tools/mcp/check_strictness_policy.py`
+- Step 1863: Added sprint 163 integration summary artifact
+  - `editor/src/Sprint163IntegrationSummary.h`
+
+- Step 1864: Implemented recursive object/array grammar rule generation
+  - `tools/mcp/generate_tool_grammars.py`
+- Step 1865: Added union handling in strict generation flow
+  - `tools/mcp/generate_tool_grammars.py`
+- Step 1866: Added constraint-aware scalar/object handling (where representable)
+  - `tools/mcp/generate_tool_grammars.py`
+- Step 1867: Added strict grammar CI runner and reproducible checks
+  - `tools/mcp/run_grammar_ci_checks.sh`
+- Step 1868: Added sprint 164 integration summary artifact
+  - `editor/src/Sprint164IntegrationSummary.h`
+
+- Step 1869: Enforced strictness policy checking
+  - `tools/mcp/check_strictness_policy.py`
+  - `tools/mcp/grammars/strictness_policy.json`
+- Step 1870: Added artifact fingerprinting and lock verification
+  - `tools/mcp/grammars/manifest.json`
+  - `tools/mcp/grammars/manifest.lock`
+  - `tools/mcp/verify_grammar_manifest.py`
+- Step 1871: Added CI integration script for strict grammar pipeline
+  - `tools/mcp/run_grammar_ci_checks.sh`
+- Step 1872: Added runtime strict grammar verification path
+  - `tools/mcp/validate_slm_runtime.sh` (`STRICT_GRAMMARS=1`)
+- Step 1873: Added sprint 165 integration summary artifact
+  - `editor/src/Sprint165IntegrationSummary.h`
+
+## Verification
+
+Executed:
+
+- `./tools/mcp/run_grammar_ci_checks.sh`
+
+Result: PASS
+
+Outputs generated and verified:
+
+- `tools/mcp/grammars/dispatch.gbnf`
+- `tools/mcp/grammars/dispatch_schema.json`
+- `tools/mcp/grammars/per_tool_schemas.json`
+- `tools/mcp/grammars/normalized_tool_schemas.json`
+- `tools/mcp/grammars/strictness_report.json`
+- `tools/mcp/grammars/manifest.json`
+- `tools/mcp/grammars/manifest.lock`
+
+Coverage status:
+
+- Tool schemas: 347
+- Per-tool GBNF files: 347
+- Dispatch schema `oneOf` entries: 347
+
+Current strictness report:
+
+- `unwaived_fallback_count`: 390
+- `unsupported_schema_entry_count`: 1
+
+Policy is configured to fail on any regression beyond this baseline.