42 lines
930 B
Markdown
42 lines
930 B
Markdown
|
# Run Spec: wrong_tool_selection_01
|
||
|
|
|
||
|
|
## Context
|
||
|
|
|
||
|
|
Synthetic MCP data-collection case.
|
||
|
|
family = wrong_tool_selection
|
||
|
|
variant = 1
|
||
|
|
|
||
|
|
## Objective
|
||
|
|
|
||
|
|
Exercise wrong_tool_selection behavior and produce deterministic stage-labeled traces.
|
||
|
|
|
||
|
|
## Anti-Pattern To Detect
|
||
|
|
|
||
|
|
- Select semantically adjacent tools for the wrong workflow phase.
|
||
|
|
|
||
|
|
## Target Behavior
|
||
|
|
|
||
|
|
- Use phase-correct ordering: intake -> generate -> queue -> validate.
|
||
|
|
- Keep tool-call chain bounded and auditable.
|
||
|
|
- Preserve deterministic output ordering.
|
||
|
|
|
||
|
|
## Requirements
|
||
|
|
|
||
|
|
- Workspace-relative paths only.
|
||
|
|
- Deterministic tool sequencing.
|
||
|
|
- Valid JSON arguments for each tool invocation.
|
||
|
|
|
||
|
|
## Acceptance Criteria
|
||
|
|
|
||
|
|
- At least one tool_selection event.
|
||
|
|
- At least one tool_execution event.
|
||
|
|
- No malformed MCP payloads.
|
||
|
|
- No unbounded loops.
|
||
|
|
|
||
|
|
## Data Capture Tags
|
||
|
|
|
||
|
|
- family: wrong_tool_selection
|
||
|
|
- variant: 1
|
||
|
|
- capture_mode: run_spec
|
||
|
|
- expected_failure_signature: wrong_tool_selection
|