141 lines
7.7 KiB
HTML
141 lines
7.7 KiB
HTML
|
|
<!DOCTYPE html>
|
||
|
|
<html lang="en">
|
||
|
|
<head>
|
||
|
|
<meta charset="UTF-8">
|
||
|
|
<title>Dataset Anatomy</title>
|
||
|
|
<style>
|
||
|
|
* { box-sizing: border-box; margin: 0; padding: 0; }
|
||
|
|
body { background: #0f1117; font-family: 'Segoe UI', system-ui, sans-serif; display: flex; align-items: center; justify-content: center; min-height: 100vh; }
|
||
|
|
.slide { width: 960px; padding: 56px 72px; }
|
||
|
|
h2 { color: #e2e8f0; font-size: 1.5rem; font-weight: 400; letter-spacing: 0.05em; text-transform: uppercase; margin-bottom: 48px; text-align: center; }
|
||
|
|
|
||
|
|
.top-stats { display: flex; gap: 20px; margin-bottom: 36px; }
|
||
|
|
.stat-card { flex: 1; background: #161b27; border-radius: 10px; padding: 22px 20px; text-align: center; border: 1.5px solid #2d3748; }
|
||
|
|
.stat-num { font-size: 2.2rem; font-weight: 700; margin-bottom: 4px; }
|
||
|
|
.stat-label { font-size: 0.72rem; letter-spacing: 0.1em; text-transform: uppercase; color: #6b7280; }
|
||
|
|
.c1 .stat-num { color: #60a5fa; }
|
||
|
|
.c2 .stat-num { color: #4ade80; }
|
||
|
|
.c3 .stat-num { color: #f87171; }
|
||
|
|
.c4 .stat-num { color: #fbbf24; }
|
||
|
|
|
||
|
|
.mid { display: flex; gap: 24px; margin-bottom: 28px; }
|
||
|
|
|
||
|
|
.class-balance { flex: 1; background: #161b27; border-radius: 10px; padding: 22px 22px; border: 1.5px solid #2d3748; }
|
||
|
|
.section-title { font-size: 0.65rem; letter-spacing: 0.12em; text-transform: uppercase; color: #6b7280; margin-bottom: 16px; }
|
||
|
|
|
||
|
|
.bar-row { display: flex; align-items: center; gap: 12px; margin-bottom: 14px; }
|
||
|
|
.bar-name { font-size: 0.82rem; color: #94a3b8; width: 200px; flex-shrink: 0; }
|
||
|
|
.bar-track { flex: 1; height: 22px; background: #1e2433; border-radius: 4px; overflow: hidden; position: relative; }
|
||
|
|
.bar-fill { height: 100%; border-radius: 4px; display: flex; align-items: center; padding-left: 10px; font-size: 0.72rem; font-weight: 600; white-space: nowrap; }
|
||
|
|
.bar-fill.pos-resolve { background: linear-gradient(90deg, #1d4ed8 0%, #3b82f6 100%); color: #bfdbfe; width: 76.9%; }
|
||
|
|
.bar-fill.neg-resolve { background: #1e2433; color: #4a5568; width: 23.1%; }
|
||
|
|
.bar-fill.pos-architect { background: linear-gradient(90deg, #5b21b6 0%, #8b5cf6 100%); color: #ddd6fe; width: 19.8%; }
|
||
|
|
.bar-fill.neg-architect { background: #1e2433; color: #4a5568; width: 80.2%; }
|
||
|
|
.bar-pct { font-size: 0.75rem; color: #6b7280; width: 40px; text-align: right; flex-shrink: 0; }
|
||
|
|
|
||
|
|
.corpus-issue { flex: 0 0 300px; background: #1a1500; border: 1.5px solid #f59e0b; border-radius: 10px; padding: 22px; }
|
||
|
|
.corpus-issue .section-title { color: #92400e; }
|
||
|
|
.issue-item { display: flex; gap: 10px; margin-bottom: 12px; align-items: flex-start; }
|
||
|
|
.issue-bullet { color: #f59e0b; flex-shrink: 0; font-size: 0.85rem; margin-top: 2px; }
|
||
|
|
.issue-text { font-size: 0.82rem; color: #d97706; line-height: 1.5; }
|
||
|
|
.issue-text strong { color: #fbbf24; }
|
||
|
|
|
||
|
|
.tsv-preview { background: #161b27; border-radius: 10px; padding: 22px 24px; border: 1.5px solid #2d3748; }
|
||
|
|
.tsv-header { display: flex; gap: 0; margin-bottom: 14px; }
|
||
|
|
.col-head { font-size: 0.65rem; letter-spacing: 0.1em; text-transform: uppercase; color: #6b7280; padding: 0 12px; border-right: 1px solid #2d3748; }
|
||
|
|
.col-head:first-child { padding-left: 0; width: 70px; }
|
||
|
|
.col-head:nth-child(2) { width: 60px; }
|
||
|
|
.col-head:last-child { flex: 1; border-right: none; }
|
||
|
|
.tsv-row { display: flex; gap: 0; padding: 7px 0; border-bottom: 1px solid #1a1f2e; font-family: 'Courier New', monospace; }
|
||
|
|
.tsv-row:last-child { border-bottom: none; }
|
||
|
|
.col-val { font-size: 0.78rem; padding: 0 12px; border-right: 1px solid #1e2433; white-space: nowrap; overflow: hidden; text-overflow: ellipsis; }
|
||
|
|
.col-val:first-child { padding-left: 0; width: 70px; font-weight: 700; }
|
||
|
|
.col-val:nth-child(2) { width: 60px; color: #4a5568; }
|
||
|
|
.col-val:last-child { flex: 1; border-right: none; color: #94a3b8; }
|
||
|
|
.v1 { color: #4ade80; }
|
||
|
|
.v0 { color: #6b7280; }
|
||
|
|
</style>
|
||
|
|
</head>
|
||
|
|
<body>
|
||
|
|
<div class="slide">
|
||
|
|
<h2>Dataset Anatomy — prereq_op_selector</h2>
|
||
|
|
|
||
|
|
<div class="top-stats">
|
||
|
|
<div class="stat-card c1"><div class="stat-num">1000</div><div class="stat-label">runs extracted</div></div>
|
||
|
|
<div class="stat-card c2"><div class="stat-num">1297</div><div class="stat-label">accepted rows</div></div>
|
||
|
|
<div class="stat-card c3"><div class="stat-num">24</div><div class="stat-label">schema-drift rejected</div></div>
|
||
|
|
<div class="stat-card c4"><div class="stat-num">~17</div><div class="stat-label">unique text templates</div></div>
|
||
|
|
</div>
|
||
|
|
|
||
|
|
<div class="mid">
|
||
|
|
<div class="class-balance">
|
||
|
|
<div class="section-title">Class balance</div>
|
||
|
|
<div class="bar-row">
|
||
|
|
<div class="bar-name">needs_resolve_dependencies = yes</div>
|
||
|
|
<div class="bar-track"><div class="bar-fill pos-resolve">997 rows</div></div>
|
||
|
|
<div class="bar-pct">76.9%</div>
|
||
|
|
</div>
|
||
|
|
<div class="bar-row">
|
||
|
|
<div class="bar-name">needs_resolve_dependencies = no</div>
|
||
|
|
<div class="bar-track"><div class="bar-fill neg-resolve">300 rows</div></div>
|
||
|
|
<div class="bar-pct">23.1%</div>
|
||
|
|
</div>
|
||
|
|
<div style="height:10px"></div>
|
||
|
|
<div class="bar-row">
|
||
|
|
<div class="bar-name">needs_architect_review = yes</div>
|
||
|
|
<div class="bar-track"><div class="bar-fill pos-architect">257 rows</div></div>
|
||
|
|
<div class="bar-pct">19.8%</div>
|
||
|
|
</div>
|
||
|
|
<div class="bar-row">
|
||
|
|
<div class="bar-name">needs_architect_review = no</div>
|
||
|
|
<div class="bar-track"><div class="bar-fill neg-architect">1040 rows</div></div>
|
||
|
|
<div class="bar-pct">80.2%</div>
|
||
|
|
</div>
|
||
|
|
</div>
|
||
|
|
|
||
|
|
<div class="corpus-issue">
|
||
|
|
<div class="section-title">⚠ Corpus limitation</div>
|
||
|
|
<div class="issue-item">
|
||
|
|
<div class="issue-bullet">▸</div>
|
||
|
|
<div class="issue-text">Only <strong>~17 unique text templates</strong> across 1297 rows. High row count masks low actual diversity.</div>
|
||
|
|
</div>
|
||
|
|
<div class="issue-item">
|
||
|
|
<div class="issue-bullet">▸</div>
|
||
|
|
<div class="issue-text">The taskitem schema records <strong>outputs</strong>, not discriminative inputs. RSA-relevant fields were never stored.</div>
|
||
|
|
</div>
|
||
|
|
<div class="issue-item">
|
||
|
|
<div class="issue-bullet">▸</div>
|
||
|
|
<div class="issue-text">Baselines are <strong>intentionally weak</strong>. Pipeline is correct; signal improves with schema changes upstream.</div>
|
||
|
|
</div>
|
||
|
|
</div>
|
||
|
|
</div>
|
||
|
|
|
||
|
|
<div class="tsv-preview">
|
||
|
|
<div class="section-title">Fabricate TSV format — prereq_resolve_train.tsv (sample rows)</div>
|
||
|
|
<div class="tsv-header">
|
||
|
|
<div class="col-head">label</div>
|
||
|
|
<div class="col-head">hop</div>
|
||
|
|
<div class="col-head">text (title · reasons · accepts · constraints)</div>
|
||
|
|
</div>
|
||
|
|
<div class="tsv-row">
|
||
|
|
<div class="col-val v1">1</div><div class="col-val">0</div>
|
||
|
|
<div class="col-val">title: Execution Readiness Primary | reasons: high_confidence_clear_path | accepts: at least one tool selection event; no malformed mcp payloads</div>
|
||
|
|
</div>
|
||
|
|
<div class="tsv-row">
|
||
|
|
<div class="col-val v0">0</div><div class="col-val">0</div>
|
||
|
|
<div class="col-val">title: Intake Foundation Primary | reasons: high_confidence_clear_path | accepts: deterministic taskitems with strict execution contracts | constraints: primary language go</div>
|
||
|
|
</div>
|
||
|
|
<div class="tsv-row">
|
||
|
|
<div class="col-val v1">1</div><div class="col-val">0</div>
|
||
|
|
<div class="col-val">title: Intake Foundation Primary | reasons: high_confidence_clear_path | accepts: scenario 1 given when then; scenario 2 given when then | constraints: language runtime constraints</div>
|
||
|
|
</div>
|
||
|
|
<div class="tsv-row">
|
||
|
|
<div class="col-val v0">0</div><div class="col-val">0</div>
|
||
|
|
<div class="col-val">title: Execution Readiness Primary | reasons: high_confidence_clear_path | accepts: at least one tool execution event; no unbounded loops</div>
|
||
|
|
</div>
|
||
|
|
</div>
|
||
|
|
|
||
|
|
</div>
|
||
|
|
</body>
|
||
|
|
</html>
|