Ticket map escalates on a documentation-only case: behavior-verifier fails, test-writer unexpected_pass #593

New issue

Open

opened 2026-09-15 13:55:41 +00:00 by jared · 0 comments

jared commented

2026-09-15 13:55:41 +00:00

Owner

Context

Implementation 17 on ticket #587 ran the poodr-ticket-implementation.yaml map.
Case 5 of the ticket's ## Cases section asked for a prose change to SKILL.md.
The programmer made that edit in round 1, together with the code change.

Observed

behavior-verifier (dispatch 230, 25 s, 2 tool uses) returned fail. It named outstanding tasks.
The map routed the run to test-writer (dispatch 232).
test-writer wrote tests/skills/implement_skill_default_map_test.rb. The test asserts on the raw SKILL.md text.
Its diff-test gate exited 0 at once.

verdict: escalate
reason: unexpected_pass:test-writer/diff-test

Rubocop then flagged that test three times with Sdlc/Structural/RawFileContentAssertion.
The orchestrator finished the case by hand. It deleted the prose test, committed, and closed the run.

Reproduce

n/a: pipeline-behavior defect, not a single reproducible command

Expected

A documentation-only case must not sit under ## Cases. Per ADR-0190, that section holds one observable given/when/then per line.
The TicketShape check must flag a documentation-only line under ## Cases.
As an alternative or additional fix, the behavior-verifier charter should gain a rule: an outstanding task whose only evidence is a text-file diff is verified by reading, not by routing to test-writer.
Triage picks between these two candidates.

Origin

Trigger: implementation-open run 17 on ticket #587, poodr-ticket-implementation.yaml map, dispatch 230/232
Improvised this session: orchestrator hand-deleted the prose test, committed, and closed the run
Chain: unexpected_pass:test-writer/diff-test ← test-writer wrote a raw-text-assertion test for a documentation case ← behavior-verifier failed a documentation-only task instead of verifying it by reading ← DESIGN (ADR-0190 does not exclude documentation-only lines from ## Cases)
Root candidate: this ticket, candidate (a): extend the capture template's agent-ready variant and the TicketShape check to exclude documentation/prose edits from ## Cases
Where: docs/memory-system ticket-map shape rules (ADR-0190), os-sdlc behavior-verifier charter
Session: b1c83b81-7be1-4f17-9e8e-cae36a934f25
Transcript: (session id above; no separate transcript path provided)
VERDICT: CREATE (ticket-skeptic: named defect class with a complete Origin chain ending in a real DESIGN gap; ADR-0190 does not exclude prose lines from ## Cases; root candidate itself, no in-session duplicate)

## Context Implementation 17 on ticket #587 ran the poodr-ticket-implementation.yaml map. Case 5 of the ticket's `## Cases` section asked for a prose change to SKILL.md. The programmer made that edit in round 1, together with the code change. ## Observed behavior-verifier (dispatch 230, 25 s, 2 tool uses) returned fail. It named outstanding tasks. The map routed the run to test-writer (dispatch 232). test-writer wrote `tests/skills/implement_skill_default_map_test.rb`. The test asserts on the raw SKILL.md text. Its diff-test gate exited 0 at once. ``` verdict: escalate reason: unexpected_pass:test-writer/diff-test ``` Rubocop then flagged that test three times with `Sdlc/Structural/RawFileContentAssertion`. The orchestrator finished the case by hand. It deleted the prose test, committed, and closed the run. ## Reproduce n/a: pipeline-behavior defect, not a single reproducible command ## Expected A documentation-only case must not sit under `## Cases`. Per ADR-0190, that section holds one observable given/when/then per line. The `TicketShape` check must flag a documentation-only line under `## Cases`. As an alternative or additional fix, the behavior-verifier charter should gain a rule: an outstanding task whose only evidence is a text-file diff is verified by reading, not by routing to test-writer. Triage picks between these two candidates. ## Origin - Trigger: implementation-open run 17 on ticket #587, poodr-ticket-implementation.yaml map, dispatch 230/232 - Improvised this session: orchestrator hand-deleted the prose test, committed, and closed the run - Chain: unexpected_pass:test-writer/diff-test ← test-writer wrote a raw-text-assertion test for a documentation case ← behavior-verifier failed a documentation-only task instead of verifying it by reading ← DESIGN (ADR-0190 does not exclude documentation-only lines from `## Cases`) - Root candidate: this ticket, candidate (a): extend the capture template's agent-ready variant and the TicketShape check to exclude documentation/prose edits from `## Cases` - Where: docs/memory-system ticket-map shape rules (ADR-0190), os-sdlc behavior-verifier charter - Session: b1c83b81-7be1-4f17-9e8e-cae36a934f25 - Transcript: (session id above; no separate transcript path provided) - VERDICT: CREATE (ticket-skeptic: named defect class with a complete Origin chain ending in a real DESIGN gap; ADR-0190 does not exclude prose lines from `## Cases`; root candidate itself, no in-session duplicate)

jared added the

plugin/os-sdlc

filed-by/agent

labels

2026-09-15 13:55:41 +00:00

jared referenced this issue

2026-09-15 13:56:42 +00:00

TemplateValidator requires Owner sketch and Cases on ready-for-agent tickets; capture template and ticket-decompose emit them (ADR-0190) #588

jared referenced this issue

2026-09-15 14:21:11 +00:00

TemplateValidator requires Owner sketch and Cases on ready-for-agent tickets; capture template and ticket-decompose emit them (ADR-0190) #588