Write the missing tests for 55 os-sdlc survivors in evidence #1661

New issue

Closed

opened 2026-11-09 22:13:17 +00:00 by jared · 1 comment

jared commented

2026-11-09 22:13:17 +00:00

Owner

Problem

The second mutation pass (2026-11-09) left 55 survivors in 12 files under lib/os_sdlc/evidence/. No test kills them. A survivor means a changed behavior that the suite does not see. Ruling 100 puts a unit test for lib/os_sdlc/<path>.rb at test/os_sdlc/<path>_test.rb.

Observed

The pass ran bin/os-sdlc-mutation-pass run . on main at 38b3284d0. docs/research/mutation-testing/2026-11-09-second-pass/survivors.md lists each survivor with its original and mutated text. This ticket takes the groups that survivors.md classes as missing test. Each line below gives the file, its survivor count, and the mutation kinds.

lib/os_sdlc/evidence/direct_unit_entries.rb (13): return_nil 3, boolean_connector 2, condition_false 2, condition_true 2, statement_removal 2, boolean_literal 1, comparison 1
lib/os_sdlc/evidence/fingerprint/sender_entries.rb (10): condition_false 3, statement_removal 3, condition_true 2, return_nil 2
lib/os_sdlc/evidence/probe/lsp/lookup.rb (8): comparison 2, return_nil 2, boolean_connector 1, boolean_literal 1, condition_false 1, statement_removal 1
lib/os_sdlc/evidence/resolution/token_resolution.rb (5): condition_true 2, statement_removal 2, condition_false 1
lib/os_sdlc/evidence/fingerprint/probe_output.rb (4): boolean_connector 1, boolean_literal 1, condition_true 1, statement_removal 1
lib/os_sdlc/evidence/lazy_lsp_session.rb (4): return_nil 2, statement_removal 2
lib/os_sdlc/evidence/probe/entries.rb (4): boolean_connector 1, boolean_literal 1, condition_true 1, statement_removal 1
lib/os_sdlc/evidence/fingerprint/sender_row.rb (3): boolean_literal 2, condition_true 1
lib/os_sdlc/evidence/fingerprint.rb (1): comparison 1
lib/os_sdlc/evidence/fingerprint/site_list.rb (1): comparison 1
lib/os_sdlc/evidence/resolution/method_query.rb (1): statement_removal 1
lib/os_sdlc/evidence/resolution/token_query.rb (1): condition_true 1

Reproduce

n/a: the survivors come from a whole pass. Verify with a targeted run: bin/os-sdlc-mutation-pass run <files> --no-matrix.

Approach

For each file listed, write the missing paired test at test/os_sdlc/<lib path>_test.rb (ruling 100). The test must kill each survivor of that file. When a survivor shows dead code (a branch no caller reaches), delete the code if no caller needs it, and write no test for it. When a survivor is equivalent (the mutant has the same behavior), rule it equivalent in a comment on this ticket with the reason. Then verify with a targeted --no-matrix run over the files of this ticket. Do not run a whole pass.

Required work: none beyond the acceptance criteria.

Acceptance criteria

Given a targeted --no-matrix Mutineer run on the files listed in this ticket, when the run ends, then no survivor remains except ones that this ticket rules equivalent with a reason.
Given a file that has a deleted dead-code candidate, when the suite runs, then it is green and no caller of the deleted code remains.

Origin

Trigger: second whole-codebase mutation pass, 2026-11-09 (docs/research/mutation-testing/2026-11-09-second-pass/)
Improvised this session: none
Chain: survivors ← no paired unit test for the file ← tests were written at the pipeline level, and the unit test per file (ruling 100) was never added ← DESIGN (ruling 100)
Root candidate: none found; searched survivor, mutation, mutant, missing test, evidence
Where: lib/os_sdlc/evidence/
Session: bc5ad309-36b7-4fe5-a67f-1d90187242eb
Transcript: /home/jared/.claude/projects/-home-jared-dev-cc-os-plugins-os-sdlc/bc5ad309-36b7-4fe5-a67f-1d90187242eb.jsonl

VERDICT: CREATE (ticket-skeptic, 2026-11-09): no open ticket covers these survivors.

## Problem The second mutation pass (2026-11-09) left 55 survivors in 12 files under lib/os_sdlc/evidence/. No test kills them. A survivor means a changed behavior that the suite does not see. Ruling 100 puts a unit test for `lib/os_sdlc/<path>.rb` at `test/os_sdlc/<path>_test.rb`. ## Observed The pass ran `bin/os-sdlc-mutation-pass run .` on main at 38b3284d0. `docs/research/mutation-testing/2026-11-09-second-pass/survivors.md` lists each survivor with its original and mutated text. This ticket takes the groups that `survivors.md` classes as `missing test`. Each line below gives the file, its survivor count, and the mutation kinds. - `lib/os_sdlc/evidence/direct_unit_entries.rb` (13): return_nil 3, boolean_connector 2, condition_false 2, condition_true 2, statement_removal 2, boolean_literal 1, comparison 1 - `lib/os_sdlc/evidence/fingerprint/sender_entries.rb` (10): condition_false 3, statement_removal 3, condition_true 2, return_nil 2 - `lib/os_sdlc/evidence/probe/lsp/lookup.rb` (8): comparison 2, return_nil 2, boolean_connector 1, boolean_literal 1, condition_false 1, statement_removal 1 - `lib/os_sdlc/evidence/resolution/token_resolution.rb` (5): condition_true 2, statement_removal 2, condition_false 1 - `lib/os_sdlc/evidence/fingerprint/probe_output.rb` (4): boolean_connector 1, boolean_literal 1, condition_true 1, statement_removal 1 - `lib/os_sdlc/evidence/lazy_lsp_session.rb` (4): return_nil 2, statement_removal 2 - `lib/os_sdlc/evidence/probe/entries.rb` (4): boolean_connector 1, boolean_literal 1, condition_true 1, statement_removal 1 - `lib/os_sdlc/evidence/fingerprint/sender_row.rb` (3): boolean_literal 2, condition_true 1 - `lib/os_sdlc/evidence/fingerprint.rb` (1): comparison 1 - `lib/os_sdlc/evidence/fingerprint/site_list.rb` (1): comparison 1 - `lib/os_sdlc/evidence/resolution/method_query.rb` (1): statement_removal 1 - `lib/os_sdlc/evidence/resolution/token_query.rb` (1): condition_true 1 ## Reproduce n/a: the survivors come from a whole pass. Verify with a targeted run: `bin/os-sdlc-mutation-pass run <files> --no-matrix`. ## Approach For each file listed, write the missing paired test at `test/os_sdlc/<lib path>_test.rb` (ruling 100). The test must kill each survivor of that file. When a survivor shows dead code (a branch no caller reaches), delete the code if no caller needs it, and write no test for it. When a survivor is equivalent (the mutant has the same behavior), rule it equivalent in a comment on this ticket with the reason. Then verify with a targeted `--no-matrix` run over the files of this ticket. Do not run a whole pass. Required work: none beyond the acceptance criteria. ## Acceptance criteria 1. Given a targeted `--no-matrix` Mutineer run on the files listed in this ticket, when the run ends, then no survivor remains except ones that this ticket rules equivalent with a reason. 2. Given a file that has a deleted dead-code candidate, when the suite runs, then it is green and no caller of the deleted code remains. ## Origin - Trigger: second whole-codebase mutation pass, 2026-11-09 (`docs/research/mutation-testing/2026-11-09-second-pass/`) - Improvised this session: none - Chain: survivors ← no paired unit test for the file ← tests were written at the pipeline level, and the unit test per file (ruling 100) was never added ← DESIGN (ruling 100) - Root candidate: none found; searched survivor, mutation, mutant, missing test, evidence - Where: lib/os_sdlc/evidence/ - Session: bc5ad309-36b7-4fe5-a67f-1d90187242eb - Transcript: /home/jared/.claude/projects/-home-jared-dev-cc-os-plugins-os-sdlc/bc5ad309-36b7-4fe5-a67f-1d90187242eb.jsonl VERDICT: CREATE (ticket-skeptic, 2026-11-09): no open ticket covers these survivors.

jared added the

plugin/os-sdlc

filed-by/user

category/code-change

labels

2026-11-09 22:13:17 +00:00

jared commented

2026-11-10 22:10:33 +00:00

Author

Owner

Resolution

Done: Paired unit tests kill every evidence survivor. Ruling 107 deletions: @session = nil in LazyLspSession#initialize; the unreachable if @site branch of Probe::Lsp::Lookup#empty_command (with a site, the definition is always a Location, so empty_result never runs). Ruled equivalent with reason: Fingerprint#visibility_for > vs >= (the marker line holds only 'private', so no method line equals it)

Evidence: One packet run over all 12 sources: 213 mutants, 0 unruled survivors, score 99.5; suite 4166 runs, 0 failures; sonnet review fix applied (shared StubbedCodeSearch double)

Follow-ups: #1683 covers the 1 uncovered mutant in evidence/fingerprint.rb

## Resolution **Done:** Paired unit tests kill every evidence survivor. Ruling 107 deletions: @session = nil in LazyLspSession#initialize; the unreachable if @site branch of Probe::Lsp::Lookup#empty_command (with a site, the definition is always a Location, so empty_result never runs). Ruled equivalent with reason: Fingerprint#visibility_for > vs >= (the marker line holds only 'private', so no method line equals it) **Evidence:** One packet run over all 12 sources: 213 mutants, 0 unruled survivors, score 99.5; suite 4166 runs, 0 failures; sonnet review fix applied (shared StubbedCodeSearch double) **Follow-ups:** #1683 covers the 1 uncovered mutant in evidence/fingerprint.rb

jared closed this issue

2026-11-10 22:10:33 +00:00

jared referenced this issue from a commit

2026-11-11 00:18:29 +00:00

test(os-sdlc): paired unit tests kill the evidence survivors; two no-op lines deleted (ruling 107); one survivor ruled equivalent (#1661)

jared referenced this issue from a commit

2026-11-11 00:18:29 +00:00

docs(status): os-sdlc history row for #1661