jared/cc-os

Watch

Fork 0

Cover the uncovered system_model mutants #1694

New issue

Closed

opened 2026-11-11 16:24:20 +00:00 by jared · 2 comments

jared commented

2026-11-11 16:24:20 +00:00

Owner

Problem

The second mutation pass (2026-11-09) left 43 uncovered mutants in 11 files under lib/os_sdlc/system_model/. No test runs the code at these mutants. An uncovered mutant is code that the suite never executes, so a change there goes unseen. Ruling 100 puts a unit test for lib/os_sdlc/<path>.rb at test/os_sdlc/<path>_test.rb.

Observed

The second mutation pass ran bin/os-sdlc-mutation-pass run . on 2026-11-09. .mutineer/pass.json lists 43 mutants in this ticket under no_coverage. A no_coverage mutant is a changed behavior that no test runs. The survivor tickets #1656 to #1664 took only the survived mutants, so no ticket covers these. Each line below gives the file, its uncovered count, and the mutation kinds.

lib/os_sdlc/system_model/recorder/trace.rb (24): statement_removal 7, return_nil 5, condition_false 4, condition_true 4, boolean_connector 2, comparison 2
lib/os_sdlc/system_model/recorder/use_case.rb (8): statement_removal 4, return_nil 3, boolean_literal 1
lib/os_sdlc/system_model/class_facts.rb (2): comparison 1, return_nil 1
lib/os_sdlc/system_model/extractor/references.rb (2): boolean_literal 2
lib/os_sdlc/system_model/child_process.rb (1): return_nil 1
lib/os_sdlc/system_model/extractor/walk.rb (1): return_nil 1
lib/os_sdlc/system_model/pattern/rule/unmeasured.rb (1): return_nil 1
lib/os_sdlc/system_model/pattern_site/example_run.rb (1): return_nil 1
lib/os_sdlc/system_model/recorder/install.rb (1): return_nil 1
lib/os_sdlc/system_model/stereotype_rules/distribution.rb (1): return_nil 1
lib/os_sdlc/system_model/tracer.rb (1): return_nil 1

Reproduce

n/a: the uncovered mutants come from a whole pass. Verify with a targeted run: bin/os-sdlc-mutation-pass run <files> --no-matrix.

Approach

For each listed file, write the paired unit test at test/os_sdlc/<lib path>_test.rb (ruling 100). The test must run the uncovered code and kill its mutants. Check the older test locations first (test/cops/, test/daemon/, test/lint/, test/system_model_*). A test there may already cover the file and only need a move or an extension. Where the code calls a process, use an adapter and a recorded fixture (ruling 88). Reuse test/support/process_recording.rb and the recorded_* doubles. No test starts a real process.

When a mutant shows dead code (code no caller reaches), delete the code and write no test for it (ruling 107). When a mutant is equivalent (the mutant has the same behavior), rule it equivalent in a comment on this ticket with the reason. Follow plugins/os-sdlc/references/survivor-loop.md. Then verify with a targeted --no-matrix run over the files of this ticket. Do not run a whole pass.

Required work: none beyond the acceptance criteria.

Acceptance criteria

Given a targeted --no-matrix Mutineer run on the files listed in this ticket, when the run ends, then it reports no uncovered mutant and no survivor, except ones that this ticket deletes or rules equivalent with a reason.
Given a file with deleted unreachable code, when the suite runs, then it is green and no caller of the deleted code remains.

Origin

Trigger: #1683 split, 2026-11-11
Improvised this session: none
Chain: uncovered mutants ← survivor tickets #1656-#1664 took only survived mutants ← the second pass split only survivors into tickets ← DESIGN (docs/research/mutation-testing/2026-11-09-second-pass/)
Root candidate: none found; searched uncovered, no_coverage, mutant, system_model
Where: lib/os_sdlc/system_model/
Parent: #1683
Session: 974224e0-190b-4ca9-814e-eb971a24f35a
Transcript: /home/jared/.claude/projects/-home-jared-dev-cc-os-plugins-os-sdlc/974224e0-190b-4ca9-814e-eb971a24f35a.jsonl

VERDICT: CREATE (ticket-skeptic, 2026-11-11): child of the #1683 required split; no open ticket covers these files.

## Problem The second mutation pass (2026-11-09) left 43 uncovered mutants in 11 files under lib/os_sdlc/system_model/. No test runs the code at these mutants. An uncovered mutant is code that the suite never executes, so a change there goes unseen. Ruling 100 puts a unit test for `lib/os_sdlc/<path>.rb` at `test/os_sdlc/<path>_test.rb`. ## Observed The second mutation pass ran `bin/os-sdlc-mutation-pass run .` on 2026-11-09. `.mutineer/pass.json` lists 43 mutants in this ticket under `no_coverage`. A no_coverage mutant is a changed behavior that no test runs. The survivor tickets #1656 to #1664 took only the survived mutants, so no ticket covers these. Each line below gives the file, its uncovered count, and the mutation kinds. - `lib/os_sdlc/system_model/recorder/trace.rb` (24): statement_removal 7, return_nil 5, condition_false 4, condition_true 4, boolean_connector 2, comparison 2 - `lib/os_sdlc/system_model/recorder/use_case.rb` (8): statement_removal 4, return_nil 3, boolean_literal 1 - `lib/os_sdlc/system_model/class_facts.rb` (2): comparison 1, return_nil 1 - `lib/os_sdlc/system_model/extractor/references.rb` (2): boolean_literal 2 - `lib/os_sdlc/system_model/child_process.rb` (1): return_nil 1 - `lib/os_sdlc/system_model/extractor/walk.rb` (1): return_nil 1 - `lib/os_sdlc/system_model/pattern/rule/unmeasured.rb` (1): return_nil 1 - `lib/os_sdlc/system_model/pattern_site/example_run.rb` (1): return_nil 1 - `lib/os_sdlc/system_model/recorder/install.rb` (1): return_nil 1 - `lib/os_sdlc/system_model/stereotype_rules/distribution.rb` (1): return_nil 1 - `lib/os_sdlc/system_model/tracer.rb` (1): return_nil 1 ## Reproduce n/a: the uncovered mutants come from a whole pass. Verify with a targeted run: `bin/os-sdlc-mutation-pass run <files> --no-matrix`. ## Approach For each listed file, write the paired unit test at `test/os_sdlc/<lib path>_test.rb` (ruling 100). The test must run the uncovered code and kill its mutants. Check the older test locations first (`test/cops/`, `test/daemon/`, `test/lint/`, `test/system_model_*`). A test there may already cover the file and only need a move or an extension. Where the code calls a process, use an adapter and a recorded fixture (ruling 88). Reuse `test/support/process_recording.rb` and the `recorded_*` doubles. No test starts a real process. When a mutant shows dead code (code no caller reaches), delete the code and write no test for it (ruling 107). When a mutant is equivalent (the mutant has the same behavior), rule it equivalent in a comment on this ticket with the reason. Follow `plugins/os-sdlc/references/survivor-loop.md`. Then verify with a targeted `--no-matrix` run over the files of this ticket. Do not run a whole pass. Required work: none beyond the acceptance criteria. ## Acceptance criteria 1. Given a targeted `--no-matrix` Mutineer run on the files listed in this ticket, when the run ends, then it reports no uncovered mutant and no survivor, except ones that this ticket deletes or rules equivalent with a reason. 2. Given a file with deleted unreachable code, when the suite runs, then it is green and no caller of the deleted code remains. ## Origin - Trigger: #1683 split, 2026-11-11 - Improvised this session: none - Chain: uncovered mutants ← survivor tickets #1656-#1664 took only survived mutants ← the second pass split only `survivors` into tickets ← DESIGN (`docs/research/mutation-testing/2026-11-09-second-pass/`) - Root candidate: none found; searched uncovered, no_coverage, mutant, system_model - Where: lib/os_sdlc/system_model/ - Parent: #1683 - Session: 974224e0-190b-4ca9-814e-eb971a24f35a - Transcript: /home/jared/.claude/projects/-home-jared-dev-cc-os-plugins-os-sdlc/974224e0-190b-4ca9-814e-eb971a24f35a.jsonl VERDICT: CREATE (ticket-skeptic, 2026-11-11): child of the #1683 required split; no open ticket covers these files.

jared added the

plugin/os-sdlc

filed-by/agent

category/code-change

labels

2026-11-11 16:24:20 +00:00

jared referenced this issue

2026-11-11 16:24:32 +00:00

Cover the 388 mutants that no test runs #1683

jared commented

2026-11-11 16:56:24 +00:00

Author

Owner

Work started on branch ticket-1694 (survivor loop, plugins/os-sdlc/references/survivor-loop.md).

jared referenced this issue

2026-11-11 17:09:47 +00:00

Cover the 388 mutants that no test runs #1683

jared commented

2026-11-11 17:09:48 +00:00

Author

Owner

Resolution

Done: Survivor loop over the system_model files in 3 packet groups. 6 tests added; test/system_model_recorder_use_case_test.rb moved to its paired path test/os_sdlc/system_model/recorder/use_case_test.rb. Ruling 107 deleted ClassFacts#io_signature, Extractor::References#visit_class_node and #visit_module_node (Body sends both to Walk), StereotypeRules::Distribution#share, Pattern::Rule::Unmeasured#sites. 5 equivalent rulings (super calls required by Lint/MissingSuper, a declaration-only assignment, an ignored return value).

Evidence: main 5b6e0cb07, 813848b37, 1475fb701 (merged). Orchestrator re-ran the packets: groups C and D 0 survivors of 71 and 44; group A 0 survivors of 15 with 12 known uncovered mutants, ruled not equivalent (ruling 137) and recorded on #1683. Suite 4932 runs 0 failures; rubocop clean.

Follow-ups: The 12 known uncovered mutants are recorded on umbrella #1683 (the skeptic dropped a separate ticket, depth-1).

## Resolution **Done:** Survivor loop over the system_model files in 3 packet groups. 6 tests added; test/system_model_recorder_use_case_test.rb moved to its paired path test/os_sdlc/system_model/recorder/use_case_test.rb. Ruling 107 deleted ClassFacts#io_signature, Extractor::References#visit_class_node and #visit_module_node (Body sends both to Walk), StereotypeRules::Distribution#share, Pattern::Rule::Unmeasured#sites. 5 equivalent rulings (super calls required by Lint/MissingSuper, a declaration-only assignment, an ignored return value). **Evidence:** main 5b6e0cb07, 813848b37, 1475fb701 (merged). Orchestrator re-ran the packets: groups C and D 0 survivors of 71 and 44; group A 0 survivors of 15 with 12 known uncovered mutants, ruled not equivalent (ruling 137) and recorded on #1683. Suite 4932 runs 0 failures; rubocop clean. **Follow-ups:** The 12 known uncovered mutants are recorded on umbrella #1683 (the skeptic dropped a separate ticket, depth-1).

jared closed this issue

2026-11-11 17:09:48 +00:00

jared referenced this issue from a commit

2026-11-11 17:09:49 +00:00

test(os-sdlc): paired tests cover the uncovered system_model mutants (#1694)

jared referenced this issue from a commit

2026-11-11 17:09:49 +00:00

chore(os-sdlc): unrule 12 #1694 mutants that are not equivalent

jared referenced this issue from a commit

2026-11-11 17:09:49 +00:00

docs(status): os-sdlc history row for #1694

jared referenced this issue