jared/cc-os
Watch
1
0
Fork
You've already forked cc-os
 0
Code Issues 378 Pull requests Projects Releases Packages Wiki Activity

Write the missing tests for 151 os-sdlc survivors in crc #1660

New issue
Closed
opened 2026-11-09 22:13:15 +00:00 by jared · 1 comment
jared commented 2026-11-09 22:13:15 +00:00
Owner
Copy link

Problem

The second mutation pass (2026-11-09) left 151 survivors in 60 files under lib/os_sdlc/crc/. No test kills them. A survivor means a changed behavior that the suite does not see. Ruling 100 puts a unit test for lib/os_sdlc/<path>.rb at test/os_sdlc/<path>_test.rb.

Observed

The pass ran bin/os-sdlc-mutation-pass run . on main at 38b3284d0. docs/research/mutation-testing/2026-11-09-second-pass/survivors.md lists each survivor with its original and mutated text. This ticket takes the groups that survivors.md classes as missing test. Each line below gives the file, its survivor count, and the mutation kinds.

  • lib/os_sdlc/crc/verdict_rules.rb (11): arithmetic 2, condition_false 2, condition_true 2, return_nil 2, boolean_literal 1, comparison 1, statement_removal 1
  • lib/os_sdlc/crc/records/row_check.rb (10): condition_false 3, boolean_connector 2, return_nil 2, statement_removal 2, comparison 1
  • lib/os_sdlc/crc/shares/table.rb (6): condition_true 4, return_nil 1, statement_removal 1
  • lib/os_sdlc/crc/census/visibility_call.rb (5): condition_false 2, condition_true 2, statement_removal 1
  • lib/os_sdlc/crc/filing/read_back_check.rb (5): condition_true 2, condition_false 1, return_nil 1, statement_removal 1
  • lib/os_sdlc/crc/ledger/commits/changes.rb (5): boolean_connector 4, comparison 1
  • lib/os_sdlc/crc/shares/rulings.rb (5): condition_true 2, arithmetic 1, return_nil 1, statement_removal 1
  • lib/os_sdlc/crc/tickets.rb (5): condition_true 2, condition_false 1, return_nil 1, statement_removal 1
  • lib/os_sdlc/crc/tickets/readiness_check.rb (5): arithmetic 2, condition_true 2, condition_false 1
  • lib/os_sdlc/crc/census/scoped_report.rb (4): return_nil 3, statement_removal 1
  • lib/os_sdlc/crc/score/detectors.rb (4): condition_true 2, return_nil 1, statement_removal 1
  • lib/os_sdlc/crc/shares/packing.rb (4): condition_false 2, arithmetic 1, boolean_connector 1
  • lib/os_sdlc/crc/shares/row_merge.rb (4): arithmetic 1, condition_true 1, return_nil 1, statement_removal 1
  • lib/os_sdlc/crc/census/requiring_file.rb (3): condition_false 1, condition_true 1, return_nil 1
  • lib/os_sdlc/crc/ledger.rb (3): arithmetic 1, condition_true 1, statement_removal 1
  • lib/os_sdlc/crc/ledger/check/applied_row.rb (3): comparison 1, condition_false 1, return_nil 1
  • lib/os_sdlc/crc/open_rows.rb (3): boolean_connector 1, condition_false 1, statement_removal 1
  • lib/os_sdlc/crc/progress_table.rb (3): return_nil 2, condition_true 1
  • lib/os_sdlc/crc/records/adr_affected_paths.rb (3): boolean_connector 2, boolean_literal 1
  • lib/os_sdlc/crc/records/path_lookup.rb (3): condition_false 1, condition_true 1, statement_removal 1
  • lib/os_sdlc/crc/statements/value_block.rb (3): boolean_literal 2, boolean_connector 1
  • lib/os_sdlc/crc/census.rb (2): condition_false 1, condition_true 1
  • lib/os_sdlc/crc/census/batch.rb (2): comparison 1, return_nil 1
  • lib/os_sdlc/crc/census/files.rb (2): condition_false 1, return_nil 1
  • lib/os_sdlc/crc/census/halted_report.rb (2): boolean_literal 1, return_nil 1
  • lib/os_sdlc/crc/census/partition.rb (2): comparison 2
  • lib/os_sdlc/crc/census/run.rb (2): condition_true 1, statement_removal 1
  • lib/os_sdlc/crc/filing/backlog_client.rb (2): condition_true 1, statement_removal 1
  • lib/os_sdlc/crc/ledger/check.rb (2): boolean_connector 1, return_nil 1
  • lib/os_sdlc/crc/ledger/commits/row_rule.rb (2): boolean_connector 2
  • lib/os_sdlc/crc/live_lines.rb (2): boolean_literal 1, condition_true 1
  • lib/os_sdlc/crc/placement/rulings.rb (2): condition_true 1, statement_removal 1
  • lib/os_sdlc/crc/shares/patch.rb (2): arithmetic 1, return_nil 1
  • lib/os_sdlc/crc/sweep/file_scan.rb (2): condition_false 1, condition_true 1
  • lib/os_sdlc/crc/sweep/substitution.rb (2): condition_true 1, return_nil 1
  • lib/os_sdlc/crc/tickets/candidate.rb (2): condition_false 1, return_nil 1
  • lib/os_sdlc/crc/census/artifacts.rb (1): return_nil 1
  • lib/os_sdlc/crc/census/batches.rb (1): statement_removal 1
  • lib/os_sdlc/crc/census/row_view.rb (1): condition_false 1
  • lib/os_sdlc/crc/census/run_scope.rb (1): return_nil 1
  • lib/os_sdlc/crc/census/settings.rb (1): condition_false 1
  • lib/os_sdlc/crc/census/source_row.rb (1): condition_false 1
  • lib/os_sdlc/crc/census/totals.rb (1): comparison 1
  • lib/os_sdlc/crc/census/vocabulary.rb (1): return_nil 1
  • lib/os_sdlc/crc/census/word.rb (1): comparison 1
  • lib/os_sdlc/crc/filing.rb (1): condition_false 1
  • lib/os_sdlc/crc/filing/run.rb (1): return_nil 1
  • lib/os_sdlc/crc/ledger/commits/commit.rb (1): condition_true 1
  • lib/os_sdlc/crc/placement/source_directory.rb (1): condition_false 1
  • lib/os_sdlc/crc/records/test_path_check.rb (1): condition_true 1
  • lib/os_sdlc/crc/shares/line.rb (1): arithmetic 1
  • lib/os_sdlc/crc/shares/row_line_check.rb (1): arithmetic 1
  • lib/os_sdlc/crc/shares/tsv_parser.rb (1): arithmetic 1
  • lib/os_sdlc/crc/shares/verdict_split.rb (1): condition_true 1
  • lib/os_sdlc/crc/sweep/line_scan.rb (1): condition_true 1
  • lib/os_sdlc/crc/sweep/listing_failed.rb (1): return_nil 1
  • lib/os_sdlc/crc/sweep/row_substitutions.rb (1): condition_false 1
  • lib/os_sdlc/crc/sweep/substitutions.rb (1): condition_false 1
  • lib/os_sdlc/crc/tickets/structure_rulings.rb (1): boolean_literal 1
  • lib/os_sdlc/crc/wave_progress.rb (1): statement_removal 1

Reproduce

n/a: the survivors come from a whole pass. Verify with a targeted run: bin/os-sdlc-mutation-pass run <files> --no-matrix.

Approach

For each file listed, write the missing paired test at test/os_sdlc/<lib path>_test.rb (ruling 100). The test must kill each survivor of that file. When a survivor shows dead code (a branch no caller reaches), delete the code if no caller needs it, and write no test for it. When a survivor is equivalent (the mutant has the same behavior), rule it equivalent in a comment on this ticket with the reason. Then verify with a targeted --no-matrix run over the files of this ticket. Do not run a whole pass.

Required work: none beyond the acceptance criteria.

Acceptance criteria

  1. Given a targeted --no-matrix Mutineer run on the files listed in this ticket, when the run ends, then no survivor remains except ones that this ticket rules equivalent with a reason.
  2. Given a file that has a deleted dead-code candidate, when the suite runs, then it is green and no caller of the deleted code remains.

Origin

  • Trigger: second whole-codebase mutation pass, 2026-11-09 (docs/research/mutation-testing/2026-11-09-second-pass/)
  • Improvised this session: none
  • Chain: survivors ← no paired unit test for the file ← tests were written at the pipeline level, and the unit test per file (ruling 100) was never added ← DESIGN (ruling 100)
  • Root candidate: none found; searched survivor, mutation, mutant, missing test, crc
  • Where: lib/os_sdlc/crc/
  • Session: bc5ad309-36b7-4fe5-a67f-1d90187242eb
  • Transcript: /home/jared/.claude/projects/-home-jared-dev-cc-os-plugins-os-sdlc/bc5ad309-36b7-4fe5-a67f-1d90187242eb.jsonl

VERDICT: CREATE (ticket-skeptic, 2026-11-09): no open ticket covers these survivors.

## Problem The second mutation pass (2026-11-09) left 151 survivors in 60 files under lib/os_sdlc/crc/. No test kills them. A survivor means a changed behavior that the suite does not see. Ruling 100 puts a unit test for `lib/os_sdlc/<path>.rb` at `test/os_sdlc/<path>_test.rb`. ## Observed The pass ran `bin/os-sdlc-mutation-pass run .` on main at 38b3284d0. `docs/research/mutation-testing/2026-11-09-second-pass/survivors.md` lists each survivor with its original and mutated text. This ticket takes the groups that `survivors.md` classes as `missing test`. Each line below gives the file, its survivor count, and the mutation kinds. - `lib/os_sdlc/crc/verdict_rules.rb` (11): arithmetic 2, condition_false 2, condition_true 2, return_nil 2, boolean_literal 1, comparison 1, statement_removal 1 - `lib/os_sdlc/crc/records/row_check.rb` (10): condition_false 3, boolean_connector 2, return_nil 2, statement_removal 2, comparison 1 - `lib/os_sdlc/crc/shares/table.rb` (6): condition_true 4, return_nil 1, statement_removal 1 - `lib/os_sdlc/crc/census/visibility_call.rb` (5): condition_false 2, condition_true 2, statement_removal 1 - `lib/os_sdlc/crc/filing/read_back_check.rb` (5): condition_true 2, condition_false 1, return_nil 1, statement_removal 1 - `lib/os_sdlc/crc/ledger/commits/changes.rb` (5): boolean_connector 4, comparison 1 - `lib/os_sdlc/crc/shares/rulings.rb` (5): condition_true 2, arithmetic 1, return_nil 1, statement_removal 1 - `lib/os_sdlc/crc/tickets.rb` (5): condition_true 2, condition_false 1, return_nil 1, statement_removal 1 - `lib/os_sdlc/crc/tickets/readiness_check.rb` (5): arithmetic 2, condition_true 2, condition_false 1 - `lib/os_sdlc/crc/census/scoped_report.rb` (4): return_nil 3, statement_removal 1 - `lib/os_sdlc/crc/score/detectors.rb` (4): condition_true 2, return_nil 1, statement_removal 1 - `lib/os_sdlc/crc/shares/packing.rb` (4): condition_false 2, arithmetic 1, boolean_connector 1 - `lib/os_sdlc/crc/shares/row_merge.rb` (4): arithmetic 1, condition_true 1, return_nil 1, statement_removal 1 - `lib/os_sdlc/crc/census/requiring_file.rb` (3): condition_false 1, condition_true 1, return_nil 1 - `lib/os_sdlc/crc/ledger.rb` (3): arithmetic 1, condition_true 1, statement_removal 1 - `lib/os_sdlc/crc/ledger/check/applied_row.rb` (3): comparison 1, condition_false 1, return_nil 1 - `lib/os_sdlc/crc/open_rows.rb` (3): boolean_connector 1, condition_false 1, statement_removal 1 - `lib/os_sdlc/crc/progress_table.rb` (3): return_nil 2, condition_true 1 - `lib/os_sdlc/crc/records/adr_affected_paths.rb` (3): boolean_connector 2, boolean_literal 1 - `lib/os_sdlc/crc/records/path_lookup.rb` (3): condition_false 1, condition_true 1, statement_removal 1 - `lib/os_sdlc/crc/statements/value_block.rb` (3): boolean_literal 2, boolean_connector 1 - `lib/os_sdlc/crc/census.rb` (2): condition_false 1, condition_true 1 - `lib/os_sdlc/crc/census/batch.rb` (2): comparison 1, return_nil 1 - `lib/os_sdlc/crc/census/files.rb` (2): condition_false 1, return_nil 1 - `lib/os_sdlc/crc/census/halted_report.rb` (2): boolean_literal 1, return_nil 1 - `lib/os_sdlc/crc/census/partition.rb` (2): comparison 2 - `lib/os_sdlc/crc/census/run.rb` (2): condition_true 1, statement_removal 1 - `lib/os_sdlc/crc/filing/backlog_client.rb` (2): condition_true 1, statement_removal 1 - `lib/os_sdlc/crc/ledger/check.rb` (2): boolean_connector 1, return_nil 1 - `lib/os_sdlc/crc/ledger/commits/row_rule.rb` (2): boolean_connector 2 - `lib/os_sdlc/crc/live_lines.rb` (2): boolean_literal 1, condition_true 1 - `lib/os_sdlc/crc/placement/rulings.rb` (2): condition_true 1, statement_removal 1 - `lib/os_sdlc/crc/shares/patch.rb` (2): arithmetic 1, return_nil 1 - `lib/os_sdlc/crc/sweep/file_scan.rb` (2): condition_false 1, condition_true 1 - `lib/os_sdlc/crc/sweep/substitution.rb` (2): condition_true 1, return_nil 1 - `lib/os_sdlc/crc/tickets/candidate.rb` (2): condition_false 1, return_nil 1 - `lib/os_sdlc/crc/census/artifacts.rb` (1): return_nil 1 - `lib/os_sdlc/crc/census/batches.rb` (1): statement_removal 1 - `lib/os_sdlc/crc/census/row_view.rb` (1): condition_false 1 - `lib/os_sdlc/crc/census/run_scope.rb` (1): return_nil 1 - `lib/os_sdlc/crc/census/settings.rb` (1): condition_false 1 - `lib/os_sdlc/crc/census/source_row.rb` (1): condition_false 1 - `lib/os_sdlc/crc/census/totals.rb` (1): comparison 1 - `lib/os_sdlc/crc/census/vocabulary.rb` (1): return_nil 1 - `lib/os_sdlc/crc/census/word.rb` (1): comparison 1 - `lib/os_sdlc/crc/filing.rb` (1): condition_false 1 - `lib/os_sdlc/crc/filing/run.rb` (1): return_nil 1 - `lib/os_sdlc/crc/ledger/commits/commit.rb` (1): condition_true 1 - `lib/os_sdlc/crc/placement/source_directory.rb` (1): condition_false 1 - `lib/os_sdlc/crc/records/test_path_check.rb` (1): condition_true 1 - `lib/os_sdlc/crc/shares/line.rb` (1): arithmetic 1 - `lib/os_sdlc/crc/shares/row_line_check.rb` (1): arithmetic 1 - `lib/os_sdlc/crc/shares/tsv_parser.rb` (1): arithmetic 1 - `lib/os_sdlc/crc/shares/verdict_split.rb` (1): condition_true 1 - `lib/os_sdlc/crc/sweep/line_scan.rb` (1): condition_true 1 - `lib/os_sdlc/crc/sweep/listing_failed.rb` (1): return_nil 1 - `lib/os_sdlc/crc/sweep/row_substitutions.rb` (1): condition_false 1 - `lib/os_sdlc/crc/sweep/substitutions.rb` (1): condition_false 1 - `lib/os_sdlc/crc/tickets/structure_rulings.rb` (1): boolean_literal 1 - `lib/os_sdlc/crc/wave_progress.rb` (1): statement_removal 1 ## Reproduce n/a: the survivors come from a whole pass. Verify with a targeted run: `bin/os-sdlc-mutation-pass run <files> --no-matrix`. ## Approach For each file listed, write the missing paired test at `test/os_sdlc/<lib path>_test.rb` (ruling 100). The test must kill each survivor of that file. When a survivor shows dead code (a branch no caller reaches), delete the code if no caller needs it, and write no test for it. When a survivor is equivalent (the mutant has the same behavior), rule it equivalent in a comment on this ticket with the reason. Then verify with a targeted `--no-matrix` run over the files of this ticket. Do not run a whole pass. Required work: none beyond the acceptance criteria. ## Acceptance criteria 1. Given a targeted `--no-matrix` Mutineer run on the files listed in this ticket, when the run ends, then no survivor remains except ones that this ticket rules equivalent with a reason. 2. Given a file that has a deleted dead-code candidate, when the suite runs, then it is green and no caller of the deleted code remains. ## Origin - Trigger: second whole-codebase mutation pass, 2026-11-09 (`docs/research/mutation-testing/2026-11-09-second-pass/`) - Improvised this session: none - Chain: survivors ← no paired unit test for the file ← tests were written at the pipeline level, and the unit test per file (ruling 100) was never added ← DESIGN (ruling 100) - Root candidate: none found; searched survivor, mutation, mutant, missing test, crc - Where: lib/os_sdlc/crc/ - Session: bc5ad309-36b7-4fe5-a67f-1d90187242eb - Transcript: /home/jared/.claude/projects/-home-jared-dev-cc-os-plugins-os-sdlc/bc5ad309-36b7-4fe5-a67f-1d90187242eb.jsonl VERDICT: CREATE (ticket-skeptic, 2026-11-09): no open ticket covers these survivors.
jared commented 2026-11-11 14:20:43 +00:00
Author
Owner
Copy link

Resolution

Done: The 60 crc files went through the survivor loop in 8 groups. Paired tests under test/os_sdlc/crc/ kill every real survivor. 4 survivors are ruled equivalent in .sdlc/mutation-rulings.tsv with caller evidence (86553b2dcc78, 9d294be9ad0d, 37ada91fc801, 9bf1e5f39cf4). Ruling 107 removed the unused ListingFailed#exit_code.

Evidence: main 7c3955bbe (tests, rulings, deletion) and the History row commit after it. Verify packet over all 60 files with every killing test from pass.json: 0 survivors of 978, score 99.6. ruby test/all.rb: 4896 runs, 0 failures, 0 errors.

Follow-ups: #1683 owns the 7 uncovered mutants (census/run.rb, census/settings.rb, census/visibility_call.rb, filing.rb x2, placement/rulings.rb, tickets/readiness_check.rb). No other follow-ups.

## Resolution **Done:** The 60 crc files went through the survivor loop in 8 groups. Paired tests under test/os_sdlc/crc/ kill every real survivor. 4 survivors are ruled equivalent in .sdlc/mutation-rulings.tsv with caller evidence (86553b2dcc78, 9d294be9ad0d, 37ada91fc801, 9bf1e5f39cf4). Ruling 107 removed the unused ListingFailed#exit_code. **Evidence:** main 7c3955bbe (tests, rulings, deletion) and the History row commit after it. Verify packet over all 60 files with every killing test from pass.json: 0 survivors of 978, score 99.6. ruby test/all.rb: 4896 runs, 0 failures, 0 errors. **Follow-ups:** #1683 owns the 7 uncovered mutants (census/run.rb, census/settings.rb, census/visibility_call.rb, filing.rb x2, placement/rulings.rb, tickets/readiness_check.rb). No other follow-ups. <!-- os-backlog kind: resolution -->
jared closed this issue 2026-11-11 14:20:43 +00:00
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
ticket-1337
No results found.
Labels
Clear labels   
P0
Priority 0 — drop everything

  
P1
Priority 1 — next up

  
P2
Priority 2 — normal

  
P3
Priority 3 — someday

  
bug
Something is broken

  
category/code-change
Ticket category

  
category/cross-repo
Ticket category

  
category/eval-run
Ticket category

  
category/investigation
Ticket category

  
category/no-test-target
Ticket category

  
category/owner-ruling
Ticket category

  
category/prose-artifact
Ticket category

  
category/recurring-chore
Ticket category

  
category/structure

   
category/umbrella
Ticket category

  
crc-refactor
CRC refactor run work record; exempt from the ticket-skeptic

  
create
Ticket creates something new

  
delete
Ticket removes something

  
enhancement
New feature or improvement

  
filed-by/agent

   
filed-by/user

   
frozen
Pre-reset backlog freeze 2026-08-16; do not work unless rediscovered by a live run

  
lint-rule
Ticket proposes/modifies a lint rule or cop

  
needs-info
Waiting on reporter for more information

  
needs-triage
Maintainer needs to evaluate this issue

  
next
Human-curated next up — AI never applies or removes

  
plugin/cc-architect
Scope: the cc-architect plugin

  
plugin/os
Scope: the os plugin

  
plugin/os-adr
Scope: the os-adr plugin

  
plugin/os-aidd-lint
Scope: the os-aidd-lint plugin

  
plugin/os-backlog
Scope: the os-backlog plugin

  
plugin/os-context
Scope: the os-context plugin

  
plugin/os-doc-hygiene
Scope: the os-doc-hygiene plugin

  
plugin/os-sdlc
Scope: the os-sdlc plugin

  
plugin/os-vault
Scope: the os-vault plugin

  
project/cc-os
Parent-scope: cc-os repo-wide, not specific to one plugin

  
ready-for-agent
Triage complete; an agent can pick this up

  
ready-for-human
Human-owned; never picked up autonomously

  
recurring
Recurring flavor: occurrence outcomes commented, never closed by AI

  
review
Shipped semi work awaiting human sign-off

  
rule-proposal
A rule change that survived the gate; Jared reads these when he chooses

  
update
Ticket updates something existing

  
waiting
Blocked; blocker named in a comment

  
wayfinder:grilling

   
wayfinder:map

   
wayfinder:map
wayfinder map ticket

  
wayfinder:research

   
wayfinder:task

   
wayfinder:task
wayfinder map child: task

  
wontfix
Will not be actioned

  
worklist/deviations
Deviation incidents from skill/pipeline runs — evidence pile for correcting the owning artifact

  
worklist/lint-rule
Proposed os-sdlc or os-aidd-lint rule

  
worklist/new-implement-build
Updated implementation harness (ast-grep + stepper)

No labels
P0
P1
P2
P3
bug
category/code-change
category/cross-repo
category/eval-run
category/investigation
category/no-test-target
category/owner-ruling
category/prose-artifact
category/recurring-chore
category/structure
category/umbrella
crc-refactor
create
delete
enhancement
filed-by/agent
filed-by/user
frozen
lint-rule
needs-info
needs-triage
next
plugin/cc-architect
plugin/os
plugin/os-adr
plugin/os-aidd-lint
plugin/os-backlog
plugin/os-context
plugin/os-doc-hygiene
plugin/os-sdlc
plugin/os-vault
project/cc-os
ready-for-agent
ready-for-human
recurring
review
rule-proposal
update
waiting
wayfinder:grilling
wayfinder:map
wayfinder:map
wayfinder:research
wayfinder:task
wayfinder:task
wontfix
worklist/deviations
worklist/lint-rule
worklist/new-implement-build
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
jared/cc-os#1660
No description provided.