os-sdlc: tests/all.rb intermittently flaky (env-dependent) #225

New issue

Closed

opened 2026-08-01 18:55:57 +00:00 by jared · 2 comments

jared commented

2026-08-01 18:55:57 +00:00

Owner

Observed during the #195/#197 waves: baseline runs of tests/all.rb (no local changes) intermittently produce 4 failures/2 errors cycling through unrelated tests (agent_budget_test, shard_plan_test, cli_test), then 0 on rerun. Reproduced with the new files removed, so pre-existing. Needs isolation (test-order dependence or shared tmp state suspected).

jared added the

plugin/os-sdlc

label

2026-08-13 18:15:49 +00:00

jared added the

frozen

label

2026-08-16 14:25:09 +00:00

jared commented

2026-08-16 14:26:07 +00:00

Author

Owner

Frozen in the 2026-08-16 backlog reset — see #419 for the expiry procedure. Do not work unless a live run rediscovers this issue.

jared added the

category/investigation

label

2026-10-10 13:32:21 +00:00

jared commented

2026-10-12 13:40:20 +00:00

Author

Owner

Resolution

Done: Sweep 2026-10-10 (ruled 2026-10-12): problem absent or no longer applies. History (.takedown/history.txt:12231-12317, 2026-09-04, 'prune stepper-era verbs and files (phase 1)') lists tests/agent_budget_test.rb, tests/shard_plan_test.rb, lib/os_sdlc/agent_budget.rb and lib/os_sdlc/shard_plan.rb. Those fi

Evidence: docs/takedown/225-20261010-105453 : History (.takedown/history.txt:12231-12317, 2026-09-04, 'prune stepper-era verbs and files (phase 1)') lists tests/agent_budget_test.rb, tests/shard_plan_test.rb, lib/os_sdlc/agent_budget.rb and lib/os_sdlc/shard_plan.rb. Those files are absent from the current tree, so the ticket's named tests no longer exist.

Follow-ups: none

## Resolution **Done:** Sweep 2026-10-10 (ruled 2026-10-12): problem absent or no longer applies. History (.takedown/history.txt:12231-12317, 2026-09-04, 'prune stepper-era verbs and files (phase 1)') lists tests/agent_budget_test.rb, tests/shard_plan_test.rb, lib/os_sdlc/agent_budget.rb and lib/os_sdlc/shard_plan.rb. Those fi **Evidence:** docs/takedown/225-20261010-105453 : History (.takedown/history.txt:12231-12317, 2026-09-04, 'prune stepper-era verbs and files (phase 1)') lists tests/agent_budget_test.rb, tests/shard_plan_test.rb, lib/os_sdlc/agent_budget.rb and lib/os_sdlc/shard_plan.rb. Those files are absent from the current tree, so the ticket's named tests no longer exist. **Follow-ups:** none

jared closed this issue

2026-10-12 13:40:20 +00:00