jared
/
cc-os
1
0
Fork 0
Code Issues 17 Pull Requests Packages Projects Releases Wiki Activity

WS4 IRL re-audit: Fable orchestration economics post-v3 (~2026-07-22) #8

New Issue
Open
opened 2026-07-08 15:19:08 +00:00 by jared · 1 comment
jared commented 2026-07-08 15:19:08 +00:00
Owner
Copy Link

Two weeks after shipping ORCHESTRATION.md v3 (2026-07-08, commit 397145b), re-run the Fable economics mini-audit on ~5 NEW real sessions per the IRL feedback loop (eval-methodology-irl-feedback-loop):

  • Method: docs/orchestration-audit/2026-07-08-fable-econ-miniaudit.md — but compute REAL main-loop share this time: subagent transcripts persist at ~/.claude/projects///subagents/agent-*.jsonl with per-message usage blocks (vault note claude-code-subagent-transcripts-and-token-accounting).
  • Compare main-loop token share + miss shapes vs the 2026-07-08 baseline (implementation fan-out was the dominant miss; mid-session threshold decay the watch item).
  • Promote any NEW miss shapes into eval scenarios (run-set AND reserve are contaminated — new scenarios needed for any future wording tuning).
  • Baseline + shipped-wording results: vault note os-orchestration-ws4-econ-wording-results; plan: docs/plans/ws4-orchestration-economics.md.
Two weeks after shipping ORCHESTRATION.md v3 (2026-07-08, commit 397145b), re-run the Fable economics mini-audit on ~5 NEW real sessions per the IRL feedback loop ([[eval-methodology-irl-feedback-loop]]): - Method: docs/orchestration-audit/2026-07-08-fable-econ-miniaudit.md — but compute REAL main-loop share this time: subagent transcripts persist at ~/.claude/projects/<flat-cwd>/<session-id>/subagents/agent-*.jsonl with per-message usage blocks (vault note [[claude-code-subagent-transcripts-and-token-accounting]]). - Compare main-loop token share + miss shapes vs the 2026-07-08 baseline (implementation fan-out was the dominant miss; mid-session threshold decay the watch item). - Promote any NEW miss shapes into eval scenarios (run-set AND reserve are contaminated — new scenarios needed for any future wording tuning). - Baseline + shipped-wording results: vault note [[os-orchestration-ws4-econ-wording-results]]; plan: docs/plans/ws4-orchestration-economics.md.
jared added the
ready-for-agent
 label 2026-07-12 22:25:52 +00:00
jared commented 2026-07-12 22:25:52 +00:00
Author
Owner
Copy Link

This was generated by AI during triage.

Labeled ready-for-agent with a time gate: do not run before ~2026-07-22 (needs two weeks of NEW post-v3 sessions to audit). The run itself is agent-executable via /os-orchestration:audit-sessions per the method doc; findings review is the human step. Autonomy: afk-ready once the date gate passes.

> *This was generated by AI during triage.* Labeled ready-for-agent with a time gate: do not run before ~2026-07-22 (needs two weeks of NEW post-v3 sessions to audit). The run itself is agent-executable via /os-orchestration:audit-sessions per the method doc; findings review is the human step. Autonomy: afk-ready once the date gate passes.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
main
research/clutter-inventory
Labels
Clear labels   
P0

Priority 0 — drop everything

  
P1

Priority 1 — next up

  
P2

Priority 2 — normal

  
P3

Priority 3 — someday

  
afk-ready

Autonomous end-to-end; closed after verification

  
hitl

Human-owned; never picked up autonomously

  
next

Human-curated next up — AI never applies or removes

  
ready-for-agent

Triage complete; an agent can pick this up

  
review

Shipped semi work awaiting human sign-off

  
semi

Autonomous through mechanical parts; stops at gates; ships to review

  
waiting

Blocked; blocker named in a comment

  
wayfinder:grilling

   
wayfinder:map

   
wayfinder:research

   
wayfinder:task
No Label
P0
P1
P2
P3
afk-ready
hitl
next
ready-for-agent
review
semi
waiting
wayfinder:grilling
wayfinder:map
wayfinder:research
wayfinder:task
Milestone
Clear milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
No Assignees
1 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: jared/cc-os#8
No description provided.
Delete Branch "%!s(<nil>)"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?