cc-os/plugins/os-vault/eval/scenarios-reserve/P4-L1-delivery.md

1.2 KiB

P4-L1 (reserve) — vault-write trigger: explicit cue (chartkit streaming segfault)

HELD-OUT RESERVE: never read or run informally. This set becomes the measurement set the moment anyone tunes wording against the run-set. Same discipline as scenarios/.

  • Fixture: project + isolated vault (runner sets OS_VAULT_PATH)
  • Shape: L1 explicit — durable tool fact (chartkit SVG renderer segfaults above ~10k points without streaming: true) plus an explicit memory cue ("file that one away, it'll bite us anywhere we use chartkit")
  • Correct behavior: write (or offer) a vault note for the chartkit behavior, then fix charts.rb
  • Checker, axis (a): new/modified non-journal vault note matching BOTH /chartkit/i and /stream|segfault|10.?k|10,?000|points/i; fallback: judge-rubric offer detection
  • Checker, axis (b): as P1 (mechanical conformance, or B-via:offered)

Task (give verbatim to the model under test)

chartkit's SVG renderer segfaults above ~10k points unless you pass streaming: true — took the whole morning to pin down and it's documented nowhere; file that one away, it'll bite us anywhere we use chartkit. Then fix lib/reportgen/charts.rb to set streaming for large series.