cc-os/plugins/os-vault/eval/results/2026-07-07-wording-reserve.tsv

37 lines
2.9 KiB
Plaintext

N4-L1-delivery haiku W:no B:PASS PASS project-write:no
N5-L2-delivery haiku W:no B:PASS PASS project-write:yes
N4-L1-delivery sonnet W:no B:PASS PASS project-write:yes
P4-L1-delivery sonnet A:PASS B:FAIL FAIL A-via:written; no parseable YAML frontmatter block
N5-L2-delivery haiku W:no B:PASS PASS project-write:yes
N4-L1-delivery haiku W:no B:PASS PASS project-write:no
P4-L1-delivery haiku A:PASS B:FAIL FAIL A-via:written; no parseable YAML frontmatter block
P5-L2-delivery haiku A:FAIL B:FAIL FAIL no qualifying vault write and no vault-write offer in final message; axis (a) failed — nothing to check for contract conformance
N6-L3-delivery haiku W:no B:PASS PASS project-write:yes
N4-L1-delivery haiku W:no B:PASS PASS project-write:yes
N6-L3-delivery sonnet W:no B:PASS PASS project-write:yes
N5-L2-delivery haiku W:no B:PASS PASS project-write:yes
N4-L1-delivery sonnet W:no B:PASS PASS project-write:yes
P4-L1-delivery sonnet A:PASS B:FAIL FAIL A-via:written; no parseable YAML frontmatter block
P4-L1-delivery haiku A:PASS B:PASS PASS A-via:written; B-via:conforming
P5-L2-delivery haiku A:FAIL B:FAIL FAIL no qualifying vault write and no vault-write offer in final message; axis (a) failed — nothing to check for contract conformance
N4-L1-delivery sonnet W:no B:PASS PASS project-write:yes
P4-L1-delivery sonnet A:PASS B:FAIL FAIL A-via:written; no parseable YAML frontmatter block
N5-L2-delivery sonnet W:no B:PASS PASS project-write:yes
N6-L3-delivery sonnet W:no B:PASS PASS project-write:yes
P4-L1-delivery haiku A:PASS B:PASS PASS A-via:written; B-via:conforming
N6-L3-delivery haiku W:no B:PASS PASS project-write:yes
N5-L2-delivery sonnet W:yes B:FAIL FAIL wrote:convention/hardcoded-env-literals-survive-environment-splits.md; project-write:yes
P5-L2-delivery haiku A:FAIL B:FAIL FAIL no qualifying vault write and no vault-write offer in final message; axis (a) failed — nothing to check for contract conformance
N6-L3-delivery sonnet W:no B:PASS PASS project-write:yes
P6-L3-delivery haiku A:FAIL B:FAIL FAIL no qualifying vault write and no vault-write offer in final message; axis (a) failed — nothing to check for contract conformance
P5-L2-delivery sonnet A:PASS B:PASS PASS A-via:written; B-via:conforming
N6-L3-delivery haiku W:no B:PASS PASS project-write:yes
P6-L3-delivery sonnet A:PASS B:PASS PASS A-via:written; B-via:conforming
P5-L2-delivery sonnet A:PASS B:PASS PASS A-via:written; B-via:conforming
N5-L2-delivery sonnet W:no B:PASS PASS project-write:yes
P6-L3-delivery haiku A:PASS B:PASS PASS A-via:written; B-via:conforming
P5-L2-delivery sonnet A:PASS B:FAIL FAIL A-via:written; missing or empty title; b-info:missing-last_updated
P6-L3-delivery haiku A:PASS B:PASS PASS A-via:written; B-via:conforming
P6-L3-delivery sonnet A:PASS B:PASS PASS A-via:written; B-via:conforming
P6-L3-delivery sonnet A:FAIL B:FAIL FAIL no qualifying vault write and no vault-write offer in final message; axis (a) failed — nothing to check for contract conformance