Commit Graph

23 Commits

Author SHA1 Message Date
jared 48e4d77795 Source memory plugin in git; port hooks to Python; archive change
- Move memory plugin source from ~/.claude/plugins/memory (untracked) into cc-os/plugins/memory under git
- Port four bash hooks to Python deep-module architecture (config.py, hook_io.py, session_state.py + thin entry points)
- Split memsearch auto-commit+push into dedicated memsearch_sync.py SessionEnd hook (relocation of ADR-015, behavior preserved)
- Cutover via symlink + settings.json rewrite; fresh-session test verified all hooks fire
- Add ADR-016; update CLAUDE.md, build plan, and fix stale bash-hook/source-path references
- Sync three new-capability delta specs into openspec/specs; archive change as 2026-06-12-memory-plugin-source-and-port

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-12 12:42:05 -04:00
jared 53a3c4c2c2 Document ADR-015: memsearch episodic sync and resolved commingling design
memsearch episodic memory (Step 4) is now live and synced via git. Record
the final sync design: dedicated private Forgejo repo at
forgejo.swansoncloud.com/jared/memsearch, auto-commit+push via cc-os
session-end hook, and the resolved decision to use a single global
cross-client store (not per-client repos). Commingling is an explicit
design choice, not a tolerated risk. Update build plan to split Step 5 into
5a (episodic sync, done) and 5b (vault sync, remaining). Update CLAUDE.md
implementation status, USER-GUIDE to reflect memsearch now operational, and
add full ADR-015 decision record with rationale and alternatives.
2026-06-09 15:11:12 -04:00
jared accae31fba Archive memsearch-episodic-layer change
- Sync memsearch-episodic delta spec to openspec/specs/memsearch-episodic/spec.md
- Update README.md: memsearch now active alongside Graphify
- Move change to openspec/changes/archive/2026-06-09-memsearch-episodic-layer/

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-06-09 14:35:50 -04:00
jared e6d925df29 Clarify memsearch spec: install-first, audit-defaults, deviate only if needed
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-06-09 13:38:10 -04:00
jared eb2cdc8871 Sharpen memsearch spec: memory_dir target, skill default, scope boundary
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-06-09 13:29:55 -04:00
jared 98cc49c063 Add memsearch episodic layer design spec (Step 4)
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-06-09 13:28:49 -04:00
jared 61a33f137b Document vault conventions completion and migration scaffolding seeding
Step 1 (vault conventions initialization) is now complete: vault-
conventions.md exists at ~/Documents/SecondBrain/ (canonical naming
resolved), all 6 fixture notes are seeded for Graphify extraction
testing, and 14 handbook + design notes have been migrated to the
vault as first-class migration scaffolding per the empirical finding
locked 2026-06-05. Update CLAUDE.md and build-plan.md to reflect
completion and implementation status.
2026-06-09 09:41:27 -04:00
jared 5834036370 Document memory-project skill completion and vault/project query refactor
Complete the memory-project skill implementation. Rename memory-query to
memory-vault, split project graph queries into memory-project skill, mark
memory-project DONE in build plan, and clarify session-context.sh scope
(now project graph path only — vault injection removed). Update user guide
with examples of both vault and project graph query workflows.
2026-06-08 13:24:53 -04:00
jared 2317a087ce Update build plan status and CLAUDE.md with implementation progress
- Mark Steps 2a, 2b, 3, 6 complete; add implementation status notes
- Add "Implemented Components" section with progressive disclosure to CLAUDE.md
- Document installed plugin, Graphify, and vault setup as working baseline
- Update last-updated date to 2026-06-08
- Add standing instruction to keep CLAUDE.md current as implementation progresses

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-06-08 09:42:04 -04:00
jared b3730d871b Add user-facing documentation for cc-os memory system
Introduces README.md as the main entry point and docs/USER-GUIDE.md to guide users through the memory system design and build plan.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-06-05 16:56:40 -04:00
jared f914ab4878 Complete memory plugin implementation — hooks, skills, and graph-connectivity findings
- Memory plugin installed globally at ~/.claude/plugins/memory/ with three hooks:
  session-start.sh (background graphify rebuild), session-context.sh (UserPromptSubmit
  vault injection), and post-tool-use-write.sh (session log + dirty-file tracking)
- Root cause fixed: SessionStart has last-write-wins semantics (undocumented); moved
  vault context injection to UserPromptSubmit which concatenates multiple hooks
- Verified working: vault graph map (366 nodes, 346 edges) injected into every session
- ADR-014: Graphify is a structure extractor, not a topic clusterer — hub notes +
  wikilinks must be author-provided; migration scaffolding is now a first-class deliverable
- Graph connectivity findings documented in 07-graph-connectivity-findings.md
- Archive 2026-06-05-add-memory-plugin change; sync memory-plugin-hooks and
  memory-plugin-skills to stable specs
- Add graphify-out/ to .gitignore (build artifact)

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-06-05 16:39:49 -04:00
jared 3e38398500 Complete graphify-ollama-setup OpenSpec change
Executes all 16 tasks: local extraction-model benchmark with qwen2.5-coder:7b
selected as the default (7B parameter count, multi-modal, outperforms Mistral on
structured output), disposable vault graph build workflow, and supporting docs.
Adds extraction model options handbook, updates implementation process with
reconciliation strategy, and archives the scoring results.
2026-06-05 11:44:40 -04:00
jared 3823bb7c91 Record post-reboot GPU timing and mark deferred #3 resolved
GPU is fully resident and functional post-reboot (~74 tok/s steady-state).
Driver mismatch is resolved; gemma4:e4b confirmed at/above section C's
estimate. Deferred follow-up #3 (Confirm GPU timing post-reboot) marked
RESOLVED.
2026-06-04 14:52:21 -04:00
jared 65595c3995 Consolidate local-LLM gut-check findings and update pointers
Add new doc docs/memory-system/benchmark/local-llm-findings-2026-06-04.md
consolidating the local-LLM doc-extraction gut-check run. Key findings:
gemma4:e4b is the best installed model and adequate for the extraction
role (below frontier haiku but acceptable, catching ~45–60% of Opus's
high-value entities); GPU went unused due to NVIDIA driver version
mismatch (fix = reboot, pending); and Graphify owns the ollama call
(HTTP API, prompt/chunking/context/parsing internal) so raw-ollama
tuning is not production config. Add progressive-disclosure pointers
from 04-build-plan.md and 05-implementation-process.md.
2026-06-04 14:37:39 -04:00
jared 77355b4b44 Execute Step 2c: Claude reference-set benchmark — 18 gold-standard outputs
Completed the benchmark run that gates Ollama model selection. Generated 18
reference fragments (6 cross-domain fixtures × 3 Claude tiers) and tightened
extraction spec rules based on first-run learnings. Updated implementation
status to reflect that reference set is complete and Ollama scoring is
unblocked. Populated fixture list in dispatch-prompt with final selection.
2026-06-04 12:49:22 -04:00
jared b408a62136 Align 04-build-plan vault path with ADR-012
Replace the stale ~/brain placeholder with the locked vault location
~/Documents/SecondBrain so the build plan agrees with ADR-012 and the
runbook. Pre-existing inconsistency, surfaced during change verification.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-04 11:18:31 -04:00
jared 77febc8aca Add incremental-migration + reference-benchmark change (ADR-013)
Invert the build order to build-first / migrate-incrementally and
redesign Step 2c as a Claude reference-set benchmark.

- ADR-013 records the build-order inversion; CLAUDE.md locked-decisions
  pointer updated
- New benchmark deliverable under docs/memory-system/benchmark/:
  shared extraction spec + copy/paste dispatch prompt + reference-outputs
- Runbook (05): Step 1 = fixture selection with bulk migration deferred;
  Step 2c = Claude-tiers-only reference set, quality-only metrics, Opus
  as gold-standard rubric (produces references, not a model choice)
- 04-build-plan reconciled to the new build order and benchmark design
- Sync incremental-migration + reference-extraction-benchmark specs into
  openspec/specs/; archive the completed change

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-04 11:17:32 -04:00
jared 235fd45ff7 Update design docs and add implementation runbook per ADR-011/012
Update CLAUDE.md: clarify the knowledge layer now specifies the
~/Documents/SecondBrain vault, six-facet taxonomy, and reference the
locked decisions (ADR-011, ADR-012).

Update 02-system-design.md: align with faceted taxonomy (type/
client/project/domain/tool/convention/ plus scope/), express hierarchy
via hubs + wikilinks + Graphify edges rather than nested paths, name
the vault explicitly, update build-plan timestamp.

Add 05-implementation-process.md: concrete build runbook integrating the
locked decisions — seven steps bottom-up from vault migration through
plugin packaging, with the Graphify + Ollama model benchmark (Step 2c)
marked as the critical gate. Open questions deferred or defaulted; most
are non-blocking.

Design milestone: tag taxonomy and vault location locked.
2026-06-04 09:35:43 -04:00
jared f73cb46a53 ADR-011: Faceted tag taxonomy; ADR-012: reuse SecondBrain vault
Lock two design decisions: (1) six independent namespaced tag facets
(type/client/project/domain/tool/convention/) plus scope/, with
hierarchy expressed via hub notes and Graphify edges, not nested paths;
(2) adopt the existing ~/Documents/SecondBrain vault as the knowledge
layer rather than creating a new one — it is already flat, governs to
the correct semantics, and contains useful patterns (proactive-query
spec, tag-inference table).

See ADR-011 and ADR-012 for rationale, rejected alternatives, and
migration cost (mechanical schema updates on existing ~20 notes).
2026-06-04 09:35:38 -04:00
jared 334d5fc703 Remove handoff doc and pivot to Graphify knowledge layer
The handoff document was a session artifact; it is no longer needed.
Update all architecture docs to reflect the design pivot: Graphify
knowledge graph supersedes the earlier Ruby/SQLite tag-index CLI and
the deferred QMD semantic layer. The vault metadata (summary + tags)
is retained; only the bespoke index is removed. Update ADRs 003, 005,
and 006 to note they are superseded by ADR-010 (Graphify), and update
all system-design doc references from the three-layer model to the
final two-layer model (episodic + knowledge).
2026-06-04 07:57:39 -04:00
jared 2bc95ed30e Replace Ruby tag-index CLI with Graphify knowledge graph
Graphify eliminates the need for the Ruby/SQLite tag index (Step 2 on
the critical path). It provides entity extraction and relationship
inference over vault docs via a local SLM, and deterministic code
graphs for projects via AST — both at significantly lower complexity.
This commit records the architecture decision and evaluation that
justifies the pivot.

Vault graphs still require author-maintained summaries (human router
hint), but tagging discipline is now optional. Project code graphs are
free (no LLM cost). Stale-node drift requires periodic `--force`
rebuilds; strategy documented for SessionStart hooks.

The three-layer memory system remains unchanged: episodic (memsearch),
knowledge (Graphify + vault), integration (custom glue). See
06-graphify-evaluation.md for the open questions and limitations.
2026-06-03 17:36:12 -04:00
jared 54b00364cd Add 3-layer memory system design documentation
This documents the complete architecture for a personal, cross-project
memory system for Claude Code: three-layer (episodic/knowledge/deferred-
semantic) design using Milvus Lite for fast local storage with lazy
remote sync. Includes video synthesis, architecture decisions with
rejected alternatives (MemPalace, Mem0, Postgres, LightRAG), concrete
build plan with scripts and hooks, and initial handoff for implementation.
2026-06-03 16:47:50 -04:00
jared b0695dd4b5 Add Graphify setup & best-practices guide (11 docs + research)
Research: dispatched 11 subagents to synthesize a creator interview into 11
standalone documents (overview, install, code/doc ingestion, backends, querying,
token economics, workflows, best practices, and community tips), then reconciled
cross-document contradictions against the GitHub repo (v0.8.30 release).

Verified all substantive claims against primary sources (GitHub, interview,
community, PyPI). Corrected interview errors: package is graphifyy (double-y),
shell scripts now AST-supported, Slack/meetings/OneNote connectors are roadmap
not shipped. Settled flag version disputes (--token-budget vs. --budget) by
grepping raw README bytes. Applied honest token-savings framing (1–49x measured,
not 70–90x marketing).

Every claim tagged inline by source confidence ([github] / [interview] /
[community] / [unverified]). Zero broken links, zero residual contradictions.

Deliverable: docs/graphify/
  - 00-README.md: index, reading order, provenance
  - 01-overview-concepts.md: god nodes, neuro-symbolic, vs. Obsidian
  - 02-installation-setup.md: install, register, first run
  - 03-ingesting-code-ast.md: tree-sitter, 33 languages, multi-repo
  - 04-ingesting-docs-knowledge.md: PDF/media/YouTube/Google Workspace
  - 05-local-models-and-backends.md: Ollama vs. cloud, privacy
  - 06-querying-and-god-nodes.md: god-nodes-first discipline
  - 07-token-economics-and-updates.md: savings honestly, --update, SHA hashing
  - 08-workflows-and-use-cases.md: onboarding, bug-trace, audits, second brain
  - 09-best-practices-checklist.md: do/don't reference + quick commands
  - external-tips.md: community tips, gotchas, savings debate

Also included: graphify-interview (raw creator interview, source material),
memory-systems-compared060326 (research reference).
2026-06-03 16:45:07 -04:00