docs(adr): ADR 125 Context Language Model + plan (resident mode, llama.cpp out) #547

Open
toasterson wants to merge 14 commits from docs/context-language-model into main
Owner

Design for a Context Language Model in akh-medu, clean-room from Shao et al., Context Language Models (arXiv:2609.37725). The reference repo is CC BY-NC 4.0, so no code or prompt text from it is used.

  • ADR 125: the akh edits its own live context (LiveContext reconciled every tool round; edited text is always a model Note; pins and every eviction reported to SafetyEnforced; evictions journaled). Typed context_edit tool, AkhContextBench, skill evolution against a sealed split, ADR 110 reward mapping for Lilith.
  • D12–D15, resident mode: context arena + KV resident in akh-owned Candle inference; edits as KV operations priced by Gemma 4's layout (v̂-only global KV, f16 sliding ring, delta shifts with M1b caps 52/6); mmap'd session tiers; akhinferd for split hosts; llama.cpp leaves Lilith's serving path at the CLM-R5 cutover (operator decision 2026-10-05).
  • Plan: slices CLM-1..8 and R1..R5 (+R1b). GPT-6.1 Sol implements, Kimi K3 owns the math (M1, M1a, M1b notes, all pre-registered), the architect reviews.
  • Briefs: CLM-1, CLM-2, CLM-4, CLM-R1, CLM-R2 under docs/ai/phases/clm/, plus reviews.
  • Pause handoff (2026-10-06): docs/ai/phases/clm/README.md — state of every branch/PR, open operator decisions, artifact locations on the NFS share, resume checklist. Code PRs #555 (CLM-1, accepted) and #556 (CLM-R1, not yet certified) are stacked on this branch.

Docs only. No code changes.

Design for a **Context Language Model** in akh-medu, clean-room from Shao et al., *Context Language Models* (arXiv:2609.37725). The reference repo is CC BY-NC 4.0, so no code or prompt text from it is used. - **ADR 125**: the akh edits its own live context (`LiveContext` reconciled every tool round; edited text is always a model `Note`; pins and every eviction reported to `SafetyEnforced`; evictions journaled). Typed `context_edit` tool, AkhContextBench, skill evolution against a sealed split, ADR 110 reward mapping for Lilith. - **D12–D15, resident mode**: context arena + KV resident in akh-owned Candle inference; edits as KV operations priced by Gemma 4's layout (v̂-only global KV, f16 sliding ring, delta shifts with M1b caps 52/6); mmap'd session tiers; `akhinferd` for split hosts; llama.cpp leaves Lilith's serving path at the CLM-R5 cutover (operator decision 2026-10-05). - **Plan**: slices CLM-1..8 and R1..R5 (+R1b). GPT-6.1 Sol implements, Kimi K3 owns the math (M1, M1a, M1b notes, all pre-registered), the architect reviews. - **Briefs**: CLM-1, CLM-2, CLM-4, CLM-R1, CLM-R2 under `docs/ai/phases/clm/`, plus reviews. - **Pause handoff (2026-10-06)**: `docs/ai/phases/clm/README.md` — state of every branch/PR, open operator decisions, artifact locations on the NFS share, resume checklist. Code PRs #555 (CLM-1, accepted) and #556 (CLM-R1, not yet certified) are stacked on this branch. Docs only. No code changes.
Clean-room design from arXiv:2609.37725: the akh edits its own live
context. LiveContext reconciled per tool round, D4 attribution/pin
safety, edit journal, typed context_edit tool, AkhContextBench,
skill evolution against a sealed split, ADR 110 reward mapping.
D12-D15: context arena + KV resident in akh-owned Candle inference,
edits as KV ops priced by Gemma 4's layout, mmap'd session tiers,
akhinferd for split hosts; llama.cpp leaves Lilith's serving path at
the CLM-R5 cutover (operator decision 2026-10-05).
docs: roadmap entry for the Context Language Model plan (ADR 125)
Some checks failed
CI / test-session-platform (pull_request) Has been cancelled
CI / test-sokar (pull_request) Has been cancelled
CI / check-seshat (pull_request) Has been cancelled
CI / check-akh-medu (pull_request) Has been cancelled
CI / test-akh-medu (pull_request) Has been cancelled
CI / docker-seshd (pull_request) Has been cancelled
CI / docker-sokard (pull_request) Has been cancelled
CI / docker-akh-transcripts (pull_request) Has been cancelled
CI / publish-chart (pull_request) Has been cancelled
CI / platform-images-home (pull_request) Has been cancelled
CI / platform-images-core (pull_request) Has been cancelled
CI / platform-images-daemons (pull_request) Has been cancelled
CI / platform-images-fleet (pull_request) Has been cancelled
CI / platform-images-collect (pull_request) Has been cancelled
f1dbd2371c
docs(clm): CLM-1 implementation brief, M1 math brief; ADR 125 D4.3 pins stay in place
Some checks failed
CI / test-session-platform (pull_request) Has been cancelled
CI / test-sokar (pull_request) Has been cancelled
CI / check-seshat (pull_request) Has been cancelled
CI / check-akh-medu (pull_request) Has been cancelled
CI / test-akh-medu (pull_request) Has been cancelled
CI / docker-seshd (pull_request) Has been cancelled
CI / docker-sokard (pull_request) Has been cancelled
CI / docker-akh-transcripts (pull_request) Has been cancelled
CI / publish-chart (pull_request) Has been cancelled
CI / platform-images-home (pull_request) Has been cancelled
CI / platform-images-core (pull_request) Has been cancelled
CI / platform-images-daemons (pull_request) Has been cancelled
CI / platform-images-fleet (pull_request) Has been cancelled
CI / platform-images-collect (pull_request) Has been cancelled
149bfb35ff
Derives the delta-RoPE identity for Gemma 4's half-split pairing from
src/nlu/vendored/quantized_gemma4.rs (cited per line), bounds repeated-shift
error growth in f32/f16/bf16, prices rotate-at-read vs delta shifts, shows the
global layers' single stored tensor must be the bare-normalized V with
K = RoPE(w_k x bar-v) derived at read, and pre-registers every CLM-R1/CLM-4/
CLM-5 gate, tolerance, sample size and test oracle before any measurement.

No Rust changes.
docs(adr): ADR 125 D13 storage layout from the M1 math note (v̂-only global KV, f16 sliding ring with f32 delta shifts); record the decode window bug
Some checks failed
CI / test-session-platform (pull_request) Has been cancelled
CI / test-sokar (pull_request) Has been cancelled
CI / check-seshat (pull_request) Has been cancelled
CI / check-akh-medu (pull_request) Has been cancelled
CI / test-akh-medu (pull_request) Has been cancelled
CI / docker-seshd (pull_request) Has been cancelled
CI / docker-sokard (pull_request) Has been cancelled
CI / docker-akh-transcripts (pull_request) Has been cancelled
CI / publish-chart (pull_request) Has been cancelled
CI / platform-images-home (pull_request) Has been cancelled
CI / platform-images-core (pull_request) Has been cancelled
CI / platform-images-daemons (pull_request) Has been cancelled
CI / platform-images-fleet (pull_request) Has been cancelled
CI / platform-images-collect (pull_request) Has been cancelled
73d89da10d
docs(clm): CLM-R1 implementation brief (Gemma 4 KV store, decode-window fix, chunked prefill, M1 parity harness)
All checks were successful
CI / test-sokar (pull_request) Successful in 12m53s
CI / check-seshat (pull_request) Successful in 11m25s
CI / test-akh-medu (pull_request) Successful in 17m0s
CI / test-session-platform (pull_request) Successful in 41m42s
CI / check-akh-medu (pull_request) Successful in 50m42s
CI / docker-sokard (pull_request) Successful in 1h1m45s
CI / platform-images-home (pull_request) Successful in 3m38s
CI / publish-chart (pull_request) Successful in 1h23m50s
CI / platform-images-daemons (pull_request) Successful in 34m5s
CI / platform-images-core (pull_request) Successful in 1h12m31s
CI / docker-akh-transcripts (pull_request) Successful in 2h49m30s
CI / docker-seshd (pull_request) Successful in 3h2m20s
CI / platform-images-fleet (pull_request) Successful in 9m10s
CI / platform-images-collect (pull_request) Successful in 14m3s
5728a46f68
docs(clm): CLM-2 implementation brief (clm arm, per-round reconcile, persistence, telemetry)
Some checks failed
CI / check-seshat (pull_request) Successful in 8m8s
CI / check-akh-medu (pull_request) Successful in 8m4s
CI / test-sokar (pull_request) Successful in 16m33s
CI / docker-seshd (pull_request) Successful in 9m44s
CI / docker-akh-transcripts (pull_request) Successful in 9m30s
CI / docker-sokard (pull_request) Successful in 11m10s
CI / test-session-platform (pull_request) Successful in 34m41s
CI / platform-images-home (pull_request) Has been cancelled
CI / platform-images-core (pull_request) Has been cancelled
CI / platform-images-daemons (pull_request) Has been cancelled
CI / platform-images-fleet (pull_request) Has been cancelled
CI / platform-images-collect (pull_request) Has been cancelled
CI / publish-chart (pull_request) Has been cancelled
CI / test-akh-medu (pull_request) Has been cancelled
437cff068e
docs(adr): ADR 125 D13 KV budget B(C) per M1a (0.82 GB @ C=256), bf16 cap, strict window; plan CLM-R1 exit
Some checks failed
CI / test-akh-medu (pull_request) Has been cancelled
CI / docker-seshd (pull_request) Has been cancelled
CI / docker-sokard (pull_request) Has been cancelled
CI / docker-akh-transcripts (pull_request) Has been cancelled
CI / publish-chart (pull_request) Has been cancelled
CI / platform-images-home (pull_request) Has been cancelled
CI / platform-images-core (pull_request) Has been cancelled
CI / platform-images-daemons (pull_request) Has been cancelled
CI / platform-images-fleet (pull_request) Has been cancelled
CI / platform-images-collect (pull_request) Has been cancelled
CI / check-akh-medu (pull_request) Has been cancelled
CI / test-sokar (pull_request) Has been cancelled
CI / check-seshat (pull_request) Has been cancelled
CI / test-session-platform (pull_request) Has been cancelled
9dd0a1d3dc
docs(adr): ADR 125 — protected suffix, overflow compacts over the live log, journal table (CLM-2 review R3/R4/R6)
Some checks failed
CI / test-session-platform (pull_request) Has been cancelled
CI / test-sokar (pull_request) Has been cancelled
CI / check-seshat (pull_request) Has been cancelled
CI / check-akh-medu (pull_request) Has been cancelled
CI / test-akh-medu (pull_request) Has been cancelled
CI / docker-seshd (pull_request) Has been cancelled
CI / docker-sokard (pull_request) Has been cancelled
CI / docker-akh-transcripts (pull_request) Has been cancelled
CI / publish-chart (pull_request) Has been cancelled
CI / platform-images-home (pull_request) Has been cancelled
CI / platform-images-core (pull_request) Has been cancelled
CI / platform-images-daemons (pull_request) Has been cancelled
CI / platform-images-fleet (pull_request) Has been cancelled
CI / platform-images-collect (pull_request) Has been cancelled
bd0e0fc499
docs(clm): CLM-4 brief — AkhContextBench task families, pre-registered splits and stats (M1 §5–§6), runner, sealed one-shot
Some checks failed
CI / check-akh-medu (pull_request) Has been cancelled
CI / test-akh-medu (pull_request) Has been cancelled
CI / docker-seshd (pull_request) Has been cancelled
CI / docker-sokard (pull_request) Has been cancelled
CI / docker-akh-transcripts (pull_request) Has been cancelled
CI / publish-chart (pull_request) Has been cancelled
CI / platform-images-home (pull_request) Has been cancelled
CI / platform-images-core (pull_request) Has been cancelled
CI / platform-images-daemons (pull_request) Has been cancelled
CI / platform-images-fleet (pull_request) Has been cancelled
CI / platform-images-collect (pull_request) Has been cancelled
CI / check-seshat (pull_request) Has been cancelled
CI / test-sokar (pull_request) Has been cancelled
CI / test-session-platform (pull_request) Has been cancelled
930de956f1
docs(plan): CLM-R1b (Q8_0 Vulkan/HIP) slice; CLM-R2 math inputs incl. M1b
Some checks failed
CI / test-session-platform (pull_request) Has been cancelled
CI / test-sokar (pull_request) Has been cancelled
CI / check-seshat (pull_request) Has been cancelled
CI / check-akh-medu (pull_request) Has been cancelled
CI / test-akh-medu (pull_request) Has been cancelled
CI / docker-seshd (pull_request) Has been cancelled
CI / docker-sokard (pull_request) Has been cancelled
CI / docker-akh-transcripts (pull_request) Has been cancelled
CI / publish-chart (pull_request) Has been cancelled
CI / platform-images-home (pull_request) Has been cancelled
CI / platform-images-core (pull_request) Has been cancelled
CI / platform-images-daemons (pull_request) Has been cancelled
CI / platform-images-fleet (pull_request) Has been cancelled
CI / platform-images-collect (pull_request) Has been cancelled
f5150d53a7
docs(adr): ADR 125 D13 shift caps 52/6 and conventional f32 RoPE table per M1b
Some checks failed
CI / docker-seshd (pull_request) Has been cancelled
CI / docker-sokard (pull_request) Has been cancelled
CI / docker-akh-transcripts (pull_request) Has been cancelled
CI / publish-chart (pull_request) Has been cancelled
CI / platform-images-home (pull_request) Has been cancelled
CI / platform-images-core (pull_request) Has been cancelled
CI / platform-images-daemons (pull_request) Has been cancelled
CI / platform-images-fleet (pull_request) Has been cancelled
CI / platform-images-collect (pull_request) Has been cancelled
CI / check-seshat (pull_request) Has been cancelled
CI / test-session-platform (pull_request) Has been cancelled
CI / test-akh-medu (pull_request) Has been cancelled
CI / test-sokar (pull_request) Has been cancelled
CI / check-akh-medu (pull_request) Has been cancelled
47cd98d42c
docs(clm): CLM-R2 brief — ContextArena, KvOp execution on Gemma 4 store, ResidencePolicy, exactness/drift oracles (dispatch gated on R1 certification)
Some checks failed
CI / test-session-platform (pull_request) Has been cancelled
CI / test-sokar (pull_request) Has been cancelled
CI / check-seshat (pull_request) Has been cancelled
CI / check-akh-medu (pull_request) Has been cancelled
CI / test-akh-medu (pull_request) Has been cancelled
CI / docker-seshd (pull_request) Has been cancelled
CI / docker-sokard (pull_request) Has been cancelled
CI / docker-akh-transcripts (pull_request) Has been cancelled
CI / publish-chart (pull_request) Has been cancelled
CI / platform-images-home (pull_request) Has been cancelled
CI / platform-images-core (pull_request) Has been cancelled
CI / platform-images-daemons (pull_request) Has been cancelled
CI / platform-images-fleet (pull_request) Has been cancelled
CI / platform-images-collect (pull_request) Has been cancelled
eb297010d6
docs(clm): pause handoff 2026-10-06 — branch/PR state, open decisions, artifact locations, resume checklist
All checks were successful
CI / test-sokar (pull_request) Successful in 11m18s
CI / check-akh-medu (pull_request) Successful in 16m21s
CI / docker-seshd (pull_request) Successful in 10m36s
CI / check-seshat (pull_request) Successful in 20m2s
CI / publish-chart (pull_request) Successful in 12m17s
CI / test-akh-medu (pull_request) Successful in 24m46s
CI / test-session-platform (pull_request) Successful in 40m30s
CI / docker-sokard (pull_request) Successful in 37m21s
CI / platform-images-home (pull_request) Successful in 10m29s
CI / docker-akh-transcripts (pull_request) Successful in 45m55s
CI / platform-images-core (pull_request) Successful in 1h12m0s
CI / platform-images-daemons (pull_request) Successful in 1h59m34s
CI / platform-images-fleet (pull_request) Successful in 1h22m22s
CI / platform-images-collect (pull_request) Successful in 3h10m8s
d686d4fdec
All checks were successful
CI / test-sokar (pull_request) Successful in 11m18s
CI / check-akh-medu (pull_request) Successful in 16m21s
CI / docker-seshd (pull_request) Successful in 10m36s
CI / check-seshat (pull_request) Successful in 20m2s
CI / publish-chart (pull_request) Successful in 12m17s
CI / test-akh-medu (pull_request) Successful in 24m46s
CI / test-session-platform (pull_request) Successful in 40m30s
CI / docker-sokard (pull_request) Successful in 37m21s
CI / platform-images-home (pull_request) Successful in 10m29s
CI / docker-akh-transcripts (pull_request) Successful in 45m55s
CI / platform-images-core (pull_request) Successful in 1h12m0s
CI / platform-images-daemons (pull_request) Successful in 1h59m34s
CI / platform-images-fleet (pull_request) Successful in 1h22m22s
CI / platform-images-collect (pull_request) Successful in 3h10m8s
This pull request can be merged automatically.
This branch is out-of-date with the base branch
You are not authorized to merge this pull request.
View command line instructions

Checkout

From your project repository, check out a new branch and test the changes.
git fetch -u origin docs/context-language-model:docs/context-language-model
git switch docs/context-language-model

Merge

Merge the changes and update on Forgejo.

Warning: The "Autodetect manual merge" setting is not enabled for this repository, you will have to mark this pull request as manually merged afterwards.

git switch main
git merge --no-ff docs/context-language-model
git switch docs/context-language-model
git rebase main
git switch main
git merge --ff-only docs/context-language-model
git switch docs/context-language-model
git rebase main
git switch main
git merge --no-ff docs/context-language-model
git switch main
git merge --squash docs/context-language-model
git switch main
git merge --ff-only docs/context-language-model
git switch main
git merge docs/context-language-model
git push origin main
Sign in to join this conversation.
No reviewers
No labels
follow-up
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
toasterson/akh-medu!547
No description provided.