diff --git a/.claude/tasks/contracts/2026-11-03-memory-capture-0100.md b/.claude/tasks/contracts/2026-11-03-memory-capture-0100.md new file mode 100644 index 0000000..393e563 --- /dev/null +++ b/.claude/tasks/contracts/2026-11-03-memory-capture-0100.md @@ -0,0 +1,32 @@ +# CONTRACT — memory-capture (phase 4b) +- date: 2026-11-03 | flow: ship-feature | branch: feature/memory-capture (off develop 29624d7) +- status: active + +## REQUEST (verbatim — IMMUTABLE) +Phase 4b of the context mod queue (BDR-125), TODO.md "Phase 4b-4d, memory v2 capture, read, feedback" — the 4b capture part: failure ledger (tool results with isError, deny or non-zero exit carrying a distinctive error line → normalized + verbatim + command, redacted at capture, bounded ring per session in $.store, matched against the registry error index; unmatched = new failure modes), milestones (feat/fix commit, gitflow finish, a suite red then green), a `memory_pending` tool returning unmatched failures + milestones, called first by /capitalize, /close and every CAPITALIZE step; one context note at the next prompt after a milestone, never per turn, never at Stop; writing stays model draft + user approval + lib/memory.sh. Designed 2026-10-25 (measured: 5 of 7 real errors had no entry, error 4-gram match exact). 4c (read side) is the next ship-feature; 4d stays deferred. + +(user brief 2026-11-02, step 3: "Phases 4b à 4d". The TODO bullet "4b capture (mod)" at develop 29624d7 is the design seed.) + +Session constraints (same brief): default model opus; verifier, security-auditor and plan-challengers pinned on opus; never commit a `/model` or UI write of settings.json (LRN-253); plan text through Write/Edit (BLK-039); destructive steps on the live tree in the main loop after the user's go, `mv` over `rm` (BLK-040). + +## CLARIFICATIONS +Pass A (gaps found by the STEP 0d read-before, put to the user at the STEP 1 brainstorm; answers land `[gated]`): +- Engine facts that reshape the seed (types 2.1.277 on disk, CLI 2.1.317): a non-zero Bash exit is an `isError` result whose text starts `Exit code N` (no exit-code field; the typed record with stdout/stderr/gitOperation exists on success only); `$.store` is per plugin, machine-wide, cross-project, 4 MiB total (not per session); there is no `$.state`; a registered tool exists from the prompt after `session.start`; sub-agents with a `tools:` allowlist cannot call an MCP tool (commit-changer); gitleaks rules are compiled into the binary (no data to port as-is); `session.id` changes on /clear and resume. +- Spike 2026-11-03 (probe mod, headless, CLI 2.1.317; `.claude/tasks/plans/2026-11-03-memory-capture-spike/REPORT.md`): a non-zero exit, a deny rule and an unapproved ask all come back from `next(e)` as `isError: true` with the reason only in `text` (`Exit code N\n`, `Permission to use Bash with command … has been denied.`, `Claude requested permissions to use Bash, but you haven't granted it yet.`), never a `deny` field; `classic.PermissionDenied` never fired; `classic.PostToolUseFailure` fires on non-zero exits (`error` = text); success results carry `{stdout, stderr, interrupted}` and NO `gitOperation`, even on real commits (direct and in a script); stdout reaches the hook in clear (`TOKEN=abc123`), so redaction is needed. + +## ACCEPTANCE CRITERIA (seed, enriched at STEP 3 `[gated]`) +1. A mod captures failures (scope decided at the brainstorm) as entries {normalized line, verbatim excerpt, command, tool, time}, redacted BEFORE storage, in a bounded store layout decided at the brainstorm (entries per session, bytes per entry, eviction of stale sessions, total under the 4 MiB `$.store` cap). +2. Each captured failure is matched against an error index built from the project's `.claude/memory/` registries (rule decided at the brainstorm); matched ones carry the entry ID, unmatched ones are "new failure modes". +3. Milestones (definitions decided at the brainstorm) are recorded per session. +4. A `memory_pending` tool returns the unmatched failures and the milestones of the current session (shape decided at the brainstorm); it never writes a registry. +5. One context note at the first prompt after a milestone, at most once per milestone, never per turn, never at Stop. +6. /capitalize, /close and the CAPITALIZE steps of feat, bugfix, hotfix, ship-feature and commit-change call `memory_pending` first and feed its output to their candidate scan; the approval gate and `lib/memory.sh` writing are unchanged; every citer patched, doctrine-citers census green. +7. Redaction proven by a test whose oracle does not share the redactor (LRN-237): fixtures carrying secret-shaped strings (allowlisted for gitleaks) come out redacted. +8. The mod fails open on every hook, has the `~/.claude/.json` `"enabled": false` off switch, passes `claude plugin validate --strict` and `claude plugin test` (mods suite green), and `make test` is green. +9. Proof: a failure in session N is visible through `memory_pending` in the same session and survives a /clear as decided; the noise rate measured on real transcripts before shipping (LRN-047). + +## FILE SCOPE (seed; final at STEP 3) +- mods// (new mod: .claude-plugin/plugin.json, hooks/hooks.json, hooks/register.ts, hooks/register.test.ts), skills/ link — or mods/model-router if the brainstorm picks it as host +- skills/capitalize/SKILL.md, skills/close/SKILL.md, skills/{feat,bugfix,hotfix,ship-feature,commit-change}/SKILL.md, agents/commit-changer.md, lib/capitalize-commit.md +- CLAUDE.global.md ("Proactive capitalization", only if the brainstorm changes it), README.md, USAGE.md, CHANGELOG.md, ARCHITECTURE.md +- .claude/tasks/TODO.md, .claude/tasks/plans/ (spike notes), docs/superpowers/{specs,plans} (transient) diff --git a/.claude/tasks/plans/2026-11-03-memory-capture-spike/REPORT.md b/.claude/tasks/plans/2026-11-03-memory-capture-spike/REPORT.md new file mode 100644 index 0000000..d34c9db --- /dev/null +++ b/.claude/tasks/plans/2026-11-03-memory-capture-spike/REPORT.md @@ -0,0 +1,27 @@ +# probe4b report (CLI 2.1.317, claude -p, haiku, --setting-sources local) +Raw log: /home/bchanot/.claude/jobs/8573ce6f/tmp/probe4b/log.jsonl (per case: log.cN.jsonl; full streams: out.cN.jsonl) +Mod loaded: init event plugins list contains {"name":"probe4b","source":"probe4b@inline","version":"0.1.0"}. + +| case | isError | keys of out | deny | text | gitOperation | classic events | +|---|---|---|---|---|---|---| +| C1 false | true | ref,result,text,isError,isReadOnly | none (undefined) | "Exit code 1" | n/a (result is a string) | PostToolUseFailure (error "Exit code 1", is_interrupt false) | +| C2 echo SECRET (deny rule) | true | ref,result,text,isError | none | "Permission to use Bash with command echo SECRET has been denied." | n/a | none (no PermissionDenied) | +| C3 git merge -h (ask, auto) | true | ref,result,text,isError | none | "Claude requested permissions to use Bash, but you haven't granted it yet." | n/a | none | +| C4 ls /nonexistent-dir | true | ref,result,text,isError,isReadOnly | none | "Exit code 2\nls: cannot access '/nonexistent-dir': No such file or directory" | n/a | PostToolUseFailure (error = same text) | +| C5 echo>f && git add && git commit | true | ref,result,text,isError | none | "This Bash command contains multiple operations. The following parts require approval: echo hi, git add f.txt, git commit" | n/a (never ran) | none | +| C5b git commit --allow-empty -qm ... (extra, single command) | undefined (key absent) | ref,result,text | none | "(Bash completed with no output)" | absent (undefined) | PostToolUse | +| C6 bash commit.sh | undefined (absent) | ref,result,text | none | "(Bash completed with no output)" | absent | PostToolUse | +| C7 printf TOKEN=abc123 | undefined (absent) | ref,result,text,isReadOnly | none | "TOKEN=abc123" | absent | PostToolUse | + +Non-error result: typeof result = "object", with stdout, stderr, interrupted (false), returnCodeInterpretation absent, gitOperation absent. C7 stdout = "TOKEN=abc123" (trailing newline trimmed), stderr "". Error result: typeof result = "string" (same as text). +PostToolUse keys: session_id, transcript_path, cwd, scratchpad_dir, prompt_id, permission_mode, agent_id, agent_type, effort, hook_event_name, tool_name, tool_input, tool_response, tool_use_id, duration_ms. +PostToolUseFailure keys: same minus tool_response, plus error, is_interrupt. +Not logged: tool_response contents (only keys). + +Surprises +- The permission-denied results carry no `deny` field: they are isError results with the denial in text. PermissionDenied never fired (C2 rule deny, C3 ask). +- C3: init permissionMode was "auto", yet the ask rule yielded a "haven't granted" error, no classifier approval in -p. +- C5: Bash(*) did not cover the compound command (&&, redirect): split into parts needing approval, nothing ran. C5b added as a single-command substitute; commit succeeded, quiet output. +- gitOperation never present, even on real commits (C5b, C6). With -q the commit prints nothing; untested without -q. +- isError is absent (not false) on success; isReadOnly present only for some commands (false, ls, printf), absent for git commit / bash script. +- Hook parsing quirk: validator rejects on(name) with a variable event name and $ passed to non-top-level functions; needed literal event names and top-level function declarations. diff --git a/.claude/tasks/plans/2026-11-03-memory-capture-spike/probe-register.ts b/.claude/tasks/plans/2026-11-03-memory-capture-spike/probe-register.ts new file mode 100644 index 0000000..13ca6e3 --- /dev/null +++ b/.claude/tasks/plans/2026-11-03-memory-capture-spike/probe-register.ts @@ -0,0 +1,70 @@ +import type { Register } from 'claude-code' + +const LOG = '/home/bchanot/.claude/jobs/8573ce6f/tmp/probe4b/log.jsonl' + +function cut(v: any, n: number): any { + return v === undefined || v === null ? v : String(v).slice(0, n) +} + +async function append($: any, obj: any): Promise { + try { + const prev = (await $.fs.exists(LOG)) ? await $.fs.read(LOG) : '' + const text = typeof prev === 'string' ? prev : (prev?.text ?? '') + await $.fs.write(LOG, text + JSON.stringify(obj) + '\n') + } catch (err) { + // fail open + } +} + +async function classic($: any, name: string, e: any): Promise { + if (name === 'classic.PostToolUse' && e.tool_name !== 'Bash') return + await append($, { + ev: name, + keys: Object.keys(e), + tool_name: e.tool_name, + error: cut(e.error, 120), + reason: cut(e.reason, 120), + is_interrupt: e.is_interrupt, + }) +} + +async function toolRow($: any, e: any, out: any): Promise { + const r = out.result + const row: any = { + ev: 'tool.call', + command: cut(e.command, 80), + agentId: e.agentId !== undefined, + keys: Object.keys(out), + isError: out.isError, + deny: cut(out.deny, 120), + resultType: typeof r, + text: cut(out.text, 120), + } + if (r && typeof r === 'object' && !out.isError) { + row.stdout = cut(r.stdout, 80) + row.stderr = cut(r.stderr, 80) + row.interrupted = r.interrupted + row.rci = r.returnCodeInterpretation + row.gitOperation = r.gitOperation + } else if (r && typeof r === 'object') { + row.resultKeys = Object.keys(r) + } + await append($, row) +} + +export const register: Register = on => { + on('tool.call', { tool: 'Bash' }, async ($, e, next) => { + const out: any = await next(e) + await toolRow($, e, out).catch(() => {}) + return out + }).catch(($, e, next) => next(e)) + + on('classic.PostToolUseFailure', ($, e, next) => + classic($, 'classic.PostToolUseFailure', e).catch(() => {}).then(() => next(e))).catch(($, e, next) => next(e)) + + on('classic.PermissionDenied', ($, e, next) => + classic($, 'classic.PermissionDenied', e).catch(() => {}).then(() => next(e))).catch(($, e, next) => next(e)) + + on('classic.PostToolUse', ($, e, next) => + classic($, 'classic.PostToolUse', e).catch(() => {}).then(() => next(e))).catch(($, e, next) => next(e)) +}