docs(spec): model routing — reflection inline / execution sonnet (design)
This commit is contained in:
@@ -0,0 +1,143 @@
|
|||||||
|
# Model routing — reflection inline (big model) / execution pinned (Sonnet) — design
|
||||||
|
|
||||||
|
**Date**: 2026-07-15 · **Status**: approved (user, 2026-07-15) · **Branch**: `feature/model-routing`
|
||||||
|
**Lifecycle**: transient planning artifact (BDR-065) — committed during the run, deleted post-merge.
|
||||||
|
|
||||||
|
## Principle
|
||||||
|
|
||||||
|
The session model is assumed to be a big reasoning model (Fable 5, or Opus when
|
||||||
|
Fable is unavailable). Everything that **thinks** — brainstorming, planning,
|
||||||
|
technical decisions, audits, loop decisions — runs INLINE in the main
|
||||||
|
conversation, or in subagents that inherit the session model. Everything that
|
||||||
|
**executes** a ready-made plan — writing code, applying fix bundles, commits,
|
||||||
|
deliverable rendering — runs on Sonnet-pinned subagents. A blocking gate
|
||||||
|
enforces the "session = big model" assumption at the entry of every reflection
|
||||||
|
orchestrator.
|
||||||
|
|
||||||
|
User verdicts baked in (2026-07-14/15):
|
||||||
|
- Scope = hybrid: ship-feature/init-project execution → sonnet; `/feat`
|
||||||
|
re-architected (plan inline → dispatch executor); bugfix/hotfix stay fully
|
||||||
|
inline (BDR-050 conserved for them).
|
||||||
|
- Gate = BLOCKING, not advisory.
|
||||||
|
- Audit agents inherit the session model (no opus pin); the gate extends to
|
||||||
|
audit orchestrators.
|
||||||
|
- verifier + security-auditor KEEP `model: sonnet` (job9 decision confirmed).
|
||||||
|
- client-handover-writer → sonnet (requires converting its inline-load to a
|
||||||
|
true dispatch; human gates relocate to the main loop).
|
||||||
|
|
||||||
|
## 1. Blocking model gate
|
||||||
|
|
||||||
|
New `lib/model-check.sh`: resolves the current session model from
|
||||||
|
`settings.json` (physical path resolution — LRN-023 class), normalizes
|
||||||
|
(`claude-fable-5[1m]` → fable, `claude-opus-*` → opus, sonnet, haiku), prints
|
||||||
|
`big|small|unknown`. Exit 0 = big, 2 = small, 3 = unknown.
|
||||||
|
|
||||||
|
New `lib/model-gate.md` snippet (same include pattern as `lib/design-gate.md`):
|
||||||
|
run the check; `small` → STOP the skill: "session model is <X> — reflection
|
||||||
|
requires Fable/Opus. Switch with /model, then relaunch." `unknown` →
|
||||||
|
fail-visible: show the raw value, ask the user to confirm or abort (BDR-025
|
||||||
|
doctrine — unknown never silently passes).
|
||||||
|
|
||||||
|
Wired as a STEP 0 line in the reflection orchestrators:
|
||||||
|
`ship-feature, init-project, feat, bugfix, onboard, seo, geo, web-validate,
|
||||||
|
harden, audit-delta, tour, code-clean`.
|
||||||
|
NOT wired in: `hotfix` (trivial by definition), `commit-change`, `doc`,
|
||||||
|
`status`, `release-candidate`.
|
||||||
|
|
||||||
|
Caveats to prove at implementation time:
|
||||||
|
- `/model` mid-session rewrites settings.json (LRN-098 observed it once —
|
||||||
|
re-prove with a live flip-test before trusting the source).
|
||||||
|
- The helper itself must be flip-tested (LRN-096: an unproven guard is a
|
||||||
|
vacuous guard).
|
||||||
|
|
||||||
|
## 2. Frontmatter pins (`agents/*.md`)
|
||||||
|
|
||||||
|
| Agent | Before | After | Rationale |
|
||||||
|
|---|---|---|---|
|
||||||
|
| feater | (inherit) | **sonnet** | executor as subagent: seo/geo L1 applier + new /feat dispatch |
|
||||||
|
| hotfixer | (inherit) | **sonnet** | L1 applier (seo/geo/web-validate); /hotfix inline unaffected (pin inert on inline load) |
|
||||||
|
| client-handover-writer | opus | **sonnet** | deliverable executor; pin becomes EFFECTIVE only with §5 dispatch conversion (today's opus pin is inert — the agent is inline-loaded) |
|
||||||
|
| analyzer | haiku | **(none — inherit)** | analysis feeds the plan = reflection; runs big via the session model |
|
||||||
|
| verifier | sonnet | keep | F1 confirmed (job9) |
|
||||||
|
| security-auditor | sonnet | keep | F1 confirmed (job9) |
|
||||||
|
| seo-analyzer, geo-analyzer, validator-analyzer | (inherit) | keep (inherit) | audit = reflection = session model; covered by the gate |
|
||||||
|
| code-cleaner | (inherit) | keep (inherit) | audit phase = reflection; fixes hand off to refactorer (sonnet) via CODE-CLEAN-SCOPE.md (job9 H1) |
|
||||||
|
| doc-syncer, onboarder, scaffolder, refactorer, interviewer, plugin-advisor | sonnet | keep | workers/executors |
|
||||||
|
| status-reporter | haiku | keep | mechanical collector |
|
||||||
|
| bugfixer, commit-changer | (inherit) | keep | inline-only playbooks — a pin would be inert |
|
||||||
|
|
||||||
|
## 3. `/feat` re-architecture (partial supersede of BDR-050 — feat only)
|
||||||
|
|
||||||
|
`skills/feat/SKILL.md` absorbs the reflection: analyze-before-plan, design
|
||||||
|
gate, MINI-PLAN, contract (`lib/contract-interview.md`) — all inline. Then
|
||||||
|
dispatches `Agent(subagent_type="feater")` (sonnet via pin) with: the
|
||||||
|
contract, the plan, the branch name, repo conventions.
|
||||||
|
|
||||||
|
`agents/feater.md` is rewritten as a pure executor: implement the plan to the
|
||||||
|
letter, run project checks, commit (no attribution trailers), return a
|
||||||
|
structured summary. No user interaction inside feater (subagents cannot ask) —
|
||||||
|
every decision must be closed pre-dispatch.
|
||||||
|
|
||||||
|
The verify-secure loop moves out of feater.md into the /feat main loop
|
||||||
|
(LRN-083 invariant: loop decisions live in the main loop): fresh verifier →
|
||||||
|
ECARTS → re-dispatch feater with the verdict deltas, bounded 3×; then the
|
||||||
|
security gate. Escalation paths unchanged.
|
||||||
|
|
||||||
|
## 4. SDD execution pinned (ship-feature STEP 4, init-project STEP 8)
|
||||||
|
|
||||||
|
One instruction line in each SKILL.md: every implementation subagent
|
||||||
|
dispatched under `superpowers:subagent-driven-development` MUST carry
|
||||||
|
`model: "sonnet"` in the Agent call. No fork of the superpowers skill — the
|
||||||
|
main loop emits the Agent calls and controls the params.
|
||||||
|
|
||||||
|
## 5. client-handover conversion (inline-load → true dispatch)
|
||||||
|
|
||||||
|
`skills/client-handover/SKILL.md`: collect params inline (URL, logo, options),
|
||||||
|
then `Agent(subagent_type="client-handover-writer")` — the sonnet pin becomes
|
||||||
|
effective. Human gates (per-axis threshold escalation, overrides) RELOCATE to
|
||||||
|
the main loop: the writer returns a structured `GATE NEEDED` status instead of
|
||||||
|
asking; the dispatcher asks the user and re-dispatches (or continues via
|
||||||
|
SendMessage) with the decision. `AskUserQuestion` is removed from the writer's
|
||||||
|
tools.
|
||||||
|
|
||||||
|
OPEN VERIFY POINT: the writer's own nested dispatches (seo/harden re-runs as
|
||||||
|
general-purpose subagents) — verify at implementation what nested children
|
||||||
|
inherit (session model vs parent model). If they inherit the sonnet parent,
|
||||||
|
the re-run audits violate the principle → force the model explicitly in those
|
||||||
|
nested dispatches or lift them to the main loop.
|
||||||
|
|
||||||
|
## 6. web-validate fixes → L1 applier
|
||||||
|
|
||||||
|
STEP 3 stops applying fixes via inline Edit; dispatches `hotfixer` (sonnet)
|
||||||
|
with the fix bundle — same pattern as seo/geo (BDR-061 alignment).
|
||||||
|
|
||||||
|
## 7. Memory / doc / tests
|
||||||
|
|
||||||
|
- New BDR: model-routing principle (reflection inline big / executors sonnet /
|
||||||
|
blocking gate); partial supersede of BDR-050 (feat only); records F1
|
||||||
|
(verifier/security stay sonnet) and the analyzer haiku→inherit change.
|
||||||
|
- README: agent-model table refresh. CHANGELOG Unreleased entry.
|
||||||
|
- Tests: flip-tests for `model-check.sh` (fable[1m] / opus / sonnet / garbage
|
||||||
|
fixtures); gate STOP proven on a small-model fixture (LRN-096); /feat smoke
|
||||||
|
on a throwaway repo (LRN-079): plan inline → dispatch carries sonnet →
|
||||||
|
verify loop decided in main loop; grep census: no executor dispatch without
|
||||||
|
an effective pin.
|
||||||
|
|
||||||
|
## Out of scope / accepted deviations
|
||||||
|
|
||||||
|
- `/doc` and `/commit-change` stay inline on the session model (judgment and
|
||||||
|
execution interleaved; converting them buys little). Revisit under quota
|
||||||
|
pressure.
|
||||||
|
- bugfix/hotfix fully inline (BDR-050 conserved).
|
||||||
|
- No per-agent "fable-else-opus" fallback exists in the harness — the session
|
||||||
|
model IS the fallback mechanism; the gate is its backstop.
|
||||||
|
|
||||||
|
## Risks
|
||||||
|
|
||||||
|
- Model strings in settings.json may change shape with CC updates →
|
||||||
|
model-check must return `unknown` (fail-visible), never guess.
|
||||||
|
- feater as a subagent loses main-conversation context → the plan becomes the
|
||||||
|
contract; weak plans cost verify-loop iterations. Mitigation:
|
||||||
|
contract-interview stays mandatory in /feat.
|
||||||
|
- Nested model inheritance under client-handover-writer unknown → §5 verify
|
||||||
|
point.
|
||||||
Reference in New Issue
Block a user