test(census): seo/geo agent⇄dispatcher contract locks (C1 P1, pre-reword)
71 locks, flip-proven (7 scratch mutations → 7 FAILs): judge verdict grammar, FIX BUNDLE + READY-TO-APPLY sentinel, signals handoff, ALL STEP headers (interiors included, conf#5), collect report, bundle item fields parsed by L1 appliers, score labels (BDR-010/LRN-011), scoring blocks, trajectory, envelope keys. Locks existing state — reword commits must keep this green. + plan v3 (challenged 3 lenses FATAL/FATAL/CONCERNS + 1 confirmation pass FATAL(9), every BLOCKER closed by a named change, §5bis record) + directive-language inventory annex (analyzer report).
This commit is contained in:
@@ -0,0 +1,174 @@
|
||||
# ANNEX — directive-language inventory (analyzer report, 2026-07-30)
|
||||
|
||||
Produced by a read-only analyzer dispatch over agents/seo-analyzer.md
|
||||
(1528 l) + agents/geo-analyzer.md (1106 l), cross-referenced against
|
||||
every consumer. Referenced by the C1 plan (same folder, -1402.md).
|
||||
|
||||
## 0. Token census (raw)
|
||||
|
||||
| Token family | seo-analyzer.md | geo-analyzer.md |
|
||||
|---|---|---|
|
||||
| MUST/must | 12 | 6 |
|
||||
| MANDATORY/mandatory | 8 | 4 |
|
||||
| NEVER/never | 42 | 33 |
|
||||
| ALWAYS/always | 6 | 1 |
|
||||
| CRITICAL/critical | 3 | 1 |
|
||||
| Do NOT / do not | 24 | 8 |
|
||||
| verbatim | 6 | 3 |
|
||||
| STOP | 3 | 4 |
|
||||
| refuse/REFUSE | 6 | 4 |
|
||||
| ⚠️ blocks | 0 | 0 |
|
||||
|
||||
## 1. Test locks on these files (complete list — 6 per file)
|
||||
|
||||
model-routing.test.sh:67-68 `model: opus` (both) · :150-157 `MODE:
|
||||
collect|judge|template` + `COLLECTION COMPLETE` (both) ·
|
||||
seo-data.test.sh:538-540 `fetch.sh crux` / `fetch.sh queries` /
|
||||
`Performance GSC` (seo) · :542-543 `fetch.sh schema_gen` /
|
||||
`fetch.sh content_quality` (geo).
|
||||
NOT locked by any test: READY-TO-APPLY sentinel, envelope headings,
|
||||
score-block shapes, JUDGE-ERROR strings, batch labels — contracts by
|
||||
consumer only; a rewrite can break them silently and make test stays
|
||||
green. Sibling dispatcher locks: model-routing.test.sh:159-166.
|
||||
Stale line-number comments (no enforcement): lib/url-guard.sh:9,
|
||||
url-guard.test.sh:20, source-scope.sh:25, seo-data/README.md:196/309,
|
||||
drift.py:4, linkgraph.py:4 — all already drifted.
|
||||
|
||||
## 2. Format contract (artifact → consumer) — FREEZE SET
|
||||
|
||||
seo-analyzer: signals `.audit/seo-signals-<RUNID>.md` (+clean/load sites
|
||||
in /seo) · `COLLECTION COMPLETE — RUNID: <RUNID>` terminal ·
|
||||
`COLLECT REPORT` w/ `STATUS: DONE|BLOCKED` · `SEO JUDGE — VERDICT:
|
||||
ERROR(<reason>)` · judge report forwarded verbatim to template ·
|
||||
`SEO SCORING (<depth>)` block w/ `COVERAGE SOURCE:`/`COVERAGE LIVE :`
|
||||
+ 7 axes + `SEO GLOBAL (weighted): XX.X/20` (score.py:26-37 mirrors
|
||||
weights) · `TRAJECTORY TO 17/20 (code-only)` · `fetch.sh score` JSON
|
||||
(`axes.{technical,on-page,seo-local,off-page,social,competitive,legal}`,
|
||||
severities `critique|haute|moyenne|basse`, `status:"na"`) · `FIX PLAN (N
|
||||
findings total)` + BATCH A…F (tier-mapping tolerant) · `## FIX BUNDLE
|
||||
(for dispatcher)` + `### AUTO/### GATED/### USER ACTIONS` + item fields
|
||||
`id: applier: files: concern: current: expected:` · sentinel `READY TO
|
||||
APPLY — awaiting dispatcher confirmation` (also reused by /harden:366) ·
|
||||
envelope `SEO AGENT RESULT` + `## SECTION FOR SEO.md §2…§6` + `## ENTRIES
|
||||
FOR SEO.md §0/§8/§9/§10/§11/§15` · `Automatisation possible avec:` per
|
||||
§11 entry · standalone `.claude/audits/SEO.md` w/ `**Score SEO** : XX.X
|
||||
/ 20` (client-handover-writer.md:344 labeled grep) + §0-§15 + Historique.
|
||||
geo-analyzer: same families with GEO names; envelope `GEO AGENT RESULT`
|
||||
+ `## SECTION FOR SEO.md §7` (7.1-7.6); `**Score GEO** : XX.X / 20`
|
||||
(handover parses it only inside SEO.md, allow_fallback=no); G1-G7
|
||||
batches (G1-G4/G6 AUTO · G5 GATED · G7 USER). Both: STEP NUMBERS are
|
||||
addressed by dispatchers (seo: 2-5/6-11/12-14; geo: 0-5/6-12/13-15;
|
||||
also depth-matrix.md:17-19,37) — renumbering re-points dispatch prompts.
|
||||
Engine interfaces: fetch.sh verbs {crux,queries,inspect,cannibal,
|
||||
sitemap,rendercheck,linkgraph,score,schema_gen,content_quality} ·
|
||||
url-guard.sh host|url · source-scope.sh findargs|list · resources/*.md.
|
||||
|
||||
## 3-4. Site classification counts
|
||||
|
||||
| | seo | geo | total |
|
||||
|---|---|---|---|
|
||||
| A machine-parsed contract | ~52 | ~41 | ~93 (12 test-locked) |
|
||||
| B safety/policy invariant | ~30 | ~31 | ~61 |
|
||||
| C process choreography | ~21 | ~12 | ~33 |
|
||||
| D other/domain-fact | ~20 | ~13 | ~33 |
|
||||
|
||||
### Class C sites — seo-analyzer.md (rewrite targets)
|
||||
:61 "First action." · :143-148 CMS-detect-before-edit ordering ·
|
||||
:208-210 "keep the two consistent" (runtime cross-file reconcile) ·
|
||||
:508 "run this BEFORE anything else in STEP 5" (ordering; the refusal
|
||||
rule itself is B) · :550-553 "Record the denominator BEFORE sampling"
|
||||
(ordering; honesty rule is B) · :602-604 "Sanity-check the grouping
|
||||
before trusting it" (self-verify) · :606-618 sampling-method essay ·
|
||||
:661-680 C1a 20-line rationale (rule itself is B at :1493-1501) ·
|
||||
:875 per-item method · :970-971 "Run it twice on the same file before
|
||||
publishing" (exact BDR-081 over-verification class) · :1147 "AUTO items
|
||||
are a commitment, not a suggestion." · :1149-1157 P0 CMS-plugin-first
|
||||
mandate · :1159-1162 P0 Bing mandate (dup of geo :777-786) · :1217 "Do
|
||||
not proceed to STEP 12 until this plan is printed." · :1260-1261 +
|
||||
:1342-1350 + :1502-1503 landing-page rule ×3 · :1309-1320 bundle
|
||||
completeness checklist (10 checkboxes self-audit) · :1504 "Preserve
|
||||
existing valid SEO." · :1522-1523 WebSearch-on-FULL extra-verify ·
|
||||
:1525-1526 "Transparency. Every automated change logged" (VESTIGIAL —
|
||||
agent applies nothing, pre-BDR-061).
|
||||
|
||||
### Class C sites — geo-analyzer.md
|
||||
:48 "copy these patterns" · :124 "First action." + :127-139 ask-block
|
||||
(unreachable when dispatched) · :230 conditional skip · :262-269 +
|
||||
:873 + :1063-1065 PERMISSIVE default ×3 · :360 ordering · :394 "20-50
|
||||
real customer questions (P0)" · :777-786 MANDATORY AI-index submission
|
||||
(dup of seo :1159-1162) · :811 "Consolidate EVERY finding" · :823
|
||||
"Print the plan before STEP 13" · :1102-1103 WebSearch extra-verify ·
|
||||
:1106 "Every automated change logged in §14" (VESTIGIAL; §15 log is
|
||||
dispatcher's per :959).
|
||||
|
||||
### Class B anchors (keep obligation, dedup emphasis)
|
||||
CWD/TARGET MISMATCH twins (seo :117-126 ≈ geo :173-181) · url-guard
|
||||
mandatory (seo :287-291 ≈ geo :273-277) · R2 refuse-to-score (seo
|
||||
:519-548, geo :548-557; BDR-072) · NAP direction rule (seo :801-812,
|
||||
geo :1073-1087; LRN-032-zenquality) · COVERAGE mandatory (seo
|
||||
:1110-1130, geo :725-729; LRN-133) · never-apply/L1 (BDR-061; LRN-105
|
||||
named-ban) · C1a build-output ban · no-invented-content/DGCCRF ·
|
||||
"Compute the scores, do not feel them (I7)" (BDR-073) · §14 mandatory
|
||||
disclosure lines (backlinks BDR-071, security headers I4) · honest
|
||||
llms.txt framing · cite-sources (LRN-131).
|
||||
|
||||
## 6. Duplication map (sweep ALL twins — LRN-113)
|
||||
|
||||
seo internal: never-apply ×4 (:1227-1234, :1352-1357, :1468-1472,
|
||||
:1527-1528) · landing-page ×3 (:1260, :1342, :1502) · shared-file
|
||||
discipline ×2 (:1254, :1486) · bundle self-containment ×2 (:1249,
|
||||
:1473) · COVERAGE ×4 (:438, :1000, :1096, :1110) · security-headers-
|
||||
not-scored ×3 (:281, :977, :994) · 30/70 ×3 (:397, :614, :1165) ·
|
||||
sentinel-verbatim ×3 (:1301, :1304, :1397).
|
||||
geo internal: PERMISSIVE ×3 · never-apply ×4 (:826-832, :842-848,
|
||||
:1031-1034, :1104-1105) · tier-mapping ×2 (:824, :850) ·
|
||||
content_quality-advisory ×2 (:584, :622) · shared-file ×2 (:858,
|
||||
:1047) · llms-honest ×2 (:337, :1066) · cite-sources ×2 (:17, :1089).
|
||||
Cross-agent twins (stay twins — both files dispatch standalone):
|
||||
CWD block · url-guard block · MODE DETECTION · MODE BOUNDARY · R2 ·
|
||||
COVERAGE · NAP rule · RULES section skeleton · C1a · automation rule ·
|
||||
Bing/AI-index action · CDN/WAF check.
|
||||
Agent↔dispatcher duplication (stays — dispatch prompt is per-run
|
||||
context, agent spec serves standalone/no-MODE paths): NAP ×4 total ·
|
||||
shared-file ×7 · security-headers ×5 · domain split · weights 80/20-
|
||||
75/25 · Historique · never-re-derive (test-locked dispatcher side).
|
||||
|
||||
## 7. Contradictions / ambiguities found
|
||||
|
||||
1. seo :1525-1526 + geo :1106 vestigial "automated change logged"
|
||||
(agent applies nothing; geo :959 says dispatcher fills §15).
|
||||
2. Ask-the-user blocks unreachable in dispatched path (seo :64-75,
|
||||
:88-112; geo :127-139, :153-168); /geo:41 states it outright.
|
||||
3. Collect boundary wording: agents "STEP 0-5 ONLY" vs /seo "STEP 2-5
|
||||
only (context replaces STEP 0-1)" — works by prompt override.
|
||||
4. geo judge does live work (sameAs curls :477-492, web_search) unlike
|
||||
pure-judgment seo judge — asymmetric split, by design.
|
||||
5. /harden imposes its own output contract (HARDEN.md, /100) the agent
|
||||
spec never acknowledges; keys on "NARROW-SCOPE" in dispatch prompt.
|
||||
6. "LRN-032" cite is ambiguous in THIS repo (local LRN-032 = different
|
||||
lesson; the NAP lesson is zenquality's registry) — keep the
|
||||
"zenquality" qualifier wherever cited.
|
||||
7. geo :376-377 uncited FAQ-citation-rate claim vs geo :1089-1097
|
||||
cite-sources rule (LRN-131 failure class).
|
||||
8. Score-label parse fragility: client-handover extract_score fallback
|
||||
greps FIRST X/20 in file — losing the `Score SEO` label would
|
||||
silently read `TRAJECTORY TO 17/20` as 17.0. (Latent, downstream.)
|
||||
9. GEO scoring has no deterministic engine (score.py covers SEO axes
|
||||
only) — BDR-073 binds only half the pair.
|
||||
|
||||
## 8. Binding memory (from the analyzer's read-before)
|
||||
|
||||
IN FORCE: BDR-081 (premise) · LRN-139 (when-guidance shape) · BDR-061
|
||||
(bundle+sentinel decision) · BDR-077 (mode split, fail-closed, locks
|
||||
survive) · BDR-073 (deterministic scoring) · BDR-072 (R2 refuse) ·
|
||||
BDR-071 (off-page ceiling + §14 line) · BDR-010/LRN-011 (labeled
|
||||
scores gate) · LRN-133 (omission legible) · LRN-131/132/EVAL-025
|
||||
(WebSearch ≠ verification) · LRN-105 (named ban stays explicit) ·
|
||||
LRN-080/088 (measure before delete → dogfood) · LRN-113 (sweep whole
|
||||
surface) · LRN-093 (no vacuous locks; single-line anchors) ·
|
||||
LRN-126/137 (mode split carries data paths) · BLK-017 (Bing deferred).
|
||||
|
||||
## 9. Open questions → dispatcher decisions (see plan §4b)
|
||||
|
||||
Q1 freeze scope · Q2 census extension · Q3 dedup strategy ·
|
||||
Q4 vestigial lines · Q5 /harden //onboard reconciliation.
|
||||
@@ -0,0 +1,342 @@
|
||||
# PLAN v2 — De-prescribe seo-analyzer.md + geo-analyzer.md for Opus 5
|
||||
|
||||
Date: 2026-07-30 · Branch: feature/seo-geo-deprescription (off develop, started)
|
||||
KIND: build-plan · Author: main-loop session (Fable 5)
|
||||
Parent decision: BDR-081 N5 (deferred as separate project) · Method: LRN-139
|
||||
v2: revised after the 3-lens challenge (§5bis) — every BLOCKER closed by a
|
||||
named change; one confirmation challenger pass follows before execution.
|
||||
|
||||
## 1. Context & evidence (v2 — sizing corrected per simplicity#1)
|
||||
|
||||
Both agents are opus-pinned (BDR-076) → every judge phase runs Opus 5.
|
||||
BDR-081 profile applies: literal following, over-verification when told
|
||||
to verify, conflicting/duplicated rules burn reasoning tokens. These are
|
||||
the LONGEST agent files in the repo (1528 + 1106 l) with real downstream
|
||||
parsers — NOT the densest (measured: ~4.5 directive hits/100 l, ranks
|
||||
20th/22nd; security-auditor is 17/100). What this pass buys, honestly:
|
||||
(a) removal of self-output-verification demands (the one pattern the
|
||||
baseline dogfood caught live: the judge reported "run twice, identical
|
||||
output" — seo:970 firing), (b) removal of vestigial pre-BDR-061 lines
|
||||
and 2 real contradictions, (c) small same-audience/same-range dedup,
|
||||
(d) caps→when-guidance on choreography. The verification apparatus
|
||||
(census + 3-lens challenge + before/after dogfood) is USER-DIRECTED for
|
||||
this chantier, not derived from the density premise.
|
||||
|
||||
## 2. Contract surface (v2 — split per correctness#5)
|
||||
|
||||
### 2a. Machine-parsed (named non-LLM consumer: test, script, or literal
|
||||
grep in a dispatcher step) — byte-frozen
|
||||
- `model: opus`, `MODE: collect|judge|template`, `COLLECTION COMPLETE`
|
||||
(model-routing.test.sh:67-68,150-157).
|
||||
- `fetch.sh crux|queries` + `Performance GSC` (seo), `fetch.sh
|
||||
schema_gen|content_quality` (geo) (seo-data.test.sh:538-543).
|
||||
- `SEO|GEO JUDGE — VERDICT: ERROR(` — dispatcher ERROR CONTRACT
|
||||
fail-closes on it (skills/seo:316-318, skills/geo:65-68).
|
||||
- `## FIX BUNDLE` + sentinel `READY TO APPLY — awaiting dispatcher
|
||||
confirmation` — apply step keys on it (skills/seo:524, skills/geo:101;
|
||||
reused by /harden:366).
|
||||
- `.audit/<seo|geo>-signals-<RUNID>.md` names + fail-closed load.
|
||||
- STEP numbering: dispatchers address ranges literally (seo 2-5/6-11/
|
||||
12-14; geo 0-5/6-12/13-15; depth-matrix:17-19,37).
|
||||
- `**Score SEO** : XX.X / 20` / `**Score GEO** : XX.X / 20` labels —
|
||||
client-handover-writer.md:344-345 labeled grep (BDR-010/LRN-011);
|
||||
losing the SEO label silently falls back to first-X/20-in-file.
|
||||
- Bundle item fields `id: applier: files: current: expected:` — pasted
|
||||
verbatim into hotfixer/feater at L1; `applier: bash` run in-loop.
|
||||
- url-guard call sites: seo-analyzer.md:287-295, geo-analyzer.md:273-280
|
||||
(NOT ":257" as v1 said — robustness#5) + sitemap-URL guard seo:573-582.
|
||||
- `NARROW-SCOPE` keying of the I4 carve-out (seo:981-983) — /harden's
|
||||
dispatch prompt relies on it.
|
||||
|
||||
### 2b. LLM-convention contracts (no code consumer; the dispatcher LLM
|
||||
merges by these shapes) — locked in the census, still frozen
|
||||
`SEO|GEO AGENT RESULT` envelopes · `## SECTION FOR SEO.md §N` ·
|
||||
`## ENTRIES FOR SEO.md` · `SEO|GEO SCORING (` blocks + `COVERAGE
|
||||
SOURCE`/`COVERAGE LIVE` lines + `GLOBAL (weighted)` · `TRAJECTORY TO
|
||||
17/20 (code-only)` · `FIX PLAN (` (seo) · batch labels A-F / G1-G7
|
||||
(tier recognition tolerant, labels nominal) · `COLLECT REPORT` +
|
||||
`STATUS: DONE|BLOCKED` · `Automatisation possible avec:` · §0-§15
|
||||
report skeleton + Historique. CROSS-AGENT NOTES emit-instruction lives
|
||||
in /seo's dispatch prompts (dispatcher-side lock only).
|
||||
|
||||
## 3. Class B invariants — obligation kept, single strongest statement;
|
||||
security ORDERINGS byte-frozen (robustness#5/#7)
|
||||
|
||||
- Guard-first orderings, frozen verbatim: seo:287-291 / geo:273-277
|
||||
("Guard the domain before it reaches a shell… Run the guard FIRST…
|
||||
never 'clean up' the value and retry") + seo:573-582 URL loop.
|
||||
- seo:550 "Record the denominator BEFORE sampling" — the ordering IS
|
||||
the honesty mechanism (a post-hoc denominator is self-serving);
|
||||
frozen; only surrounding prose may compress.
|
||||
- NAP direction rule (LRN-032-zenquality — keep the qualifier, the bare
|
||||
ID is ambiguous in this repo), R2 refuse-to-score (BDR-072), COVERAGE
|
||||
obligations (LRN-133 — note :436-439 is a DISTINCT index-reach
|
||||
obligation, not a repeat), §14 mandatory disclosure lines (BDR-071
|
||||
backlinks verbatim line, I4 security-headers), never-apply/L1
|
||||
(BDR-061; LRN-105 named ban), C1a build-output ban, no-invented-
|
||||
content/DGCCRF, deterministic scoring (BDR-073), fail-closed judge,
|
||||
shared-file Edit-not-Write discipline, honest llms.txt framing,
|
||||
cite-sources (LRN-131).
|
||||
- External-freshness checks are NOT self-verification (robustness#6):
|
||||
seo:1522-1523 + geo:1102-1103 verify a DRIFTING WORLD feeding an
|
||||
AUTO-tier robots.txt edit — kept, reworded as when-guidance ("crawler
|
||||
lists shift; cross-check before emitting G1 from the dated resource").
|
||||
|
||||
## 4. Work items v2
|
||||
|
||||
- P0 SEQUENCING + LIVE-TREE EXPOSURE (robustness#4, conf#2/#3/#4/#9):
|
||||
agents/ resolves through ~/.claude symlinks to the WORKING TREE —
|
||||
edits are live between Edit calls, before any commit. Rules:
|
||||
(1) the FULL baseline completes before the first agent edit —
|
||||
signals + judge reports + TEMPLATE envelopes + merged SEO.md +
|
||||
HUMAN-ACTIONS.md (conf#2: without frozen template artifacts the
|
||||
template-range edits would have no differential and P0 makes one
|
||||
unobtainable later);
|
||||
(2) all baseline artifacts copied to the DURABLE, gitignored
|
||||
`.audit/dogfood-baseline/` in this repo before the first edit
|
||||
(conf#9: the session scratchpad dies with the session/reboot;
|
||||
LRN-124: .audit/** is never committed);
|
||||
(3) freeze window: no /seo //geo //harden //onboard AND no
|
||||
/client-handover (spawns /seo — conf#3) nor any skill transitively
|
||||
dispatching either analyzer, in ANY project, until the after-dogfood
|
||||
verdict;
|
||||
(4) aborts (conf#4): mid-reword interrupt or after-dogfood failure →
|
||||
`git checkout HEAD -- agents/seo-analyzer.md agents/geo-analyzer.md`
|
||||
(in-flight revert, index-safe); `git checkout develop -- agents/…`
|
||||
is reserved for a WHOLE-BRANCH abandon; after an abort the named
|
||||
exit is either (a) fix + re-run the after-dogfood, or (b) present
|
||||
the static evidence (census + git diff review) to the human who may
|
||||
accept or abandon at the gate — no open-ended reverted state.
|
||||
- P1 CENSUS (commit 1, test-only, green pre-reword — compatible with
|
||||
§7's same-commit rule: it locks EXISTING state and changes no agent
|
||||
file; reword commits carry any census DELTA): DONE in working tree —
|
||||
lib/tests/seo-geo-contract.test.sh 54/0, shellcheck clean, real
|
||||
flip-test run: 7 scratch mutations → 7 FAILs (not "by construction" —
|
||||
robustness#10). File-qualified locks (correctness#4): `FIX PLAN (` +
|
||||
`applier: bash` + `Score SEO` seo-only; `Score GEO` geo-only.
|
||||
Incidental locks dropped (CROSS-AGENT NOTE agent-side, bare
|
||||
`applier:`). Item fields locked both files. v3 (conf#5): EVERY
|
||||
`## STEP n —` header locked, interiors included (seo 0-14, geo 0-15)
|
||||
— census now 71/0. Freeze mechanism for the
|
||||
~40 A-sites the census does not cover: reviewed `git diff -U0
|
||||
agents/*.md` on each reword commit (simplicity#4).
|
||||
- P2 REWORD seo-analyzer.md (commit 2):
|
||||
(a) Self-OUTPUT verification, v3 (conf#1/#8 — neither is deleted
|
||||
outright): :970-971 "run it twice" → when-guidance integrity
|
||||
guard ("if the findings JSON changed after scoring, re-run and
|
||||
explain the move" — score.py is deterministic, so a moving
|
||||
output means mutated findings: anti-score-shopping, BDR-073;
|
||||
the unconditional double-run the baseline judge burned goes
|
||||
away, the guard stays); :1217 "Do not proceed until printed" →
|
||||
when-guidance scoped to the single-shot path ("single-shot runs
|
||||
print the FIX PLAN before STEP 12 serializes it" — MODE: judge
|
||||
stops at 11, but /harden //onboard execute the whole file,
|
||||
conf#1). The completeness checklist :1309-1320 is NOT deleted:
|
||||
its routing rows (stock-photo→GATED(E), compression→AUTO(bash)
|
||||
or §11, aggregateRating→AUTO(hotfixer), structural→GATED(D)…)
|
||||
are unique routing content (robustness#3) — reshape into a plain
|
||||
mapping table, drop only the checkbox self-audit framing.
|
||||
(b) DELETE vestigial :1525-1526 (contradicts BDR-061; Q4).
|
||||
(c) DEDUP under the invariant (correctness#1 + robustness#1): only
|
||||
VERBATIM same-AUDIENCE (spec rule / bundle-item payload /
|
||||
phase-local caveat) same-MODE-RANGE (collect 0-5 / judge 6-11 /
|
||||
template 12-14 / RULES=global) repeats merge. Expected survivors
|
||||
per family listed at execution in the commit message; honest
|
||||
net: never-apply 4→3 (RULES pair merges; template-range
|
||||
statements stay), sentinel-verbatim reminders 3→2, landing-page
|
||||
3→2 (payload instance :1260 + one spec statement; :1342 vs
|
||||
:1502 merge), bundle-self-containment 2→1 (same range).
|
||||
NOT deduped (v1 was wrong — distinct rules or cross-range):
|
||||
COVERAGE ×4, 30/70 ×3, security-headers ×3, shared-file
|
||||
discipline (payload vs spec audiences).
|
||||
(d) SOFTEN caps/orderings to when-guidance, keeping semantics:
|
||||
:61, :508 (gate stays before on-page scoring; emphasis drops),
|
||||
:875, :1147, :1149-1157 CMS-plugin-first folded together with
|
||||
:143-148 into ONE statement (correctness#3 — two strengths of
|
||||
one rule otherwise), :1159-1162 Bing (content rule kept, caps
|
||||
drop; FULL-only → statically verified), essays :606-618 +
|
||||
:661-680 compressed keeping the rule + LRN citations; :602-604
|
||||
kept as a when-guidance failure detector ("families ≈ URLs →
|
||||
the heuristic broke — say so"), not deleted (robustness#8).
|
||||
(e) Dispositions completing the C-list (correctness#3): :208-210 →
|
||||
static pointer ("the CDN/WAF twin check lives in geo STEP 4");
|
||||
:1504 KEEP as-is (one-line scope guard).
|
||||
- P3 REWORD geo-analyzer.md (commit 3), same invariant:
|
||||
PERMISSIVE ×3: ALL survive (collect/template/RULES ranges;
|
||||
:873 is the item-level default guarding an unconfirmed AUTO
|
||||
robots.txt edit — named survivor, robustness#9). never-apply 4→3
|
||||
(RULES pair merges). tier-mapping :824/:850 BOTH stay (judge vs
|
||||
template ranges). content_quality-advisory 2→1 (same range).
|
||||
shared-file 2× stays (payload vs spec). llms-honest 2× stays
|
||||
(collect vs RULES). cite-sources 2× stays (:17 guards the header
|
||||
stats specifically). :1106 vestigial → reworded to the truth
|
||||
(dispatcher fills the log — matches :959; Q4). :777-786 caps →
|
||||
plain content rule (FULL-only). :1102-1103 → freshness
|
||||
when-guidance (kept — §3). :394 quantity softened ("substantial,
|
||||
real customer questions"). :48 softened. :124-139 ask-block KEPT
|
||||
(standalone path). Orderings :360/:811/:823 softened. :376-377
|
||||
uncited claim → honest framing (no invented source).
|
||||
- P4 DOGFOOD AFTER (v3 — ordered by decisiveness, conf#7): fresh copy
|
||||
of zenquality-frozen; phases in this order so a mid-run death still
|
||||
leaves the decisive evidence (billing class already realised once):
|
||||
(ii-first) judges fed the FROZEN baseline signals
|
||||
(.audit/dogfood-baseline/) → judge reports vs frozen baseline judge
|
||||
reports, ZERO collect variance — the decisive Opus-judge-prose
|
||||
differential; (iii) templates on those judge reports → envelopes,
|
||||
compared against the frozen BASELINE envelopes — the template
|
||||
verdict anchors on ENVELOPES only (SEO.md/HUMAN-ACTIONS.md are
|
||||
dispatcher-merged by this authoring session, non-attributable —
|
||||
conf#10); (i-last) fresh collects, same pre-answered context →
|
||||
(a) shape check of signals/COLLECT REPORT vs baseline, (b)
|
||||
FIELD-LEVEL diff of the fresh signals vs baseline signals (record
|
||||
blocks, COVERAGE counts, denominators — a shape-valid file with a
|
||||
dropped field must be caught, conf#6), and (c) ONE end-to-end seo
|
||||
judge on the FRESH signals (the domain with the most collect-range
|
||||
edits) so the reworded collect→judge handoff runs at least once.
|
||||
Comparison mechanical-first: presence-assertion script (named home:
|
||||
`.audit/dogfood-baseline/assert-after.sh`, session-reproducible,
|
||||
never committed — conf#11) + a FRESH reader agent diffing
|
||||
before/after WITHOUT this plan in context (correctness#7); the
|
||||
authoring session only arbitrates its report. If the after-run dies:
|
||||
P0(4) abort + named exit applies; no merge request meanwhile.
|
||||
- P5 GATES: make test full suite (census + model-routing + seo-data +
|
||||
no-vacuous-locks) · shellcheck on touched .sh · per-RANGE grep sweep
|
||||
for every deduped family (asserts the named survivor lines exist in
|
||||
their ranges — mode-blind ≥1× sweep is insufficient, robustness#1) ·
|
||||
MEASURED deltas recorded (simplicity#7): wc -l + directive-token
|
||||
census (annex §0 grep set) per file, before/after, into the BDR.
|
||||
(v1's manual MODE/STEP sweep dropped — the census asserts it,
|
||||
simplicity#5.)
|
||||
- P6 CAPITALIZE: BDR (decision, invariant, deltas, alternatives), LRN
|
||||
(audience×range dedup invariant — reusable), journal, CHANGELOG.
|
||||
TODO C1 checked. NO merge (human gate). Checkpoint report includes
|
||||
the DYNAMICALLY-UNVERIFIED list (§6bis).
|
||||
|
||||
## 4b. Dispatcher decisions (v2)
|
||||
|
||||
- Q1 freeze scope: all §2a byte-frozen + §2b frozen via census; the
|
||||
remaining unlocked A-prose freeze = per-commit git diff review.
|
||||
- Q2 census: done (P1), flip-proven.
|
||||
- Q3 dedup: WITHIN-file, same-AUDIENCE, same-MODE-RANGE, verbatim
|
||||
repeats only. Cross-agent + agent↔dispatcher twins stay. (Mechanism
|
||||
note correcting robustness#1's premise: every dispatch loads the FULL
|
||||
agent file; the risk is ATTENTIONAL — a literal-following model told
|
||||
"run STEP 13-15" deprioritizes guidance scoped to another step's
|
||||
body — not access. Same fix either way.)
|
||||
- Q4 vestigial: seo :1525-1526 DELETE; geo :1106 REWORD to
|
||||
dispatcher-owns-log (correctness#6 resolved).
|
||||
- Q5 /harden //onboard: out of scope (N6); their dispatch-prompt
|
||||
contracts are untouched by agent-file rewording; `NARROW-SCOPE`
|
||||
keying frozen (§2a).
|
||||
|
||||
## 5. Dogfood protocol (v2)
|
||||
|
||||
Baseline (DONE for collect+judge SEO; geo judge in flight at v2 time):
|
||||
frozen zenquality copy (no .env), inline pipeline (canonical /seo shape
|
||||
— the nested-CLI attempt died on the CLI monthly spend limit, recorded),
|
||||
absolute PROJECT ROOT in every dispatch, `/seo local conservative`,
|
||||
STEP 0 pre-answered, NAP = NAP-KIT.md (user-confirmed 2026-07-10).
|
||||
Baseline artifacts frozen under the DURABLE `.audit/dogfood-baseline/`
|
||||
(gitignored, never committed — conf#9): signals ×2, judge reports ×2,
|
||||
template ENVELOPES ×2, merged SEO.md, HUMAN-ACTIONS.md (conf#2 — the
|
||||
template phase runs to completion BEFORE the first agent edit).
|
||||
After-run per P4. LIMITS stated honestly
|
||||
(robustness#2): conservative never enters STEP 1b/1.5 (no applier parses
|
||||
an item this run — the item-field contract is census-locked statically);
|
||||
LOCAL never executes STEP 3-4/6-7 FULL branches (Bing/AI-index emission
|
||||
text, live checks — the FULL-only conditionals were exercised and
|
||||
correctly declined in the baseline judge). These stay on the
|
||||
§6bis unverified list for the human gate; a FULL/aggressive dry-run is
|
||||
an OPTION the user may order at checkpoint, not part of this plan.
|
||||
|
||||
## 5bis. CHALLENGE SYNTHESIS (2026-07-30)
|
||||
|
||||
Verdicts: correctness FATAL(3) [1 BLOCKER, 2 MAJOR, 4 MINOR] ·
|
||||
robustness FATAL(9) [3 BLOCKER, 6 MAJOR, 2 MINOR] · simplicity
|
||||
CONCERNS(3) [3 MAJOR, 4 MINOR]. All three lenses returned. Every
|
||||
BLOCKER closed by a named v2 change:
|
||||
- correctness#1 (audience-blind dedup) + robustness#1 (mode-blind
|
||||
dedup) → §4b Q3 invariant + P2(c)/P3 rewritten + P5 per-range sweep.
|
||||
- robustness#2 (dogfood can't reach riskiest edits) → §5 honest limits
|
||||
+ §6bis unverified list + P2(d)/P3 minimal-diff on FULL-only sites +
|
||||
static census cover; FULL/aggressive run offered to the human, not
|
||||
silently added (billing exposure robustness#11).
|
||||
- robustness#3 (routing table misfiled as self-check) → P2(a) keeps
|
||||
routing rows verbatim.
|
||||
Majors adopted: R4 live-tree abort path (P0) · R5 url-guard anchors
|
||||
corrected + security orderings frozen (§2a/§3) · R6 external-freshness
|
||||
kept (§3) · R7 :550 frozen (§3) · R8 :602 kept as detector (P2(d)) ·
|
||||
R9 :873 named survivor (P3) · C2 folded into R2's resolution · C3 full
|
||||
dispositions (P2(d)/(e), P3) · S1 §1 rewritten · S2 controlled
|
||||
judge-replay (P4) · S3 mechanical presence script (P4). Minors adopted:
|
||||
C4 file-qualified locks · C5 §2 split · C6 three inconsistencies
|
||||
resolved (P1 note, Q4, N1 marker) · C7 fresh-reader diff · S4 diff-
|
||||
review freeze · S5 sweep dropped · S6+R10 census corrected+flip-proven ·
|
||||
S7 measured deltas. Rejected/scoped: S1's apparatus-shrinking (the
|
||||
apparatus is user-directed); R1's access premise corrected to
|
||||
attentional (fix adopted unchanged).
|
||||
|
||||
CONFIRMATION PASS (robustness lens, v2 → v3): FATAL(9) — 2 BLOCKER +
|
||||
7 MAJOR/MINOR, all targeting the v2 amendments as asked. Closed by
|
||||
name: conf#1 no-MODE single-shot → §6bis + P2(a) :1217 scoped-softened
|
||||
· conf#2 missing baseline template artifacts → P0(1) full-baseline
|
||||
precondition · conf#3 /client-handover freeze → P0(3) · conf#4 abort
|
||||
HEAD-vs-develop + named exit → P0(4) · conf#5 interior STEP locks →
|
||||
census extended to all headers (71/0) · conf#6 collect→judge seam →
|
||||
P4(i) field-diff + one end-to-end seo judge on fresh signals · conf#7
|
||||
decisiveness order → P4 reordered (ii)→(iii)→(i) · conf#8 :970
|
||||
anti-score-shopping → when-guidance reword, not deletion · conf#9
|
||||
volatile baseline → durable .audit/dogfood-baseline/ · conf#10
|
||||
dispatcher-owned artifacts → envelope-anchored template verdict ·
|
||||
conf#11 script home named. Challenge budget exhausted (1 re-pass max):
|
||||
residual risk goes to the human gate with this record.
|
||||
|
||||
## 6. Explicitly NOT doing
|
||||
|
||||
- N1 No dispatcher (SKILL.md) edits.
|
||||
- N2 No scoring-weight, axis, or depth-matrix changes.
|
||||
- N3 No model-pin changes (BDR-076).
|
||||
- N4 No weakening of class-B invariants (§3 hardened in v2: security
|
||||
orderings byte-frozen).
|
||||
- N5 No new modes, no pipeline reshaping (BDR-077).
|
||||
- N6 No /harden //onboard contract reconciliation (annex §7.5).
|
||||
- N7 No collect-boundary wording fix (works by prompt override).
|
||||
- N8 No cross-agent shared-resource consolidation.
|
||||
- N9 No deterministic GEO score engine (annex §7.9).
|
||||
- N10 No FULL/aggressive dogfood in this plan (user option at gate).
|
||||
|
||||
## 6bis. Dynamically-unverified edit surface (for the human gate)
|
||||
|
||||
Sites edited by P2/P3 that no dogfood run executes: FULL-branch content
|
||||
(seo :1159-1162 Bing emission, geo :777-786 AI-index emission, both
|
||||
freshness when-guidances), apply-path parsing (STEP 1b/1.5 — item
|
||||
pasted into appliers; covered statically by census item-field locks +
|
||||
frozen bundle templates), STEP 6-7 external-presence prose, and the
|
||||
no-MODE single-shot path (conf#1: /harden and /onboard dispatch the
|
||||
agents without a MODE line — "all steps in sequence" — so the whole
|
||||
reworded body drives those runs; every never-apply and ordering
|
||||
statement that path relies on keeps a surviving instance, and :1217
|
||||
is softened-scoped to it, never deleted). Mitigation: minimal diffs
|
||||
there (caps→plain only), census locks, git-diff review.
|
||||
|
||||
## 4c. Backlog surfaced (not this branch)
|
||||
|
||||
- Score-label fallback fragility in client-handover-writer.md (can read
|
||||
`TRAJECTORY TO 17/20` as 17.0 if the label vanishes) — annex §7.8.
|
||||
- Stale lib/ line-number comments pointing at agent lines (annex §1).
|
||||
- Baseline judge's gate observation: /client-handover 17/20 gate passes
|
||||
with an open `critique` finding — "open critique = independent
|
||||
blocker" is worth its own decision.
|
||||
|
||||
## 7. Constraints for challengers
|
||||
|
||||
- Registries append-only; census green throughout; reword commits keep
|
||||
54/0 + model-routing + seo-data locks green.
|
||||
- Agent files symlink-live INCLUDING between Edit calls (P0 abort path).
|
||||
- §2a byte-identical; §2b frozen; STEP numbering preserved; §3 security
|
||||
orderings verbatim.
|
||||
- Dedup only same-audience + same-mode-range verbatim repeats; named
|
||||
survivors per family in commit messages; P5 per-range sweep.
|
||||
- The judge phase is Opus 5; collect/template Sonnet — literal
|
||||
following applies to all (E5 "since 4.7").
|
||||
- Baseline artifacts frozen before first edit; after-run design per P4.
|
||||
@@ -0,0 +1,82 @@
|
||||
#!/usr/bin/env bash
|
||||
# lib/tests/seo-geo-contract.test.sh — census: seo/geo agent ⇄ dispatcher
|
||||
# machine contract (C1 de-prescription, 2026-07-30). Locks every string a
|
||||
# consumer parses BEFORE the choreography reword, so the reword commits
|
||||
# prove contract preservation by keeping this green. Complements
|
||||
# model-routing.test.sh (which already locks model pins + MODE:* +
|
||||
# COLLECTION COMPLETE).
|
||||
set -u
|
||||
R="$(cd "$(dirname "$0")/../.." && pwd)"
|
||||
pass=0; fail=0
|
||||
ok() { pass=$((pass+1)); }
|
||||
ko() { fail=$((fail+1)); printf 'FAIL %s\n' "$1"; }
|
||||
has() { if grep -qF "$2" "$R/$1"; then ok; else ko "$1 missing: $2"; fi; }
|
||||
|
||||
SEO=agents/seo-analyzer.md
|
||||
GEO=agents/geo-analyzer.md
|
||||
|
||||
# 1) judge verdict grammar — DISPATCHER ERROR CONTRACT (skills/seo STEP 1,
|
||||
# skills/geo STEP 1B) fail-closes on this exact shape
|
||||
has "$SEO" 'SEO JUDGE — VERDICT: ERROR('
|
||||
has "$GEO" 'GEO JUDGE — VERDICT: ERROR('
|
||||
has "skills/seo/SKILL.md" 'SEO JUDGE — VERDICT: ERROR('
|
||||
has "skills/geo/SKILL.md" 'GEO JUDGE — VERDICT: ERROR('
|
||||
|
||||
# 2) fix-bundle section + apply sentinel — parsed by /seo STEP 1b/1.5 and
|
||||
# /geo STEP 1b/2 before any L1 apply
|
||||
for f in "$SEO" "$GEO" skills/seo/SKILL.md skills/geo/SKILL.md; do
|
||||
has "$f" '## FIX BUNDLE'
|
||||
has "$f" 'READY TO APPLY — awaiting dispatcher confirmation'
|
||||
done
|
||||
|
||||
# 3) signals handoff — judge loads the collect artifact fail-closed
|
||||
has "$SEO" '.audit/seo-signals-'
|
||||
has "$GEO" '.audit/geo-signals-'
|
||||
has "skills/seo/SKILL.md" '.audit/seo-signals-<RUNID_SEO>.md'
|
||||
has "skills/geo/SKILL.md" '.audit/geo-signals-<RUNID>.md'
|
||||
|
||||
# 4) STEP numbering — dispatchers reference agent step ranges literally:
|
||||
# /seo: "STEP 2-5" collect · "STEP 6-11" seo judge · "STEP 6-12" geo
|
||||
# judge · "STEP 12-14" seo template · "STEP 13-15" geo template;
|
||||
# /geo: "STEP 0-5". Lock EVERY step header on the agent side (interiors
|
||||
# too — merging/renumbering one silently re-points the dispatch ranges)
|
||||
# and the ranges on the dispatcher side.
|
||||
for n in 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14; do has "$SEO" "## STEP $n —"; done
|
||||
for n in 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15; do has "$GEO" "## STEP $n —"; done
|
||||
has "skills/seo/SKILL.md" 'STEP 2-5'
|
||||
has "skills/seo/SKILL.md" 'STEP 6-11'
|
||||
has "skills/seo/SKILL.md" 'STEP 6-12'
|
||||
has "skills/seo/SKILL.md" 'STEP 12-14'
|
||||
has "skills/seo/SKILL.md" 'STEP 13-15'
|
||||
has "skills/geo/SKILL.md" 'STEP 0-5'
|
||||
has "skills/geo/SKILL.md" '6-12, report scoring' # "STEP\n6-12" line-wraps
|
||||
has "skills/geo/SKILL.md" 'STEP 13-15'
|
||||
|
||||
# 5) collect-mode report emission (dispatcher waits on it between phases)
|
||||
has "$SEO" 'COLLECT REPORT'
|
||||
has "$GEO" 'COLLECT REPORT'
|
||||
|
||||
# 6) bundle-item routing + the item fields the L1 appliers parse
|
||||
# (the item is pasted verbatim into hotfixer/feater — /seo STEP 1.5)
|
||||
for f in "$SEO" "$GEO"; do
|
||||
has "$f" 'applier: hotfixer'
|
||||
has "$f" 'applier: feater'
|
||||
has "$f" ' files:'
|
||||
has "$f" ' current:'
|
||||
has "$f" ' expected:'
|
||||
done
|
||||
has "$SEO" 'applier: bash'
|
||||
|
||||
# 7) cross-agent escalation block — merged into SEO.md §11 by /seo STEP 2.
|
||||
# The emit instruction lives in /seo's DISPATCH PROMPTS, not in the agent
|
||||
# specs (geo-analyzer.md never mentions it; seo-analyzer.md only once,
|
||||
# incidentally — NOT locked, it is prose). Lock the dispatcher side only.
|
||||
has "skills/seo/SKILL.md" 'CROSS-AGENT NOTES TO'
|
||||
|
||||
# 8) trajectory block — mandatory in envelopes (/geo audit-end deliverables,
|
||||
# /seo §1 merge)
|
||||
has "$SEO" 'TRAJECTORY TO 17/20'
|
||||
has "$GEO" 'TRAJECTORY TO 17/20'
|
||||
|
||||
printf 'seo-geo contract locks: %d pass, %d fail\n' "$pass" "$fail"
|
||||
[ "$fail" -eq 0 ]
|
||||
Reference in New Issue
Block a user