test(census): seo/geo agent⇄dispatcher contract locks (C1 P1, pre-reword)
71 locks, flip-proven (7 scratch mutations → 7 FAILs): judge verdict grammar, FIX BUNDLE + READY-TO-APPLY sentinel, signals handoff, ALL STEP headers (interiors included, conf#5), collect report, bundle item fields parsed by L1 appliers, score labels (BDR-010/LRN-011), scoring blocks, trajectory, envelope keys. Locks existing state — reword commits must keep this green. + plan v3 (challenged 3 lenses FATAL/FATAL/CONCERNS + 1 confirmation pass FATAL(9), every BLOCKER closed by a named change, §5bis record) + directive-language inventory annex (analyzer report).
This commit is contained in:
Bastien Chanot
@@ -0,0 +1,174 @@
|
|||||||
|
# ANNEX — directive-language inventory (analyzer report, 2026-07-30)
|
||||||
|
|
||||||
|
Produced by a read-only analyzer dispatch over agents/seo-analyzer.md
|
||||||
|
(1528 l) + agents/geo-analyzer.md (1106 l), cross-referenced against
|
||||||
|
every consumer. Referenced by the C1 plan (same folder, -1402.md).
|
||||||
|
|
||||||
|
## 0. Token census (raw)
|
||||||
|
|
||||||
|
| Token family | seo-analyzer.md | geo-analyzer.md |
|
||||||
|
|---|---|---|
|
||||||
|
| MUST/must | 12 | 6 |
|
||||||
|
| MANDATORY/mandatory | 8 | 4 |
|
||||||
|
| NEVER/never | 42 | 33 |
|
||||||
|
| ALWAYS/always | 6 | 1 |
|
||||||
|
| CRITICAL/critical | 3 | 1 |
|
||||||
|
| Do NOT / do not | 24 | 8 |
|
||||||
|
| verbatim | 6 | 3 |
|
||||||
|
| STOP | 3 | 4 |
|
||||||
|
| refuse/REFUSE | 6 | 4 |
|
||||||
|
| ⚠️ blocks | 0 | 0 |
|
||||||
|
|
||||||
|
## 1. Test locks on these files (complete list — 6 per file)
|
||||||
|
|
||||||
|
model-routing.test.sh:67-68 `model: opus` (both) · :150-157 `MODE:
|
||||||
|
collect|judge|template` + `COLLECTION COMPLETE` (both) ·
|
||||||
|
seo-data.test.sh:538-540 `fetch.sh crux` / `fetch.sh queries` /
|
||||||
|
`Performance GSC` (seo) · :542-543 `fetch.sh schema_gen` /
|
||||||
|
`fetch.sh content_quality` (geo).
|
||||||
|
NOT locked by any test: READY-TO-APPLY sentinel, envelope headings,
|
||||||
|
score-block shapes, JUDGE-ERROR strings, batch labels — contracts by
|
||||||
|
consumer only; a rewrite can break them silently and make test stays
|
||||||
|
green. Sibling dispatcher locks: model-routing.test.sh:159-166.
|
||||||
|
Stale line-number comments (no enforcement): lib/url-guard.sh:9,
|
||||||
|
url-guard.test.sh:20, source-scope.sh:25, seo-data/README.md:196/309,
|
||||||
|
drift.py:4, linkgraph.py:4 — all already drifted.
|
||||||
|
|
||||||
|
## 2. Format contract (artifact → consumer) — FREEZE SET
|
||||||
|
|
||||||
|
seo-analyzer: signals `.audit/seo-signals-<RUNID>.md` (+clean/load sites
|
||||||
|
in /seo) · `COLLECTION COMPLETE — RUNID: <RUNID>` terminal ·
|
||||||
|
`COLLECT REPORT` w/ `STATUS: DONE|BLOCKED` · `SEO JUDGE — VERDICT:
|
||||||
|
ERROR(<reason>)` · judge report forwarded verbatim to template ·
|
||||||
|
`SEO SCORING (<depth>)` block w/ `COVERAGE SOURCE:`/`COVERAGE LIVE :`
|
||||||
|
+ 7 axes + `SEO GLOBAL (weighted): XX.X/20` (score.py:26-37 mirrors
|
||||||
|
weights) · `TRAJECTORY TO 17/20 (code-only)` · `fetch.sh score` JSON
|
||||||
|
(`axes.{technical,on-page,seo-local,off-page,social,competitive,legal}`,
|
||||||
|
severities `critique|haute|moyenne|basse`, `status:"na"`) · `FIX PLAN (N
|
||||||
|
findings total)` + BATCH A…F (tier-mapping tolerant) · `## FIX BUNDLE
|
||||||
|
(for dispatcher)` + `### AUTO/### GATED/### USER ACTIONS` + item fields
|
||||||
|
`id: applier: files: concern: current: expected:` · sentinel `READY TO
|
||||||
|
APPLY — awaiting dispatcher confirmation` (also reused by /harden:366) ·
|
||||||
|
envelope `SEO AGENT RESULT` + `## SECTION FOR SEO.md §2…§6` + `## ENTRIES
|
||||||
|
FOR SEO.md §0/§8/§9/§10/§11/§15` · `Automatisation possible avec:` per
|
||||||
|
§11 entry · standalone `.claude/audits/SEO.md` w/ `**Score SEO** : XX.X
|
||||||
|
/ 20` (client-handover-writer.md:344 labeled grep) + §0-§15 + Historique.
|
||||||
|
geo-analyzer: same families with GEO names; envelope `GEO AGENT RESULT`
|
||||||
|
+ `## SECTION FOR SEO.md §7` (7.1-7.6); `**Score GEO** : XX.X / 20`
|
||||||
|
(handover parses it only inside SEO.md, allow_fallback=no); G1-G7
|
||||||
|
batches (G1-G4/G6 AUTO · G5 GATED · G7 USER). Both: STEP NUMBERS are
|
||||||
|
addressed by dispatchers (seo: 2-5/6-11/12-14; geo: 0-5/6-12/13-15;
|
||||||
|
also depth-matrix.md:17-19,37) — renumbering re-points dispatch prompts.
|
||||||
|
Engine interfaces: fetch.sh verbs {crux,queries,inspect,cannibal,
|
||||||
|
sitemap,rendercheck,linkgraph,score,schema_gen,content_quality} ·
|
||||||
|
url-guard.sh host|url · source-scope.sh findargs|list · resources/*.md.
|
||||||
|
|
||||||
|
## 3-4. Site classification counts
|
||||||
|
|
||||||
|
| | seo | geo | total |
|
||||||
|
|---|---|---|---|
|
||||||
|
| A machine-parsed contract | ~52 | ~41 | ~93 (12 test-locked) |
|
||||||
|
| B safety/policy invariant | ~30 | ~31 | ~61 |
|
||||||
|
| C process choreography | ~21 | ~12 | ~33 |
|
||||||
|
| D other/domain-fact | ~20 | ~13 | ~33 |
|
||||||
|
|
||||||
|
### Class C sites — seo-analyzer.md (rewrite targets)
|
||||||
|
:61 "First action." · :143-148 CMS-detect-before-edit ordering ·
|
||||||
|
:208-210 "keep the two consistent" (runtime cross-file reconcile) ·
|
||||||
|
:508 "run this BEFORE anything else in STEP 5" (ordering; the refusal
|
||||||
|
rule itself is B) · :550-553 "Record the denominator BEFORE sampling"
|
||||||
|
(ordering; honesty rule is B) · :602-604 "Sanity-check the grouping
|
||||||
|
before trusting it" (self-verify) · :606-618 sampling-method essay ·
|
||||||
|
:661-680 C1a 20-line rationale (rule itself is B at :1493-1501) ·
|
||||||
|
:875 per-item method · :970-971 "Run it twice on the same file before
|
||||||
|
publishing" (exact BDR-081 over-verification class) · :1147 "AUTO items
|
||||||
|
are a commitment, not a suggestion." · :1149-1157 P0 CMS-plugin-first
|
||||||
|
mandate · :1159-1162 P0 Bing mandate (dup of geo :777-786) · :1217 "Do
|
||||||
|
not proceed to STEP 12 until this plan is printed." · :1260-1261 +
|
||||||
|
:1342-1350 + :1502-1503 landing-page rule ×3 · :1309-1320 bundle
|
||||||
|
completeness checklist (10 checkboxes self-audit) · :1504 "Preserve
|
||||||
|
existing valid SEO." · :1522-1523 WebSearch-on-FULL extra-verify ·
|
||||||
|
:1525-1526 "Transparency. Every automated change logged" (VESTIGIAL —
|
||||||
|
agent applies nothing, pre-BDR-061).
|
||||||
|
|
||||||
|
### Class C sites — geo-analyzer.md
|
||||||
|
:48 "copy these patterns" · :124 "First action." + :127-139 ask-block
|
||||||
|
(unreachable when dispatched) · :230 conditional skip · :262-269 +
|
||||||
|
:873 + :1063-1065 PERMISSIVE default ×3 · :360 ordering · :394 "20-50
|
||||||
|
real customer questions (P0)" · :777-786 MANDATORY AI-index submission
|
||||||
|
(dup of seo :1159-1162) · :811 "Consolidate EVERY finding" · :823
|
||||||
|
"Print the plan before STEP 13" · :1102-1103 WebSearch extra-verify ·
|
||||||
|
:1106 "Every automated change logged in §14" (VESTIGIAL; §15 log is
|
||||||
|
dispatcher's per :959).
|
||||||
|
|
||||||
|
### Class B anchors (keep obligation, dedup emphasis)
|
||||||
|
CWD/TARGET MISMATCH twins (seo :117-126 ≈ geo :173-181) · url-guard
|
||||||
|
mandatory (seo :287-291 ≈ geo :273-277) · R2 refuse-to-score (seo
|
||||||
|
:519-548, geo :548-557; BDR-072) · NAP direction rule (seo :801-812,
|
||||||
|
geo :1073-1087; LRN-032-zenquality) · COVERAGE mandatory (seo
|
||||||
|
:1110-1130, geo :725-729; LRN-133) · never-apply/L1 (BDR-061; LRN-105
|
||||||
|
named-ban) · C1a build-output ban · no-invented-content/DGCCRF ·
|
||||||
|
"Compute the scores, do not feel them (I7)" (BDR-073) · §14 mandatory
|
||||||
|
disclosure lines (backlinks BDR-071, security headers I4) · honest
|
||||||
|
llms.txt framing · cite-sources (LRN-131).
|
||||||
|
|
||||||
|
## 6. Duplication map (sweep ALL twins — LRN-113)
|
||||||
|
|
||||||
|
seo internal: never-apply ×4 (:1227-1234, :1352-1357, :1468-1472,
|
||||||
|
:1527-1528) · landing-page ×3 (:1260, :1342, :1502) · shared-file
|
||||||
|
discipline ×2 (:1254, :1486) · bundle self-containment ×2 (:1249,
|
||||||
|
:1473) · COVERAGE ×4 (:438, :1000, :1096, :1110) · security-headers-
|
||||||
|
not-scored ×3 (:281, :977, :994) · 30/70 ×3 (:397, :614, :1165) ·
|
||||||
|
sentinel-verbatim ×3 (:1301, :1304, :1397).
|
||||||
|
geo internal: PERMISSIVE ×3 · never-apply ×4 (:826-832, :842-848,
|
||||||
|
:1031-1034, :1104-1105) · tier-mapping ×2 (:824, :850) ·
|
||||||
|
content_quality-advisory ×2 (:584, :622) · shared-file ×2 (:858,
|
||||||
|
:1047) · llms-honest ×2 (:337, :1066) · cite-sources ×2 (:17, :1089).
|
||||||
|
Cross-agent twins (stay twins — both files dispatch standalone):
|
||||||
|
CWD block · url-guard block · MODE DETECTION · MODE BOUNDARY · R2 ·
|
||||||
|
COVERAGE · NAP rule · RULES section skeleton · C1a · automation rule ·
|
||||||
|
Bing/AI-index action · CDN/WAF check.
|
||||||
|
Agent↔dispatcher duplication (stays — dispatch prompt is per-run
|
||||||
|
context, agent spec serves standalone/no-MODE paths): NAP ×4 total ·
|
||||||
|
shared-file ×7 · security-headers ×5 · domain split · weights 80/20-
|
||||||
|
75/25 · Historique · never-re-derive (test-locked dispatcher side).
|
||||||
|
|
||||||
|
## 7. Contradictions / ambiguities found
|
||||||
|
|
||||||
|
1. seo :1525-1526 + geo :1106 vestigial "automated change logged"
|
||||||
|
(agent applies nothing; geo :959 says dispatcher fills §15).
|
||||||
|
2. Ask-the-user blocks unreachable in dispatched path (seo :64-75,
|
||||||
|
:88-112; geo :127-139, :153-168); /geo:41 states it outright.
|
||||||
|
3. Collect boundary wording: agents "STEP 0-5 ONLY" vs /seo "STEP 2-5
|
||||||
|
only (context replaces STEP 0-1)" — works by prompt override.
|
||||||
|
4. geo judge does live work (sameAs curls :477-492, web_search) unlike
|
||||||
|
pure-judgment seo judge — asymmetric split, by design.
|
||||||
|
5. /harden imposes its own output contract (HARDEN.md, /100) the agent
|
||||||
|
spec never acknowledges; keys on "NARROW-SCOPE" in dispatch prompt.
|
||||||
|
6. "LRN-032" cite is ambiguous in THIS repo (local LRN-032 = different
|
||||||
|
lesson; the NAP lesson is zenquality's registry) — keep the
|
||||||
|
"zenquality" qualifier wherever cited.
|
||||||
|
7. geo :376-377 uncited FAQ-citation-rate claim vs geo :1089-1097
|
||||||
|
cite-sources rule (LRN-131 failure class).
|
||||||
|
8. Score-label parse fragility: client-handover extract_score fallback
|
||||||
|
greps FIRST X/20 in file — losing the `Score SEO` label would
|
||||||
|
silently read `TRAJECTORY TO 17/20` as 17.0. (Latent, downstream.)
|
||||||
|
9. GEO scoring has no deterministic engine (score.py covers SEO axes
|
||||||
|
only) — BDR-073 binds only half the pair.
|
||||||
|
|
||||||
|
## 8. Binding memory (from the analyzer's read-before)
|
||||||
|
|
||||||
|
IN FORCE: BDR-081 (premise) · LRN-139 (when-guidance shape) · BDR-061
|
||||||
|
(bundle+sentinel decision) · BDR-077 (mode split, fail-closed, locks
|
||||||
|
survive) · BDR-073 (deterministic scoring) · BDR-072 (R2 refuse) ·
|
||||||
|
BDR-071 (off-page ceiling + §14 line) · BDR-010/LRN-011 (labeled
|
||||||
|
scores gate) · LRN-133 (omission legible) · LRN-131/132/EVAL-025
|
||||||
|
(WebSearch ≠ verification) · LRN-105 (named ban stays explicit) ·
|
||||||
|
LRN-080/088 (measure before delete → dogfood) · LRN-113 (sweep whole
|
||||||
|
surface) · LRN-093 (no vacuous locks; single-line anchors) ·
|
||||||
|
LRN-126/137 (mode split carries data paths) · BLK-017 (Bing deferred).
|
||||||
|
|
||||||
|
## 9. Open questions → dispatcher decisions (see plan §4b)
|
||||||
|
|
||||||
|
Q1 freeze scope · Q2 census extension · Q3 dedup strategy ·
|
||||||
|
Q4 vestigial lines · Q5 /harden //onboard reconciliation.
|
||||||
@@ -0,0 +1,342 @@
|
|||||||
|
# PLAN v2 — De-prescribe seo-analyzer.md + geo-analyzer.md for Opus 5
|
||||||
|
|
||||||
|
Date: 2026-07-30 · Branch: feature/seo-geo-deprescription (off develop, started)
|
||||||
|
KIND: build-plan · Author: main-loop session (Fable 5)
|
||||||
|
Parent decision: BDR-081 N5 (deferred as separate project) · Method: LRN-139
|
||||||
|
v2: revised after the 3-lens challenge (§5bis) — every BLOCKER closed by a
|
||||||
|
named change; one confirmation challenger pass follows before execution.
|
||||||
|
|
||||||
|
## 1. Context & evidence (v2 — sizing corrected per simplicity#1)
|
||||||
|
|
||||||
|
Both agents are opus-pinned (BDR-076) → every judge phase runs Opus 5.
|
||||||
|
BDR-081 profile applies: literal following, over-verification when told
|
||||||
|
to verify, conflicting/duplicated rules burn reasoning tokens. These are
|
||||||
|
the LONGEST agent files in the repo (1528 + 1106 l) with real downstream
|
||||||
|
parsers — NOT the densest (measured: ~4.5 directive hits/100 l, ranks
|
||||||
|
20th/22nd; security-auditor is 17/100). What this pass buys, honestly:
|
||||||
|
(a) removal of self-output-verification demands (the one pattern the
|
||||||
|
baseline dogfood caught live: the judge reported "run twice, identical
|
||||||
|
output" — seo:970 firing), (b) removal of vestigial pre-BDR-061 lines
|
||||||
|
and 2 real contradictions, (c) small same-audience/same-range dedup,
|
||||||
|
(d) caps→when-guidance on choreography. The verification apparatus
|
||||||
|
(census + 3-lens challenge + before/after dogfood) is USER-DIRECTED for
|
||||||
|
this chantier, not derived from the density premise.
|
||||||
|
|
||||||
|
## 2. Contract surface (v2 — split per correctness#5)
|
||||||
|
|
||||||
|
### 2a. Machine-parsed (named non-LLM consumer: test, script, or literal
|
||||||
|
grep in a dispatcher step) — byte-frozen
|
||||||
|
- `model: opus`, `MODE: collect|judge|template`, `COLLECTION COMPLETE`
|
||||||
|
(model-routing.test.sh:67-68,150-157).
|
||||||
|
- `fetch.sh crux|queries` + `Performance GSC` (seo), `fetch.sh
|
||||||
|
schema_gen|content_quality` (geo) (seo-data.test.sh:538-543).
|
||||||
|
- `SEO|GEO JUDGE — VERDICT: ERROR(` — dispatcher ERROR CONTRACT
|
||||||
|
fail-closes on it (skills/seo:316-318, skills/geo:65-68).
|
||||||
|
- `## FIX BUNDLE` + sentinel `READY TO APPLY — awaiting dispatcher
|
||||||
|
confirmation` — apply step keys on it (skills/seo:524, skills/geo:101;
|
||||||
|
reused by /harden:366).
|
||||||
|
- `.audit/<seo|geo>-signals-<RUNID>.md` names + fail-closed load.
|
||||||
|
- STEP numbering: dispatchers address ranges literally (seo 2-5/6-11/
|
||||||
|
12-14; geo 0-5/6-12/13-15; depth-matrix:17-19,37).
|
||||||
|
- `**Score SEO** : XX.X / 20` / `**Score GEO** : XX.X / 20` labels —
|
||||||
|
client-handover-writer.md:344-345 labeled grep (BDR-010/LRN-011);
|
||||||
|
losing the SEO label silently falls back to first-X/20-in-file.
|
||||||
|
- Bundle item fields `id: applier: files: current: expected:` — pasted
|
||||||
|
verbatim into hotfixer/feater at L1; `applier: bash` run in-loop.
|
||||||
|
- url-guard call sites: seo-analyzer.md:287-295, geo-analyzer.md:273-280
|
||||||
|
(NOT ":257" as v1 said — robustness#5) + sitemap-URL guard seo:573-582.
|
||||||
|
- `NARROW-SCOPE` keying of the I4 carve-out (seo:981-983) — /harden's
|
||||||
|
dispatch prompt relies on it.
|
||||||
|
|
||||||
|
### 2b. LLM-convention contracts (no code consumer; the dispatcher LLM
|
||||||
|
merges by these shapes) — locked in the census, still frozen
|
||||||
|
`SEO|GEO AGENT RESULT` envelopes · `## SECTION FOR SEO.md §N` ·
|
||||||
|
`## ENTRIES FOR SEO.md` · `SEO|GEO SCORING (` blocks + `COVERAGE
|
||||||
|
SOURCE`/`COVERAGE LIVE` lines + `GLOBAL (weighted)` · `TRAJECTORY TO
|
||||||
|
17/20 (code-only)` · `FIX PLAN (` (seo) · batch labels A-F / G1-G7
|
||||||
|
(tier recognition tolerant, labels nominal) · `COLLECT REPORT` +
|
||||||
|
`STATUS: DONE|BLOCKED` · `Automatisation possible avec:` · §0-§15
|
||||||
|
report skeleton + Historique. CROSS-AGENT NOTES emit-instruction lives
|
||||||
|
in /seo's dispatch prompts (dispatcher-side lock only).
|
||||||
|
|
||||||
|
## 3. Class B invariants — obligation kept, single strongest statement;
|
||||||
|
security ORDERINGS byte-frozen (robustness#5/#7)
|
||||||
|
|
||||||
|
- Guard-first orderings, frozen verbatim: seo:287-291 / geo:273-277
|
||||||
|
("Guard the domain before it reaches a shell… Run the guard FIRST…
|
||||||
|
never 'clean up' the value and retry") + seo:573-582 URL loop.
|
||||||
|
- seo:550 "Record the denominator BEFORE sampling" — the ordering IS
|
||||||
|
the honesty mechanism (a post-hoc denominator is self-serving);
|
||||||
|
frozen; only surrounding prose may compress.
|
||||||
|
- NAP direction rule (LRN-032-zenquality — keep the qualifier, the bare
|
||||||
|
ID is ambiguous in this repo), R2 refuse-to-score (BDR-072), COVERAGE
|
||||||
|
obligations (LRN-133 — note :436-439 is a DISTINCT index-reach
|
||||||
|
obligation, not a repeat), §14 mandatory disclosure lines (BDR-071
|
||||||
|
backlinks verbatim line, I4 security-headers), never-apply/L1
|
||||||
|
(BDR-061; LRN-105 named ban), C1a build-output ban, no-invented-
|
||||||
|
content/DGCCRF, deterministic scoring (BDR-073), fail-closed judge,
|
||||||
|
shared-file Edit-not-Write discipline, honest llms.txt framing,
|
||||||
|
cite-sources (LRN-131).
|
||||||
|
- External-freshness checks are NOT self-verification (robustness#6):
|
||||||
|
seo:1522-1523 + geo:1102-1103 verify a DRIFTING WORLD feeding an
|
||||||
|
AUTO-tier robots.txt edit — kept, reworded as when-guidance ("crawler
|
||||||
|
lists shift; cross-check before emitting G1 from the dated resource").
|
||||||
|
|
||||||
|
## 4. Work items v2
|
||||||
|
|
||||||
|
- P0 SEQUENCING + LIVE-TREE EXPOSURE (robustness#4, conf#2/#3/#4/#9):
|
||||||
|
agents/ resolves through ~/.claude symlinks to the WORKING TREE —
|
||||||
|
edits are live between Edit calls, before any commit. Rules:
|
||||||
|
(1) the FULL baseline completes before the first agent edit —
|
||||||
|
signals + judge reports + TEMPLATE envelopes + merged SEO.md +
|
||||||
|
HUMAN-ACTIONS.md (conf#2: without frozen template artifacts the
|
||||||
|
template-range edits would have no differential and P0 makes one
|
||||||
|
unobtainable later);
|
||||||
|
(2) all baseline artifacts copied to the DURABLE, gitignored
|
||||||
|
`.audit/dogfood-baseline/` in this repo before the first edit
|
||||||
|
(conf#9: the session scratchpad dies with the session/reboot;
|
||||||
|
LRN-124: .audit/** is never committed);
|
||||||
|
(3) freeze window: no /seo //geo //harden //onboard AND no
|
||||||
|
/client-handover (spawns /seo — conf#3) nor any skill transitively
|
||||||
|
dispatching either analyzer, in ANY project, until the after-dogfood
|
||||||
|
verdict;
|
||||||
|
(4) aborts (conf#4): mid-reword interrupt or after-dogfood failure →
|
||||||
|
`git checkout HEAD -- agents/seo-analyzer.md agents/geo-analyzer.md`
|
||||||
|
(in-flight revert, index-safe); `git checkout develop -- agents/…`
|
||||||
|
is reserved for a WHOLE-BRANCH abandon; after an abort the named
|
||||||
|
exit is either (a) fix + re-run the after-dogfood, or (b) present
|
||||||
|
the static evidence (census + git diff review) to the human who may
|
||||||
|
accept or abandon at the gate — no open-ended reverted state.
|
||||||
|
- P1 CENSUS (commit 1, test-only, green pre-reword — compatible with
|
||||||
|
§7's same-commit rule: it locks EXISTING state and changes no agent
|
||||||
|
file; reword commits carry any census DELTA): DONE in working tree —
|
||||||
|
lib/tests/seo-geo-contract.test.sh 54/0, shellcheck clean, real
|
||||||
|
flip-test run: 7 scratch mutations → 7 FAILs (not "by construction" —
|
||||||
|
robustness#10). File-qualified locks (correctness#4): `FIX PLAN (` +
|
||||||
|
`applier: bash` + `Score SEO` seo-only; `Score GEO` geo-only.
|
||||||
|
Incidental locks dropped (CROSS-AGENT NOTE agent-side, bare
|
||||||
|
`applier:`). Item fields locked both files. v3 (conf#5): EVERY
|
||||||
|
`## STEP n —` header locked, interiors included (seo 0-14, geo 0-15)
|
||||||
|
— census now 71/0. Freeze mechanism for the
|
||||||
|
~40 A-sites the census does not cover: reviewed `git diff -U0
|
||||||
|
agents/*.md` on each reword commit (simplicity#4).
|
||||||
|
- P2 REWORD seo-analyzer.md (commit 2):
|
||||||
|
(a) Self-OUTPUT verification, v3 (conf#1/#8 — neither is deleted
|
||||||
|
outright): :970-971 "run it twice" → when-guidance integrity
|
||||||
|
guard ("if the findings JSON changed after scoring, re-run and
|
||||||
|
explain the move" — score.py is deterministic, so a moving
|
||||||
|
output means mutated findings: anti-score-shopping, BDR-073;
|
||||||
|
the unconditional double-run the baseline judge burned goes
|
||||||
|
away, the guard stays); :1217 "Do not proceed until printed" →
|
||||||
|
when-guidance scoped to the single-shot path ("single-shot runs
|
||||||
|
print the FIX PLAN before STEP 12 serializes it" — MODE: judge
|
||||||
|
stops at 11, but /harden //onboard execute the whole file,
|
||||||
|
conf#1). The completeness checklist :1309-1320 is NOT deleted:
|
||||||
|
its routing rows (stock-photo→GATED(E), compression→AUTO(bash)
|
||||||
|
or §11, aggregateRating→AUTO(hotfixer), structural→GATED(D)…)
|
||||||
|
are unique routing content (robustness#3) — reshape into a plain
|
||||||
|
mapping table, drop only the checkbox self-audit framing.
|
||||||
|
(b) DELETE vestigial :1525-1526 (contradicts BDR-061; Q4).
|
||||||
|
(c) DEDUP under the invariant (correctness#1 + robustness#1): only
|
||||||
|
VERBATIM same-AUDIENCE (spec rule / bundle-item payload /
|
||||||
|
phase-local caveat) same-MODE-RANGE (collect 0-5 / judge 6-11 /
|
||||||
|
template 12-14 / RULES=global) repeats merge. Expected survivors
|
||||||
|
per family listed at execution in the commit message; honest
|
||||||
|
net: never-apply 4→3 (RULES pair merges; template-range
|
||||||
|
statements stay), sentinel-verbatim reminders 3→2, landing-page
|
||||||
|
3→2 (payload instance :1260 + one spec statement; :1342 vs
|
||||||
|
:1502 merge), bundle-self-containment 2→1 (same range).
|
||||||
|
NOT deduped (v1 was wrong — distinct rules or cross-range):
|
||||||
|
COVERAGE ×4, 30/70 ×3, security-headers ×3, shared-file
|
||||||
|
discipline (payload vs spec audiences).
|
||||||
|
(d) SOFTEN caps/orderings to when-guidance, keeping semantics:
|
||||||
|
:61, :508 (gate stays before on-page scoring; emphasis drops),
|
||||||
|
:875, :1147, :1149-1157 CMS-plugin-first folded together with
|
||||||
|
:143-148 into ONE statement (correctness#3 — two strengths of
|
||||||
|
one rule otherwise), :1159-1162 Bing (content rule kept, caps
|
||||||
|
drop; FULL-only → statically verified), essays :606-618 +
|
||||||
|
:661-680 compressed keeping the rule + LRN citations; :602-604
|
||||||
|
kept as a when-guidance failure detector ("families ≈ URLs →
|
||||||
|
the heuristic broke — say so"), not deleted (robustness#8).
|
||||||
|
(e) Dispositions completing the C-list (correctness#3): :208-210 →
|
||||||
|
static pointer ("the CDN/WAF twin check lives in geo STEP 4");
|
||||||
|
:1504 KEEP as-is (one-line scope guard).
|
||||||
|
- P3 REWORD geo-analyzer.md (commit 3), same invariant:
|
||||||
|
PERMISSIVE ×3: ALL survive (collect/template/RULES ranges;
|
||||||
|
:873 is the item-level default guarding an unconfirmed AUTO
|
||||||
|
robots.txt edit — named survivor, robustness#9). never-apply 4→3
|
||||||
|
(RULES pair merges). tier-mapping :824/:850 BOTH stay (judge vs
|
||||||
|
template ranges). content_quality-advisory 2→1 (same range).
|
||||||
|
shared-file 2× stays (payload vs spec). llms-honest 2× stays
|
||||||
|
(collect vs RULES). cite-sources 2× stays (:17 guards the header
|
||||||
|
stats specifically). :1106 vestigial → reworded to the truth
|
||||||
|
(dispatcher fills the log — matches :959; Q4). :777-786 caps →
|
||||||
|
plain content rule (FULL-only). :1102-1103 → freshness
|
||||||
|
when-guidance (kept — §3). :394 quantity softened ("substantial,
|
||||||
|
real customer questions"). :48 softened. :124-139 ask-block KEPT
|
||||||
|
(standalone path). Orderings :360/:811/:823 softened. :376-377
|
||||||
|
uncited claim → honest framing (no invented source).
|
||||||
|
- P4 DOGFOOD AFTER (v3 — ordered by decisiveness, conf#7): fresh copy
|
||||||
|
of zenquality-frozen; phases in this order so a mid-run death still
|
||||||
|
leaves the decisive evidence (billing class already realised once):
|
||||||
|
(ii-first) judges fed the FROZEN baseline signals
|
||||||
|
(.audit/dogfood-baseline/) → judge reports vs frozen baseline judge
|
||||||
|
reports, ZERO collect variance — the decisive Opus-judge-prose
|
||||||
|
differential; (iii) templates on those judge reports → envelopes,
|
||||||
|
compared against the frozen BASELINE envelopes — the template
|
||||||
|
verdict anchors on ENVELOPES only (SEO.md/HUMAN-ACTIONS.md are
|
||||||
|
dispatcher-merged by this authoring session, non-attributable —
|
||||||
|
conf#10); (i-last) fresh collects, same pre-answered context →
|
||||||
|
(a) shape check of signals/COLLECT REPORT vs baseline, (b)
|
||||||
|
FIELD-LEVEL diff of the fresh signals vs baseline signals (record
|
||||||
|
blocks, COVERAGE counts, denominators — a shape-valid file with a
|
||||||
|
dropped field must be caught, conf#6), and (c) ONE end-to-end seo
|
||||||
|
judge on the FRESH signals (the domain with the most collect-range
|
||||||
|
edits) so the reworded collect→judge handoff runs at least once.
|
||||||
|
Comparison mechanical-first: presence-assertion script (named home:
|
||||||
|
`.audit/dogfood-baseline/assert-after.sh`, session-reproducible,
|
||||||
|
never committed — conf#11) + a FRESH reader agent diffing
|
||||||
|
before/after WITHOUT this plan in context (correctness#7); the
|
||||||
|
authoring session only arbitrates its report. If the after-run dies:
|
||||||
|
P0(4) abort + named exit applies; no merge request meanwhile.
|
||||||
|
- P5 GATES: make test full suite (census + model-routing + seo-data +
|
||||||
|
no-vacuous-locks) · shellcheck on touched .sh · per-RANGE grep sweep
|
||||||
|
for every deduped family (asserts the named survivor lines exist in
|
||||||
|
their ranges — mode-blind ≥1× sweep is insufficient, robustness#1) ·
|
||||||
|
MEASURED deltas recorded (simplicity#7): wc -l + directive-token
|
||||||
|
census (annex §0 grep set) per file, before/after, into the BDR.
|
||||||
|
(v1's manual MODE/STEP sweep dropped — the census asserts it,
|
||||||
|
simplicity#5.)
|
||||||
|
- P6 CAPITALIZE: BDR (decision, invariant, deltas, alternatives), LRN
|
||||||
|
(audience×range dedup invariant — reusable), journal, CHANGELOG.
|
||||||
|
TODO C1 checked. NO merge (human gate). Checkpoint report includes
|
||||||
|
the DYNAMICALLY-UNVERIFIED list (§6bis).
|
||||||
|
|
||||||
|
## 4b. Dispatcher decisions (v2)
|
||||||
|
|
||||||
|
- Q1 freeze scope: all §2a byte-frozen + §2b frozen via census; the
|
||||||
|
remaining unlocked A-prose freeze = per-commit git diff review.
|
||||||
|
- Q2 census: done (P1), flip-proven.
|
||||||
|
- Q3 dedup: WITHIN-file, same-AUDIENCE, same-MODE-RANGE, verbatim
|
||||||
|
repeats only. Cross-agent + agent↔dispatcher twins stay. (Mechanism
|
||||||
|
note correcting robustness#1's premise: every dispatch loads the FULL
|
||||||
|
agent file; the risk is ATTENTIONAL — a literal-following model told
|
||||||
|
"run STEP 13-15" deprioritizes guidance scoped to another step's
|
||||||
|
body — not access. Same fix either way.)
|
||||||
|
- Q4 vestigial: seo :1525-1526 DELETE; geo :1106 REWORD to
|
||||||
|
dispatcher-owns-log (correctness#6 resolved).
|
||||||
|
- Q5 /harden //onboard: out of scope (N6); their dispatch-prompt
|
||||||
|
contracts are untouched by agent-file rewording; `NARROW-SCOPE`
|
||||||
|
keying frozen (§2a).
|
||||||
|
|
||||||
|
## 5. Dogfood protocol (v2)
|
||||||
|
|
||||||
|
Baseline (DONE for collect+judge SEO; geo judge in flight at v2 time):
|
||||||
|
frozen zenquality copy (no .env), inline pipeline (canonical /seo shape
|
||||||
|
— the nested-CLI attempt died on the CLI monthly spend limit, recorded),
|
||||||
|
absolute PROJECT ROOT in every dispatch, `/seo local conservative`,
|
||||||
|
STEP 0 pre-answered, NAP = NAP-KIT.md (user-confirmed 2026-07-10).
|
||||||
|
Baseline artifacts frozen under the DURABLE `.audit/dogfood-baseline/`
|
||||||
|
(gitignored, never committed — conf#9): signals ×2, judge reports ×2,
|
||||||
|
template ENVELOPES ×2, merged SEO.md, HUMAN-ACTIONS.md (conf#2 — the
|
||||||
|
template phase runs to completion BEFORE the first agent edit).
|
||||||
|
After-run per P4. LIMITS stated honestly
|
||||||
|
(robustness#2): conservative never enters STEP 1b/1.5 (no applier parses
|
||||||
|
an item this run — the item-field contract is census-locked statically);
|
||||||
|
LOCAL never executes STEP 3-4/6-7 FULL branches (Bing/AI-index emission
|
||||||
|
text, live checks — the FULL-only conditionals were exercised and
|
||||||
|
correctly declined in the baseline judge). These stay on the
|
||||||
|
§6bis unverified list for the human gate; a FULL/aggressive dry-run is
|
||||||
|
an OPTION the user may order at checkpoint, not part of this plan.
|
||||||
|
|
||||||
|
## 5bis. CHALLENGE SYNTHESIS (2026-07-30)
|
||||||
|
|
||||||
|
Verdicts: correctness FATAL(3) [1 BLOCKER, 2 MAJOR, 4 MINOR] ·
|
||||||
|
robustness FATAL(9) [3 BLOCKER, 6 MAJOR, 2 MINOR] · simplicity
|
||||||
|
CONCERNS(3) [3 MAJOR, 4 MINOR]. All three lenses returned. Every
|
||||||
|
BLOCKER closed by a named v2 change:
|
||||||
|
- correctness#1 (audience-blind dedup) + robustness#1 (mode-blind
|
||||||
|
dedup) → §4b Q3 invariant + P2(c)/P3 rewritten + P5 per-range sweep.
|
||||||
|
- robustness#2 (dogfood can't reach riskiest edits) → §5 honest limits
|
||||||
|
+ §6bis unverified list + P2(d)/P3 minimal-diff on FULL-only sites +
|
||||||
|
static census cover; FULL/aggressive run offered to the human, not
|
||||||
|
silently added (billing exposure robustness#11).
|
||||||
|
- robustness#3 (routing table misfiled as self-check) → P2(a) keeps
|
||||||
|
routing rows verbatim.
|
||||||
|
Majors adopted: R4 live-tree abort path (P0) · R5 url-guard anchors
|
||||||
|
corrected + security orderings frozen (§2a/§3) · R6 external-freshness
|
||||||
|
kept (§3) · R7 :550 frozen (§3) · R8 :602 kept as detector (P2(d)) ·
|
||||||
|
R9 :873 named survivor (P3) · C2 folded into R2's resolution · C3 full
|
||||||
|
dispositions (P2(d)/(e), P3) · S1 §1 rewritten · S2 controlled
|
||||||
|
judge-replay (P4) · S3 mechanical presence script (P4). Minors adopted:
|
||||||
|
C4 file-qualified locks · C5 §2 split · C6 three inconsistencies
|
||||||
|
resolved (P1 note, Q4, N1 marker) · C7 fresh-reader diff · S4 diff-
|
||||||
|
review freeze · S5 sweep dropped · S6+R10 census corrected+flip-proven ·
|
||||||
|
S7 measured deltas. Rejected/scoped: S1's apparatus-shrinking (the
|
||||||
|
apparatus is user-directed); R1's access premise corrected to
|
||||||
|
attentional (fix adopted unchanged).
|
||||||
|
|
||||||
|
CONFIRMATION PASS (robustness lens, v2 → v3): FATAL(9) — 2 BLOCKER +
|
||||||
|
7 MAJOR/MINOR, all targeting the v2 amendments as asked. Closed by
|
||||||
|
name: conf#1 no-MODE single-shot → §6bis + P2(a) :1217 scoped-softened
|
||||||
|
· conf#2 missing baseline template artifacts → P0(1) full-baseline
|
||||||
|
precondition · conf#3 /client-handover freeze → P0(3) · conf#4 abort
|
||||||
|
HEAD-vs-develop + named exit → P0(4) · conf#5 interior STEP locks →
|
||||||
|
census extended to all headers (71/0) · conf#6 collect→judge seam →
|
||||||
|
P4(i) field-diff + one end-to-end seo judge on fresh signals · conf#7
|
||||||
|
decisiveness order → P4 reordered (ii)→(iii)→(i) · conf#8 :970
|
||||||
|
anti-score-shopping → when-guidance reword, not deletion · conf#9
|
||||||
|
volatile baseline → durable .audit/dogfood-baseline/ · conf#10
|
||||||
|
dispatcher-owned artifacts → envelope-anchored template verdict ·
|
||||||
|
conf#11 script home named. Challenge budget exhausted (1 re-pass max):
|
||||||
|
residual risk goes to the human gate with this record.
|
||||||
|
|
||||||
|
## 6. Explicitly NOT doing
|
||||||
|
|
||||||
|
- N1 No dispatcher (SKILL.md) edits.
|
||||||
|
- N2 No scoring-weight, axis, or depth-matrix changes.
|
||||||
|
- N3 No model-pin changes (BDR-076).
|
||||||
|
- N4 No weakening of class-B invariants (§3 hardened in v2: security
|
||||||
|
orderings byte-frozen).
|
||||||
|
- N5 No new modes, no pipeline reshaping (BDR-077).
|
||||||
|
- N6 No /harden //onboard contract reconciliation (annex §7.5).
|
||||||
|
- N7 No collect-boundary wording fix (works by prompt override).
|
||||||
|
- N8 No cross-agent shared-resource consolidation.
|
||||||
|
- N9 No deterministic GEO score engine (annex §7.9).
|
||||||
|
- N10 No FULL/aggressive dogfood in this plan (user option at gate).
|
||||||
|
|
||||||
|
## 6bis. Dynamically-unverified edit surface (for the human gate)
|
||||||
|
|
||||||
|
Sites edited by P2/P3 that no dogfood run executes: FULL-branch content
|
||||||
|
(seo :1159-1162 Bing emission, geo :777-786 AI-index emission, both
|
||||||
|
freshness when-guidances), apply-path parsing (STEP 1b/1.5 — item
|
||||||
|
pasted into appliers; covered statically by census item-field locks +
|
||||||
|
frozen bundle templates), STEP 6-7 external-presence prose, and the
|
||||||
|
no-MODE single-shot path (conf#1: /harden and /onboard dispatch the
|
||||||
|
agents without a MODE line — "all steps in sequence" — so the whole
|
||||||
|
reworded body drives those runs; every never-apply and ordering
|
||||||
|
statement that path relies on keeps a surviving instance, and :1217
|
||||||
|
is softened-scoped to it, never deleted). Mitigation: minimal diffs
|
||||||
|
there (caps→plain only), census locks, git-diff review.
|
||||||
|
|
||||||
|
## 4c. Backlog surfaced (not this branch)
|
||||||
|
|
||||||
|
- Score-label fallback fragility in client-handover-writer.md (can read
|
||||||
|
`TRAJECTORY TO 17/20` as 17.0 if the label vanishes) — annex §7.8.
|
||||||
|
- Stale lib/ line-number comments pointing at agent lines (annex §1).
|
||||||
|
- Baseline judge's gate observation: /client-handover 17/20 gate passes
|
||||||
|
with an open `critique` finding — "open critique = independent
|
||||||
|
blocker" is worth its own decision.
|
||||||
|
|
||||||
|
## 7. Constraints for challengers
|
||||||
|
|
||||||
|
- Registries append-only; census green throughout; reword commits keep
|
||||||
|
54/0 + model-routing + seo-data locks green.
|
||||||
|
- Agent files symlink-live INCLUDING between Edit calls (P0 abort path).
|
||||||
|
- §2a byte-identical; §2b frozen; STEP numbering preserved; §3 security
|
||||||
|
orderings verbatim.
|
||||||
|
- Dedup only same-audience + same-mode-range verbatim repeats; named
|
||||||
|
survivors per family in commit messages; P5 per-range sweep.
|
||||||
|
- The judge phase is Opus 5; collect/template Sonnet — literal
|
||||||
|
following applies to all (E5 "since 4.7").
|
||||||
|
- Baseline artifacts frozen before first edit; after-run design per P4.
|
||||||
@@ -0,0 +1,82 @@
|
|||||||
|
#!/usr/bin/env bash
|
||||||
|
# lib/tests/seo-geo-contract.test.sh — census: seo/geo agent ⇄ dispatcher
|
||||||
|
# machine contract (C1 de-prescription, 2026-07-30). Locks every string a
|
||||||
|
# consumer parses BEFORE the choreography reword, so the reword commits
|
||||||
|
# prove contract preservation by keeping this green. Complements
|
||||||
|
# model-routing.test.sh (which already locks model pins + MODE:* +
|
||||||
|
# COLLECTION COMPLETE).
|
||||||
|
set -u
|
||||||
|
R="$(cd "$(dirname "$0")/../.." && pwd)"
|
||||||
|
pass=0; fail=0
|
||||||
|
ok() { pass=$((pass+1)); }
|
||||||
|
ko() { fail=$((fail+1)); printf 'FAIL %s\n' "$1"; }
|
||||||
|
has() { if grep -qF "$2" "$R/$1"; then ok; else ko "$1 missing: $2"; fi; }
|
||||||
|
|
||||||
|
SEO=agents/seo-analyzer.md
|
||||||
|
GEO=agents/geo-analyzer.md
|
||||||
|
|
||||||
|
# 1) judge verdict grammar — DISPATCHER ERROR CONTRACT (skills/seo STEP 1,
|
||||||
|
# skills/geo STEP 1B) fail-closes on this exact shape
|
||||||
|
has "$SEO" 'SEO JUDGE — VERDICT: ERROR('
|
||||||
|
has "$GEO" 'GEO JUDGE — VERDICT: ERROR('
|
||||||
|
has "skills/seo/SKILL.md" 'SEO JUDGE — VERDICT: ERROR('
|
||||||
|
has "skills/geo/SKILL.md" 'GEO JUDGE — VERDICT: ERROR('
|
||||||
|
|
||||||
|
# 2) fix-bundle section + apply sentinel — parsed by /seo STEP 1b/1.5 and
|
||||||
|
# /geo STEP 1b/2 before any L1 apply
|
||||||
|
for f in "$SEO" "$GEO" skills/seo/SKILL.md skills/geo/SKILL.md; do
|
||||||
|
has "$f" '## FIX BUNDLE'
|
||||||
|
has "$f" 'READY TO APPLY — awaiting dispatcher confirmation'
|
||||||
|
done
|
||||||
|
|
||||||
|
# 3) signals handoff — judge loads the collect artifact fail-closed
|
||||||
|
has "$SEO" '.audit/seo-signals-'
|
||||||
|
has "$GEO" '.audit/geo-signals-'
|
||||||
|
has "skills/seo/SKILL.md" '.audit/seo-signals-<RUNID_SEO>.md'
|
||||||
|
has "skills/geo/SKILL.md" '.audit/geo-signals-<RUNID>.md'
|
||||||
|
|
||||||
|
# 4) STEP numbering — dispatchers reference agent step ranges literally:
|
||||||
|
# /seo: "STEP 2-5" collect · "STEP 6-11" seo judge · "STEP 6-12" geo
|
||||||
|
# judge · "STEP 12-14" seo template · "STEP 13-15" geo template;
|
||||||
|
# /geo: "STEP 0-5". Lock EVERY step header on the agent side (interiors
|
||||||
|
# too — merging/renumbering one silently re-points the dispatch ranges)
|
||||||
|
# and the ranges on the dispatcher side.
|
||||||
|
for n in 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14; do has "$SEO" "## STEP $n —"; done
|
||||||
|
for n in 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15; do has "$GEO" "## STEP $n —"; done
|
||||||
|
has "skills/seo/SKILL.md" 'STEP 2-5'
|
||||||
|
has "skills/seo/SKILL.md" 'STEP 6-11'
|
||||||
|
has "skills/seo/SKILL.md" 'STEP 6-12'
|
||||||
|
has "skills/seo/SKILL.md" 'STEP 12-14'
|
||||||
|
has "skills/seo/SKILL.md" 'STEP 13-15'
|
||||||
|
has "skills/geo/SKILL.md" 'STEP 0-5'
|
||||||
|
has "skills/geo/SKILL.md" '6-12, report scoring' # "STEP\n6-12" line-wraps
|
||||||
|
has "skills/geo/SKILL.md" 'STEP 13-15'
|
||||||
|
|
||||||
|
# 5) collect-mode report emission (dispatcher waits on it between phases)
|
||||||
|
has "$SEO" 'COLLECT REPORT'
|
||||||
|
has "$GEO" 'COLLECT REPORT'
|
||||||
|
|
||||||
|
# 6) bundle-item routing + the item fields the L1 appliers parse
|
||||||
|
# (the item is pasted verbatim into hotfixer/feater — /seo STEP 1.5)
|
||||||
|
for f in "$SEO" "$GEO"; do
|
||||||
|
has "$f" 'applier: hotfixer'
|
||||||
|
has "$f" 'applier: feater'
|
||||||
|
has "$f" ' files:'
|
||||||
|
has "$f" ' current:'
|
||||||
|
has "$f" ' expected:'
|
||||||
|
done
|
||||||
|
has "$SEO" 'applier: bash'
|
||||||
|
|
||||||
|
# 7) cross-agent escalation block — merged into SEO.md §11 by /seo STEP 2.
|
||||||
|
# The emit instruction lives in /seo's DISPATCH PROMPTS, not in the agent
|
||||||
|
# specs (geo-analyzer.md never mentions it; seo-analyzer.md only once,
|
||||||
|
# incidentally — NOT locked, it is prose). Lock the dispatcher side only.
|
||||||
|
has "skills/seo/SKILL.md" 'CROSS-AGENT NOTES TO'
|
||||||
|
|
||||||
|
# 8) trajectory block — mandatory in envelopes (/geo audit-end deliverables,
|
||||||
|
# /seo §1 merge)
|
||||||
|
has "$SEO" 'TRAJECTORY TO 17/20'
|
||||||
|
has "$GEO" 'TRAJECTORY TO 17/20'
|
||||||
|
|
||||||
|
printf 'seo-geo contract locks: %d pass, %d fail\n' "$pass" "$fail"
|
||||||
|
[ "$fail" -eq 0 ]
|
||||||
Reference in New Issue
Block a user