Commit Graph
47 Commits
Author SHA1 Message Date
bchanot 264c5fa3fc docs(docs): RUST.md §10.8 R4.6 record (buffers, memory, parity, E3/E4 three engines, release series, W1, risks); ledger targets filled; compare-exports script; roundtrip raster-failure case; TODO R4.6 closed; memory BDR-062, LRN-063/064, journal 2026-10-19 02:49:42 +02:00
bchanot 9e688b6801 feat(domain): R4.6 ExportSession (incremental export, OD-2): rasters decoded and written on arrival, chunked file handed out in parts, views composed by the core, raster_size_of (O4); wasm ExportSession and CoreExportSession; R4 digests re-frozen (catalog and page tree written last, B2) 2026-10-19 01:15:43 +02:00
bchanot babe7b76d2 test(tests): R4.5 timing of the L export with real rasters (ignored by default, release only) 2026-10-18 23:28:45 +02:00
bchanot ba6ac078be test(tests): R4.5 export-side security cases; ledger rows of the writer cases point at cargo (only the R4.7 compare rows pending) 2026-10-18 23:24:37 +02:00
bchanot 4d45de5745 feat(domain): R4.5b/c serialiser, export driver, self-check, from_envelope; O2 parity suite
objects.rs (own minimal writer: numbered objects, streams, classic xref, pdf-lib's string
forms; pdf-writer not used: every number spelt through numberToString, no f32), serialize.rs
(catalog with names tree and AF, pages, 3 Type1 WinAnsi fonts, image XObjects with the
DeviceGray SMask, Link annotations with hex ASCII URIs, Info with Producer/Creator
Faunosteo, the Flate attachment with Params and Filespec), export.rs (checks → envelope
as JSON.stringify(_, null, 2) → layout → file → self-check through the R4 reader;
export_from_envelope). cargo pdf_serialize against the 14 R3 PDFs: content streams equal
after resource-name resolution, image planes and SMasks equal, links equal, Info equal
but Producer/Creator, attachment bytes equal (store path: values equal, D-R11 order);
qpdf --check clean, pdfdetach lists the attachment, poppler 150 dpi 0 pixel differs on
14 runs; R4 PDF → Rust import = R3 PDF import, re-export from the envelope byte-identical;
R4 output digests frozen in goldens/r4/pdf.*.sha256.
2026-10-18 23:10:18 +02:00
bchanot d7984449ed feat(domain): R4.5a PNG gate (pngIssue port) and UPNG-rule decoder (O6 108/108)
The branding gate in pngIssue's order; the decoder reproduces UPNG's decode and toRGBA8
(typed-array semantics, first-row filter rewrite, the Average first-row pre-pass at
absolute offsets, the 16-bit grey tRNS key at off + x, 16-bit high byte, palette tRNS by
declared length), pdf-lib's alpha drop; caps checked before any allocation; crafted
files refused (animated, text chunks without NUL, broken streams) where UPNG spun or
threw. 108 O6 rows equal; 50 hostile files return in under 20 ms.
2026-10-18 23:07:28 +02:00
bchanot d420f67352 feat(domain): R4.5a content stream emitter: pdf-lib operator sequences and numberToString byte for byte
drawText/drawImage/drawLine/drawRectangle as pdf-lib 1.17.1 emits them (cleanText, 24 TL,
upper-case hex, the doubled m of drawLine, the h f of a filled rectangle); numberToString
with the e-N / e+N branches and V8's Math.pow(10, k) one-ULP quirk at k = 23 and 210;
WinAnsi text encoding. The 12 R3 PDFs' 60 content streams (224,534 bytes) equal the
emitter's output from the O1 logs with only the resource names renamed; 703 O4 cases.
2026-10-18 22:54:04 +02:00
bchanot 5dd4c26f18 chore(domain): R4.5 scaffold: content and png modules, test targets, lopdf as a dev-dependency 2026-10-18 22:41:46 +02:00
bchanot 1550d2160a test(tests): R4.4 layout timing on L and CAP; ledger rows of the text and layout cases point at cargo 2026-10-18 21:51:40 +02:00
bchanot 70007e0c93 feat(domain): R4.4 layout to a draw log: text rules, AFM metrics, dates (O4, O5, O6) and the page layouts (O1)
pdf::write: text (safe_text with the frozen V8 classes, js_upper from the O4 tables,
js_trim, measure = Σ(WX || 250 + KPX) × size / 1000 over WinAnsi bytes, wrap_lines on JS
\s), afm_data generated by scripts/r4-afm-data.mjs from O5 and O4, dates (Date.UTC years
0-99 → 19xx, fr-FR / en-US long dates), input checks (branding and labels schemas,
snapshot gate with the R3 SVG reader, sheet mismatch, page caps), the header, footer,
observation and conclusion layouts into a DrawLog (per page, footers last, links by page).
cargo: O4 55,992 widths bit-exact, 1,168 wraps, safeText over every code point, upper
1,580, O6 6,468 cells + 22; O1 12 runs 2,124 ops equal at full precision; the Step 6 text
and image goldens (24) derive from the log. ts-rs: ExportInput, ExportErrorKind,
ExportWarning, LogoSlot.
2026-10-18 21:47:40 +02:00
bchanot 71bcb742c9 feat(domain): R4.4 scaffold of the pdf writer module (feature pdf-write, text contract, test targets) 2026-10-18 21:31:10 +02:00
bchanot cad485b13c test(tests): fix the pinned value count past the depth cap (65 + 1000 + 65); doc comment 2026-10-18 16:35:54 +02:00
bchanot 593893a7c2 fix(domain): OD-3 value count runs past the depth cap; the rescue-copy guard covers the archive text
Security gate finding (R4.2): prescan stopped counting once the depth exceeded 64, so a
16 MiB rescue copy nested 65 deep passed the value budget with 66 values and built its
792 MiB tree. The count now runs to the end (the depth verdict unchanged, the PDF probe
unchanged); the class is in the budget suite (48 MiB, refused) and pinned in cargo.
2026-10-18 16:28:32 +02:00
bchanot 2661a68b16 test(tests): R4.2 seeded mutation robustness of the PDF reader (no panic on content) 2026-10-18 16:17:36 +02:00
bchanot ebcae06ac1 test(tests): R4.2 ledger: reader rows point at their cargo tests, census checks they exist
69 ported rows of scan, inflate, read and the security import cases now name the O7/O9
cargo tests; r4-ledger.mjs refuses a ported cargo target absent from cargo test --list.
2026-10-18 16:14:10 +02:00
bchanot 6ee04c96c5 feat(domain): R4.2e OD-3 value cap (400,000), rescue-copy guard, 1 GiB linear ceiling, budget measurements
json_js::MAX_JSON_VALUES from the R4.2e measurements (CAP envelope 39,652 values, 612-leaf
export 23,803; ~100 B of tree per value, a 16 MiB dense document 784 MiB with the cap off,
16 MiB with it); draft.restore refuses an over-budget copy as invalid; --max-memory 1 GiB
proven to trap on the proofs build; cargo pdf_budget prints the value table, the Node
budget suite prints the per-class cost (fresh instance, W4 asserted).
2026-10-18 16:06:36 +02:00
bchanot f8579bc19a feat(domain): R4.2d attachment probe, import_pdf and SheetHandle.import_pdf on the wasm facade
locate_attachment (shared 16 MiB budget, JS-path steps in the TypeScript order, OD-3 cap
hook off until measured), pdf::import, facade import_pdf with the PdfImportKind kinds
(ts-rs exported). cargo: O7 144 inputs (locate, read, archive rows) and O8 51 cases equal
to the R3 path, 3 OD-4 differences declared (lone surrogate in an overwritten duplicate
value). Node through the shipped module: the same O8 outcomes, every reference PDF.
Module 421.7 KB gzip (W1 budget 600 KB).
2026-10-18 15:55:46 +02:00
bchanot 9850a8341a feat(domain): R4.2c json_js: JS-path side effects of the attachment probe
starts_json_object, depth and value prescan (OD-3 proxy), TextDecoder-parity lossy decode
(400-case oracle generated by scripts/r4-utf8-oracle.mjs, 0 difference), overflow → null
rewrite with the JSON number grammar, lone-surrogate neutralised probe (OD-4).
2026-10-18 15:44:54 +02:00
bchanot 55819fbd32 feat(domain): R4.2b inflate_flate on miniz_oxide with DecompressionStream verdicts (O9 26/26)
Non-wrapping output buffer growing to limit + 1, trailing bytes refused, Adler-32 checked;
12 flate rows of O7 and the browser columns agree.
2026-10-18 15:44:53 +02:00
bchanot a3fc44fd3a feat(domain): R4.2a pdf::read scan, strings and stamp (port of scan.ts, JS regex semantics explicit)
find_embedded_files, decode_pdf_string, has_archive_stamp on the frozen O7 oracle: 144 PDF
inputs, 178 candidates, 19 string rows, all equal to the TypeScript.
2026-10-18 15:44:52 +02:00
bchanot 09ce18b6dc test(tests): R4 oracle plumbing for the cargo reader suites (inputs, generators, sha256) 2026-10-18 15:32:37 +02:00
bchanot 21d34fb9a7 feat(domain): R4.2 scaffold of the pdf reader module (feature pdf-read, miniz_oxide)
Module layout of plan §B.1.1 for the reader (read/{scan,strings,stamp,inflate,probe},
json_js), shared constants and types, index_of; feature-gated test targets; the wasm
facade enables the feature; rust-check runs the gated clippy and tests.
2026-10-18 15:29:58 +02:00
bchanot 4439fd2420 test(tests): R4.1e browser harness and TS baselines (Chromium, Firefox, WebKit)
Playwright harness under scripts/browser: 127.0.0.1 server with the DEPLOY
CSP, export and import baselines of the TypeScript engine under a 4 GiB RSS
watchdog (not a guaranteed memory limit), O9 browser columns in
inflate.browsers.json (26 rows agree with Node in all three engines).
Results of 2026-10-18 committed; the O9 Node test no longer expects browser
columns in inflate.json.
2026-10-18 15:05:28 +02:00
bchanot 4bdfda59ba test(tests): R4.1f O10 report:compare outputs and the R4 test ledger (299 cases) 2026-10-18 06:00:34 +02:00
bchanot 516342beca test(tests): R4.1c text, AFM, dates and PNG oracles (O4, O5, O6) 2026-10-18 05:37:18 +02:00
bchanot 96df15edae test(tests): R4.1d O7 reader outcomes (155 inputs, regex-semantics rows) and O9 inflate verdicts (Node) 2026-10-18 05:35:12 +02:00
bchanot 7a4297933d test(tests): R4.1d O8 differential tolerance corpus on the full R3 import path (51 cases) 2026-10-18 05:21:10 +02:00
bchanot 6882c6da4a feat(anatomy): an unnamed trigger carries the opened view's name per language 2026-10-15 01:00:44 +02:00
bchanot 23895b9351 fix(anatomy): url() locality skips CSS whitespace only (security audit R3 pass 2) 2026-10-15 00:40:30 +02:00
bchanot 157c854ed1 fix(anatomy): prescan closers searched after their opener; ASCII-only href trim; root painting attributes removed (security audit R3) 2026-10-15 00:25:43 +02:00
bchanot 43a370aed1 feat(anatomy): text and output caps, hostile corpus through the shipped wasm within budgets; SheetSession poisons on non-closed throws 2026-10-14 23:55:22 +02:00
bchanot 842797b440 feat(anatomy): view.canvas op on the loaded sheet; drawings read once at load 2026-10-14 23:51:45 +02:00
bchanot 1ec9316a73 feat(anatomy): canvas and highlight composition in Rust (O1 + O3 tree-equal) 2026-10-14 23:50:14 +02:00
bchanot 67d9af3f79 feat(anatomy): annotation layer in Rust (O2 exact, attribute order kept) 2026-10-14 23:48:07 +02:00
bchanot ab41084a36 test(anatomy): clippy collapse in the sanitiser oracle test 2026-10-14 23:46:17 +02:00
bchanot 85c2183791 feat(anatomy): Rust SVG reader: tree, allowlist sanitiser, reference graph, serialiser (O4/O5 green) 2026-10-14 23:46:10 +02:00
bchanot e3168215f7 test(pdf): R3 O4 corpus edge cases (Number() values, namespaces, BOM, refused subtrees); roxmltree dependency 2026-10-14 23:34:34 +02:00
bchanot b440a2f3fa test(pdf): R3 freeze O4/O5 sanitiser verdicts on the hostile corpus and the product SVGs 2026-10-14 23:30:56 +02:00
bchanot d1aa35e97c test(pdf): R3 freeze O3 highlighted compositions as trees 2026-10-14 23:29:05 +02:00
bchanot 969b872b98 test(anatomy): R3 freeze O2 layer trees with attribute order 2026-10-14 23:27:46 +02:00
bchanot 20d03cf7fd fix(domain): refuse lone UTF-16 surrogates instead of replacing them (L1)
serde_json already refuses a lone surrogate escape; the U+FFFD pre-pass
is gone and parse_json classifies the refusal (strict escape scan, on
failure only) so callers name it: closed kind lone_surrogate from
operation inputs, sheet.check, draft.restore and archive.import.
Oracles untouched: the two L1 cases and the Zod verdict now assert that
TypeScript kept the surrogate and Rust refuses the text.
2026-10-14 21:49:28 +02:00
bchanot 21906c4358 feat(domain): R2.2 report migration, rebase, sheet snapshot and layered archive reading in Rust; draft restore and archive import operations
migrateReportV2ToV3 / readReportDocument (version read on the raw value,
JS truthiness kept, a malformed mapped path still fails the read),
rebaseReportOnSheet (??= labels, archived names first-match),
buildSheetSnapshot / assertSnapshot (raw depth, shape, caps in UTF-16 and
UTF-8, integrity), readArchiveDocument (layered: report first, wrapper,
snapshot gate, sheet invariant, unsupported_envelope origin quirk).
Checked against 84 cases frozen from the TypeScript and 765 Zod verdicts
(one declared difference: L1, a lone surrogate reads as U+FFFD), the
ported report and archive suites and the 612 legacy leaves. Facade:
draft.restore (content kinds invalid / unsupported_version, rebase_failed
never a content kind), archive.import (incompatible_version with found,
no_attachment), archive.snapshot.
2026-10-14 00:28:02 +02:00
bchanot 3639c8778e feat(domain): R2.3 editor rules in Rust — zone click chain, reducers, finding toggle, vertebra selection, report operations
zoneInteraction (decision + reducers, collectVertebrae concatenated-key
dedup, syncVertebrae Map order), FindingsTreePicker.toggleLeaf (clicked
leaf by position, parents first-wins), VertebraPicker toggle/all/none and
the store's newReport/add/remove/move, checked against 49 cases frozen
from the TypeScript (41 byte-equal, 8 equal up to key order: contract
order replaces insertion order, D-R11) and the 13-case service suite.
Typed error kinds where the TypeScript would throw or corrupt a list.
2026-10-14 00:17:22 +02:00
bchanot 0c47d0f837 feat(domain): R2.2 sheet integrity rules, publish check, SheetIndexData and SQL conformance in Rust
The 21 rules of validateSheetDocument ported with identical codes,
severities, paths and messages (frozen from the TypeScript on 26
conformance fixtures), createEmptySheetDocument, the publish check
(strict shape then rules), and the index data React reads once (positions
with Map semantics, names, spine ids, finding-path keys). The fixtures
also carry the codes private.sheet_document_issues returns: a cargo test
generates supabase/tests/011_sheet_conformance.sql and refuses drift
(PGlite 12/12 files, real stack 446/446). .prettierignore keeps the
byte-exact oracles and generated fixtures out of pnpm format.
2026-10-14 00:17:21 +02:00
bchanot 22fea8736d feat(domain): Rust sheet index and loaded sheet (bundle payload → document, migration map, positions)
Lookups follow the TypeScript index: by-id maps keep the last duplicate as
new Map does, spine annotations and finding paths take the first match as
Array.find does; a document without a main view cannot be indexed.
2026-10-14 00:05:26 +02:00
bchanot ee0700887f feat(domain): R2.1 Rust contracts of the sheet, report and archive documents
Sheet document v2, report v3 / v2 / identity, migration map, sheet snapshot,
branding, PDF labels and archive envelope ported from the Zod schemas with
their exact semantics: strict objects where Zod is strict, optional fields
absent (never null), nullable fields required, integers as JavaScript
numbers, UTF-16 caps, hand-checked patterns, url crate for .url(), lone
surrogate escapes read as U+FFFD (L1, owner confirmation pending).
Fields in Zod schema order (PDF labels in the engine dictionary order):
the curated and legacy sheets, the demo report and the three frozen
archive envelopes print byte for byte as their Zod / attachment form.
ts-rs types regenerated; plan rev 2 after three plan challenges.
2026-10-14 00:04:01 +02:00
bchanot 2a38fa37b5 chore(workspace): Rust workspace R0 — builder image, core crate (JS-compatible JSON, report contracts, facade), wasm facade, core-wasm package with proofs 2026-10-13 00:01:25 +02:00