WebJuice generation bench

2026-05-17 · 4 customers × up to 8 generation methods · comparison study

M&B Roofing (greg-sign · V2 canonical)

1 method · roofing-restoration-greg-sign

VIP Roofing Brisbane (V3 multi-page)

8 methods · vip-roofing-brisbane

Mark Squire Roof Restorations (V3 STARTER)

7 methods · mark-squire-roof-restorations

Vicwest Roofing (V3)

7 methods · vicwest-roofing

Method overview

MethodMechanismCostTime
Open Design (SOP)Daemon + codex agent · multi-page · auto-answer question forms · audit gate~$0 (codex API)5–12min
V3 pl:build-from-referenceDirect spawn claude · single index.html · classic-premium-roftix family~$0.30~3min
path-1 from-scratchPure prompt + brand · no template · single self-contained HTML$0.75124s
path-2 template-fitcp template + grep replace · no LLM$00s
path-3 batch-llmOne mega claude call · JSON multi-page envelope$1.80462s
path-4 template-referencecp baseline + LLM rewrites 4 core pages$1.60406s
path-5 block-assemblyExtract <section> blocks · LLM picks/orders/rewrites$0.4546s
path-6 hybridtemplate-fit + selective LLM regen of hero & about$0.3018s
Source: experiments/bench/runs/2026-05-16T19-35-04/ + experiments/od-baseline/sop-runs/
Detailed comparison: → per-row scoreboard
Each customer page has links to all generated HTML + handoff docs.