VasanthandClaude Opus 5.5
9a5b95448d
- dashboard.html: each section sits in OPTIONAL:<name> BEGIN/END blocks in the style, markup and script, with sample answers so a page with no bot shows it working. Core change: setUser records the role on <body>, so CSS hides admin-only parts from operators. - templates/sections.py keeps the chosen sections and deletes the rest, markers included; it stops on a broken marker. - templates/sections.md: what each section needs from the host (events, actions, desktop slot snippets, the role re-check, the login hand-off). - SKILL.md step 5 asks one multi-select question and runs sections.py. - Page check: checkpoint states, admin visibility by role and assign/remove, login theme and hand-off to auth or the stub. Cases skip on a generated page without the section; the template must carry all three. The harness signs in when the page has a login screen. - tests/test_sections.py: no sections leave no trace, and that page still passes the page check. - Eval runner: a-empty-sections variant (all three) and per-section checks. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Tests
Run everything from the repo root:
uv run --with pytest --with playwright pytest tests
-
test_*.py: assert-based self-checks for template logic (lint of unfilled Python templates, the custom palette, presets in step with the template). -
page_check/: Seam 1. Loads a dashboard page in headless Chromium with no backend, pushes contract envelopes throughwindow.__pyMsg, and asserts on what is visible. Every case runs in light, dark and narrow (800px) mode.- By default it checks the no-AI template, filled with test values. To check a
generated page instead, set
PAGE_CHECK_HTML=path/to/dashboard.html. - The page sees a fake Qt bridge. Every action the page sends is recorded in
window.__callsas[slot, ...args]. - To add a case, write a
test_*.pyfile inpage_check/that uses thepageandpush(event, data)fixtures fromconftest.py. - Optional-section cases (
test_optional_sections.py) skip on a generated page built without that section. The template must carry all of them. A page with the login section is signed in (login_result ok) before each case.
- By default it checks the no-AI template, filled with test values. To check a
generated page instead, set
-
test_sections.py: the optional-section strip tool keeps only the chosen sections, and a page with none of them still passes the page check. -
evals/: Seam 2. Runs the skills on a fixture project withclaude -p, then grades the reply and runs the page check on the page it built:uv run --with pytest --with playwright python tests/evals/run_eval.py a-emptyResults go to
evals/results/<fixture>.json. To add a fixture, add an entry toFIXTURESinrun_eval.py. -
fixtures/<letter>-<name>/: small test projects for the evals.