No-AI skill tracer: SKILL.md, theme presets, sample data, Seam 1 page check
- rpa-dashboard-no-ai/SKILL.md: trigger description and the workflow in spec order (scan, report/keep-or-restyle, colours, stack, sections, build, wire, verify). - templates/themes.md: Tebra Sky and Superbill Ember, light and dark blocks. - templates/palette.py: derives a custom palette from one brand hex and checks text contrast in light and dark. - dashboard.html: built-in sample data so a page with no bot works on first open; cleared batches in the donut; component tokens so Ember is a token-only swap; accessible names for KPI cards, nav, steps, log, search and the dark toggle. - bridge.py: placeholders inside string literals, so it passes the lint hook unfilled. - tests/page_check: Seam 1 harness (fake Qt bridge, light/dark/narrow). - tests/evals: Seam 2 runner and fixture a-empty. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
1 parent
49f8f49b65
commit
7f2ddecffb
13 files changed
+865
-57
No files matched your search
@@ -0,0 +1,29 @@
|
||||
# Tests
|
||||
|
||||
Run everything from the repo root:
|
||||
|
||||
```
|
||||
uv run --with pytest --with playwright pytest tests
|
||||
```
|
||||
|
||||
- `test_*.py`: assert-based self-checks for template logic (lint of unfilled Python
|
||||
templates, the custom palette, presets in step with the template).
|
||||
- `page_check/`: **Seam 1.** Loads a dashboard page in headless Chromium with no
|
||||
backend, pushes contract envelopes through `window.__pyMsg`, and asserts on what
|
||||
is visible. Every case runs in light, dark and narrow (800px) mode.
|
||||
- By default it checks the no-AI template, filled with test values. To check a
|
||||
generated page instead, set `PAGE_CHECK_HTML=path/to/dashboard.html`.
|
||||
- The page sees a fake Qt bridge. Every action the page sends is recorded in
|
||||
`window.__calls` as `[slot, ...args]`.
|
||||
- To add a case, write a `test_*.py` file in `page_check/` that uses the `page`
|
||||
and `push(event, data)` fixtures from `conftest.py`.
|
||||
- `evals/`: **Seam 2.** Runs the skills on a fixture project with `claude -p`,
|
||||
then grades the reply and runs the page check on the page it built:
|
||||
|
||||
```
|
||||
uv run --with pytest --with playwright python tests/evals/run_eval.py a-empty
|
||||
```
|
||||
|
||||
Results go to `evals/results/<fixture>.json`. To add a fixture, add an entry to
|
||||
`FIXTURES` in `run_eval.py`.
|
||||
- `fixtures/<letter>-<name>/`: small test projects for the evals.
|
||||
Reference in new issue
Block a user