Eval results for tickets 04-07; grader ignores bot-run skips; resolve tickets 01-07

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
This commit is contained in:
VasanthandClaude Sonnet 5.5 committed 2026-10-16 16:56:16 +05:30
1 parent 258bfbb500
commit 312742cfef
17 files changed
+2546 -19

No files matched your search

@@ -11,7 +11,7 @@ Part of: ../spec.md
**Blocked by:** 01
**Status:** ready-for-agent
**Status:** resolved
- [ ] The skill detects the PyQt project and the bot entry point, and fills in the host template's bot command, steps, step markers and friendly rules from the bot's real output.
- [ ] Clicking Run starts the bot in a separate process. The Run button disables itself while running, and the status dot goes ready → running → done/error.
@@ -20,3 +20,7 @@ Part of: ../spec.md
- [ ] The dark-mode choice persists across app restarts.
- [ ] A Python assert-based self-check covers line classification, step-marker matching and friendly-rule matching, including the "never hide an error" case.
- [ ] Skill eval on test project (b), a PyQt project with a step-marker bot: the skill doesn't ask the stack question, and the running page shows real steps and log lines.
## Comments
Resolved on branch `integration/rpa-dashboard-skills` (Oct 16, 2026). Tests: `uv run --with pytest --with playwright pytest tests` all green; skill eval results in `tests/evals/results/`.