Eval results for tickets 04-07; grader ignores bot-run skips; resolve tickets 01-07
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
This commit is contained in:
1 parent
258bfbb500
commit
312742cfef
17 files changed
+2546
-19
No files matched your search
@@ -11,7 +11,7 @@ Part of: ../spec.md
|
||||
|
||||
**Blocked by:** 01
|
||||
|
||||
**Status:** ready-for-agent
|
||||
**Status:** resolved
|
||||
|
||||
- [ ] The skill detects the PyQt project and the bot entry point, and fills in the host template's bot command, steps, step markers and friendly rules from the bot's real output.
|
||||
- [ ] Clicking Run starts the bot in a separate process. The Run button disables itself while running, and the status dot goes ready → running → done/error.
|
||||
@@ -20,3 +20,7 @@ Part of: ../spec.md
|
||||
- [ ] The dark-mode choice persists across app restarts.
|
||||
- [ ] A Python assert-based self-check covers line classification, step-marker matching and friendly-rule matching, including the "never hide an error" case.
|
||||
- [ ] Skill eval on test project (b), a PyQt project with a step-marker bot: the skill doesn't ask the stack question, and the running page shows real steps and log lines.
|
||||
|
||||
## Comments
|
||||
|
||||
Resolved on branch `integration/rpa-dashboard-skills` (Oct 16, 2026). Tests: `uv run --with pytest --with playwright pytest tests` all green; skill eval results in `tests/evals/results/`.
|
||||
Reference in new issue
Block a user