Eval results for tickets 04-07; grader ignores bot-run skips; resolve tickets 01-07
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
This commit is contained in:
1 parent
258bfbb500
commit
312742cfef
17 files changed
+2546
-19
No files matched your search
@@ -9,7 +9,7 @@ Part of: ../spec.md
|
||||
|
||||
**Blocked by:** 01
|
||||
|
||||
**Status:** ready-for-agent
|
||||
**Status:** resolved
|
||||
|
||||
- [ ] The AI skill file exists with a trigger description ("AI RPA dashboard", "extraction dashboard", "LLM/OCR review dashboard") and the shared workflow.
|
||||
- [ ] An AI contract extends the no-AI contract. These shapes came from the Superbill prototype:
|
||||
@@ -25,3 +25,7 @@ Part of: ../spec.md
|
||||
- approve stays blocked while rows are unverified (the server stub refuses);
|
||||
- "page X of Y" updates while running.
|
||||
- [ ] Skill eval on test project (d), a project with an LLM extraction call: the skill picks the AI path, asks the shared questions, and its output passes the page check with sample data.
|
||||
|
||||
## Comments
|
||||
|
||||
Resolved on branch `integration/rpa-dashboard-skills` (Oct 16, 2026). Tests: `uv run --with pytest --with playwright pytest tests` all green; skill eval results in `tests/evals/results/`.
|
||||
Reference in new issue
Block a user