Files
Rpa_Skills/tests/evals/results/handoff/h-packaged-desktop-full-r2.json
VasanthandClaude Opus 5.5 3942fad6cd Add rpa-bot-handoff skill: ops guide for bot handover
The skill scans a bot with subagents (never runs it) and writes
HANDOVER.md, an 11-section ops guide in the operator's order: where is
what, how to run, how long to wait, after the run, how to see an
exception, exception list, how you will know, how to tell us, don'ts,
issues seen before. Dev material (check against 12 failure classes from
Tebra Auto Post, gaps with file:line, incidents) goes to HANDOVER-DEV.md.

Also adds ADR-0004, glossary terms, five fixture bots and a handoff eval
runner (--resume, --regrade) with results from 47 runs of the earlier
13-section version. The grader still expects that structure and must be
updated before the next eval run.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-28 15:01:42 +05:30

32 lines
3.2 KiB
JSON

{
"case": "h-packaged-desktop/full",
"rep": 2,
"passed": false,
"checks": {
"HANDOVER.md written": true,
"no other file changed": true,
"bot never run": true,
"no placeholders left": true,
"13 sections in order": true,
"used subagents": true,
"every status listed": true,
"catalogue: 4+ complete rows": true,
"F1-F12 all accounted for": true,
"no code refs in ops sections": true,
"fix-before-handover has file refs": true,
"no secrets or personal data": true,
"where-to-look respects ops access": true,
"asks escalation": true,
"asks ops access": true,
"known incidents from history": true,
"display scaling rule": true,
"version check": false,
"shortcut prerequisite": true,
"silent update failure flagged": true
},
"cost_usd": 1.444084,
"subagents": 2,
"work_dir": "C:\\Users\\ec10866\\AppData\\Local\\Temp\\handoff-h-packaged-desktop-full-tmclh49o\\project",
"reply": "`HANDOVER.md` ready: `C:\\Users\\ec10866\\AppData\\Local\\Temp\\handoff-h-packaged-desktop-full-tmclh49o\\project\\HANDOVER.md`. Code edhuvum change pannala, bot-a run pannala.\n\n| Item | Count |\n|---|---|\n| Sections | 13 |\n| Exceptions catalogued | 16 (E01\u2013E16) |\n| Failure classes | 11 covered, 1 not applicable (F8: auto-rerun, watchdog rendum illa) |\n| Fix before handover | 15 items |\n\n**Fix before handover-la mukkiyamaanavai:**\n- **3 \"fix\" commits-um code-la apply aagala.** Launcher innum update error-a amaidhiya maraikkudhu. Spec-la `datas` line commented out-a irukku. 125% scaling fix-um button pictures-a thirumba capture pannadhu dhaan, code change illa.\n- **Duplicate posting risk:** export 10 s-kulla save aagalaina, bot pazhaya export file-oda compare panni already irukkura entries-a thirumba post pannidum (E06).\n- **Save button kidaikkalaina:** type panna entry LedgerPro-la save aagaama open-a nikkum. Adhukku apram vara lines adhe form-la type aagalaam (E08).\n- **\"Posted\":** Save click panna udane \"Posted\" nu ezhudhidum, LedgerPro-la save aachaa nu check pannaadhu. Adhoda, bot post panna lines-ku Result column \"Missing\" nu kaattum.\n- **Version theriyaadhu:** version endha screen-layum kaattala. Run crash aana reason-um enga-yum record aagala.\n- **Repo-la sensitive files:** `.env` git-la track aagudhu (naan adha open pannala). Commit aana log file-la oru payee name irukku.\n\n**Verification gaps:**\n- `data\\output` folder repo-la illa, code-um adha create pannaadhu. Adhanaala doc-la \"Before a run\" checklist-la vechirukken.\n- History scan-la `git show` deny aachu. Adhanaala incidents commit messages + current code vechu dhaan ezhudhinen, commit diffs paakkala.\n\nNeenga munnaadiye kudutha answers use pannen: escalation #rpa-support, ops access (bot screens, output folder, logs folder, DB illa), theliva illaadha statuses-ku code reading. Adhanaala neenga reply pannaama ellaa questions-um resolve aagiduchu.\n\nQUESTIONS: Escalation: who does ops call for a dev issue (team or role), and how (ticket, chat channel)? | Ops access: which of the bot's places can ops open - the app's screens, the output folder, the log folder, the database? | Unknowns: what do the statuses or exceptions whose meaning the code doesn't make clear mean?",
"stderr": ""
}