Files
Rpa_Skills/tests/evals/results/handoff/h-mail-intake-screens-r5.json
VasanthandClaude Opus 5.5 3942fad6cd Add rpa-bot-handoff skill: ops guide for bot handover
The skill scans a bot with subagents (never runs it) and writes
HANDOVER.md, an 11-section ops guide in the operator's order: where is
what, how to run, how long to wait, after the run, how to see an
exception, exception list, how you will know, how to tell us, don'ts,
issues seen before. Dev material (check against 12 failure classes from
Tebra Auto Post, gaps with file:line, incidents) goes to HANDOVER-DEV.md.

Also adds ADR-0004, glossary terms, five fixture bots and a handoff eval
runner (--resume, --regrade) with results from 47 runs of the earlier
13-section version. The grader still expects that structure and must be
updated before the next eval run.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-28 15:01:42 +05:30

31 lines
2.7 KiB
JSON

{
"case": "h-mail-intake/screens",
"rep": 5,
"passed": false,
"checks": {
"HANDOVER.md written": true,
"no other file changed": true,
"bot never run": true,
"no placeholders left": true,
"13 sections in order": true,
"used subagents": false,
"every status listed": true,
"catalogue: 4+ complete rows": true,
"F1-F12 all accounted for": true,
"no code refs in ops sections": true,
"fix-before-handover has file refs": true,
"no secrets or personal data": true,
"where-to-look respects ops access": true,
"asks escalation": true,
"asks ops access": true,
"known incidents from history": true,
"misleading status flagged": false,
"stuck Processing item blocks the queue": true,
"20 MB limit": true
},
"cost_usd": 0.7572796,
"subagents": 0,
"work_dir": "C:\\Users\\ec10866\\AppData\\Local\\Temp\\handoff-h-mail-intake-screens-9fxhg12l\\project",
"reply": "`HANDOVER.md` ready \u2014 repo root la irukku. Bot-a run pannala; code, README, log, git history mattum padichen.\n\n| Item | Result |\n|---|---|\n| Sections | 13 (template order maaraama) |\n| Exceptions | 10 (E01\u2013E10) |\n| Failure classes | 11 covered, 1 not applicable (F2 \u2014 bot entha window-um drive pannala) |\n| Fix before handover | 13 items |\n\n**Mukkiyamana findings:**\n- Moonu \"fix\" commits-um (e59f92b, 5b6f24d, 958759d) oru comment line mattum add pannirukku \u2014 code maaravae illa. Stuck \"Processing\" item innum ella run-aiyum block pannum (E02).\n- Ops-ku intake folder mattum dhaan theriyum. Statuses, notes, log ellam avangalukku theriyaathu. README la sollra `queue_viewer.xlsx` repo la illa, code-um adha create pannala.\n- Password-protected PDF-a \"Done\"-nu mark pannudhu, aana intake folder-ku copy aagala.\n- `.env` (mailbox credentials) git-la commit aagirukku. `logs/intake.log`-la oru sender email address irukku. Rendu-um history-la irundhu remove pannanum, password-um rotate pannanum.\n\n**Verification:** file:line refs ellam section 13-la mattum dhaan irukku (grep pannitten). Doc-la credentials, IPs, server names, email address edhuvum illa.\n\n**Also noticed:** repo romba chinnadhu (oru 90-line script), adhanala skill sonna rendu subagents vechu scan pannala, naane padichen. Commit history-la `.env` irukkradhu oru security issue \u2014 doc mattum ezhudhinen, adha fix pannala.\n\nQUESTIONS: Escalation: who ops calls for a dev issue (team or role, not a personal phone number), and how (ticket, chat channel) | Ops access: which of the bot's places ops can open - the app's screens, the output folder, the log folder, the database | Unknowns: any statuses or exceptions whose meaning the code doesn't make clear",
"stderr": ""
}