Files
Rpa_Skills/tests/evals/results/handoff/h-packaged-desktop-full-r4.json
T
VasanthandClaude Opus 5.5 3942fad6cd Add rpa-bot-handoff skill: ops guide for bot handover
The skill scans a bot with subagents (never runs it) and writes
HANDOVER.md, an 11-section ops guide in the operator's order: where is
what, how to run, how long to wait, after the run, how to see an
exception, exception list, how you will know, how to tell us, don'ts,
issues seen before. Dev material (check against 12 failure classes from
Tebra Auto Post, gaps with file:line, incidents) goes to HANDOVER-DEV.md.

Also adds ADR-0004, glossary terms, five fixture bots and a handoff eval
runner (--resume, --regrade) with results from 47 runs of the earlier
13-section version. The grader still expects that structure and must be
updated before the next eval run.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-28 15:01:42 +05:30

32 lines
3.1 KiB
JSON

{
"case": "h-packaged-desktop/full",
"rep": 4,
"passed": true,
"checks": {
"HANDOVER.md written": true,
"no other file changed": true,
"bot never run": true,
"no placeholders left": true,
"13 sections in order": true,
"used subagents": true,
"every status listed": true,
"catalogue: 4+ complete rows": true,
"F1-F12 all accounted for": true,
"no code refs in ops sections": true,
"fix-before-handover has file refs": true,
"no secrets or personal data": true,
"where-to-look respects ops access": true,
"asks escalation": true,
"asks ops access": true,
"known incidents from history": true,
"display scaling rule": true,
"version check": true,
"shortcut prerequisite": true,
"silent update failure flagged": true
},
"cost_usd": 1.6434040000000003,
"subagents": 2,
"work_dir": "C:\\Users\\ec10866\\AppData\\Local\\Temp\\handoff-h-packaged-desktop-full-x2g5j69o\\project",
"reply": "`HANDOVER.md` ready, repo root-la irukku: `C:\\Users\\ec10866\\AppData\\Local\\Temp\\handoff-h-packaged-desktop-full-x2g5j69o\\project\\HANDOVER.md`. Bot-ah run pannala, code-um maathala, commit-um pannala.\n\n| Item | Result |\n|---|---|\n| Sections | 13 (template order apdiye) |\n| Exceptions catalogued | 12 (E01\u2013E12) |\n| Failure classes | 10 covered. F8 (auto-rerun / watchdog illa) and F10 (queue / lock illa) not applicable |\n| Fix before handover | 17 items |\n| Doc-la PHI / creds / IPs | Illa. `.env` padikkala. Log-la oru customer name irundhuchu, adha doc-la podala |\n\nNeenga sonna answers use pannen: escalation = #rpa-support, ops-ku DB access illa. Bot-ku DB-ae illa, adhunaala \"Where to look\" table output folder, logs folder, console window mattum point pannudhu.\n\n**Fix before handover-la mukkiyamaana items:**\n- Moonu \"fix:\" commits-um oru comment line mattum add pannirukku, code edhuvum maarala. SSL error swallow, 125% scaling, spec stub moonum innum appadiye irukku. Bot ippo run aagradhu 100% scaling rule-ah nambi dhaan.\n- \"Posted\" note Save click aana udane ezhudhudhu, LedgerPro-la save aachaannu check pannala. Posted row-um Result = \"Missing\" nu dhaan kaattudhu.\n- Crash aanaa result Excel kedaikkadhu (kadaisila dhaan save aagudhu). Error console window-la mattum dhaan theriyum.\n- Export file pazhasaa irundhaa check illa. Neraiya duplicate post aagalaam.\n- Version endha screen-layum theriyadhu. Code comment sollra window title exist-ae aagala.\n- `logs` and `data\\output` folders repo-la illa, code-um create pannala.\n\nVerification: status strings, exception IDs, leak search ellam doc-ku ethiraa check pannen. Paths ellam repo-la irukku, illa code create pannum. Exception: `data\\` and `data\\output\\` repo-la illa, adhunaala doc-la adhu oru pre-run check-aa irukku.\n\nQUESTIONS: Escalation: who ops calls for a dev issue (team or role, not a personal phone number), and how (ticket, chat channel) | Ops access: which of the bot's places ops can open - the app's screens, the output folder, the log folder, the database | Unknowns: any statuses or exceptions whose meaning the code doesn't make clear",
"stderr": ""
}