Files
Rpa_Skills/tests/evals/results/handoff/h-desktop-poster-full-r5.json
T
VasanthandClaude Opus 5.5 3942fad6cd Add rpa-bot-handoff skill: ops guide for bot handover
The skill scans a bot with subagents (never runs it) and writes
HANDOVER.md, an 11-section ops guide in the operator's order: where is
what, how to run, how long to wait, after the run, how to see an
exception, exception list, how you will know, how to tell us, don'ts,
issues seen before. Dev material (check against 12 failure classes from
Tebra Auto Post, gaps with file:line, incidents) goes to HANDOVER-DEV.md.

Also adds ADR-0004, glossary terms, five fixture bots and a handoff eval
runner (--resume, --regrade) with results from 47 runs of the earlier
13-section version. The grader still expects that structure and must be
updated before the next eval run.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-28 15:01:42 +05:30

34 lines
4.8 KiB
JSON

{
"case": "h-desktop-poster/full",
"rep": 5,
"passed": true,
"checks": {
"HANDOVER.md written": true,
"no other file changed": true,
"bot never run": true,
"no placeholders left": true,
"13 sections in order": true,
"used subagents": true,
"every status listed": true,
"catalogue: 4+ complete rows": true,
"F1-F12 all accounted for": true,
"no code refs in ops sections": true,
"fix-before-handover has file refs": true,
"no secrets or personal data": true,
"where-to-look respects ops access": true,
"asks escalation": true,
"asks ops access": true,
"known incidents from history": true,
"misleading status flagged": true,
"comma rule before a run": true,
"how to stop": true,
"not-confirmed row: check ClaimDesk first": true,
"hidden tech comments flagged": true,
"Pending batch blocks a new upload": true
},
"cost_usd": 1.8817840000000001,
"subagents": 2,
"work_dir": "C:\\Users\\ec10866\\AppData\\Local\\Temp\\handoff-h-desktop-poster-full-a_jp15nd\\project",
"reply": "`HANDOVER.md` ready \u2014 repo root la irukku: `C:\\Users\\ec10866\\AppData\\Local\\Temp\\handoff-h-desktop-poster-full-a_jp15nd\\project\\HANDOVER.md`. Bot-a run pannala; code, git history, log mattum read pannen. Unga escalation, ops access answers use pannirukken; unclear statuses-ku code-oda best reading. Unga answers already irundhadhaala skill sonna \"ask once\" step-la questions ketkala.\n\n| Check | Result |\n|---|---|\n| Sections | 13 (template-oda ella sections-um) |\n| Exceptions catalogued | 16 (E01\u2013E16) |\n| Failure classes | 12/12 covered, onnum \"not applicable\" illa |\n| Statuses | Item status 5, file status 4, clinic 2, batch 2 \u2014 ellam section 6-la irukku |\n| Fix before handover | 20 items (file:line oda) |\n\n**Ops-ku romba mukkiyamaana 4 vishayam:**\n- **Oru red row irundhaale batch Pending-la ninnudum.** Adhukku apram vara ella upload-um refuse aagum. Ops-ku DB access illa, adhanaala clear panna dev thaan venum.\n- **Green rows ellam posted illa.** \"Remittance Errors on posting\" row green-a kaatum, aana post aagala. \"Skipped\" um green thaan.\n- **\"Payment not confirmed after Save\" red row-a ninaichu re-run pannadheenga.** Post aagirukkalaam; munnaadi ClaimDesk-la check pannunga.\n- **3 \"fix\" commits-la (d9a2483, c7215d0, d84ff92) comment mattum thaan add aagirukku, code maaralai.** Wrong-window bug innum open. Save wait 20 s already initial import-laye irundhudhu.\n\n**Fix before handover (dev team, 20 items):**\n1. Window title-a \"contains ClaimDesk\" nu match pannudhu \u2014 launcher, login window, SQL tools ellathayum pidikkum.\n2. \"Rejected by app\", \"Skipped\" green Completed-a kaatudhu; internal status column screen-la illa.\n3. Tech comments DB-la mattum irukku, screen-la kaatala.\n4. Fail aana clinic-ku Report row varadhu; clinic/batch status ops-ku engayum theriyaadhu.\n5. Oru red row illa failed clinic batch-a eppavume Pending-la vechirukkum; ops clear panna vazhi illa.\n6. Watchdog heartbeat item post aana mattum thaan; healthy run-a kill pannum, ClaimDesk open-a vittudum, resume illa.\n7. Save timeout-ku apram grid-a re-check pannala \u2014 double-post risk.\n8. Sign-in success check illa; wrong password \"Clinic not found\"-a kaatum.\n9. Zero items / ellam red-a irundhaalum clinic Success; wrong-clinic check click-ku apram udane, `&` problem.\n10. Clinic cell `,` / `;`-la split aagudhu; comma ulla name eppavume run aagaadhu.\n11. Cutoff date-a text-a compare pannudhu.\n12. Input errors, \"Pending batch exists\" refusal log-la varala.\n13. Batch Pending-a irundhaalum log \"[RUN SUMMARY] done\" nu sollum.\n14. Retry duplicate rows podum; taskkill machine-la irukka ella ClaimDesk-um close pannum.\n15. Stop button illa, safe stop vazhi illa; launcher code repo-la illa.\n16. Launcher/updater repo-la illa; 1.3.0 fix comment mattum.\n17. Alerting illa \u2014 `ALERT_SMTP` define aagirukku, use aagala.\n18. DB tables code create pannaadhu; ClaimDesk path illana cryptic error.\n19. Security: `.env` git-la commit aagirukku (password-fallback key um serthu), committed log-la patient data irukku, Excel-la plain-text password.\n20. Committed log-la current code ezhudhaadha messages irukku \u2014 production-la endha build nu confirm pannunga.\n\n**Also noticed:**\n- Ops-ku \"output folder\" access sonnenga, aana bot output Excel/folder edhuvum create pannaadhu. Report screen, `logs` folder mattum thaan.\n- \"Launcher close panna bot nikkuma\" nu check panna mudiyala (launcher code repo-la illa), adhanaala doc-la UNVERIFIED nu mark pannirukken.\n\nQUESTIONS: Escalation: who ops calls for a dev issue (team or role) and how (ticket, chat channel) | Ops access: which of the bot's places ops can open - the app's screens, the output folder, the log folder, the database | Unknowns: any statuses or exceptions whose meaning the code doesn't make clear",
"stderr": ""
}