Commit Graph

9 Commits

Author SHA1 Message Date
f7acffd159 feat: indexed UI tree with SoM annotations + improved element resolution
- Flat indexed UI element list with numeric IDs and center coordinates
- Screenshot annotations: numbered colored boxes (Set of Marks)
- click_element resolves by index from cached element list
- Cursor crosshair + focused element highlight in screenshots

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-05-17 03:03:08 -03:00
3b4058afb9 feat: CDP tunnel + open_browser/close_browser + UI feedback on actions 2026-05-17 02:17:39 -03:00
c9f9fdb6b0 feat: UI feedback on actions + annotated screenshots 2026-05-17 02:02:07 -03:00
74a055a4e7 fix: use 1 minute restart interval (30s too short for task scheduler) 2026-05-16 16:44:33 -03:00
56a754309b feat: use scheduled task instead of service for user session desktop access 2026-05-16 16:40:04 -03:00
48a55317cf fix: run service as interactive process to access user desktop 2026-05-16 16:32:59 -03:00
3de8339cc0 fix: use extra_headers for websockets legacy API compatibility 2026-05-16 16:29:43 -03:00
85d0e99575 add nssm.exe binary for service installation 2026-05-16 16:27:59 -03:00
87d5db0c25 v2.0.0: tool-based architecture (no LLM on client) 2026-05-16 16:22:11 -03:00