VLAA-GUI is a modular framework for GUI automation that tackles early stopping and repetitive loops via a Completeness Verifier and a Loop Breaker component, requiring direct visual evidence before declaring success. The…

#VLAA #GUIAgents #Robotics #Automation
https://arxiv.org/abs/2604.21375

New arXiv paper introduces GUI-Hopper, which augments mobile GUI agents with app-native deeplinks discovered through static analysis and validated on real devices. The hybrid approach replaces multi-step tap sequences with single…

#AI #MobileAI #GUIagents #HCI
https://arxiv.org/abs/2609.30887

New research reveals AI systems perform worse on visual tasks when they "think harder." GUI agents achieve better accuracy by skipping the reasoning steps that typically help language models excel in text-based work. #AIVisionPerformance #GUIAgents

PAL‑UI (Planning with Active Look‑back) adds screenshot retrieval for GUI agents. PAL‑UI‑3B and PAL‑UI‑7B, trained on 8.6 K mobile navigation samples, improve success on mobile and web tasks. https://getnews.me/pal-ui-boosts-long-horizon-planning-for-vision-based-gui-agents/ #palui #guiagents

A survey of GUI agents with foundation models outlines four layers—perception, reasoning, planning, acting—and notes benchmarks and safety issues. DOI 10.48550/arXiv.2412.13501. Read more: https://getnews.me/comprehensive-survey-of-gui-agents-powered-by-large-foundation-models/ #guiagents #ai

RAG‑GUI, a plug‑in for vision‑language models, retrieves web‑tutorials to guide GUI agents and achieved 2.6%–13.3% performance gains across three benchmark tasks. Read more: https://getnews.me/retrieval-augmented-gui-agents-boosted-by-generative-guidelines/ #raggui #visionlanguage #guiagents

ProRe improves GUI agent reward assessment by adding targeted probing tasks; experiments show reward accuracy up to 5.3% higher and F1 scores improving by 19.4%. https://getnews.me/prore-proactive-reward-system-boosts-gui-agent-evaluation/ #prore #guiagents #aievaluation

VisualTrap backdoor works after poisoning just 5% of training data and survives fine‑tuning, affecting GUI agents on mobile, web and desktop. Read more: https://getnews.me/visualtrap-reveals-stealthy-backdoor-threats-in-gui-ai-agents/ #visualtrap #backdoor #guiagents

Orcust, a stepwise-feedback RL framework, boosts GUI agent performance by 22.2% on the ScreenSpot benchmark and 23.9% on ScreenSpot-Pro versus Qwen2.5-VL-7B. https://getnews.me/orcust-improves-gui-agent-performance-with-stepwise-feedback-rl/ #orcust #guiagents

UIPro, a GUI agent trained on 20.6 million tasks using a unified action space, outperforms prior agents on web navigation, desktop automation and mobile benchmarks. Read more: https://getnews.me/uipro-new-generalist-gui-agent-enhances-interaction-across-platforms/ #uipro #guiagents #automation

The Blink‑Think‑Link (BTL) framework adds Blink Data Generation and a BTL Reward, letting its BTL‑UI agent achieve state‑of‑the‑art results on static and dynamic GUI benchmarks. https://getnews.me/blink-think-link-model-boosts-ai-gui-agents-in-human-like-interaction/ #blinkthinklink #guiagents