GUISpector: Our Paper on Automated GUI Verification Presented at ICSE 2026

We are excited to announce that our paper has been presented at the ICSE 2026 — the 48th International Conference on Software Engineering in Rio de Janeiro, Brazil:

"GUISpector: An MLLM Agent Framework for Automated Verification of Natural Language Requirements in GUI Prototypes"

GUISpector is a novel framework that leverages a multimodal LLM-based agent to automatically verify whether GUI prototypes fulfill their natural language requirements. The agent autonomously plans and executes verification trajectories, extracts actionable feedback for developers, and integrates seamlessly into LLM-driven development workflows. GUISpector was evaluated on a comprehensive benchmark of 150 requirements and 900 acceptance criteria annotations across diverse GUI applications.

The work was conducted in collaboration with the human-centered systems Lab (h-lab) at the Karlsruhe Institute of Technology (KIT) and the University of Mannheim.