MissClick: Execution-Aware Adversarial Attacks on Coordinate Generation in GUI Grounding Models
Among the evaluated objectives, soft-coordinate displacement performs best for untargeted attacks, whereas place-weighted target-digit optimization performs best for targeted attacks, supporting goal-specific execution-aware objective design.