Post
Understanding a screenshot is not the same as knowing where to click.
That gap is GUI grounding.
We've open-sourced Aico Grounding, a local grounding component built to translate a natural-language UI target into a location on the screen.
Screenshot + instruction → predicted UI target.
For a real-device agent, this is one of the critical steps between seeing the interface → understanding the task → taking the right action.
The screenshot shows the grounding layer running on a real mobile UI: elements identified, IDs assigned, ready for the agent to act.
Aico Grounding: github.com/AidenAI-IO/aico-grounding
#AIAgents #GUIAgents #VisualGrounding #OpenSource
That gap is GUI grounding.
We've open-sourced Aico Grounding, a local grounding component built to translate a natural-language UI target into a location on the screen.
Screenshot + instruction → predicted UI target.
For a real-device agent, this is one of the critical steps between seeing the interface → understanding the task → taking the right action.
The screenshot shows the grounding layer running on a real mobile UI: elements identified, IDs assigned, ready for the agent to act.
Aico Grounding: github.com/AidenAI-IO/aico-grounding
#AIAgents #GUIAgents #VisualGrounding #OpenSource