Google DeepMind Unveils AI-Powered Mouse Pointer

Google DeepMind has unveiled experimental research into an AI-powered mouse pointer designed to interpret user intent by understanding onscreen content, enabling more intuitive interactions without lengthy text prompts. Powered by the Gemini model, the system, referred to as Magic Pointer or AI Pointer, is being tested in Google AI Studio and integrated into products like Gemini in Chrome and the upcoming Googlebook laptop.

The initiative addresses a longstanding limitation of the mouse cursor, which has remained largely unchanged since its introduction in 1984 as a simple navigation tool. DeepMind researchers argue that current AI assistants force users to manually describe visual contexts, such as copying content into a chat window. Instead, the new pointer captures visual and semantic details around its position, turning pixels into structured entities like dates, objects or UI elements. Users can then issue shorthand commands, such as pointing at a data table and saying "make a chart," or hovering over a paused video frame to generate a restaurant booking link.

"Our goal is to address a common frustration: because a typical AI tool lives in its own window, users need to drag...