It seems that every day the Valley is releasing new AI-powered tools designed to save us time and reshape how we interact with our devices. Many of these are minor changes you might not even notice if you don’t already know to look for them, but some mark pretty significant renovations. Google recently announced that it is bringing one such technology to its new line of Googlebook laptops. These laptops are specifically designed for seamless Gemini Intelligence integration, and one of the key features is the new Magic Pointer technology, which promises to rethink the way you use one of the most fundamental elements of the personal computer: The mouse cursor.
The company recently announced via Google DeepMind that it’s “been exploring new AI-powered capabilities to help the pointer not only understand what it’s pointing at, but also why it matters to the user.” Google noted that one of the main barriers to interacting with AI features is that they’re often relegated to separate windows. This adds extra steps as users type, copy and paste, or drag and drop information. The Magic Pointer is meant to cut out that part of the process, allowing the user to bring the AI-powered tools to the information rather than the other way around. This is meant to give users a more uninterrupted workflow.
What can the Magic Pointer do?
The intent behind the Magic Pointer is certainly a grand one. The idea to place all the power of Google’s AI directly on the cursor itself sounds overwhelming, but what does it look like in practice? It’s not yet clear what all the Magic Pointer will be able to do, but Google has already listed a few examples.
By giving your mouse a wiggle, a Gemini hot-menu will appear and offer a list of suggestions based on the context of the subject you’re pointing at on your screen. Google states that if you point at a date in an email, for instance, it might prompt you to set up a meeting or add an event to your calendar. You can point to two different images and select an option to combine them. You can point to a place on a map or an image of a building and select an option to “Show me directions,” and the AI will fill in the context and give you the information you want.
Google also shared a video showcasing some of these features, such as looking at a recipe online and using Gemini to add the ingredients to a shopping list, using a pop-up text box to issue commands for text revision and add emojis to a list, changing window colors, and using voice commands to tell the AI to perform tasks based on items being pointed at on screen.
Of course, there are some users who might not trust Gemini for their emails and other sensitive information, and this new method of using the AI probably won’t change that. It doesn’t appear to fundamentally change how the technology works, just how we interact with it.
