Google is testing the Gemini macOS application: It will read screen data

Google, Gemini macOS app has started testing on it and aims to offer a deeper artificial intelligence experience on the desktop with this version. According to the information provided by Bloomberg, the application analyzes the content on your screen thanks to its “Desktop Intelligence” feature and shapes its responses directly according to the context. This approach makes it possible for Mac users to use AI as an active assistant, not just a tool.

Gemini is available on the web today. However macOS appmaking the experience faster and more seamless. Basic features such as text generation, coding, image creation and web search are preserved; The user accesses directly from the desktop.

The “Desktop Intelligence” feature stands out as the most obvious difference of the application. When this system is active, Gemini can analyze the content in open applications and the context on your screen. According to the explanations in the application, this feature only works when Gemini is active and produces more personal responses based on the data it sees.

Gemini macOS app analyzes screen context

This approach is not entirely new in the industry. OpenAI’s ChatGPT macOS app and Anthropic’s Claude tool can also use screen context. However, Google already partially offered this capability on mobile devices. For this reason, there is an expectation of more advanced integration in the version moved to the desktop.

On the other hand, it is not yet clear whether Gemini will be able to perform direct operations between applications on the desktop. The “Computer Use” and “Coworker” features on the Claude side of Anthropic can automate certain tasks. Google is known to be testing similar capabilities on the mobile side, so an expansion to desktop seems likely.

This step of Google is also related to its cooperation with Apple. According to the agreement announced in January, Gemini models will be used in the Apple Intelligence infrastructure. This development Gemini artificial intelligence It shows that the technology will become more common on Apple devices, including macOS. Apple’s plan to turn Siri into a more chat-oriented assistant also supports this process.

According to Bloomberg, Google is testing the app with users outside the company. This detail Gemini macOS app It indicates that a public release is not far away. This move, which compensates for the lack of native applications on the Mac side, shows that Google is participating more directly in the desktop artificial intelligence competition.