As an indication of its interest in artificial intelligence (AI), Microsoft introduces new artificial intelligence features called Copilot + to users with Windows 11 2024 version (24H2). Although the company brings a few minor improvements to the operating system, the main emphasis is on Copilot + capabilities. This new update announced by Microsoft allows users to receive artificial intelligence support based on the content on their screens, with a feature called “Click to Do”.
With “Click to Do,” Copilot can help you with actions such as removing an object in the Photos app or summarizing a long article. This feature, which is very simple to use, is designed to simply click on the target while holding down the Windows key. Microsoft states that Copilot will provide context-appropriate hints in every situation. This feature, which can be described as an advanced version of the old software assistant Clippy, aims to be useful to the user without unnecessary interventions.
With the new update, the Photos application also offers the option to increase the resolution of photos up to eight times. This feature allows the user to increase the image quality as desired with a slider. Such artificial intelligence-supported features, which are also found in popular applications such as Adobe and Pixelmator, are now integrated into the operating system. In addition, the Paint application offers functions such as removing objects and creating new objects with artificial intelligence-based fill and erase options.
Microsoft has previously given hints about artificial intelligence-supported search improvements, and these features are finally coming to life with the Windows 11 2024 update. Now users will be able to search for files with simple phrases, such as “photo of my dog on the beach”, without having to learn complex search syntax.
One of the most striking innovations that comes with Copilot+ is the feature called “Recall”. This feature allows you to recall any activity on your computer. However, this feature was criticized for security vulnerabilities when it was first announced. Researchers found that Recall’s screenshot database could be accessed without administrative privileges. Following these criticisms, Microsoft postponed Recall to restructure it, and now this feature will not be enabled by default, but will only be activated with user approval. Additionally, Windows Hello will work with biometric authentication and the screenshot database will be encrypted.
Last week, Microsoft announced that data will be better isolated from hackers by using VBS Enclaves technology to improve Recall’s security. David Weston, Microsoft’s vice president of OS and enterprise security, stated that the user will always have full control over the Recall experience. However, this assurance may not be enough for users who are initially disappointed by security vulnerabilities.
Mustafa Suleyman, Microsoft’s artificial intelligence leader, stated in a blog post that Copilot will be with the user and will always securely protect personal data. However, security seems to continue to be a major concern for Copilot users in the coming period.
Windows president Pavan Davuluri stated that they learned from the problematic launch of Recall. Davuluri said that users are paying more attention to security, especially when it comes to sensitive data caches, and that Microsoft has “gone beyond expectations” in this regard. He also underlined that artificial intelligence features offer “new attacks and defense mechanisms.”
Microsoft emphasized that it has increased the security of Recall thanks to feedback from the community and will deploy Copilot + features more carefully. All these Copilot+ features will be available first to Windows Insiders and will be gradually rolled out to select devices and markets in November.
What else does Microsoft offer with the Windows 11 update?
Other Windows 11 updates that do not require Copilot+ are quite modest. Innovations such as Wi-Fi 7 support, HDR backgrounds, Energy Saving improvements that extend battery life, and better hearing aid support with Bluetooth LE are among the other highlights of the update. However, these features do not generate as much excitement as Microsoft’s new artificial intelligence-focused approach.