Danish Kapoor
Danish Kapoor

Apple's new artificial intelligence features: “Apple Intelligence”

At the WWDC 2024 event, Apple announced new operating system versions such as iOS 18 and macOS 15 Sequoia, as well as new artificial intelligence (AI) features called “Apple Intelligence”. The company had previously avoided using the term artificial intelligence when talking about machine learning features. This new system is fully integrated into iOS 18, iPadOS 18 and macOS Sequoia. Apple Intelligence harnesses the power of the Apple chip to understand and create language and visuals, perform actions in apps, and simplify everyday tasks.

With Private Cloud Compute, Apple can flexibly scale computing capacity between on-device processing and larger server-based models running on dedicated Apple chip servers. This sets a new standard for privacy in artificial intelligence. “Apple Intelligence will completely transform what users can do with our products and what our products can do for our users,” Apple CEO Tim Cook said about this innovation.

Apple Intelligence offers new ways for users to improve their text and communicate more effectively. With Writing Tools integrated system-wide in iOS 18, iPadOS 18 and macOS Sequoia, users can rewrite, correct and summarize their text almost anywhere, including Mail, Notes, Pages and third-party applications. With the Rewrite feature, Apple Intelligence allows users to choose between different versions of the texts they write by adjusting the tone of the texts according to the target audience and the task at hand.

The proofread feature checks the texts in terms of grammar, word choice and sentence structure, suggests edits and explains the reasons for these edits. Users can review and quickly accept these regulations. With the Summarize feature, users can have the text they choose summarized in a short paragraph, bullet points, table or list.

Express yourself with visual creation within Apple Intelligence

Apple Intelligence powers exciting visual creation features that help users communicate and express themselves in new ways. With Image Playground, users can create fun visuals in seconds by choosing one of animation, illustration or sketch styles. Extremely easy to use, Image Playground comes built-in to various applications such as Messages.

With Image Playground, users can choose from different concept categories such as themes, costumes, accessories and locations, describe an image by writing text, select a person from their personal photo archive, add their image and choose their favorite style. Thanks to the Image Playground experience in the Messages application, users can quickly create fun images for their friends and even receive personalized concept suggestions related to the chat.

An expression suitable for every moment with Genmoji

Users can create original Genmojis that take emojis to a whole new level to express themselves. They can create their Genmoji with additional options by writing a description. Users can also create Genmojis of their friends and family members based on their photos.

New control features over photos

Apple Intelligence makes searching for photos and videos even easier. It is now possible to search for specific photos using natural language. For example, one might search for “Maya skateboarding in a tie-dye shirt” or “Katie with stickers on her face.”

Video searches are also becoming more powerful, with the ability to find specific moments in clips. In this way, users can immediately access the relevant sections. Additionally, the new Clean Up tool can identify and remove distracting elements in the background of a photo without accidentally affecting the subject.

A new era with Siri

Powered by Apple Intelligence, Siri integrates much more deeply into the system experience. By gaining a richer language understanding capacity, Siri facilitates and accelerates users' daily tasks in a much more natural, contextual and personalized way. Even if users get stuck on words, Siri can keep track and maintain context across all requests entered.

To truly assist users, Apple Intelligence protects user privacy while deeply understanding personal context. On-device rendering and the fact that most models run entirely on-device is one of the key features of Apple Intelligence. Private Cloud Compute opens the door to even more comprehensive smart technologies by expanding the privacy and security of Apple devices to handle complex requests that require more processing power.

With Private Cloud Compute, Apple Intelligence's computing capacity can be flexibly scaled and larger server-based models can be leveraged for complex requests. These models are run on servers with Apple chips. Thus, only data related to the task given by the user is processed on Apple servers and is never stored.

ChatGPT integration

Apple is integrating ChatGPT access into experiences offered with iOS 18, iPadOS 18, and macOS Sequoia. In this way, users can access both ChatGPT's expertise and visual and text comprehension features without switching between tools. When necessary, Siri can call on ChatGPT's expertise and provide answers directly, with approval from the user.

ChatGPT will also be integrated into system-wide Writing Tools. Writing Tools will help users create content about the things they write. With Compose, users will be able to access ChatGPT visual tools and produce images in different styles that complement their writing.

When and on which devices will Apple Intelligence be available?

Apple Intelligence will be available in beta this fall as part of iOS 18, iPadOS 18, and macOS Sequoia. Some features, software platforms and languages ​​will be added over the next year. Apple Intelligence; It can be used on iPhone 15 Pro, iPhone 15 Pro Max, and iPad and Mac models with M1 and newer chips, with the Siri feature enabled and the device language set to US English.

Danish Kapoor