Apple’s AI Plans in iOS 18 to Be Revealed at WWDC 2024

Apple is set to introduce many new AI features in iOS 18, some of which will require processing in the cloud rather than on-device.

Mark Gurman announced this in his Bloomberg newsletter, explaining that the new features will likely be unveiled during Apple’s annual Worldwide Developers Conference (WWDC 2024) in June.

Power On: Inside Apple’s generative AI plan and iOS 18, including new features like AI-created Emojis, extensive Home Screen customization and a big focus on summarizing information https://t.co/5JLjWmGhTa

— Mark Gurman (@markgurman) May 26, 2024

AI in iOS 18

Apple is set to reveal Project Greymatter, its idea of AI for the masses. Project Greymatter is a set of AI tools that Apple will incorporate into its core apps, such as Safari, Photos, and Notes.

The idea is that most of the processing for the AI features will happen on the device, with more complex computations being pushed to the cloud. iOS 18 and macOS 15 have software that decides which computations will happen on-device and in the cloud.

Here’s an overview of the key AI features to be expected in iOS 18:

• Transcriptions: Voice memos will now be transcribed.
• Photo Editing: Photos can be retouched with the help of AI.
• Web Search: Safari web search is to be improved.
• Improved Search: Searches will be faster and more reliable in Spotlight.
• Text Suggestions: Your device will automatically suggest replies to emails and text messages.
• Siri: Siri will have more natural-sounding interactions and be more advanced on Apple Watch.
• Developer Tools: Xcode is also getting an AI upgrade, although no details have been released.
• Emojis: Users can create customized emojis based on their messages beyond the catalog of emojis Apple offers.
• Smart Recaps: Users can get summaries of their missed notifications and texts and any text they’re viewing on their screens.

Partnership with OpenAI

Apple will also announce its partnership with OpenAI to improve its features, especially since it lacks an in-house chatbot. This partnership will bring OpenAI’s ChatGPT into iOS 18, helping Apple to catch up with competitors like Google and Microsoft, which already have advanced AI and chatbots.

The partnership is a double-edged sword with benefits and risks:

Benefits

• Advanced AI Capabilities: Integrating OpenAI’s chatbot technology gives Apple sophisticated AI features that can enhance user experience across all Apple devices.
• Competitive Edge: This move helps Apple stay competitive in the fast-changing AI market, allowing it to offer features that rival those of Google and Microsoft.

Risks

• Controversy and Stability: OpenAI has faced controversy and internal issues, which could affect its reliability as a partner.
• Dependency on Third-Party: Relying on OpenAI means Apple has less control over this important feature, which may impact its ability to ensure user data privacy and security.

Commitment to Privacy

Most of Apple’s user base loves its commitment to privacy and security, which means that Apple must assure its clients that their data will remain safe even with AI.

The company has been touting the advantages of on-device processing for years, stating that data is more secure since it isn’t being transmitted to the cloud. Now, it has to prove that the AI-powered features that require the cloud for processing will still maintain privacy despite sending information to a data center.

According to Gurman, Apple is likely to take a specific approach to its defense: it isn’t building client profiles like Google and Meta. It’s also likely to point out the security features of the M-series chips used to conduct cloud processing. This will likely not win over any privacy experts, but the average user probably won’t care.