New iOS 18 AI Features Leaked: Smart replies, summarization, math notes, and more

Apple will launch new features with iOS 18 and some of these are now leaked suggesting an expansion of AI into the root of this operating system.

Inputs from AppleInsider revealed that Apple is developing these features under project Graymatter. It upgrades the entire system apps with new generative AI including Notes Apps, Message app, Keyboard, Photos, and more.

Smart Replies

Apple will enable users to generate automated replies for SMS and emails to simplify the reply process based on the received message or email. This functionality will be provided by on-device generative AI models.

Transcription

Notes app will gain new capability that will allow transcription of notes for easy comprehension. It will transcribe the audio in the memo app and summarize it as text. This feature could be seen as the new real-time transcription in the podcast app.

Users can read the full text of an episode, and search the episode for a specific word or phrase. Tap on the text to play the podcast from that point in the episode. It will also highlight each word to follow along.

Math

The new Notes app will support math notation using the Calculator app. The generative AI will detect any mathematical equation or math-related text in the note and suggest a related answer right away.

Math will be further popularized in the new iOS including keyboard predictions. The keyboard will get mathematical predictions while writing equations or doing math. The feature will work similarly to predictive text.

AI editing

New features will also be reflected in the image editing section. The Photos app will gain AI object removal capability and other new additions that will succeed existing ones.

Apple is also testing a generative image creation tool that could create background images for iPhone users. However, the access is limited to developers and might also come to users later. These are the latest iOS 18 AI features leaked but there’s more waiting for us to be revealed at Apple’s WWDC24 event on June 10.