These GPT-4o features are coming to iOS 18, iPadOS 18, macOS

At WWDC 24, Apple announced GPT-4o large language model (LLM) integration to iOS 18, iPadOS 18, and macOS Sequoia for generative AI features.

The integration follows a partnership between Apple and artificial intelligence (AI) firm OpenAI to enable ChatGPT in these software ecosystems. The latest model GPT-4o improves human-computer interactions.

This LLM is capable of processing text, audio, images, and video to generate a combination of text, audio, and image outputs. This new model is able to respond to audio inputs in as small as 232 milliseconds with an average of 320 milliseconds.

It also increases performance compared to GPT-4 Turbo on text in English and code. GPT-4o can process vision and audio understanding compared to existing models.

Bringing this new model into iOS 18, iPadOS 18, and macOS Sequoia will enable fast Siri interactions. GPT-4o model improves Siri’s natural language comprehensive perspective and a user can talk to the voice assistant without worrying about a pause.

Siri can now directly communicate with ChatGPT for fast answers. You can type or talk to Siri for answers and opt for ChatGPT by permitting the “Use ChatGPT” or cancel. Once allowed, users can see a broad response from ChatGPT on the same screen.

OpenAI ChatGPT Integration in Apple Siri Voice Assistant (Image Source – Apple)

Writing Tools

ChatGPT’s writing tools will also be accessible to Apple software to generate text and images. When you create a page document, the writing tools will suggest content based on the page title.

Its new compose tool allows users to access ChatGPT image tools to create images for different styles for a better reading experience. These images could be added anywhere alongside the text content in a document.

ChatGPT Writing Tools for Apple users (Image Source – Apple)

Availability

GPT-4o-powered ChatGPT features are coming to Apple iOS 18, iPadOS 18, and MacOS Sequoia later this year. These device users can access ChatGPT features for free without creating an account. However, ChatGPT users will get an option to connect their accounts for a optimized user experience.