Apple WWDC recap: Tim Cook reveals 'Apple Intelligence' AI system, iOS 18, OpenAI partnership, and the all-new Siri

• Apple's WWDC 2024 keynote outlined the new iOS 18, macOS Sequoia, iPadOS, watchOS, and Vision Pro software.

• But the big news was Tim Cook unveiling a new generative AI system, Apple Intelligence, and a new Siri.

• The Apple-OpenAI partnership was also made official, with ChatGPT integrated into Apple's software.

Apple's Worldwide Developer Conference keynote was a busy one.

It's Apple's state of the union for the software that underpins its various device families, such as iPhone, Mac, iPad, and the recently launched Vision Pro.

But Tim Cook also made room for a very big announcement, the news that was on everyone's mind: Apple's generative AI strategy, which is officially called "Apple Intelligence."

The generative AI system will be deeply integrated into iOS 18, the upcoming iPhone software, along with the latest Mac and iPad operating systems.

Apple's 13-year-old virtual assistant, Siri, is also getting a much-needed AI makeover. Executives showed various examples of how the new Siri powered by Apple Intelligence can help you complete daily tasks by accessing more granular actions within apps.

Apple also made its partnership with OpenAI official, bringing an optional ChatGPT integration to its software. This will allow users to tap into OpenAI's popular chatbot via Siri, or when completing tasks within apps, such as writing a story. Sam Altman was in attendance, though he didn't take the stage.

You can expect to see Apple Intelligence and ChatGPT integration arrive in the fall when the next iPhone launches.

But that was far from it — Apple announced a host of other features and software updates.

Luckily, we live-blogged the full WWDC keynote, so if you missed it, don't worry: Just scroll to the bottom of the page for the full recap.

Tim Cook closes things out.

Apple Intelligence, the flagship feature revealed today, is coming to iPhone 15 Pro and iPads and Macs with M1 chips or later.

Tim Cook returns to wrap up the keynote, giving a brief overview of the announcements.

That's it for this year's WWDC — see you next year!

Apple details OpenAI partnership, which brings ChatGPT to Siri and other features.

This is the result of Apple's deal with OpenAI, which Apple called a "pioneer" just now.

Apple says it's integrated ChatGPT into Mac and iOS, allowing Siri to tap into ChatGPT.

Apple says "You're in control" if you want to send anything to ChatGPT. But as a result of the partnership:

• Siri will work with ChatGPT to provide better answers to questions

• A Compose feature will use ChatGPT to create stories and text with a prompt

• You can access this without a ChatGPT account and paying users will have more paid features

• Siri will ask for permission before sharing your question with ChatGPT

Sam Altman reacted to the news on X, saying he was "very happy to be partnering with apple to integrate chatgpt into their devices later this year!"

Apple's clean-up tool uses AI to remove unwanted background details from photos.

Think of it like AI meets Photoshop. Apple says the clean-up tool uses Apple Intelligence to clean up the background of an image, removing an undesired detail.

Apple's 'Image Playground' is its spin on AI images.

Image Playground will let you create images using already available characteristics — no need to write your own prompts but you can write them if you want, Apple says.

You'll get suggestions in Messages for original images generated based on your conversations. Image Playground will also be available in Apple's apps like Keynote, Pages, and Freeform.

But there will be a dedicated Image Playground app.

Generate your own emoji with 'Genmoji'

Don't love the default emojis? Just use Apple Intelligence to generate your own "Genmoji" (see what they did there?)

Apple says Genmoji will help you "match any moment perfectly."

You can type a prompt in and get a custom emoji created instantly.

Bring on the Apple Intelligence demos!

Apple is detailing a host of examples of how Apple Intelligence will help you "save time in so many ways."

Writing Tools:

• Rewrite will suggest different versions of what you've written (improve tone to be friendlier, more professional, or more concise)

• Summarize will help you add TL;DRs to your written messages

• Smart Reply is coming to Mail: it can identify any questions you were asked over email

• In the Mail app, you can see summaries of emails instead of short previews

Notifications are getting prioritized and summarized (the example shown off is when the group chat is blowing up, it'll sum up the conversation so you're all caught up).

We're seeing some demos of what the new Siri is capable of.

Apple says this is the "start of a new era for Siri," and shows off some more examples of the new virtual assistant powered by Apple Intelligence.

• Personal context: Siri can find the things you don't remember (like finding a photo of your license, extracting your ID number, and adding it to the digital form you're filling out)

• Siri can track flights at your request and keep track of the casual plans you made over text. No need to add it to your calendar

• We also saw an example of figuring out how long it would take to arrive somewhere, based on some plans made in a text message. Siri answers the question and brings up a map without you having to tab between multiple apps.

We're getting our first look at the new Siri.

Siri, which was first introduced 13 years ago, is long overdue for an overhaul, and Apple is finally showing it off — powered with Apple Intelligence.

Apple says Siri is getting more natural, relevant, and personal. It's now more than a glowing circle, it'll be a glowing light bordering the screen instead. It'll be more conversational and understand context — no need to speak succinctly.

It can also have onscreen awareness. For example: Updating a friend's contact card with their address. Siri can act on your behalf in apps like finding a specific photo in your library or making changes in the Notes App.

You can also type to Siri for requests and switch between text and voice.

The new Siri can offer Apple support if you need help with a feature on your iPad, iPhone or Mac.

With App Intents, third-party developers will be able to define what they want to allow Siri and Apple Intelligence to access — basically, this will help Siri and Apple Intelligence plug into apps and carry out more tasks.

Apple says 'on-device' AI processing helps keep things more private.

Apple Intelligence will take action when prompted like "pull these files" "play the podcast my wife sent me." So how does it do it?

Apple is really emphasizing that Apple Intelligence can run on-device, meaning it's not outsourced to cloud servers. It's more private that way, Apple says.

But there are some tasks that will require a more complex AI model than what's possible to run on the chips within your device, in which case Apple will use some cloud processing. To do this the Apple way, Apple announces "Private Cloud Compute," which can draw on larger server-based AI models while also protecting your privacy. The cloud servers use Apple Silicon.

When you ask Apple Intelligence to do a task, the software will determine if the request can be processed on-device or if it will work with Apple's "Private Cloud Compute" servers.

If so, it will send only relevant data. Apple says this system is a "brand new standard" in AI privacy.

Craig is back to detail the new AI features.

We're seeing some examples of how Apple Intelligence will be woven into Apple's apps.

Some examples of where you'll see the new AI features:

• It can understand and create language and images

• Language: Apple Intelligence will make day-to-day tasks easier, such as in your Mail app when emailing.

• Apple Intelligence has writing tools that can rewrite and summarize text across Mail, Notes, and more apps

• Images: Create "totally original images." Apple says. Create custom animated images of  people in your Photos (three styles sketch illustration, and animations)

Tim Cook returns and announces 'Apple Intelligence,' its generative AI system.

Apple has been using "artificial intelligence and machine learning for years," Cook says. Apple's AI has to be powerful, intuitive, integrated, personal, and private, he adds.

It should be "Personal intelligence" instead of "artificial intelligence," Cook says, before a video plays to reveal the branding for Apple's AI: "Apple Intelligence."

Some new games are coming to Mac.

Apple talks about gaming updates for Mac.

Apple isn't traditionally known for gaming, so it's always looking to remind people that yes, you can play modern games on Macs.

For example, "Assassin's Creed: Mirage" and "Assassin's Creed: Shadows" are coming to Mac.

The Game Porting Toolkit 2 will allow developers to create more games that are compatible with Mac.

Apple announces new 'Passwords' app and Safari updates.

The new Passwords app lets you store and easily access your various passwords. It'll be available on iOS, Mac, iPad, and Vision Pro.

Apple didn't say as much, but this will compete directly against other password-storage apps, like LastPass and 1Password.

For Apple's internet browser, Safari, new updates include:

• Backgrounds are coming to FaceTime for when you want to hide your environment

• Safari Highlights feature makes it easier to check out new music, shows, and find important info on websites without having to search for it

Say hello to macOS Sequoia.

Sequoia is the name of Apple's new software for your MacBook and Mac. A big theme is "iPhone Mirroring," which Apple says lets you control your iPhone by "barely lifting a finger" with a virtual version of your iPhone displayed on your Mac screen.

You can use your mouse to swipe on apps and your keyboard to type in text on your iPhone. Your iPhone notifications will be sent to your Mac too.

While using "iPhone Mirroring," your real-life iPhone remains locked.

Craig is back to talk about new iPad software.

A lot of what we're seeing here echoes what we see in iOS 18. There's a more customizable home screen and Control Center.

But there are some specific iPadOS changes.

• Floating tab bar (that can morph into a sidebar) that will make it easier to navigate within apps.

• Shareplay: Screen sharing will now let you tap and draw on your screen. You'll be able to control someone else's device over shareplay (with permission).

• There's (finally) an iPad Calculator app that isn't just the scaled-up iPhone version.

• With Math Notes within the Calculator app or the Notes app, you can use the Apple Pencil to write out math problems for the calculator to help you solve, and easily add together sums and solve more complex equations with variables. Writing the equal sign will trigger the Calculator to give a solution to a math problem.

• Smart Script is meant to supercharge your handwritten notes: the feature will use on-device machine learning to recognize your handwriting and clean it up. You can copy/paste and spellcheck notes in your own handwriting.

Next up, Apple Watch's new software features!

There's a big emphasis on fitness/health here with the latest version of Apple's Watch's software, watchOS 11.

In watchOS 11, there's a new Training Load calculation.

You can rate your workouts and adjust your effort rating. This will then be used to help calculate your Training Load. The goal is to give you more insights to make adjustments to your training.

You can also adjust your goals on the day to day to make it easier or more challenging to close your rings — or take a day off without losing your streak.

The Vitals app is also here to track your vitals and "gain better context when it comes to your health."

The Health app will help users stay on top of their pregnancy with a period tracker and more info about how your body changes with pregnancy.

The Smart Stack is getting smarter. Translate languages quickly and use the "Check In" feature to let friends know you're safe, such as when you're out on a late-night workout with only your watch.

WatchOS 11 will also use machine learning to curate the best photos for your watch face.

tvOS is also getting some new features.

With InSight, you can see the actors and song names while watching content on Apple TV+ — Prime Video users may recognize this.

Smart subtitles on Apple TV will also be available when you rewind back.

AirPods are getting some new gesture controls.

AirPods will be able to respond to nonverbal gestures like nodding or shaking your head, so if you're in an elevator or somewhere you'd rather not respond to Siri verbally, you can shake your head or nod to respond without talking.

Voice Isolation is coming to AirPods Pro, removing the background noise around you to deliver "the best call quality," Apple says.

We see a quick demo of a conversation where an AirPods Pro wearer has a quiet phone call even while at a construction site.

iOS 18 brings 'biggest redesign ever to the Photos app'

Finally! In iOS 18, there's a new Photos app designed to have a more effective way to organize your photos.

• You can now filter your library to help find specific types of photos

• Scroll up in Photo Library to see collections like "Recent days"

• The new version includes groups of people when you search the "People and Pets" folder

• A new carousel to easily find favorites and featured photos by swiping

'Tap to Cash' and new features to Mail and Maps.

There are new ways to organize the Mail email app with categories like "transactions" and "sales and promotions."

You can also get all your flight information in one place with categorization.

Hiking trails are alos coming to Maps with custom hike capabilities.

Apple also announces "Tap to Cash," allowing iPhone users to exchange money phone-to-phone by tapping, like the Airdrop feature.

Messages is getting 'Tapbacks' and scheduling.

Say hello to Tapbacks, which let you quickly react to a text message with more emojis than the old default "love, like, laugh, thumbs" reactions.

"People love" tapbacks, Apple says.

Messages are also getting text formatting and the ability to schedule texts.

There are also some new effects: In iOS 18, you can add effects like "shake or "bloom" to specific words in a text.

Messages sent via satellite for when you're in a remote area without service for iPhone 14 and later.

You can now "hide" the apps you don't want others to know you've downloaded.

If you hide an app, you can lock it behind FaceID or passcode and have it not show up on the iPhone home screen — it'll be accessible in a hidden apps folder that's locked instead.

Next, it's time to hear about iOS 18.

Craig is back to announce iOS 18, calling it a "big release."

There's new iPhone home screen customization that offers "exciting new ways to personalize your iPhone further," Craig says.

There are new ways to arrange apps so you can see your home screen and wallpaper background better.

App icons in dark mode are also getting a new look.

By holding down on the home screen you can now tint your app icons thanks to a new customization menu. iOS 18 will suggest a tint color but you can also dial things to your preference.

Control Center is also getting an overhaul — it's more powerful to let you add more controls and scroll to find them and lay them out how you'd like. You can now swap your camera or flashlight controls on the lockscreen for new ones, like the Notes app.

First up: Software updates to Apple's Vision Pro.

The software that powers Apple's $3500 Vision Pro, visionOS, is getting a follow-up.

VisionOS 2 has some "big updates," Apple says.

In the Photos app, you can now turn old photos into spatial photos thanks to machine learning.

iPhone 15 Pro and Pro Max owners will also be able to capture spatial videos for Vision Pro. And Canon will make a lens for the same use.

There are also some new gesture controls for quickly accessing the menu. Amtrak riders, good news: Train support is coming to travel mode.

When connecting to your Mac, higher display resolution and overall size of the Mac display in the headset — think an ultrawide display wrapped around you — are on the way.

Tim Cook joins us from the top of the solar panel on Apple HQ.

Cook welcomes everyone and talks about providing new tools for developers.

He mentions "profound new intelligence capabilities" that he hopes everyone will enjoy.

That sure sounds a lot like AI. But before we get there, Cook highlights Apple TV+ and some upcoming seasons, such as season 2 of "Severance," and a new movie "Wolfs," starring Brad Pitt and George Clooney.

"We have so much to talk about today," Cook says. "We'll start with our OS announcements, and then we'll dive deeper into intelligence."

Here we go! The keynote is starting.

We're seeing a video playing with Apple exec Craig Federighi leading a team of employees skydiving into the event.

"It's showtime," he says, before dropping out of the plane.

You can watch the livestream right here too.

We're 10 minutes away from kickoff, and Apple will also be livestreaming the event if you want to tune in that way.

For those of you who can't listen or watch while at work, we'll also be liveblogging the entire event right here.

OpenAI CEO Sam Altman is here ... will he take the stage?

The OpenAI CEO was photographed by X user @Mac4Ever. He was also spotted by another X user at a table with Apple cofounder Steve Wozniak.

Apple has reportedly made a deal with OpenAI to bring some of its AI features to iPhones.

Now, the big question is whether Altman will take the stage himself at WWDC to talk about it, or if he's just there to watch with the rest of us.

Apple cofounder Steve Wozniak is in the house!

Steve "Woz" Wozniak was just spotted rocking some sunglasses at Apple HQ by software developer Marco Eidinger.

Woz has attended a bunch of Apple events in the past, including WWDC. Back in 2013, he was photographed at WWDC on a segway.

Tim Cook teased this WWDC will be a 'big one.'

The Apple CEO met with student developers who won its Swift Student Challenge over the weekend and said as much.

Referencing WWDC, Cook reportedly said "it's a big one."

With less than 2 hours to go until he's expected to take the stage and kick things off in full, consider us hyped up, Mr. Cook.

Tim Cook is up early and ready to roll

The CEO started the big day by sharing a photo of the sunrise with an optimistic message attached.

"Can't wait for you to join us at #WWDC24 this morning," Cook wrote on X.

'Pent-up demand'

No matter what Apple does actually announce at WWDC, it will be up to consumers to decide whether AI-based services are something they really want or need on their iPhones.

There's also a risk of annoying some iPhone owners who won't be able to use the new features because their devices aren't powerful enough.

However, getting people to buy a new iPhone is of course part of Apple's game plan. Wedbush analysts think "pent-up demand around an upgrade cycle could exceed 270 million iPhones heading into iPhone 16."

Words and pictures

One rumor we're really hoping is on the money is automatic transcription for voice notes courtesy of AI. That's a feature available on the Google Pixel phone and other apps for some time now.

Apple is also going to let users create emojis on the fly using AI, according to Bloomberg.

'Which battles to fight'

Apple's partnerships, like the rumored deal with OpenAI, are a way to pass on some of the costs and risks related to AI models, according to David Wagner of Apple shareholder Aptus Capital Advisors.

"Apple is passing off the liabilities of AI to a partner like OpenAI," he told The Wall Street Journal. "Apple knows which battles to fight and which ones not to fight. This isn't one they're fighting."

‘Apple Intelligence’

The new AI operating system that will power iPhones, iPads and Macs is expected to be called "Apple Intelligence," Bloomberg reported.

The new features will also be optional for users, per the outlet.

'Out of the ditch'

Apple is hoping to stimulate iPhone sales by adding AI features to its key product.

Trip Miller, managing partner at Apple investor Gullane Capital Partners, told The Wall Street Journal: "AI is the thing that can get Apple out of the ditch. They're this big behemoth. It takes a new story to get them moving in a new direction. AI is that opportunity for them."

Tim Cook’s keynote

Tim Cook's keynote address at WWDC starts at 1 p.m. ET and will be between 90 minutes and two hours long. You can also watch it on the Apple TV app.

Apple shares are a touch higher in premarket trading and have added 6% this year.

However, that's a less impressive performance than Microsoft, which is up more than 14% and overtook Apple as the most valuable company back in January.

AI summarization tools on the cards

Matthew Bloxham, a Bloomberg Intelligence analyst, is expecting AI summarization tools to be announced by Tim Cook.

He told Bloomberg TV: "Safari, which is their web browser, will do more intelligent summarization of things you've searched for. There might even be a AI-prompted reply for emails and messages, so lots of different features in all of their familiar apps just kind of enhancing them and elevating it to the next level."

Vision Pro headset was last year’s WWDC reveal

CEO Tim Cook unveiled Apple's first mixed-reality headset, the Vision Pro, at last year's WWDC. It was the first major product announcement since the Apple Watch in 2014.

'AI-driven accelerated growth cycle'

Wedbush Securities analysts including Dan Ives said in a note that the AI-infused products and services "will be the narrative of the Apple story for the coming years."

They predict a formal announcement of Apple's rumored partnership with OpenAI, which they think is a chatbot based on Apple LLMs and that an AI App Store will be unveiled.

They also think an AI-powered iPhone 16 launch could be on the cards this year too.

WWDC is Apple’s biggest conference

The Worldwide Developers Conference is held by Apple every year. It starts with a keynote speech from CEO Tim Cook that's available to watch on apple.com.

WWDC is being held at Apple Park, its headquarters in Cupertino, California. It's colloquially called "the ring" or "the spaceship" because its giant circular design resembles a flying saucer.

Developers will attend various sessions at the conference, which runs until Friday.

Read the original article on Business Insider