WWDC 2024 live updates: Apple Intelligence, iOS 18, iPadOS, MacOS and more

Like Devindra said, thanks for joining us! We're off to see what demos are available and will be taking a zillion meetings over the next two days, where we expect to learn more about things that were previewed today. Stick around to Engadget.com for more coverage and reports from WWDC 2024, we'll have lots to share!

Thanks for joining us folks, this has been an onslaught of news!

Cook is laying out what the rest of the week looks like for the developers that are here for WWDC. This is, after all, a developer conference. Who else would make the apps that actually work for us? Cook thanks us and we're done!

"Personal intelligence" is the phrase Apple has used more than "artificial intelligence." The framing makes all the difference. Apple Intelligence will power tools that actually have context around you and your data, instead of just being based on a collection of stolen content from the internet.

Apple Intelligence will be available to try out in US English this summer, and it's coming to iOS 18, iPadOS 18 and macOS Sequoia this fall. "This is the beginning of an exciting new chapter for personal intelligence," Federighi adds.

Generative intelligence is also coming to Xcode (developers around us cheered as this was announced). This sounds very similar to Microsoft's Github Copilot, which has been available for years.

"This is AI for the rest of us," Federighi is saying. Apple Intelligence, of course, not that other AI.

Apple is making it easy for developers to integrate AI features. If a dev has been using SiriKit, they don't have to do much extra work to take advantage of the new Siri AI features.

You can also use ChatGPT to create stories on-demand, or its sibling Dall E to create images. No surprises here. ChatGPT integration is coming to all of Apple's new operating systems later this year.

Federighi actually called OpenAI's ChatGPT the best of the advanced generative AI models out there (I'm slightly paraphrasing). The company is integrating access to ChatGPT in its own products to reduce the need to jump between services and apps.

The ChatGPT results also stay within the Siri pop-up. you're not being sent elsewhere.

You can ask Siri about something, and it can ask if you want to reference ChatGPT about it. The confirmation is key

ChatGPT gets a shout out as the market leader of generative AI.

Instant transcriptions just made the Notes app 100x more helpful to me.

We're going back to Federighi for anything more on Apple Intelligence. He says what we've seen today is "just the beginning" and telling us a bit more on the Notes app. You can use the recorder on your Notes app, and Apple Intelligence will deliver a transcription when you hit stop. This is also coming to the Phone app. Apple Intelligence is coming for free on iOS 18, iPadOS 18 and macOS Sequoia.

On-demand memory creation seems very useful — at least for lazy folks like me who always putt off editing and organizing family photos and videos.

These updates to Photos are "built on a foundation of privacy," like all of Apple Intelligence.

Sifting through your pictures to create videos and memories can be quite the chore if you have a ton of photos from your vacation. Apple Intelligence can help pick out the best photos and videos, craft a storyline with chapters based on themes it detected in your pictures and add background music and transitions.

You'll also be able to better search in photos and videos by typing out specific descriptors for, say, "Maria cartwheeling on the grass" or someone who had stickers on their face to find those specific moments.

Photo editing is getting an Apple Intelligence update too. The new Cleanup tool... is basically Google's Magic Eraser and will get rid of distractions in the background of your pictures.

Image Wand is available in the tool palette and you can use it to circle, say, a rough sketch in your note on Architecture in India. It'll help you generate a nicer looking picture to go with the contents of your note. You can also circle empty space to generate new contextual images.

Developers are getting a new Image Playground API to embed this experience into their apps. Now, we're learning about new experiences in things like the Notes app called the Image Wand.

Honestly this is giving me a bit of pause — Apple better clearly label when its images are generated by AI, or the deepfake fear will be something to contend with.

You'll be able to go back and see previously generated images too. You can also create images based on your photos and create the appearance of a friend from your pictures of them.

When you have a specific idea in mind, you can type a description to add it to your playground and you can choose a style, as well as whether it's an animation, sketch or illustration.

There's a new system experience called Image Playground, too, and it'll let you create playful images in seconds. It's built into apps like Messages. To start, you'll select from themes, costumes, places and more. When you pick one, they get added to your playground. Seconds later, you'll get a preview of what your image could look like — sort of like a visual mix and match composition.

Apps like Keynote or third-party options like Craft can help you better express yourself. In Messages, Genmoji is coming to help make custom emoji. They'll be made on-device and you can make them from the keyboard. You can type a description about rowdy squirrels or skateboarding dinosaurs for example. You can also name a contact and use their avatar in your Genmoji.

Over to Cyrus Irani to learn about expressing yourself via Apple Intelligence.

This prioritization is also coming to Notifications. Priority notifications will be surfaced higher up and they'll be summarized so if you wake up to 100 Whatsapp pings, you'll get a summary to tell you that, say, your friend got engaged.

Your inbox will also show better previews of each letter with AI-generated summaries. You'll also get a preview at the top of each email so you can spend less time skimming and scrolling. Priority emails will also be better surfaced.

Everything we're seeing around Apple Intelligence and Siri feels a lot more thoughtful than Microsoft's Copilot integration, or anything around Google's Gemini and other frameworks.

Suggested responses will also be coming, and lets you tap and pick parameters for a generated response. When you're replying to an invitation for example, you can tap to answer questions on whether you plan to go, and Apple Intelligence will draft up the right RSVP for you.

You can also rewrite something into a poem! I like to write my own poems though. Proofread is another feature and it'll help with grammar and punctuation and you can accept individual suggested edits or accept all at once. Finally, Summarize can help you get a TL;DR to insert at the top of long emails.

Siri also has information about you — with Apple Intelligence, it can take a deeper look at messages and files you've sent. This sounds very similar to Microsoft's Recall tool, but it's being sold in a way that feels more private and personal.

Now we're learning more about how Siri works with systemwide tools. First up, Mail. You can rewrite emails and get different versions suggested, then select your favorite. Suggestions are shown inline so you can pick the one that flows and integrates best. You can also get Rewrite to help with your tone. You can try to sound more friendly, professional or concise.

"This year marks the start of a new era for Siri." Ugh not Eras again.

"That's just a glimpse of the ways Siri is going to be more powerful," and some of these changes are also coming to iPad and Mac.

I'm impressed that all these mentions of "Siri" aren't triggering my iPhone. Good job Apple. Amazon please take notes!

Siri will be able to take actions across apps. You can go for refining a photo to throwing it into a Notes document. This is all part of upgrades around App Intents, which can help developers define intentions within their software.