Live updates from Apple's WWDC 2024 keynote: iOS 18, AI, and new photos

What's up next? For Apple, it's not just AI, it's Apple Intelligence.

The tech company shared what it has coming at its annual Worldwide Developers Conference (WWDC), which kicked off Monday, including what's planned for iOS 18, AI and machine learning integration across devices and software, redesigned Photos, and a smarter Siri.

Here's what was announced at Apple's WWDC keynote:

1. AI = Apple Intelligence

Apple is embracing the power of generative models and how it can enhance its existing software with Apple Intelligence.

Capabilities will include actions across apps — like carrying out tasks seamlessly on your behalf.

The company also announced Private Cloud computing and privacy protections for Apple Intelligence to help users manage control of their data.

Siri is getting smarter and will be more "natural, relevant, personal." Demos of Siri updates included how the virtual assistant can better cross-reference information and take action responding to conversational language and become more useful to users. Siri's changes will also be coming to Mac and iPad, not just iPhone.

Apple Intelligence can also help your writing, such as in emails and other documents, with proofreading and rewrite features, including tones, summaries, and editing. There will also be a smart reply option. Summaries will also be in emails, along with identifying priority messages.

Apple is also partnering with ChatGPT, so Siri may tap into ChatGPT to supplement responses, for which it will first ask for user permission.

2. Genmoji

Apple Intelligence will also extend to emojis. These Genmoji can be created in messages using natural search language across themes, concepts, accessories, places, and more.

In addition to messages, the Genmoji will be available in Keynote, Pages, and Freeform apps, along with an Image Wand in the Notes app, in the tool palette. There will also be a new dedicated Image Playground app.

3. MacOS Sequoia

The next version of macOS, Sequoia, ushers in a new chapter of productivity and creativity. The Apple ecosystem gives users unparalleled integration across all kinds of devices. Your Mac, iPad, and iPhone work effortlessly and continuously to make you your most productive self.

Continuity

Many of us love how simple the universal clipboard makes pasting text from your Mac onto your iPhone (or vice versa), or how universal control makes your devices work together as an integrated display. iPhone Mirroring is the next step in this seamless experience, allowing your to mirror your iPhone onto your Mac, even if your phone is in the other room.

Any iPhone notifications sent to your Mac open in iPhone Mirroring automatically and all iPhone audio comes through to your Mac. Your phone stays locked in the other room or integrates smoothly in Standby mode. Mirroring makes it easy to share files from your Mac to your iPhone with a simple drag-and-drop.

Tiles and video conferencing

With Sequoia, you can snap your window tiles to different parts of your screen to stay organized. And if your house is disorganized too, you can add a background to your video calls, previewing it in Presenter Preview.

Passwords app

The new Passwords app works across all your devices to manage all your passwords and passkeys. This includes:

• Wi-Fi, app, website, and shared passwords
• Verification codes
• Sign in with Apple
• Passkeys

Safari

Safari is the world’s fastest browser and is built with a privacy-first mindset. In Sequoia, it’s easier to digest your content with Highlights — machine learning that summarizes key information. A redesigned Reader removes distractions to make it easier to read webpages, creating a table of contents and a summary for quick browsing.

4. iPad 18

Productivity tools

The new floating tab bar makes it easier to navigate to different parts of an app, expanding to a full menu when needed and keeping content edge to edge. And in apps like Pages, Keynote, Numbers and Swift Playgrounds, it’s easier to browse your documents.

Across app animations are more responsive, improving the user experience. These animations are available as APIs for developers to use in their own apps.

ii. SharePlay

When screen sharing with SharePlay, you can draw on the screen to show what action the user needs to take. Or for more involved work, you can ask permission to remotely control your iPad or iPhone.

iii. Calculator and Notes

A calculator has come to iPad! Based on the iPhone calculator, on the iPad it’s updated to take advantage of the bigger display. It also features Math Notes, which allows you to write out math problems for your iPad to solve. Math Notes:

• Uses the same functions as the scientific calculator
• Supports variables
• Updates equations in real-time
• Generates graphs based on your handwritten equations and variables

The Notes app also supports Math Notes! It also uses Smart Script to recreate your handwriting style to clean up your handwriting. You can type, rearrange, and scribble out what you wrote, and Notes will clean it up for you.

5. WatchOS 11

The latest software update for the Apple Watch will bring a redesigned watch face, a more intelligent smart stack, and other features to better help keep you active and monitor your health.

There will be more insights, and you can adjust the summary tab and your goals by the day of the week. Apple is also introducing a new Vitals app.

For the Watch faces, machine learning can help you find an image best suited for your watch face from your photos.

6. Some app changes in iOS 18

Photos. Apple is introducing the "biggest redesign ever" for the photos app, including new smart collections, carousels, and organization, such as recent days and sorting out screenshots.

Map. New topographic maps and hiking trails, including national parks.

Wallet. A "tap to cash," to share cash without sharing other private info and event tickets are getting a new design and new features.

Messages. In messages, users can tap back with any emoji or sticker, and you will be able to schedule messages to send later. There will be more format options for messages, such as strike-through or italics, and more tech effects, which can be added to any text.

7. iOS 18

The next iPhone operating system, iOS 18, will have a new dark look and allow users to bring up customization sheets, tints with color, and more. But arguably one of the biggest changes is coming to the control center, which is being revamped and also will be available to third-party developers.

There will be a new controls gallery with new options, and users can resize and adjust the apps as well as adjust options for the lock screen and reprogram the action button and other features.

iOS 18 will offer more ways to protect your privacy, including locking an app (so information from the app won't appear in other locations) or even hiding an app. You can also lock or restrict access to contacts and accessories.

8. Vision OS

Apple announced its Vision OS 2, its first major software update for the Vision Pro device.

Some of the updates include hand motions for bringing up the home menu or accessing notifications on the Mac virtual display, train support in travel mode, and also changes for photos and video.

Users can create a spatial photo from images already in their camera roll and also can experience panoramas with others through share options. Users can create spatial content, and Apple says they are making it easier to do so and also capture spatial video for their immersive video feature.

Canon will also be offering a new lens that will allow for capturing spatial video. It will be available this fall.

The Vision Pro will also now be available in more countries.