We demonstrated Apple Intelligence. This is what the new AI tools can do

Apple’s new artificial intelligence tools are here. Now the company is trying to help customers understand them.

The Cupertino, California-based tech giant on Wednesday began offering 15-minute briefings for customers at its hundreds of U.S. stores on the company’s new line of AI tools, called Apple Intelligence, which allows iPhone users to compose emails faster, create new emojis, and remove their exes from photos.

Apple Intelligence is a key feature of Apple’s latest operating system, which the company hopes will encourage more customers to upgrade and buy more devices. The new capabilities are prominently featured in ads for the iPhone 16 and iPhone 16 Pro that have aired recently, including during the World Series.

AI tools have been available to the wider public for some time, but putting them directly into the hands of loyal Apple users could significantly accelerate mainstream adoption of the technology. But the features will likely have a steep learning curve for some users, so Apple Store employees are tasked with guiding customers through them.

The first set of new tools became available with the latest operating system update and works on iPhone 15 Pro, iPad A17 Pro or M1, Mac with M1 or newer models.

“One of the problems with a new tool like Apple Intelligence is that people will try it in the first place,” said Rob Enderle, principal analyst at consultancy Enderle Group. “We tend to be creatures of habit and especially as we get older, we don’t mess around with things that are new and different. Getting people to use the tool becomes an important part of actually validating (whether) the tools (are) good.”

Here are some of the key features of Apple Intelligence that The Times demonstrated.

Assisting with communication

New AI tools can help iPhone, Mac and iPad users proofread and compose messages.

For example, an iPhone user planning a sushi gathering at her home can type a few lines of text describing the time and place of the event, and Apple Intelligence will help create a full invitation.

Apple Intelligence can help change the tone of the message, whether the user wants it to be more friendly or professional.

The technician can also flag questions in an email that a user hasn’t answered, summarize memos, and prioritize notifying users of time-sensitive messages, such as when a delivery has arrived, so the note doesn’t get lost in their inbox.

Collecting memories, erasing exes

The AI ​​tools can help users better find specific photos in their libraries and create short videos to relive memories based on typing descriptions. For example, a mother can type “Hannah and her bunny through the years” and the software will generate a compilation video of slideshows from her photo library with music.

Apple Intelligence also has a photo editing tool in the Photos app that allows users to remove unwanted objects or people from their photos by tapping, swiping away or circling the image. This allows users to remove selfie sticks, photobombers, or even your ex-boyfriend or girlfriend from the photo.

A smarter Siri?

The updated tools will allow Apple’s Siri voice command system to better detect what a user is asking, even if they stumble over their words. Users can choose to speak to Siri or type questions.

For example, if someone says to Siri, “Set an alarm for – oh wait, no – set a timer for 10 minutes. Actually, I just thought about it, I can probably do it in five minutes. Make it five minutes,” the software could theoretically figure out what the tongue-tied person meant to say.

Emojis on request

Apple Intelligence also allows users to create their own custom emojis that they can use as stickers or responses in text messages. For example, users can type a description such as “shrimp in a cowboy hat” and receive a corresponding emoji that they can use in communication.

Apple said more Apple Intelligence tools will arrive in December, including tools that create emoji-like images from photos of their friends and family and the ability to access ChatGPT via Siri.