Apple's Audio Intelligence puts the consent switch on one wrist
Apple built the wearer a careful consent flow for the Watch's new listening features and built nothing for the person across the table. That is the part it will have to answer for when it moves to glasses.
The Product Desk
What happened
- Apple's Watch Ultra 4 and Series 12 add Live Rewind and Siri Recap, which Fast Company says reposition a health device into an always-listening AI assistant strapped to the wrist.
- Live Rewind keeps a rolling 15-second audio buffer on the watch that is continually overwritten, transcribing the last buffer onto the display when the wearer activates it.
- All four Audio Intelligence features, including Shazam song identification and alerts for doorbells and crying babies, remain completely nonfunctional until the user enables them.
Why it matters
- What it limits constraint A flat "it all runs on device" answer to a security review is wrong for half the pair, since Siri Recap's text makes a round trip to Apple's cloud even though its audio never leaves the wrist.
- Who's exposed exposure Anyone in earshot of an enabled watch is inside the buffer with no control of their own, so the job of telling them lands on whoever wrote the meeting policy.
- Who has to decide decision Allowing a wrist that manufactures meeting synopses into rooms where notes are retained is now a call someone has to make without a documented lifetime for the summary text.
- What it sets up precedent If the wearer-only opt-in is the pattern Apple carries into smart glasses, as Fast Company expects, it will meet the bystander question on a device worn on the face rather than the wrist.
Next story · Product · Oct 7
iFixit's teardown finds every new Apple Watch battery swap still starts at the glued screenConfirmed2 publishers
Start with the person across the table. Their voice goes into the same rolling 15-second buffer as the wearer's, and when Live Rewind is activated, their last sentence surfaces as text on a screen they cannot see [5]. The consent Apple built here is genuine and carefully engineered, and it belongs entirely to the one person who enabled the setting [8].
Opt-in settles what happens inside the wearer's own settings screen, nothing more. Per Fast Company's account of the design, the wearer's enablement and the exclave's access restrictions are the whole of the control surface; no notice to the other party appears anywhere in it [12].
The engineering does something specific here rather than something vague. Audio goes into a new Secure Exclave on the S11 chip, gets processed there, and gets deleted, out of reach of watchOS, other apps, Apple, and the wearer [9]. Run an hour-long meeting past Live Rewind and that buffer is written and overwritten roughly 240 times, with no audio left behind at the end [11].
The two novel features part company after that. Live Rewind's transcription runs on the watch and the audio never travels to Apple [15]. Siri Recap deletes the raw audio after on-device speech recognition and then sends the text to Private Cloud Compute to be summarised before the synopsis comes back, which Apple says it cannot read [7]. Counting off-device hops, that is zero for one feature and one for the other [14].
The artifact changes the calculation. A synopsis is not a transcript, by Apple's own description [6], but it is still a durable piece of text with the substance of a conversation in it, and text gets pasted into tickets, forwarded, and retained. Apple's account tracks the audio all the way to deletion and stops following the summary at the moment it lands on the wearer's screen [13].
Each listening feature sorts along two axes. Axis one: what durable artifact does the feature leave, and has that artifact been off the device? Axis two: who other than the wearer can switch the feature off? Live Rewind lands in the easy quadrant, leaving no artifact and never leaving the watch. Siri Recap lands in the quadrant where the artifact is text, the text has made a round trip to Apple's cloud, and the only off switch sits on somebody's wrist.
Fast Company reads all of this as a preview of how Apple will handle public unease about the smart glasses market it plans to enter [16]. The exclave travels well to that device. The wearer-only opt-in does not, because a sealed chip answers where the data went, not whether anyone else in the room agreed to its collection.
How long a Siri Recap summary lives once it is text is checkable and currently unanswered [13], and so is whether any off switch exists that is not on the wearer's wrist [12].
What to watch
- A published retention window for Siri Recap summaries, or an administrator control that lets someone other than the wearer disable Audio Intelligence.
- Whether Apple's smart glasses reuse the Secure Exclave design and add any signal to the people being listened to.
- Whether third-party developers ever get access to the exclave's buffers, which are currently sealed off from other apps on the watch.
Clarity's read
What the record supports and how the coverage leans. The claims behind it follow.
Reality
- Evidence72
- Adoption
- Not scored
- Hype gap+18
- Incentives66
- Confidence70
Perspective Coverage
21 publishers- Builder
- Builder 35%
- Operator
- Operator 37%
- Investor
- Investor 28%
Claim ledger
Ranked by verification strength, evidence, and original report placement.
- [1]
Apple introduced the Apple Watch Ultra 4 and Apple Watch Series 12, adding two new agentic tools called Live Rewind and Siri Recap.
- [2]
Fast Company writes that Live Rewind and Siri Recap reposition the Apple Watch from a device primarily focused on health to one that also acts as an always-listening AI assistant strapped to the wrist.
- [3]
Apple's "Audio Intelligence" banner refers to four new AI-powered features on the Ultra 4 and Series 12.
- [4]
Two of the four features are automatic identification of playing music using Shazam, shown on a watch widget, and constant listening for sounds such as alarms, a crying baby and doorbells to warn the user, which Fast Company notes is particularly beneficial for people with hearing impairments.
- [5]
Live Rewind has the watch constantly listen to conversations and store them locally and briefly in buffers of roughly 15 seconds that are continually overwritten; when the user activates the feature, the previous 15-second buffer is transcribed and displayed on the watch screen.
- [6]
Siri Recap creates AI-generated synopses of conversations with the relevant points rather than transcriptions, which Apple positions as automatic note-taking in workplace meetings.
- [7]
Siri Recap permanently deletes the raw audio after on-device speech recognition transcribes it into text; that text is then sent to Apple's Private Cloud Compute for processing and summarisation before being returned to the user, and by design Apple cannot access data sent to its private cloud.
- [8]
All four Audio Intelligence features are opt-in: the user must enable them or they remain completely nonfunctional.
- [9]
Apple designed Audio Intelligence so recordings stay inaccessible to watchOS, other apps on the watch, Apple itself and the user, using a new Secure Exclave on the S11 chipset in the Ultra 4 and Series 12 that processes and analyses audio, never permanently stores recordings, and deletes them after processing.
- [10]
Apple says Live Rewind is useful when someone quickly mentions information the wearer may not have fully absorbed, such as recipe instructions or a book recommendation.
- [11]
An hour of Live Rewind operation writes and overwrites the 15-second buffer about 240 times, retaining no audio.
- [12]
The only consent and control mechanisms described in Fast Company's account are the wearer's opt-in and the exclave's access restrictions; no mechanism for notifying or letting a bystander decline appears in it.
- [13]
Apple's described data lifecycle for Siri Recap ends when the summary text is returned to the user; no retention period for that returned text is given.
- [14]
Of the two novel Audio Intelligence features, Live Rewind involves zero transmissions off the watch and Siri Recap involves one, the text sent to Private Cloud Compute.
- [15]
Live Rewind's transcription runs locally on the Apple Watch, so the audio data is never sent to Apple.
- [16]
Fast Company argues that Apple's handling of Audio Intelligence privacy hints at how the company may address growing public unease around smart glasses, the next wearable market it plans to enter.
Sources
21 independent publishers whose own reporting we read for this story.
- androidpolice.comApple Watch 12 and Ultra 4's biggest upgrade isn't the hardware—it's what your wrist can now hear
1 article · September 9, 2026
- apple.comApple unveils Apple Watch Ultra 4 - Apple
2 articles · September 9, 2026
- arstechnica.comApple starts preorders for Watch Series 12, Ultra 4 with new Health Sensing System
1 article · September 9, 2026
- bgr.comThis Is The Apple Watch Series 12 And Ultra 4 - Here's What's Actually New
2 articles · September 9, 2026
- cnet.comApple Watch Series 12: Familiar Design, Different Everywhere Else - CNET
3 articles · September 10, 2026
- cultofmac.comApple Watch Series 12 is the upgrade long-term users have been waiting for | Cult of Mac
1 article · September 9, 2026
- digitaltrends.comApple Watch Series 12 debuts with S11 chip, Audio Intelligence, and better health tracking for $399 - Digital Trends
2 articles · September 10, 2026
- engadget.comApple Watch Series 12 hands-on: New sensing system, health features and audio intelligence
2 articles · September 10, 2026
- fastcompany.comNew Apple Watch AI features hint at how Apple plans to address privacy concerns in future smart glasses
1 article · September 9, 2026
- macstories.netApple Watch Series 12 and Apple Watch Ultra 4: The MacStories Overview - MacStories
1 article · September 9, 2026
- macworld.comApple Watch Series 12 and Ultra 4: Their 7 biggest surprises | Macworld
1 article · September 9, 2026
- mashable.comApple Watch Ultra 4 unveiled: Pricing, specs, and new features | Mashable
2 articles · September 9, 2026
- mobilesyrup.comApple unveils Apple Watch Series 12 and Ultra 4
1 article · September 9, 2026
- notebookcheck.netApple Watch 12 and Ultra 4 launch with sensor upgrades, S11 ARM chip, and innovative features - Notebookcheck News
1 article · September 9, 2026
- phandroid.comApple's New Watch Will Rewind Conversations You Just Missed - Phandroid
1 article · September 9, 2026
- slashgear.comDo You Want To Be As Connected As Apple Watch Series 12 And Ultra 4 Want You To Be?
1 article · September 9, 2026
- t3.comApple Watch Series 12 is official, and here are six new features worth knowing about | T3
1 article · September 9, 2026
- theverge.comHands on with the new Apple Watch Series 12 and Apple Watch Ultra 4
2 articles · September 10, 2026
- thurrott.comApple Unveils New Watch Series 12 and Watch Ultra 4
1 article · September 9, 2026
- tomsguide.comApple Watch 12 and Apple Watch Ultra 4 preorders are live — save up to $430 | Tom's Guide
2 articles · September 9, 2026
- wired.comApple Doesn’t Want You to Worry About the New Apple Watch’s Listening Features
1 article · September 9, 2026
Topics and entities
Topics
- Smartwatches
- On-Device AI
- Bystander consent
- Wearable Privacy And Recording Indicators
- Confidential Computing
- Ambient Computing