Apple’s always-listening Watch AI enters beta in iOS 27.3, English only

Apple released the first developer betas of iOS 27.3 and watchOS 27.3 on Tuesday, according to Bloomberg. Bloomberg says they bring the Watch’s always-listening AI tools into testing, along with an AI platform for China and a new Health app.

Four Watch listening features, two of them still beta

The listening tools are the Audio Intelligence suite that Apple introduced in September for the Apple Watch Series 12 and Apple Watch Ultra 4. TechCrunch reports that the suite has four opt-in features: sound recognition for sirens, alarms and doorbells; Shazam song identification; Live Rewind; and Siri Recaps. Apple’s support page lists the first two as ordinary features. It labels Live Rewind and Siri Recap as beta.

With Live Rewind, a double press of the Digital Crown shows a text snippet of the last 15 seconds of speech. Siri Recap takes ambient notes on conversations and turns them into short summaries instead of transcripts. According to TechCrunch, users review recaps at the end of the day and when they first unlock the watch in the morning, then choose what to save to Notes or Journal.

Bloomberg’s public summary also mentions a new Health app and Apple’s AI platform for China. The summary does not say what either contains, and Apple’s support page does not cover them. Those two items are therefore unconfirmed here.

Who can run it, and who cannot

Per Apple’s support page, Sound Recognition and Shazam need a Series 12 or Ultra 4 paired with an iPhone 11 or later (or an iPhone SE, 2nd generation or later) running iOS 27. Live Rewind and Siri Recap are stricter. They need an iPhone 16 series or newer, plus Apple Intelligence and Siri AI (Beta).

Both are English only for now, with more languages to follow. Neither is available to users under 13, and users under 18 on a Child Account need a parent or guardian to switch them on. Apple says Siri AI will not initially be available in the EU on iOS, iPadOS or watchOS, which echoes our report on Siri AI adding five languages while the EU stays locked out. TechCrunch notes that Apple says the features will reach the public beta before a general release. It gives no date.

A microphone that is always on, and the limits Apple sets

An always-listening wrist device raises obvious privacy questions, and Apple’s documentation answers them in detail. The company says audio is held in a hardware-isolated buffer in the S11 chip’s Secure Exclave and then deleted, and that no recording is stored. Sound Recognition and Live Rewind are processed on the device. Saving or querying a Live Rewind snippet sends it to Private Cloud Compute. Siri Recap sends a condensed, encrypted transcript there. Apple says that data is neither stored nor accessible to it.

Retention is short. Unsaved Siri Recap summaries delete after seven days. Live Rewind snippets vanish about 30 seconds after the display dims unless they are saved or sent to Siri. Apple says users can view, edit, delete or export saved items in the Siri app.

Apple also describes safeguards for people near the wearer. Live Rewind plays an audible chime, even in silent mode or with headphones connected. It also shows a full-screen animation and a microphone indicator, and it requires a deliberate double press. Siri Recap is designed to leave out sensitive data such as financial details and government IDs, and content such as self-harm promotion. Apple itself concedes that automated filtering may miss some sensitive information. It also warns that summaries and snippets may be incomplete or inaccurate.

Two gaps remain. Live Rewind may transcribe speech word for word without attributing it to a speaker, and Siri Recap may include names that come up in conversation. Whether bystanders will accept that is a social question, and the beta period is where Apple will find out. The privacy claims come from Apple itself and have not been independently verified.

What the beta changes for readers

For most people, nothing changes today. The builds are developer betas, the two headline features need recent hardware, and they work in English only. For developers and early testers with a Series 12 or Ultra 4, the update brings the first real-world test of whether on-device detection plus cloud summarization can run on a watch without hurting battery life, which Apple says it should not.