New AI Features for Apple Watch: Recording and Summarising Conversations
The tech giant is testing new 'Audio Intelligence' features for its latest wearable devices.
New Capabilities for Apple Watch
Apple has officially launched beta testing for its “Audio Intelligence” technology, bringing new AI-driven features to Apple Watch Series 12 owners. Available to developers as part of the iOS 27.3 update, the software aims to significantly enhance the watch’s ability to process audio information.
The update introduces four primary features: ambient sound identification, music recognition, Live Rewind, and Siri Recaps. The first two are designed to simplify daily routines; for instance, the watch can alert users with hearing impairments to doorbells, alarms, or other crucial sounds, while music recognition is powered by Shazam.
How Live Rewind and Siri Recaps Work
Live Rewind and Siri Recaps are garnering the most attention for their interaction with human speech. Live Rewind allows users to double-tap the Digital Crown to replay the last 15 seconds of audio. This is particularly useful for capturing quick instructions or lists, which are then displayed on the screen as text.
Siri Recaps offers a broader scope, summarising conversations to highlight key points such as meeting details, deadlines, or payment information. Apple states that the system does not store raw audio recordings and does not identify individual speakers to ensure privacy. Recordings are automatically deleted after seven days unless the user chooses to save them.
Security and Privacy
Apple has placed a strong emphasis on transparency, ensuring that AI-driven recording does not go unnoticed by others. When the feature is active, the watch emits a specific signal and displays an on-screen animation to alert those nearby that the device is processing information.
The technology is powered by the S11 chip and Apple’s “Private Cloud Compute.” Data processing occurs within a secure, encrypted environment that even Apple cannot access. The system is designed to automatically filter out sensitive information, such as financial data or personal identifiers.
These features will be available to Apple Watch Series 12 and Apple Watch Ultra 4 users once the beta testing phase concludes. This development marks a significant step in the evolution of wearables, allowing users to manage their time and information more efficiently.