Audio Augmented Reality
Head-worn auditory listening system which processes all auditory information in order to selectively cancel, add, enhance, or attenuate auditory events for the listener. This system can improve a user’s hearing capabilities, auditory user experience and safety in noisy environments.
I was part of the ideation, patenting and refinements for this concept and I directly managed the creation of the first 3 proof-of-concept prototypes. I also managed the creation of the UX video you see on this page that was presented at CES and other trade shows.
Our team’s work on this project directly influenced HARMAN products, including JBL headphones and earbuds with Ambient Aware, with an estimated 5 million units sold to date. This highlights how our efforts shaped the company’s strategy and contributed significantly to its success.
Multiple patents were created from this project
This concept video demonstrates earbuds with AAR, allowing users to cancel, enhance, or replace sounds. Using gestures, users can point to mute traffic or amplify a kettle boiling. Voice commands enable replacing sound categories, like swapping traffic noise for ocean waves, creating a customizable audio experience.
This image (from one of our patents) illustrates an AAR system where the user controls their auditory environment by adjusting the prominence of various sound sources. Users can reduce, or completely remove sounds such as traffic noise, background chatter while also adding or enhancing sounds like music, nature sounds, alerts or interlocutor voices.
This Indiegogo campaign video showcases a prototype for AAR headphones that detect customizable sound events, like the user's name, doorbells, or car horns, and alert the wearer even if they can't hear them. A feature-complete proof of concept was demonstrated at CES 2016, though the campaign did not proceed due to corporate constraints.
This concept video highlights an in-cabin AAR system where users control sound emphasis, de-emphasis, or cancellation via voice commands, while critical sounds like sirens always pass through. Unlike head-worn systems, in-vehicle AAR leverages existing microphones, sound systems, and voice agents, making it simpler to implement and less computationally constrained.
Demonstration of our AAR prototype at CES 2016
Company: Harman International
Team: Future Experience Team
Location: Palo Alto, CA
Year: 2014-2016