Pupil-Based Driver Monitoring System
Project developed at: Harman International
HARMAN’s Pupil-Based Driver Monitoring System measures increases in pupil dilation as an indication of a driver’s mental workload. HARMAN’s new proprietary eye and pupil tracking system detects high cognitive load and mental multitasking in the driver’s seat, and signals the car’s other safety systems to adapt to the driver’s state. The technology represents a major step forward in the domain of Advanced Safety and Driver Monitoring Systems (DMS) for vehicles.
Adoption of in-cabin cameras is growing rapidly, enabling features such as occupant detection and driver drowsiness monitoring. With the introduction of high cognitive load detection, HARMAN’s eye and pupil tracking technology brings additional value to the driver-facing camera. The technology eliminates the need for complex sensors built into seats and steering wheels, or biometric sensors that require physical contact with the driver. This camera continually captures the driver’s pupil dilation, and a proprietary software algorithm analyzes the pupil reflex using advanced filtering and signal processing. The filter isolates and identifies responses triggered by high cognitive load. The calculated outputs are used to intuitively adjust user interfaces, like placing mobile devices in do-not-disturb mode or adjusting ADAS system intervention thresholds to minimize physical and mental distraction to the driver. To learn more about the solution, view this video demonstration here.
I worked on this project from conception to the completion of the first proof of concept. I managed internal and external resources for this project and showed the first prototype at CES 2016.
HARMAN’S Pupil-Based Driver Monitoring System was also named a finalist in CTIA’s 10th Annual Emerging Technology Awards.
This system was also showcased in: https://news.harman.com/releases/harman-showcases-todays-ultimate-in-vehicle-experiences-at-gims-2019
More info at:
This video introduces a groundbreaking pupil-based driver monitoring system designed to measure cognitive workload without requiring driver-worn sensors. This video was taken at CES 2016 and showcases our first demonstrator. We show here how the system uses a driver-facing camera to track pupil fluctuations, providing real-time insights into a driver's cognitive workload and level of distraction.
The demonstration takes place in a driving simulator, where the system monitors the driver's focus during normal driving conditions. Midway through, a conversation is initiated with the driver, illustrating how cognitive workload increases when engaging in additional tasks. This innovative system aims to enhance road safety by detecting cognitive overload and adjusting vehicle systems to minimize distractions.
Company: Harman International
Team: Future Experience Team
Location: Palo Alto, CA
Year: 2016
Testing the prototype of the pupil-based driver monitoring system, Inso demonstrate how the setup uses real-time pupil analysis to assess cognitive workload and attention levels. The system, integrated with a multi-screen driving simulator, aims to create a realistic driving environment where it’s easier and safer to measure cognitive overload and driving mistakes
This image shows an article in the Italian magazine Quattroruote, featuring me and my work in automotive innovation, highlighting the work on cognitive workload measurement via pupils monitoring. The article, titled "Sarà Misurato Anche il Pensiero" (Thoughts Will Also Be Measured), refers to the development of a pupil-based driver monitoring system in specific.