Neuromorphic Driver Monitoring Systems: A Computationally Efficient Proof-of-Concept for Driver Distraction Detection

Jan 1, 2023·
Waseem Shariff
,
Mehdi Sefidgar Dilmaghani
,
Paul Kielty
,
Joe Lemley
,
Muhammad Ali Farooq
,
Faisal Khan
,
Peter Corcoran
· 0 min read
Abstract
Driver Monitoring Systems (DMS) represent a promising approach for enhancing driver safety within vehicular technologies. This research explores the integration of neuromorphic event camera technology into DMS, offering faster and more localized detection of changes due to motion or lighting in an imaged scene. When applied to the observation of a human subject, an event camera provides a new level of sensing capabilities over conventional imaging systems. The study focuses on the application of DMS by incorporating event cameras, augmented by submanifold sparse neural network models (SSNN) to reduce computational complexity. To validate the effectiveness of the proposed machine learning pipeline built on event data, we have opted for driver distraction as a critical use case. The SSNN model is trained on synthetic event data generated from the publicly available Drive&Act and Driver Monitoring Dataset (DMD) using a video-to-event conversion algorithm (V2E). The proposed approach yields comparable performance with state-of-the-art methods, achieving an accuracy of 86.25% on the Drive&Act dataset and 80% on the comprehensive DMD while significantly reducing computational complexity. In addition, to demonstrate the generalization of our results, the network is also evaluated using a locally acquired event dataset gathered from a commercially available neuromorphic event sensor.
Type
Publication
IEEE Open Journal of Vehicular Technology