Neuromorphic Driver Monitoring Systems: A Computationally Efficient Proof-of-Concept for Driver Distraction Detection
Jan 1, 2023·,,,,,,·
0 min read
Waseem Shariff
Mehdi Sefidgar Dilmaghani
Paul Kielty
Joe Lemley
Muhammad Ali Farooq
Faisal Khan
Peter Corcoran

Abstract
Driver Monitoring Systems (DMS) represent a promising approach for enhancing driver safety within vehicular technologies. This research explores the integration of neuromorphic event camera technology into DMS, offering faster and more localized detection of changes due to motion or lighting in an imaged scene. When applied to the observation of a human subject, an event camera provides a new level of sensing capabilities over conventional imaging systems. The study focuses on the application of DMS by incorporating event cameras, augmented by submanifold sparse neural network models (SSNN) to reduce computational complexity. To validate the effectiveness of the proposed machine learning pipeline built on event data, we have opted for driver distraction as a critical use case. The SSNN model is trained on synthetic event data generated from the publicly available Drive&Act and Driver Monitoring Dataset (DMD) using a video-to-event conversion algorithm (V2E). The proposed approach yields comparable performance with state-of-the-art methods, achieving an accuracy of 86.25% on the Drive&Act dataset and 80% on the comprehensive DMD while significantly reducing computational complexity. In addition, to demonstrate the generalization of our results, the network is also evaluated using a locally acquired event dataset gathered from a commercially available neuromorphic event sensor.
Type
Publication
IEEE Open Journal of Vehicular Technology