BMW. Colin Barnden22 Jun 2022 14:22
https://youtu.be/stREsgTyOmU
The YouTube video "BMW iDrive 8 Demo" (https://lnkd.in/e_RNdszb) provides an excellent insight into the sophistication and operation of the #driver #monitoring #system #DMS for BMW Group #iDrive8.
It reveals for the first time (to me, if no one else) that there are three #IR illumination pods on the instrument cluster for the DMS, one center top, one bottom right, and one bottom left. There look to be four #IR LEDs on the top (two either side of the image sensor), and six on either edge of the cluster. The locations are marked in the picture below.
Now watch the video and try to pause on a single frame with any two (or all) of the three pods illuminated. I didn't succeed once. This can be taken as evidence of an intelligent control path between the image algorithms and the LED illuminators, almost certainly to vary the illumination angle of the face and eyes across multiple frames to increase core signal availability and tracking robustness. This is what is known as "optical path expertise" and improves performance and reliability compared with just shining a load of IR light onto the driver's face.
DMS is a complete system, not just #software, and the pursuit of optical path expertise is a key enabling factor in Seeing Machines building up a significant #technology and #performance lead over its closest competitors, notably Smart Eye and Cipia. The consideration of the #optical elements (LEDs, image sensor, lens) together with the imaging algorithms is what I call a "highly integrated imaging signal chain," and which others have termed #codesign.
Other critical system #design considerations include #algorithm #embedding (acceleration), availability of naturalistic driving data, and functional safety #FuSa expertise (ISO 26262). Underpinning system design is the necessity of #humanfactors behavioral science, and to train the algorithms to understand human behavior as it applies to accident risk. This is different from simply monitoring driver's head pose, eye gaze and blinks, and beeping annoyingly at inopportune moments.
The state-of-the-art for DMS technology in a series production vehicle is assessed as a straight fight between Ford Motor Company (for #BlueCruise) and BMW (for iDrive 8). Also in the mix is General Motors for Enhanced #SuperCruise. All three are judged to use DMS from Seeing Machines and all are deemed capable of over-the-air #OTA updates, making analysis of DMS functionality a moving target.
YouTube #videos revealing the "illumination strategy" will be a secondary check to helping identify the DMS #vendor in any specific model. #Automakers appear extremely reluctant to reveal their nominated DMS suppliers, suggesting they regard DMS as absolutely critical to their #safety technology and #****pit #experience #roadmap.