I also like the fact that Magna have not patented "the" mirror, but a range of mirrors to cover various price points with optional extras such as OMS, built in displays, visible or hidden DMS camera and LEDs etc. They really have this all sewn up!
What can I say JC? This patent spells it out pretty clearly!
There are some clues about implementation "first processor" and "second processor" looks like there is a core using Occula to do the DMS and the second core that is handling the front facing camera for object detection. We also see two versions of the rear view camera, one where the lens and LEDs are visible below the mirror, and another where they are embedded behind the mirror.
The classifications are getting more interesting too:
(i) driver (or occupant) head found, (ii) abnormal head posture, (iii) false head detection in the driver's seat / area or in the passenger seat / area, (iv) eyes of the driver (or occupant) closed, (v) eyes of the driver not facing the road in front of the vehicle, (vi) position of the driver in the driver's seat (and / or position of the occupant in the Passenger seat), (vii) driver looking at a target, (viii) microsleep, (ix) driver (or occupant) asleep, (x) level of drowsiness of the driver (or occupant), (xi) category of the driver's hand position (such as using aspects of the systems described in U.S. Publication No. US-2018-0231976 (which is hereby incorporated by reference in its entirety), (xii) classification of a driver-held object, (xiii) driver (or occupant) nods with the head, (xiv) driver (o the occupant) speaks, (xv) driver (or occupant) laughs, (xvi) driver (or occupant) coughs, (xvii) driver (or occupant) sneezes, (xviii) driver or occupant) yawns, (xix) driver (or Occupant) turns the body, (xx) driver (or occupant) smokes, (xxi) driver (or occupant) holds a cell phone to his head, (xxii) driver (or occupant) changes, (xxiii) face identification, (xxiv) presence of an occupant, (xxv) presence of a child, (xxvi) presence of a child seat, (xxvii) video conference of the driver (or occupant) and / or (xxviii) the driver (or occupant) takes a selfie.
DMS eye gaze linked to identified objects in front of the car:
For example, the processor can determine the driver's attention and / or the driver's gaze direction (by processing image data captured by the driver monitoring camera) and by determining a hazard in front of the vehicle (by processing image data captured by the forward-looking camera) and in an area that is from the driver is not seen at the time, the system can generate a warning to the driver to inform the driver of the potential hazard that requires their attention.
When the mirror is moved, DMS has to re-orient itself by mapping pre-determined features in the cabin so that it can map the drivers head position and eye gaze relative to the car (not the moveable mirror) this has been mentioned before in SEE patents
I do like the idea of the mirror setting itself up for the driver automatically by working with the DMS camera!
I presume this is more about patent protection rather than allowing for our Swedish friends "The system can use any suitable face tracking software or algorithm."
Apologies, I am way behind on my reading. Good, no, bloody amazing find JC. Thanks also to Jazz for standing up to patent duties. If you are in any doubt, look at the pictures in the pdf, this is not pie in the sky, this is a mirror unit not far from production and if you know your US car logos it won't take long to ID the vehicle.
We have separate cameras for DMS and OMS hidden in the rear view mirror. Plus temperature readings of the passengers too (to spot anyone left behind - or for climate control) our friend Colin will like the heat pipes to dump the excess heat from all of the cameras and processing.
So hit this link, and enjoy the pictures. One day I may catch up and read the words too! https://www.freepatentsonline.com/20210291739.pdf
JC, remember that film Wall-E where the passengers reclined in mobile seats that moved automatically, until they all became obese and lacking in enough muscles to allow them to stand. Well this patent is one of the first steps.
This one shows how convoluted patents can get in order to solve one problem. TL;DR; It won't work!
CONTENT ADJUSTMENT BASED ON VEHICLE MOTION AND EYE GAZE.
Passengers get travel sick when reading on their phones. With AVs drivers will get this opportunity too! Honda's solution is to replicate what you were reading on your car's display but to stabilise the image so that as the car hits a bump on the road, the image will be constant relative to the surroundings as perceived from the position of the driver's eyes, so motion sickness is reduced. This will also require you to navigate on the mobile and eye tracking keeps everything together.
Of course this is not going to work and if it makes the driver feel better, the moving text will appear worse and more distracting for the passengers who have a different motions based on their size, weight and position in the car.
DETROIT, Aug 23 (Reuters) - Ford Motor Co(F.N) has doubled its production target for the F-150 Lightning because of strong early demand for the full-sized electric pickup truck ahead of its 2022 launch, and the company plans to spend an additional $850 million to meet that target, several people and suppliers familiar with the plans said.
The No. 2 U.S. automaker is targeting annual production of more than 80,000 in 2024, up from its prior target of more than 40,000, according to the sources, who asked not to be identified.
Very nice, only tomorrow apparently. Strange how those words all seem so familiar. Did they appear on an RMS months ago? https://www.lse.co.uk/rns/SEE/see-and-cae-to-deliver-crew-training-system-97ihcsass9yq2i3.html
Ah, I spot the difference now we know which branch of the Aussie military needs flight Simulators, and they name the locations just like in that top secret Project Jerico magazine article.
Interesting JC, a partial but incomplete DMS. Points for looking at window, speedo or mirrors, and it sens a message to your personal device if necessary. No details on how it would detect gaze other than a camera. Nothing on IR or illumination. XEVO are connected with Lear Corporation, a Teir 1,so probably linked to infotainment wonder whose eye gaze they are using?
Sometimes it is worth reading the small print first:
1Always pay attention while driving and when using Super Cruise. Do not use a hand-held device. Visit Cadillac.com/supercruise or chevy.com/electric/super-cruise for compatible roads and full details.
2Trailering will be available post-launch for the GMC HUMMER EV models and 2022 Cadillac Escalade.
3Automatic lane change is not available while trailering.
4The 2022 Cadillac Escalade is not yet available in dealerships.
5The 2022 Cadillac CT4 will be available in late summer 2021.
6The 2022 Cadillac CT5 will be available in late summer 2021.
7The 2022 Chevrolet Silverado is not yet available in dealerships and Super Cruise will be available in the late 2022 Model Year.
8The 2022 GMC HUMMER EV Pickup will be available in fall 2022.
9The 2022 GMC Sierra is not yet available in dealerships and Super Cruise will be available in the late 2022 Model Year.
10The 2023 Cadillac LYRIQ will be available in the first half of 2022.
11The 2024 GMC HUMMER EV SUV will be available in the first half of 2023.
12The 2022 Cadillac XT6 will be available in the second half of 2021.
13The 2022 Chevrolet Bolt EUV will be available in late summer 2021.
They like it!
"I, for one, embrace our new robotic overlords"