Member Info for TheLongestShot

JC - Thanks, I searched last night but was looking for "Aptiv" not "Delphi".

I will have a read through tonight

JC who could be providing the sensor fusion to see which hazards the driver had not seen?

https://www.aptiv.com/newsroom/article/safety-and-convenience-innovations-powered-by-interior-sensing

One of the exciting technologies we had on display at the 2020 International Consumer Electronics Show (CES) in Las Vegas earlier this month was Aptiv’s interior sensing platform. Using the latest generation of cameras and radars, the system can recognize and respond to drivers’ and passengers’ body positioning, gestures, and eye movement. It’s a simple concept based on sophisticated software, and this one technology opens the door to a whole host of innovations ranging from comfort and convenience to lifesaving.

With Aptiv Driver State Sensing, when the car senses that the driver is distracted – or even asleep – it can sound an alert or take other appropriate actions. With 41% of crashes resulting from driver inattention or distraction, and another 7% resulting from sleep, this is a critical advance in itself.

We’re taking the idea a step further by integrating that capability with exterior sensors. For more than two decades, Aptiv has led the industry in sensing and perception systems, introducing the industry’s first automotive-grade radar, the first exterior sensor fusion of radar and vision, and the first AI-powered 3D Gesture Recognition System.

It’s with that deep background and understanding of the vehicle systems that we approached the application of interior sensing. For example, at CES we showed Aptiv Interior/Exterior Sensor Fusion, which allows a car to detect when a driver is distracted or unaware of a hazard outside the vehicle and proactively warns them to prevent a life-threatening incident before it occurs

Here is the support page for the XC40 2020 (Late) manual.

https://www.volvocars.com/uk/support/manuals/xc40/2020-late/driver-support/driver-alert-control/driver-alert-control

It is as I expected detecting your lane keeping abilities using the forward facing camera. It is not a driver facing camera. I don't expect this to change with the electric model when it launches in the spring, I do

Driver Alert Control
Updated 11/13/2019

The Driver Alert Control (DAC) function is intended to help make the driver aware that he or she is starting to drive less consistently, e.g. if the driver becomes distracted or starts to fall asleep.

The objective for DAC is to detect slowly deteriorating driving ability and it is primarily intended for major roads. The function is not intended for city traffic.

The function is activated when speed exceeds 65 km/h (40 mph) and remains active as long as the speed is over 60 km/h (37 mph).

Driver Alert Control, the position of the car in the lane
DAC reads the position of the car in the lane.

A camera detects the edge markings painted on the carriageway and compares the alignment of the road with the driver’s steering wheel movements.

P5-1507-Driver Alert Control, the car is being driven erratically in the lane
The car is being driven erratically in the lane.

P5-1507-Driver Alert Control, time to take a brake symbol
If driving behaviour becomes noticeably inconsistent, the driver is alerted by this symbol in the driver display, combined with an acoustic signal and the text message Time to take a break.

If the car is equipped with Sensus Navigation* and has the function Rest Stop Guidance activated, suggestions for an appropriate place for a break are also displayed.

The warning is repeated after a time if driving behaviour has not improved.

Warning
Driver Alert Control should not be used to extend a period of driving. The driver should instead plan for breaks at regular intervals and make sure they are well rested.

Warning
An alarm from Driver Alert Control should be taken very seriously, as a sleepy driver is often not aware of his/her own condition.

If the alarm sounds or you feel fatigued:

Stop the car safely as soon as possible and rest.
Studies have shown that it is just as dangerous to drive while tired as it is to drive under the influence of alcohol or other stimulants.

Warning
The function is supplementary driver support intended to facilitate driving and make it safer – it cannot handle all situations in all traffic, weather and road conditions.
The driver is advised to read all sections in the Owner's Manual that relate to this function to learn about factors such as its limitations and what the driver should be aware of before using the system.
Driver support functions are not a substitute for the driver's attention and judgement. The driver is always responsible for ensuring the car is driven in a safe manner, at the appropriate speed, with an approp

https://www.volvocars.com/uk/support/manuals/v60/2018/driver-support/driver-alert-system/driver-alert-system

It is "watching" your performances via the lane markings using a forward facing camera that is a key part of the LKA. I imagine it keeps track of how smooth your centering ability is, or are you starting to make less frequent but sharper corrections. So a step up from just a steering input monitor.

Bauchsapt

No the driver alert system is connected to the lane keeping assistant. If you are driving and move out of your lane or are not staying in the centre of the lane it warns you. But can only work if the lanes are clearly marked.

Gentex

Last year at CES 2019 when Autonocast interviewed Seeing Machines, one of the other guests was the guy from Gentex

https://www.motor1.com/news/390860/aston-gentex-camera-monitoring-system/

Let's hope they exchanged business cards. Gentex would be a good way to get Seeing Machines into lower volume high value cars!

https://www.press.bmwgroup.com/global/article/detail/T0304187EN/the-bmw-group-at-the-consumer-electronics-show-ces-2020-in-las-vegas?language=en

8 mentions of gaze and that was without mentioning the new visor that also needs to see where your eyes are.

It is a good sign, the company is growing up and needs a bit more management and control. It is not the Wild West any more, the law men are coming to town

https://www.nytimes.com/2020/01/17/business/motion-sickness-self-driving-cars.html#click=https://t.co/KMW5xKlaiE

JC, in the patent that you posted earlier in the week that was monitoring reactions with multiple sensors. I assumed it still temper the driving to avoid travel sickness when it saw signs.

Then we have This NYT article about ZF:

If the future lets people focus on work instead of driving during the daily commute, many of us will have to conquer motion sickness to read memos (or tweets). Researchers are working on some fixes....
Each subject was tossed along the same twisty route for a second time but also asked to complete a set of 13 simple cognitive and visual tasks on an iPad Mini. About 11 percent of the riders got nauseated or, for other reasons, asked that the car be stopped. Four percent vomited....

Ms. Jones wants to help people avoid and treat motion sickness. But at this early stage of her research, she’s merely aiming to better understand the “fundamentals of human response.” For example, there might be clues in how riders who get carsick hold their heads, maintain their posture or position the mobile devices they’re using. “I’m not out for the engineering solution directly,” Ms. Jones said.

But Florian Dauth, an automated-driving engineer for the ZF Group of Germany — one of the world’s largest automotive suppliers — is in the business of devising engineering solutions. He has been working for more than two years on strategies to reduce motion sickness in autonomous vehicles.

“We are developing algorithms that self-learn based on bodily reactions,” he said, referring to the machine-generated code that determines the vehicle’s path. To navigate the road safely, automated vehicles already receive and combine data from an arsenal of radar, laser, video and ultrasonic sensors. ZF says data about the passenger’s well-being should be added to the algorithm...

Mr. Dauth is collecting passengers’ biological data via cabled inputs, like measurements of brain activity from electrodes placed on a rider’s scalp and similar monitoring of the heart. When put into production, the self-driving biofeedback system would most likely be reduced to cameras powered by facial-detection software or perhaps wearable devices.

Wow, that Honda patent was interesting. It would have been far easier if they just said that is was for an Astromech droid - (R2-D2 for example) Gaze tracking was only a minor part of the communication, but still relevant.
[0075] The assistance system 1 tracks the communication of the user with the assistance system 1. Communication may comprise audible communication via speech, or visually perceivable communication via gazes, gestures such as pointing, reaching movements for an object or part of an object such as a tool.
[0076] Gazes may be determined by eye tracking.

The Toyota robot example was different, in that case there was a "man in the machine" even if the man was physically remote. Again it covers all bases, but some interesting aspects. Guiding the physical motion or focus of the robot with your eyes means that the operation of limbs is still possible, but i love the fact that when picking up the glass, the eye focus was used to do the object selection, but the arm movements were not replicated 1-1 instead they were used as gestures of what the arm should do, so the human does not need to act like Andy Serkis, instead the intention is taken so the human indicates the glass is to be picked up, but the robot works out where to position the arm to avoid touching surrounding objects.

JC,
It is going to take some time to get through this batch, but there does look to be a dependency on some of our IP (I am no expert though)

But looking at the Toyota patent, I can't get years of films out of my head. The HUD directs me to the object (Bandit) at 3 o'clock. As my gaze aligns with the target, there is a rapid beeping as the target is locked. Now, trigger on the stalk and psshhhh wipe wipe, he is gone (ok he is still there but now I can see him better)

Maps,
But their announcement didn't come with a global premium OEM (JLR) or a quote from Nick saying working with plural OEMs

Maps,
But their announcement didn't come with a global premium OEM (JLR) or a quote from Nick saying working with plural OEMs

Hi JC,

SEEhave always professed to have Optic Path expertise, so I presume that we had this knowledge in house.

There was an award for the design of the Guardian (2) system where SEE partnered with a design firm. https://www.4design.com.au/project/guardian-driver-fatigue/

Now that is for the packaging and I would not expect them to do the detailed optics. if we didn't do that it would be from a specialist on contract?

Also note the job is for a "Senior" Optics Engineer so perhaps this is additional skills in the team or a replacement especially as they have mentioned the skills and tools that they would be using

Klick,

Seeing L3 as a customer of an optical simulation ray tracing simulation tool is no surprise. But it means nothing about us working together. They need fancy optics to project backgrounds on simulators (and multiple other tasks in other parts of their company), we are using it to build lens assemblies to get images into a camera or to project led light across a car. Simple coincidence that we use the same tool

SEEu,

I think the VHS versus Betamax was won in two clear areas. Cost and content.
Sony's Betamax was better but it cost a fair percentage more say 700 against 500. You could say the same about us but we may be say 10 of cost in a 30000 vehicle so the relative cost difference is negligible. Also when you consider the downside of lower quality in DMS it is annoying or killing your customers. Neither make repeat customers. As for video, when the formats started out the main use case was rental videos, and a choice of 20 Betamax films or 100 VHS. In rental the extra play length didn't make any difference and the quality was good enough

Does this mean that if we don't get Honda through Veoneer (their top customer) , we may pick them up via Continental

win win situation (for us)

This may be very timely, in Roger's article about his ride in Veoneer's car he mentioned be directed by the car to what he had missed outside the car. Later in the week,we are at Auto World in Tokyo

https://www.xilinx.com/about/events/automotive-world.html

Real-time Driver Monitoring System (DMS) Use Case

Xilinx customer Seeing Machines will show how its (DMS) in a compact module understands the driver’s state in real-time. This intelligence enables the car’s Advanced Driver Assistance Systems (ADAS) to make decisions based on a situational understanding of what’s happening inside AND OUTSIDE OF THE VEHICLE. (caps are mine)

JC, I skimmed your Harman post too early this morning. I was overwhelmed by the plethora or sensors.

[0020] It would be useful if the autonomous vehicle could analyze the behavior of human occupants in order to gain a better understanding of events and scenarios occurring outside of the vehicle. Then, the autonomous vehicle could make more informed driving decisions, especially in situations where the autonomous vehicle is unfamiliar with one or more aspects of the environment.

Human sees stuff, car reacts to it by looking where he/she/they are looking and avoiding the object. But it only does this when their trousers turn brown or the suddenly exhibit a galvanic response (sweat)

Of course, what if you want to play "car football" it will make hitting the football with your car almost impossible. Also this could make demolition derbies last all day with the car unscathed, until the drivers can learn not to react to what they see!

I like the bit around [0061] and FIG. 9C, I will paraphrase:
Occupant sensor system sees one person focusing at a point and another person is focusing at the same point (based on direction of gaze and eye convergence) it then decides to do something based on what they are looking at.
However, in my car I would call out left (when I meant right) and one passenger would see something completely different. Several seconds later the back seat will pop their headphones off and look up from devices (700) and say "what?"

No sign of it here...
https://www.autonews.com/mobility-report/waymos-long-term-commitment-safety-drivers-autonomous-cars

But the driverless rides in Arizona don’t mean the end for Waymo’s human operators. Last summer, the company quietly finalized a multiyear contract with Transdev North America, which provides bus drivers, streetcar conductors and other transportation workers to airports and cities. The partnership is an acknowledgement that Waymo will be relying on test drivers for many years to come.
...
Under Adecco, pay started at about $20 per hour. Most time was spent as a passenger, being driven around the sunny Phoenix suburbs. “I was telling my friends it was the greatest scam I had ever uncovered,” said one former driver. “It was an awful lot of money for an awful little bit of work.”

The greatest difficulty of the job, according to multiple former drivers, is staying alert through the dull, repetitive hours of cruising. One took breaks to do jumping jacks, rolled down the windows and turned up the radio to combat drowsiness. “You really go into podcasts,” said another. Still, the driver said, not everyone stayed alert all the time. “We even had people eat full meals behind the wheel, which is not safe.”

Drivers are keenly aware of the contradiction at the heart of their jobs. “The whole goal is to work to eliminate your own position, which is a really weird thing to come in every day thinking,” said one former driver.

Withholding the white badge is one of many ways Waymo reminds its drivers that it’s looking forward to the day when they’re no longer around. Both drivers and riders are instructed to keep interactions minimal. “It was a very awkward experience,” said a former driver. “They’re instructed not to talk to you. They’re supposed to treat it like it’s a completely unmanned vehicle.”

“You could say hi,” said another. “And then you would be quiet to try to simulate an actual self-driving car.”