Member Info for TheLongestShot

OK this one has cameras...

https://insideevs.com/news/354671/byton-production-interior-pictures-released/

I think that you can just seem the camera in the strange linear feature that will be facing the driver when he rotates his chair 12 degrees and is facing the centre of the 48" display

Here is another reason to need to focus on what your autonomous car is doing:

https://www.helpnetsecurity.com/2019/06/19/tesla-gps-spoofing-attacks/

https://www.reuters.com/article/us-geely-autonomous-veoneer-idUSKCN1TK13R

GM were only selling 10 k per year in the US (plus ~200 in Canada) and we were getting ~56% of those

Still at least we now get almost twice as many (if only there wasn't a trade war on)

http://carsalesbase.com/us-car-sales-data/cadillac/cadillac-ct6

https://www.marke****ch.com/press-release/harman-announces-enhanced-adas-sensing-technologies-to-improve-safety-at-ces-2019-2019-01-07

Cabin Monitoring System

Creating conditional autonomous cars, often referred to as Level 3 autonomous cars, is the next logical step in future mobility progression. These have the ability to manage most aspects of driving by themselves, but only if certain conditions are met and if not, they would require the human to take over. The biggest challenge with these vehicles is managing the hand-over: the situation where the car must transfer control back to the driver once limitations are met. In order to ensure this happens seamlessly, HARMAN has developed an advanced Cabin Monitoring System which uses monitoring sensors to capture the most important first-order biometric features of a driver, such as eye gaze, head position, and pupil diameter among others. The system can also analyze the auditory content and heart or breathing rates of occupants using proprietary and patented algorithms to provide second-order biometric signals such as emotional activity and cognitive load. While capable of working in lower levels of autonomy, this solution will be critical to the success of semi-autonomous vehicles in the future

Nice trick Klick, you taught me something

The clue to the camera is in the text. It was located 'in the future'. I expect we will find ours there in the A-pillar with a light bar replacing the trim in on the dash

How can you monitor driver behaviour?
Eva Lahti: “In the future we will introduce cameras and driver monitoring that will not only look at the steering input, but also the driver’s eyes and posture to recognise if the driver is drowsy or perhaps under the influence of alcohol or drugs. And if the system detects that the driver shouldn’t actually be driving the car, it will warn them. This is just monitoring the driver here and now – we will not record the information or send it anywhere. The important thing to remember is that this is not surveillance of the driver.”

How much of an issue is driver distraction?
Eva Lahti: “At Volvo Cars, we say that you as a driver are always responsible for driving your car and that should be your main focus. You shouldn’t look away. But we know it doesn’t always work like that. People make short glances to the driver display, to the centre display, to the rear-view mirror. And glances are OK so long as your main focus is on the road. The problem is that with more and more assistance in cars these days, it’s easy to over-trust the car. You might be thinking, ‘the car is steering itself, so I can check emails or change the destination on the map’, but it is actually never OK to do that – even though you’re driving in assisted mode and the car is helping you to steer and keep a safe distance to the car in front. There is a lot of discussion about automated cars and automated drive but, to be clear, there are no automated cars today.”

Images from an evening on the streets of Gothenburg
Robert Thomson: “When you’re driving, you’re looking at the road for only 85% of the time. So what are you doing with the other 15%? We have to figure out how we get this human, who is easily bored and distracted, to arrive at their destination safely. What I notice, and we see it in our research too, is that people play with their cell phones – especially on the highway – they talk with the people beside them, they eat and drink. It’s these secondary tasks which can be dangerous.”

Sch, I have looked again, but above the mirror is too high. Perhaps at the top of the instrument panel between date and temperature. Still a location that is going to catch sun though. Higher in the cabin avoids the sun but harder to see the eyes, especially with glasses. Perhaps behind darlek on the horizontal bar but that looks like a storage area. or in the bar above the instruments, but if not a camera perhaps the leds are there. Or maybe there wasn't a camera...

If you follow the link to explore XC90, you can get 360 view of the interior. Darlek on the dash seems to be a grid of some sort. I suspect the camera may be in darkish plastic above the mirror, where it faces the occupants at the correct angle down?

*plane*

Terry,

Don't count your aeralis chickens yet. They are a start up and are still designing the planes.

Although, it is an interesting concept lease the plain body and upgrade the engine section/wings/tail as required.

But I suspect that the gain in ease of training on the single core cockpit, will be lost by excess cost of the package and airframe hour limits. Also, is it that important to train on a single cockpit, when the real planes won't match

Just to reiterate. Osram don't make DMS
They make an IR led and multi coloured LEDs that enable Joyson to build a DMS using SEE knowledge and technology:

The Joyson Safety Systems’ steering wheel is equipped with Osram’s Oslon Black SFH 4715S IREDs that helps track eye movement [ They illuminate the face/eye so that the camera (not from Osram) can track face/eye! ], as well as with Osram’s RGB Multiled to indicate to the driver when the ‘Super Cruise’ system is operating and what function it is currently performing. For instance, the LED lights turn green when the ‘Super Cruise’ system is engaged. The lights turn blue when the system senses the driver might not being paying attention, and turn red when the system disengages. The LEDs also blink when the IREDs are blocked from viewing the driver’s eyes.

Company X puts man on the moon ( ok, they provided hi-tech tissues so that they could wipe their nose/bum on the way)

They also need to flatter their guests. They need good names and connections to companies and new ideas to keep the Podcast going/growing and they have to have variety.

The idea that Alex was excited about was the lab demo of a driver's eye being drawn towards a risk on a screen on the windscreen. But Adam, would need:
- a decent DMS
- head and eye tracking in 3d in all conditions
- identified risks with a 3d location outside the car from the ADAS/self driving system
- a head up screen display on (whole screen)
Then they can do the maths on the last bit to draw the eyes to a risk that they noticed you hadn't seen

I think we would be closer to developing this with our partners

Thanks JC, so we do have some (hopefully) prior art in that area.
I can see that 5+ years down the line a big bunfight of claim and counterclaim over patents in this area.

Some relevant parts we may have covered:
a plurality of light sources positioned at known three dimensional locations within the monitoring environment;
one or more cameras positioned to capture image data corresponding to images of the eyes of the subject;

a system controller configured to:
process the captured images to determine a gaze position of the subject within the monitoring environment;
selectively illuminate respective ones of the light sources at respective time intervals thereby to temporarily attract the driver's gaze position towards a currently activated light source;
...

[0015] In some embodiments the selective illumination of the light sources is based on a determination of the driver's attention or distraction.
...

4. A system according to claim 3 wherein the system controller determines a current peripheral region of the subject's field of view from the current gaze position and selects a light source to be activated based on a determination that it is located in the peripheral region.

Yes,
I thought that Carl Pickering had a great CV. But I don't think his knowledge of DMS was that recent - but then again JLR did sign up with Smart Eye several years ago (SEE were locked out due to our contract)

Thanks for clarifying MajorL

Cenkos says no monitoring revenue from BdMS

Is that because
1. they know there are no revenues? - Unlikely
2. the number of devices is to low relative to fleet for them to estimate? - yes, but a significant part
3. they don't want to guess what each device will cost? - hopefully more because we will provide more raw data back to companies who can use it
4. there are revenues but the estimated life is short per device? - I expect that these vehicles will get retired when they are broken/worn out in 3/5 years
5. We don't do the monitoring because that is up to the companies - who have the best need of the data and will have the skills/systems

Nothing to worry about.

Please supply a working DMS, camera and ECU, they will add 2 visible LEDs and some software to test several times during the journey, and we will check driver is OK.

In the future may have a screen overlay and they will compute where to put a moving flash on the screen to highlight a risk that you missed (as long as someone else does all of the work to find the risk and to track the eyes) Alex pointed out that this was pretty standard in driving games - showing best racing line etc

Alex was pretty meh towards the end, especially when he asked Pickering if Tesla 3 could do DMS and Alex had to drag him through the steps to see why it wouldn't work in the dark without IR illuminators.

One day an OEM may say to SEE that we have to add some of their code to our kit. But only if we don't already have the IP.

JC - I remember one Patent with leds all over the dashboard to draw the eye. Can you remember who's it was?

Thanks S7eve,

Yes, this one isn't much fun to listen too, I listened on the website, but needed to be sped up!
Alex would work their if he wasn't working at Argo. But this is a new company, still testing in the lab no risk to us for a long time, perhaps as partners as they don't have any practical experience.

You may have seen them mentioned in junko's article in EEtimes https://www.eetimes.com/document.asp?doc_id=1334108#

Their big thing is the cognitive attention. They track the eyes responses to subliminal effects. I guess LEDs in the car firing for a millisecond or two and measure pupil dilation and the eye movement as it saccades (?) towards the stimulus. They do this at the start of the trip and if alerted by erratic behaviour such as sudden stewring picked up from the CANBUS

Alex and crew are being unfaithful

AUTONOCAST
THE FUTURE OF TRANSPORTATION.
Jun 12 #147: Carl Pickering of ADAM CogTec on The Future of Driver Monitoring

http://www.autonocast.com/blog/2019/6/12/146-carl-pickering-of-adam-cogtec-on-the-future-of-driver-monitoring

I'm off to listen now