Member Info for TheLongestShot

https://youtu.be/6XVB_Ieau0g

https://youtu.be/ELW4RbWzD4M

JC, this Qualcomm patent takes two similar tracks, one where the "driver" is wearing a headset and another track without.

It uses the usual eye tracking and attention measurement, sickness and it will indicate risks not seen by the driver eg in HUD, in the worn display or in the vehicle.

I think it also tries to match the phone to what is seen by the Internal cameras and verifies using movement data. Probably so that the phone is aware that it is being used by a driver.

Needs a proper review on a screen, but looks good

Thanks Terry, I guess this is the same as or similar to a couple that came out in January where they add "remote Photoplethysmography" (clever phone saved me remembering how to spell), rPPG to its mates, identifies thr pulse my the minute blush that is seen on the skin as a periodic variation in colour with every surge of blood. Off the top of my head, don't know if that would be possible with IR only, or if it needs iR-RGB. Hopefully it is still detected as a brightness change in just IR so it works at night and is less susceptible to reflected light from outside.

The little "r" is for remote to differentiate it from the contact version in Smart Watches, fitness bands or the fingertip clamp sensors used now in healthcare (in my day, nurses had to count!)

Qualcomm legal have asked me to clarify that the chipset can support a level 2+ juggling robot within a defined ODD (Operational Design Domain) and that an attentive human will be required to ensure the safe operation. So it is mandatory to install the JMS from Seeing Machines

Size, you gotta understand that when Qualcomm goes to a trade show for embedded electronics it doesn't go with its Seeing Machines cap on.

The PR machine is there to sell SoC chips that are full of the latest tech. Multiple camera inputs, wifi graphics processing etc. That may fit well in tomorrow's cars but that market has already been one for that generation of chips. This shw is about selling the same chip into new markets that we or Qualcomm may not have considered. Multi camera mobile security, disco ball with a 20 spinning cameras. Or even no cameras at all, but WiFi connected games device?

So why show a DMS? Because it is a great way to interact and demonstrate to get people to your booth - "but it is just black an white."
"It works in the dark and even through dark glasses and can support 4 separate applications on different operating systems - what do you need it to do?".... "Juggling toy robot with 5 cameras? Hell yeah, just as long as your mechatronics flippers are fast enough, cameras and processing will be fine here...

As for the DMS demo, if it good enough for Terry.

Now back to the plans my new hovering disco ball with 12 cameras with integral ****tail dispenser

JC, not much in this Arriver application. It is a out how a black box "Driver Attention Monitor" will interface with the car systems and suppose even detect if it is being played by the driver (like repeatedly hitting the snooze button on an alarm without waking up!)

I know enough about SCADA, Factory Talk etc and how they are implemented in industry, to know that this is not a target area for Seeing Machines

Thanks JC, now I won't go into to much research on this one, but first an explainer...
In the early days of radio, you could identify the direction of a radio signal with a shaped antenna which you rotated to get the strongest signal.
Do this from 2 or more locations and you could triangulate to get a location.

Radar does send and receive, so the delay gives you the distance so only need one device.

From the 1980s there was enough computing power to use phase arrays, with multiple aerials to send and receive. Now you can measure the relative delay between individual aerials in the horizontal and also in vertical direction to determine the direction that the signal comes from. Now these are small enough that Qualcomm plan to put one on the steering wheel and another on the passenger side so they can determine with some degree of accuracy where a working phone (or other devices like a smart watch) are in the car.

It won't replace DMS though

Plain and simple JC, you don't find me many of these, a DMS that doesn't bother mentioning head position or where the eyes are looking. It just needs to have a plurality of cameras and one can see the steering wheel and will check the driver's hand is on the wheel.

This is not a whole solution but is a defensive patent to prevent others from attempting this feature from the mirror area.

JC, this is a typical Silicon Valley patent, most of the claims stages are nothing special, simple eye gaze vectors produced by machine learning. But here is the key part of the patent:

"9. The method of any of claims 1-8, wherein the vehicle data file includes data structured in accordance with extensible markup language, wherein the vehicle data file includes a respective set of coordinates for each region of interest from the plurality of regions of interest, wherein each of the respective coordinate sets are defined relative to a centroid of a sphere that encompasses an interior of the vehicle, and wherein each of the respective sets of coordinate define a two-dimensional plane."

So Google is trying to patent the equivalent of HTML that describes the interior of a car as it is relevant to all the parts of the car that could be relevant to "what is the driver/passenger looking at?"

JC re the ROLLABLE/BENDABLE VIRTUAL 3D DISPLAY It is a land grab, ready for the future days of flying/autonomous vehicles. I don't see this coming any time soon, at least not in a way that I would get excited about the eye tracking element

JC - no doubt you spotted Simon Stent! But this is not of his usual standard. It is an evolutionary dead end. Multiple cheap cameras, connected through the steering while using "fibrescopes" with lenses on the surface of the steering wheel, so that at least one camera is not blocked by the steering wheel or the drivers arms/hands.

This is "Steampunk" at its best

This Holographic Wave guide head up display provides more flexibility in where it projects its image so that it aligns with the position of the drivers head which is provided from DMS, but other than that, not directly related to SEE tech

Thanks JC, I hoped that you noticed that this Magna US patent is actually from Germany and it is not linked to the Magna mirror, in fact, it pre-dates those patents and even describes separate DMS and OMS cameras which was the state of the art in 2018! As well as inputs from the DMS cameras, this system is using driver inputs to steering (lane keeping accuracy) or as the patent puts it "steering profile (i.e., a “coffee cup system”)" as part of its controls. This ties it to what would have been a Mobileye implementation in this time frame.

We have the object detection from the Mobileye system then if the driver is not aware of the risk, the system can highlight it and/or take appropriate action.

Based on the DMS and the inputs from the vehicle and the environment it identifies the driver's workload and also the drivers state. But interestingly, it even identifies via the DMS is it is the passenger who is operating the infotainment, so can discount this from the driver's attention calculations. Based on everything happening it works out the maximum workload of the driver at that time. via a bunch of weighted confidence calculations.

Not directly mentioned in the patent, but included in the images is a list of other features that were developed or at least identified - driver position, driver mood, facial recognition, (voice detection and driving style but not via the DMS), airbag deployment and adapt seat position in case of collision, driver presence, driver comfort preferences

Old fool, that is not a Seeing Machines DMS.

The Car is Zeeker which is part of Geely. So either Smart Eye or a local firm.

We know it is not SEE because the light flash together not alternating left or right (and occasionally together) which gives more chances of best illumination

50 pages of "patentese", builds upon existing Magna/See Patents, looks good

OmniTracs may be disappointed when they get their patent turned down, their ideas may have been outdated years ago

A sensible extra step to reduce power or improve clarity for the DMS function. After all it is important to have high refresh rate for DMS, but knowing that there is a child in the back doesn't change much per second.

I had seen the separate banks of LEDs on the circuit boards so this is a good idea.

Will read through later and see what else springs out

Mandatory for all SEE investors to watch this. Thanks Seize

Guardian has had road and driver facing cameras almost from early G2