Member Info for TheLongestShot

I saw 4x Waymo vehicles yesterday, all had Seeing Machines bDMS on board.

No surprise, but nice to see it in real life.

Now, I am in SF, so not had much time for reading, but excited to see this Dassault patent. You will know that I believe we were working with Dassault to allow the flight crew to push back their chairs and rest in the ****pit, so to see Crew tiredness integrated into the heart of these medium/long haul executive jets is great news.

Thanks JC

I am not going to go through this one in much detail. The image gives it away. Percentages for a variety of emotional states. So not exactly a science, and that is about all it will do other than phone home if it is worried.

Soulboy, I wonder what Lachlan was splitting and cleaning in his last video ;-)

The diggers in Canberra have been busy, that IP moat is getting deeper and wider.

https://patents.justia.com/assignee/seeing-machines-limited

The eyes are the key to the soul. So watch the eyes to check the driver is aware of his situation.

I am surprised that SEE don't make a product for poker players.

This is a Ronseal patent. It does what it says on the tin. The only bit needing explanation is that Electrocromic glass can be darkened while a current is passed. So you can switch instantly from 100% pimped up glass, to clear so that the driver can see through when reversing or just looking over their shoulder.

This may make the papperatzi's life more interesting

But this is
https://www.ovt.com/products/ox05b1s-e89y-1a-z/
That is 5 mega pixel for OMS
There is also a 1 Mega pixel (DMS only) and 2 mega pixel camera that will do the job. Both global shutter which is essential to synchronise with the short burst of IR illumination for low power and to freeze each frame.

Sorry, this isn't for us
1/14.46" CMOS 160 Kpixel (400 x 400) Image Sensor with PureCel®Plus-S, Global Shutter, and Nyxel® Technologies.

Tiny camera, but only 400x 400 pixels. This will be used inside an AR/VR headset to watch eyes, from extremely close up so that the eye will fill the image. Where as we need mega pixel resolution so that we can get enough pixels across the eye from arms length while also capturing the cabin.

These can also be used on the outside of the headset to pick up the fixed IR "lighthouses" so that they can track movement in 3d and head rotation

Tobii
Tobii CEO Anand Srivatsa headshot
Anand Srivatsa took over as the CEO of Tobii in December. Tobii
Founded: 2001

Headquarters: Danderyd Municipality, Sweden

Tobii, a Swedish eye-tracking firm, raised $121.8 million in funding over five rounds before its initial public offering in 2016. It makes eye-tracking and "attention computing solutions" for the healthcare, gaming, and education industries as well as the auto sector.

In August 2021, Tobii announced it was acquiring Phasya, whose software for analyzing biometric signals helped it launch a driver-monitoring system.

Tobii's CEO, Anand Srivatsa, took the helm in December after serving as a division chief executive officer for another Tobii unit. An Intel veteran, Srivatsa has a master's in electrical engineering from Stanford.

Jungo
Jungo's driver monitoring system
Jungo says its VuDrive system meets the requirements set out by Europe's safety regulators. Jungo
Founded: 2013

Headquarters: Netanya, Israel

A Cisco spinoff, Jungo went public on the Tel Aviv Stock Exchange in July 2021. It works with automakers, major industry suppliers, fleet operators, and aftermarket manufacturers. It's raised $17.5 million in funding over five rounds, the most recent of which was in 2006, according to Crunchbase. Its investors include Cisco and Intel's Communications Fund.

Jungo says its VuDrive system meets the requirements set out by Europe's safety regulators. The product is designed to track a driver's head position and gaze to look for distraction or drowsiness, and the company says fleet operators can use it to "score" their drivers.

The company is run by Opher Suhami, a Cisco veteran.

Seeing Machines
Seeing Machines CEO Paul McGlone headshot
Paul McGlone, the CEO of Seeing Machines, has a background in logistics and supply-chain management. Seeing Machines
Founded: 2000

Headquarters: Canberra, Australia

Seeing Machines, which was spun out from the Australian National University in 2000, provides hardware and software to monitor drivers, pilots, air-traffic controllers, and others. It works with transportation companies including Daimler, GM, Magna, Emirates, and Qantas.

The company launched its Guardian system for commercial trucks and buses in 2016 — it says the driver-monitoring system has since covered more than 800 million miles and detected more than 3.6 million "fatigue and distraction-related driver events." It claims its technology is "scientifically proven to reduce fatigue events by more than 90%."

Seeing Machines has raised $5.7 million in funding, according to Crunchbase. It has a partnership with the chipmaker Qualcomm.

Its CEO, Paul McGlone, has a background in logistics and supply-chain management.

Cipia
Cipia CEO Yehuda Holtzman headshot
Cipia is helmed by Yehuda Holtzman, who took over in May and previously served as the CEO of On Track Innovations. Cipia
Founded: 2005

Headquarters: Tel Aviv, Israel

The Israeli outfit was founded as Eyesight Technologies and originally focused on computer vision. It updated its name in 2020 to reflect its expansion into neural networks — "Cipia" is a reference to the brain's occipital lobe, which turns visual inputs into environmental understanding.

The company says that its products are now in millions of devices and that it has deals with five automakers. It recently announced that it was working with the chipmakers Ambarella and Mobileye and that its driver-monitoring system would be installed in a new electric SUV produced by the Chinese automaker Chery.

Cipia is helmed by Yehuda Holtzman, who took over in May. Holtzman previously served as the CEO of On Track Innovations, a near-field-communication and cashless-payment firm. The company has raised $45.9 million in funding over four rounds, according to Crunchbase.

oops a few bits of code got edited and I can read without signing in ;-)

Driver-watching cameras are expected to jump by 500% to become a $1 billion business. These 4 under-the-radar companies are already conquering the booming market.
Alex Davies 2 hours ago
Depiction of how Cipia's driver-monitoring system watches a male driver's face
Driver-monitoring systems like Cipia's look for signs of inattention or drowsiness. Cipia
Driver-facing cameras will soon be installed in millions of cars thanks to new rules in Europe.
The cameras offer safety benefits as well as new options for facial-recognition features.
They can add $200 to a vehicle's cost, creating an opportunity for suppliers to corner a new market.
Until recently, the handful of companies that supplied the auto industry with driver-facing cameras filled orders of tens of thousands of units a year. Now they're starting to sell millions.

The boom is thanks to a couple of updated regulations across the pond. Starting next year, the tech will be a prerequisite for getting a five-star safety rating under Europe's new-car-assessment program. And come 2024, the European Commission will make it mandatory in all new cars.

Driver-facing camera systems are designed to detect signs of driver inattention or drowsiness and can even automatically slow the car down, said Maite Bezerra, an industry analyst at ABI Research. In a report on the effect of the new rules, she predicted that shipments of driver-monitoring systems would rise by 487.5% between this year and 2027, good for $954 million in revenue.

As they become required to install tech that can add $200 to the cost of a vehicle, automakers are looking at additional use cases to capitalize on the investment.

Facial identification could allow a car to recognize its driver and adjust the seat position, infotainment settings, and more. Knowing a driver's head position and tracking their gaze could allow for more effective augmented-reality applications. Down the road, Bezerra said, it could even help power an AI-based personal assistant.

Bezerra predicted that from 2022 to 2025, shipments of vehicles with driver-monitoring systems would climb from 8 million to 30 million. By 2027, they could hit 47 million and account for more than half of global sales.

Europe would make up a major chunk of those, as would China, which requires the tech in many commercial vehicles. In the US, the National Highway Traffic Safety Administration is talking about adding the systems to its safety-rating system by 2026.

That all spells boom times for the handful of industry suppliers that offer these systems. "The opportunity for them is enormous," Bezerra said. She added that while more players will want in, these four established companies are poised to cash in.

I always get confused reading about head mounted displays. How can my eyes move and my head move and my whole body (in an aircraft?) move, yet despite all of this, it can still compute where to paint a pattern on a screen in front of my eyes that will align with the outside world.

My head spins just thinking about it, but the X marks the spot with some clever timed flashes

This parent shows how closely linked Veoneer and Seeing Machines must work especially for Human Factors.

My car likes to remind me to wear my seat belt, sometimes if I stay below 5 mph and in first gear I may get away with it for a while before a relaxing melodic chime alerts me, if I ignore it, 5 or 10 seconds later a new and more insistent melodic chime comes in louder. This is Veoneer in my car. The patent adds more steps like asking the driver to perform certain tasks to ensure that they have the drivers attention which they measure using the DMS and button presses, gestures, etc.

I would like to see what AlexRoi144 thinks of this as he has often said that a decent handover system was one of the things missing from Level 2+ systems. OF course this system doesn't solve the problem of urgent takeovers for issues the vehicle did not forsee!

Good find JC

so the aircraft was in an manual mode, since they took control and aborted the landing but I guess they forgot to press the TOGA button (Take Off Go Around) button to tell the aircraft what to do.

Mode confusion is quite common - but even with Seeing Machines on board, it will need a lot of extra development by the aircraft manufacturers to realise when no-one is actually flying the plane

Apologies for the 'astronomical' error. Don't worry the lens will flip the image.

This must be for a future generation of Magna mirror, the exploded view ee have seen so far didn't have room to move the lens.

Moving the lens wasn't the USP, that was having the lens not centralised with the centre of the sensor which is a sensible claim as most of the time the centre of the main objects of attention are below the axis of the mirror

The world conspires to make eye tracking difficult, wether, it is sunlight or glasses. The move to 940nm fixed many of the problems of sunlight, but it didn't so drivers from wearing sunglasses.

Now most glasses and sunglasses are not a problem. But when it just has to work in automotive "most " is not enough. So this patent combines ir and rbg in one sensor and adds a switchable polarisation filter.

Now I once had to make a switchable lens and it wasn't fun or easy, so my first thought was they are crazy. But, this isn't hard they just need to switch the polarisation, that is easy, already mass produced, miniaturised and most importantly cheap!

You, may already have one on your wrist now, that is how LCD screens work but instead of a seven segment number or pixel matrix this just needs a single small panel with two electrodes. No moving parts and already standard technology made to Automotive standards.

The relatively poor contrast ratio isn't a problem here, the current draw is low and only required if the driver's glasses need it.

So extra cost if a few cents will help to catch a few percentage points of edge cases

This is a neat idea, sensors are relatively cheap but processing isn't!

So add in a 3d Time Of Flight camera as well as the OMS camera. When you use the ToF camera it takes 300 GigaFlops to build the 3d picture of the occupants. Once that is done, switch to the 2d camera and model the 3d pose of the occupants from an AI model on the 2d image. That only costs 50 GigaFlops. So rather than specify processing to be larger they only go 3d occasionally such as when the models no longer coincide. That leaves the processing available for other ADAS tasks.

What do you need it for?
-airbag deployment
- directing air flow
-3d sound or sound cancelling or individual media for different occupants etc

Good find JC

Flight Crew Fatigue And Controlled Rest Management System

It is official TLS has lost it, but I found it in my reading pile and it was worth the wait.

So for many, many years Seeing Machines have been watching eyes to keep people awake, so surely throwing DMS into an aircraft ****pit , can't be that hard?

Well, you know that Human Factors thing they are always banging on about, well they know a thing or two about humans, but this lets them show a whole new side - watching people sleep, telling them when to sleep to be most effective how long to sleep for and when the need to be woken, so that they are rested at the key stages of a flight and truly alert. But wait, there is more. When two pilots are in an aircraft and the cabin doors are closed and they are pushing back from the airbridge, taxing across the apron, launching into the sky and all the way to cruising altitude, they are not discussing what they did at the weekend, no, it is professional clipped phrases and counter checks as they handle this risky phase of the flight - you don't want to miss an alarm or flashing warning discussing what was on the barbie. Well seeing machines is going to cover that too, lip reading to see if there is a conversation and does it coordinate with what is happening in the ****pit!

Now on to Tablets, we may think of the iPads that Pilots carry are just toys, but now they replace the mandatory stack of checklists, manuals and logs, they can manage weather, routing and navigation - this is the Electronic Flight Bag (EFB) device. Now they can do far more! "the aircraft interfacing device may include an Intelisight™ Aircraft Interface Device (AID) developed by Collins Aerospace, which is capable of storing and accessing aircraft data and communications, navigation logging, flight tracking, obtaining weather information and monitoring aircraft health among other things."

So the Collins solution has the Pilots interfacing with the outputs from Seeing Machine's computation in their EFB, they can confirm the flight plans and depending on how the pilots are feeling and how tired they are judged to be, they can plan their breaks and even sleep in a horizontal bed. This information is used to plan which pilot will be landing the plane. Over successive flights, you can track where pilots were tired and how they performed - this can even be used to adjust rostering.

Incidentally, SEE won't be watching closed eyes in a separate horizontal bed crew rest area, that is down to a worn device - does this sound familiar? Quantas' Project Sunrise has already tested most of the equipment in real flight conditions and now that Collins can sell it along with their Intelisight™ Aircraft Interface Device.

I am not sure that all pilots will get a flat bed, most will have 20-40 minutes of snooze in their chair at the ****pit (However, I wonder if FedEx pilots will rearrange the parcels to make a bed?).
A350-1000 ****pit image?
Thanks JC - another great find and