Charles Jillings, CEO of Utilico, energized by strong economic momentum across Latin America. Watch the video here.
JC you are always looking for clusters of similar patents. This batch certainly shows how working with Seeing Machines has provided a new tool for the Human Factors team at Rockwell which has resulted in a rich seam for them to mine. Even if only a fraction get to a patent it shows where their direction of travel is and there is enough width and depth in these patents to keep others out of this area.
As mentioned in the Pat aircraft videos, there are many ways to use eye tracking and seeing machines in the ****pit.
This multi feature approach using the same equipment costs little extra to deploy and adds more value to the OEMs and Airlines.
I can see pilot facing cameras being a desirable and soon a standard feature for some leading operators before becoming mandatory in certain markets.
Well done JC, SEE and Rockwell Collins
If you ever wondered where the keys are on a commercial jet. There aren't any.
That is why the pilot stays in the aircraft until the passengers disembark.
This patent application is for a multitude of locking and unlocking methods to prevent hijacks in the air and on the ground.
In films a fingerprint or eye scan opens a door. But this system can detect the wrong person in the pilot seat at any time.
In the event of incapacity you can talk to the ground to allow full authority for the passenger who just happens to be able to fly (To lose one pilot may be regarded as a misfortune; to lose both looks like carelessness)
But more likely is that the aircraft will allow the unidentified person only limited control and is most likely to engage autoland at the nearest airstrip.
This means the golden years of aircraft disaster movies are long gone.
Stellantis, most of those brands are small and regional, so the same win gets split into UK (Vauxhaul), Opel (Germany and neighbours) Peugeot (France, Spain and UK), Fiat (Italy,...) etc rather than a single badge win like Ford which has far larger volume for a single DW and no extra configuration for the varieties of cabin and furniture across the brands
Good find JC.
That patent application gets the TLS thumbs up!
Nothing too fancy, just does what it says it will do - monitor the pilot's scan pattern and identify if they are missing something, or have focussed too long in one area, all relative to the phase of the flight.
Hope it becomes part of standard fit-out before too long
And the YouTube link to the same content
https://youtu.be/hs3r_ZurVFo
Qualcomm is laying the trail for CES and their own presentations, not sparing the cash either!
https://www.linkedin.com/posts/qualcomm_ai-activity-7006364434986082305-1D1o?utm_source=share&utm_medium=member_android
Automotive is half way through. Camera in mirror and DMS
Safestocks didn't twist the knife. He just threw Smart Eye in the blender.
CFP,
JC and TLS are just a side show to fill in the gaps while Terrym snoozes and I am sure that even then he still keeps one eye on See
Thank you CFP
That new enterprise customer is Air Liquide. Over 66k employees in 75 countries https://www.airliquide.com/group/air-liquide-brief
Are you quoting someone?
This one brings home the money!
"Optical path"
The first stage of the optical path is the light source. This patent application is mostly about what you do with it
In lab conditions it takes time to configure your components, to find the sweet spot for the power level for illumination so that they pupil is not too bright or too dark. This will then be tweaked in automotive validation tests to get the best response in most conditions across the test population.
This gives a DMS that mostly works in most conditions for most of the people. It isn't 100%
What does this mean in practice?
To obtain an image that they can see when the sun is on your face, they need to have higher power, but they won't cover the very brightest sun low in your face as that would be too bright for night time. But that still means that most images are overly bright. So the accuracy in measuring the eye position will be lower all of the time and the system may not even get a successful eye position in the darkest or brightest environments.
This patent allows See to dynamically adjust lighting.
It also allows multiple images to be tested within a cycle so the best can be selected. That puts Seeing Machines at the very highest "availability" for detecting eye positions and better images improves the quality of the eye detection and so more accuracy.
There is a reason why Seeing Machines win contracts, and get to production!
Premium European car manufacturer (with 3 spokes) but blink and you miss it)
Talk of optical path, stereo cameras, the accuracy of head position to within 5mm for 3d effect display.
Proprietary LG algorithm, but acknowledged Tier 2 algorithm too.
Now working on DMS and OMS from single camera for cheaper cost.
Note stereo camera for S-Class was to support 3d display that is not available lower in the range.
Abnormal head posture
Hand position classification
Held object classification
Speaking
Laughing
Coughing
Sneezing
Yawning
Smoking
Phone Handling - video conferencing (makes facetime sound so formal!)
Classifications:
Child seat
SEat belt status
Occupant size
Occupant age
GEnder
Presence detection
Recognition - Convenience
Recognition - Security!
Occupant change
Spoofing
Facial expression
Body Pose tracking:
Eye tracking
head tracking
eyelid dynamics
Brightness control
Face searching
Mouth shape
Camera pose estimation
Frozen image detection
Face occlusion
Lens blockage
Low quality image
IR light blockage
No wonder Paul was proud of the features that he was working on and how much more efficient his team is at developing them. Wonder what else is in the pipeline?
Wow, that is a great patent. The moat is now approaching Atlantic proportions. There is no room for reasonable competition in the DMS mirror space!
The detail in the optics and thought that goes into Failure Mode Effect Analysis to derive a better solution to practical problems before they reach the market is fantastic.
The page order in the PDF has gone a little astray, but don't let that stop you from skimming.
Here is a detail of the high level signals provided by Seeing Machines DMS (lets face it, they won't put someone else's code in here)
Emotional State, Cognitive distraction
Disengagement
Visual distraction
Level of Drowsiness
Microsleeping
Sleeping
Visual State
Gesture
head nodding/shaking
Activity
This one was hard to understand.
METHOD FOR VEHICLE EYE TRACKING SYSTEM
Actually it seems to be more about using a Head Up Display to use eye tracking to select a feature with your eyes and confirming with a button, but just as you are selecting with your eyes, a cyclist appears and distracts you.
But the interface knows you were distracted, so doesn't change the feature based on your eye movement. I presume it also filters out the jolt as the cyclist is bdump, bdump run over by the front and rear wheels.
Sometimes, mechanical switches are a better idea!
If anyone else can work out what this was supposed to say I would be great to hear your interpretation
Ok, I have mixed feelings about this. It is almost the gamification of bad driving. Perfect for use with Tesla's "fool's elf driving"
So while the driver is distracted the car keeps score of the seconds, distance driven and hazards missed by the driver. From Fig 4:
"Distraction status:
5.3 s
106 m
15 Vehicles
1 Traffic Signal
3 Traffic Signs
1 Emergency Vehicle
1 School Zone
1 Crosswalk"
At this point any self respecting vehicle should incur very expensive electrical and mechanical failures to prevent future driving:
"Fault detected - Battery overheat, Wiring loom failure, Rear Left Brake seized, coolant lost"
What Esco said.
+1
My backlog is growing too!
SYSTEMS AND METHODS FOR DETECTION OF MOBILE DEVICE USE BY A VEHICLE DRIVER
This was posted on the 12th by the ever vigilant JC.
Tim Edwards, knocks another one out of the park. Many patents are dreamed up in the bath or the shower, some through brainstorming, others have come from blood, sweat and tears of practical experience. This shows evidence of the latter class.
How to detect a phone in a car is one problem, checking that it is in use by the driver is the key part if you want a positive experience. This patent stands on the shoulders of the bath thinkers and brainstormers by using that vast store of real data and human factors expertise. It goes through the various ways of detecting the phone, then to check that it is the driver that is using it. Once of the key approaches, as you would expect is to track patterns of eye gaze, to determine the relative usage patterns of various Regions Of Interest. It is always advisable to be looking at the road ahead, the instruments and the mirrors, with occasional glances at the passengers, Infotainment controls etc. But regularly glancing at a small area on your your knee, lap, the pocket next to the gear stick or the air vent is a sign that the mobile is in use.
Worth a read while we wait for a proper RNS
Just in case anyone wasn't aware. Seeing Machines are listed in London, but Australian take-over laws apply. So any holder with 10% can block a sale.
Note Magna may not exceed 9.9% ownership with the current deal (wonder why) or rather they can, but it would be expensive as they would need to pay again for their recent tranche option but at market value.
https://seeingmachines.com/investors/aim-investor-information/
So Lombard Odier can block the sale. Until recently VSI or Federated could also block, nothing precludes them topping up to hold 10%. Although macro issues may have forced FH the other way.