Member Info for johnchucka

VEHICLE CABIN LIGHTING SYSTEM
A vehicle cabin lighting system includes: a lighting device that is provided inside a vehicle cabin and that is configured to move a position of light; and a control section that is configured to determine whether or not an occupant sitting on a vehicle seat has an interest in interacting with another occupant inside the vehicle cabin based on operation of an operation section by the occupant or based on a state of the occupant sitting on the vehicle seat, and to control the lighting device so as to move the position of the light in order to direct a gaze direction of the occupant toward a vehicle width direction outer side in a case in which no interest in interacting has been determined.
https://worldwide.espacenet.com/publicationDetails/biblio?II=9&ND=3&adjacent=true&locale=en_EP&FT=D&date=20210812&CC=US&NR=2021245658A1&KC=A1
https://www.freepatentsonline.com/20210245658.pdf

DRIVER ATTENTIVENESS DETECTION METHOD AND DEVICE
A vehicle safety system (37) includes at least one image sensor device (17), a control unit arrangement (5, 20, 22) and at least one warning device (11, 12). The image sensor device (17) is arranged to detect eye configurations of a vehicle driver (19). When the warning device (11, 12) is initiated to emit a first warning signal, the control unit arrangement (5, 20, 22) is arranged to determine if the vehicle driver (19) at least partly is looking outside a warning area (24, 25) that at least partly encompasses the warning device (11, 12), and in that case to issue a second warning signal.
https://worldwide.espacenet.com/publicationDetails/biblio?FT=D&date=20210805&DB=&locale=en_EP&CC=US&NR=2021237743A1&KC=A1&ND=4

CONTINUOUS INPUT BRAIN MACHINE INTERFACE FOR AUTOMATED DRIVING FEATURES
Embodiments describe a vehicle configured with a brain machine interface (BMI) for a vehicle computing system to control vehicle functions using electrical impulses from motor cortex activity in a user's brain. A BMI training system trains the BMI device to interpret neural data generated by a motor cortex of a user and correlates the neural data to a vehicle control command associated with a neural gesture emulation function. A BMI system onboard the vehicle may receive a continuous neural data feed of neural data from the user using the trained BMI device, determine a user intention for a control instruction to control a vehicle system using the continuous neural data feed, and perform an action based on the control instruction. A user may control aspects of automated parking using the BMI device in conjunction with a vehicle controller that governs some aspects of the parking operation.
https://worldwide.espacenet.com/publicationDetails/description?CC=US&NR=2021237715A1&KC=A1&FT=D&ND=3&date=20210805&DB=&locale=en_EP
https://www.freepatentsonline.com/20210237715.pdf

*Seam not Seem.

S2020,
I'm wondering if we are just on the first seem of 'edge cases' and the second seem will comprise of the inward and outward facing cameras combined data. In my estimation it is this IP and capacity as Redindi mentioned earlier along with the first seem edge case data that gave Seeing Machines the advantage.

TLS,
Sorry, Ignore that . I'm mixing up Panasonic and Pioneer .

TLS,
Would you support the hypothesis that the patents below , closely aligned in description and publication dates and the Qualcomm/ Ford / Panasonic relationship support the idea that Seeing machines tech is likely being used by Toyota ?

Panasonic, Qualcomm and Ford Join Forces on First U.S. Deployment for C-V2X Vehicle Communications in Colorado
https://www.qualcomm.com/news/releases/2018/06/01/panasonic-qualcomm-and-ford-join-forces-first-us-deployment-c-v2x-vehicle

PIONEER CORP 2021-07-29
INFORMATION PROVISION DEVICE, INFORMATION PROVISION METHOD, INFORMATION PROVISION PROGRAM, AND RECORDING MEDIUM
https://worldwide.espacenet.com/publicationDetails/biblio?CC=WO&NR=2021149594A1&KC=A1&FT=D&ND=3&date=20210729&DB=&locale=en_EP
https://www.freepatentsonline.com/WO2021149594A1.pdf

TOYOTA MOTOR CO LTD 2021-07-29
DISPLAY CONTROL DEVICE, DISPLAY CONTROL METHOD, AND PROGRAM
https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2021229553A1&KC=A1&FT=D&ND=4&date=20210729&DB=&locale=en_EP
https://www.freepatentsonline.com/20210229553.pdf

TRAINING A NEURAL NETWORK TO DETERMINE PEDESTRIANS
A training system for a neural network system and method of training is disclosed. The method may comprise: receiving, from a sensor, an image frame captured while an operator is controlling a vehicle; using an eye-tracking system associated with the sensor, monitoring the eyes of the operator to determine eyeball gaze data; determining, from the image frame, a plurality of pedestrians; and iteratively training the neural network system to determine, from among the plurality of pedestrians, the one or more target pedestrians using the eyeball gaze data and an answer dataset that is based on the eyeball gaze data, wherein the determined one or more target pedestrians have a relatively-higher probability of collision with the vehicle than a remainder of the plurality of pedestrians.
https://www.freepatentsonline.com/20210232812.pdf
https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2021232812A1&KC=A1&FT=D&ND=3&date=20210729&DB=&locale=en_EP

Tom , you could well be right but I would point to the couple of occasions that I have logged a series of closely timed patents from SEE partners and Toyota etal as evidence that SEE are in the running. First from a post on 9/11/20 .
QUALCOMM INC
Publication 2020-10-29
METHOD AND APPARATUS FOR VEHICLE MANEUVER PLANNING AND MESSAGING
Priority date:
2019-04-29

GM GLOBAL TECH OPERATIONS
Publication 2020-10-29
DYNAMIC FORWARD COLLISION ALERT SYSTEM
Priority date:
2019-04-25

ZENUITY AB
Publication 2020-10-29
DRIVER DISTRACTION DETERMINATION
Priority date:
2019-04-26

Toyota
Publication 2020-10-29
ADAPTIVE LOCALIZED NOTIFICATIONS
Priority date:
2019-04-23

TOYOTA RES INST INC
Publication 2020-10-29
SYSTEMS AND METHODS FOR SIMULATING INSTANTANEOUS ATTENTIVE HUMAN RESPONSES TO ROAD HAZARDS FOR IMPROVED EARLY WARNING SYSTEMS AND FLEET DATA HARVESTING
Priority date:
2019-04-24

HYUNDAI MOTOR CO LTD [KR]; KIA MOTORS CORP [KR]
Publication 2020-10-29
MANUAL DRIVE CHANGING NOTIFICATION APPARATUS AND METHOD OF VEHICLE AND VEHICLE INCLUDING THE SAME
Priority date:
2019-04-24

HYUNDAI MOTOR CO LTD [KR]; KIA MOTORS CORP [KR]
Publication 2020-09-10
APPARATUS AND METHOD FOR RESTRICTING NON-DRIVING RELATED FUNCTIONS OF VEHICLE
https://worldwide.espacenet.com/publicationDetails/description?CC=US&NR=2020282979A1&KC=A1&FT=D&ND=3&date=20200910&DB=&locale=en_EP
Priority date:
2019-03-05

HONDA RES INST EUROPE GMBH
Publication 2020-10-14
METHOD FOR ASSISTING A PERSON IN ACTING IN A DYNAMIC ENVIRONMENT AND CORRESPONDING SYSTEM
https://worldwide.espacenet.com/publicationDetails/inpadocPatentFamily?CC=EP&NR=3723066A1&KC=A1&FT=D&ND=3&date=20201014&DB=&locale=en_EP
https://www.freepatentsonline.com/EP3723066A1.pdf
Priority date:
2019-04-10

and this from 17/3/21

APTIV TECH LTD
METHOD AND SYSTEM FOR DETERMINING AWARENESS DATA
Priority date:
2019-08-29

TOYOTA MOTOR ENGINEERING & MFG NORTH AMERICAN INC
VEHICLE FOR DETECTION OF IMPAIRED DRIVERS OF OTHER VEHICLES
Priority date:
2019-08-30

GM GLOBAL TECH OPERATIONS
SYSTEMS AND METHODS FOR EYE-TRACKING DATA COLLECTION AND SHARING
Priority date:
2019-08-27

HONDA MOTOR CO LTD
SYSTEM AND METHOD FOR CONTROLLING AN AUTONOMOUS CARRIAGE BASED ON USER INTENTIONS
Priority date:
2019-09-03

I also believe the inward and outward camera fusion patent that SEE have would be highly influential in the decision making process.

Some new faces on the AVCC block that I don't remember seeing the last time I looked.
https://www.avcconsortium.org/

https://www.arriver.com/
https://www.subaru.co.jp/en/

DRIVING ASSISTANCE DEVICE, DRIVING SITUATION INFORMATION ACQUISITION SYSTEM, DRIVING ASSISTANCE METHOD, AND PROGRAM
A driving assistance device includes: a line-of-sight direction detection unit that detects a direction of a line of sight of a driver of a moving body; an obstacle detection unit that detects a position of an obstacle in environs of the moving body; an assessment criteria determination unit that determines assessment criteria of a look at the obstacle by the driver based on at least one of time, location, weather, a state of the moving body, and a state of the driver; and a warning processing unit that obtains an assessment result by applying, to the assessment criteria, a score computed based on the direction of the line of sight of the driver and the position of the obstacle, the warning processing unit determining at least one of whether or not a warning needs to be issued to the driver and a level of the warning, based on the assessment result.
https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2021197722A1&KC=A1&FT=D&ND=3&date=20210701&DB=&locale=en_EP
https://www.freepatentsonline.com/20210197722.pdf

VEHICLE COMPUTER COMMAND SYSTEM WITH A BRAIN MACHINE INTERFACE
Embodiments describe a vehicle configured with a brain machine interface (BMI) for a vehicle computing system to control vehicle functions using electrical impulses from motor cortex activity in a user's brain. A BMI training system trains the BMI device to interpret neural data generated by a motor cortex of a user and correlate the neural data to a vehicle control command associated with a neural gesture emulation function. A BMI system onboard the vehicle may receive a neural data feed of neural data from the user using the trained BMI device, determine, a user intention for a control instruction to control a vehicle infotainment system using the neural data feed, and perform an action based on the control instruction. The vehicle may further include a headrest configured as a Human Machine Interface (HMI) device that reads the electrical impulses without invasive electrode connectivity.
https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2021213958A1&KC=A1&FT=D&ND=3&date=20210715&DB=&locale=en_EP
https://www.freepatentsonline.com/20210213958.pdf
https://patents.justia.com/patent/20210213958

NEURAL NETWORK BASED FACIAL ANALYSIS USING FACIAL LANDMARKS AND ASSOCIATED CONFIDENCE VALUES
Systems and methods for more accurate and robust determination of subject characteristics from an image of the subject. One or more machine learning models receive as input an image of a subject, and output both facial landmarks and associated confidence values. Confidence values represent the degrees to which portions of the subject's face corresponding to those landmarks are occluded, i.e., the amount of uncertainty in the position of each landmark location. These landmark points and their associated confidence values, and/or associated information, may then be input to another set of one or more machine learning models which may output any facial analysis quantity or quantities, such as the subject's gaze direction, head pose, drowsiness state, cognitive load, or distraction state.

[0003] Conventional gaze determination systems are not without their drawbacks, however. Overall performance and robustness of such systems remains limited, especially in edge cases or extreme situations such as large variations in head pose or partial occlusion of faces or eyes. FIG. 1 illustrates examples of such extreme situations. More specifically, FIG. 1 shows situations in which the subject's face is partially or mostly occluded (left), in this case by a respiratory mask, and in which the subject has turned her head far to one direction (right). In both examples, much of the subject's face cannot be seen (in the leftmost figure, the entirety of the subject's face below his eyes; in the rightmost figure, the entire right side of the subject's face), meaning much information on the subjects' faces is unavailable for sensing. This leaves limited information available for CNNs to determine face pose, resulting in often inaccurate results.
https://worldwide.espacenet.com/publicationDetails/description?CC=US&NR=2021182625A1&KC=A1&FT=D&ND=3&date=20210617&DB=&locale=en_EP
https://www.freepatentsonline.com/20210182625.pdf

AUTOMATED DRIVING SYSTEM
Such stimulation helps the driver to maintain his or her level of situation awareness at an appropriate level at all times.
https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2021155261A1&KC=A1&FT=D&ND=3&date=20210527&DB=&locale=en_EP
https://www.freepatentsonline.com/20210155261.pdf

Driver-Monitoring System
The techniques of this disclosure relate to a driver-monitoring system. The system includes a controller circuit that receives monitoring data from a driver-monitor sensor that is configured to monitor a driver of a vehicle while the vehicle operates in an autonomous-driving mode. The controller circuit determines a score of one or more driver-supervisory metrics based on the monitoring data, each of the driver-supervisory metrics being indicative of whether the driver is supervising the operation of the vehicle. The controller circuit determines a supervision score based on the score of the driver-supervisory metrics. The supervision score is indicative of whether the driver is ready to resume control of the vehicle. The controller circuit indicates a driver-awareness status on a display in a field of view of the driver based on the supervision score. The system can improve vehicle safety by alerting the driver when the driver exhibits reduced driver awareness behavior.
https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2021209922A1&KC=A1&FT=D&ND=3&date=20210708&DB=&locale=en_EP
https://www.freepatentsonline.com/20210209922.pdf

LOW POWER EYE TRACKING SYSTEM AND METHOD
https://worldwide.espacenet.com/publicationDetails/inpadocPatentFamily?CC=EP&NR=3042312A1&KC=A1&FT=D&ND=4&date=20160713&DB=&locale=en_EP
https://register.epo.org/application?number=EP14842026&lng=en&tab=doclist

S7,
So do SEE get paid only when the DMS option is activated even though it may not be activated in every car prior to mandating?

S7,
Is the DMS fitted as standard then activated or do they have DMS and Non DMS at production line level?

Hi Maps,
I think these are the important details of the patent. It identifies the safety gap in the market (12) , has superior DMS for distraction and fatigue detection (14) along with the low cost advantage a docking device offers by enhancing the capabilities of the ubiquitous mobile phone thereby not duplicating technology costs(71). I think it's a very important patent with a huge aftermarket application.

[0012] However one key aspect of the driving safety problem that is not addressed by devices in class (1 ) or (2) is the widespread problem of phone use while driving. Mobile phones are extremely hazardous to operate when driving due to the distracting nature of their often complex user interfaces. In many parts of the world it is now illegal to touch or operate a phone while driving but this is very difficult to enforce and studies show that these laws have nearly no effect on the behaviour of many drivers, in particular the young driver demographic. In this regard, the phone-based solution has an advantage because the phone application software can change the interface of the phone in order to remove any need for the driver to interact with the phone. [0013] Driving monitoring software that operates on phones typically uses the built-in GPS to determine where the vehicle is located and the speed of the vehicle. In addition, the built-in accelerometer in the phone can sense "shock" events such as sudden breaking or hard cornering behaviour. In addition, the forward facing primary camera of the phone is used to track information in the driving scene.

[0014] However, with regards to sensing the driver's attention, the camera on the phone that faces the user is unsuitable for this task. To measure driver attention requires continuous tracking of their head-pose, face and eye features (including their eye-opening and gaze-direction). Cameras used in modern phones have insufficient resolution and low sensitivity to infra-red wavelengths of light to accomplish these measurements reliably. In particular, gaze-tracking methods often rely on locating a known reflection from the cornea of the eye; imaging this reflection in sunlit conditions requires a narrow-band infrared filter over the lens combined with bright infra-red illuminators at the band-pass wavelength, which is hardware that does not exist in any phone.

[0071 ] The present invention also provides a system for obtaining driver performance and vehicle monitoring data. A primary benefit over existing systems is that no dedicated dash-mounted monitoring device is required and the primary cost and functionality is provided by a mobile telephone handset.

PHONE DOCKING STATION FOR ENHANCED DRIVING SAFETY
https://register.epo.org/documentView?number=US.201615550917.A&documentId=1-7-US++155509171XP1+