Member Info for johnchucka

SYSTEMS AND METHODS OF AUGMENTED REALITY VISUALIZATION BASED ON SENSOR DATA
A device is configured to estimate a gaze target of a user of an augmented reality headset based on vehicle sensor data and headset sensor data. The device is configured to generate visualization data based on the gaze target. Responsive to determining that the gaze target is inside a first vehicle, the visualization data includes a first visual depiction of a first point of interest that is outside the first vehicle. The first point of interest includes at least a portion of a particular route of a particular vehicle. The particular vehicle includes the first vehicle or a second vehicle. Responsive to determining that the gaze target is outside the first vehicle, the visualization data includes a second visual depiction of a second point of interest that is inside the first vehicle.
https://worldwide.espacenet.com/publicationDetails/biblio?II=2&ND=3&adjacent=true&locale=en_EP&FT=D&date=20210318&CC=US&NR=2021082199A1&KC=A1
https://www.freepatentsonline.com/20210082199.pdf

SCENE CONTENT AND ATTENTION SYSTEM
In some examples, a computing device includes one or more computer processors configured to receive, from an image capture device, an image of a physical scene that is viewable by an operator of a vehicle, wherein the physical scene is at least partially in a trajectory of the vehicle; receive, from an eye-tracking sensor, eye-tracking data that indicates a portion of the physical scene at which vision of the operator is directed; generate, based at least in part on excluding the portion of the physical scene at which vision of the operator is directed, a description of the physical scene; and perform at least one operation based at least in part on the description of the physical scene that is generated based at least in part on excluding the portion of the physical scene at which the vision of the operator is directed.
https://worldwide.espacenet.com/publicationDetails/biblio?CC=WO&NR=2021048765A1&KC=A1&FT=D&ND=3&date=20210318&DB=&locale=en_EP
https://www.freepatentsonline.com/WO2021048765A1.pdf

SYSTEMS AND METHODS FOR GAZE TO CONFIRM GESTURE COMMANDS IN A VEHICLE
Disclosed is a method, system, and apparatus for configuring vehicle systems using gaze confirmed gesture commands. The method may include capturing, with at least one imaging system of a vehicle, image data depicting an occupant of the vehicle. The method may also include detecting a gaze of the occupant to a region of the vehicle depicted within the image data, detecting further comprises determining a user interface context for the region of the vehicle. Furthermore, the method may include detecting a motion command defining an input for configuring a vehicle system depicted within the image data. Additionally, the method may include executing the command to configure the vehicle system when the motion command defines an allowable input for the user interface context.

[0017] Similarly, in the illustrated embodiment, image processor 114, having received images or video from camera systems 102-2, can process the images or video to produce gaze detection and gaze target on the user's eye 129. In embodiments, gaze detection includes processes for measuring and monitoring a point of gaze of a user to regions of a vehicle in which system 100 is used, for example vehicle 202 in FIG. 2. For example, a gaze may be detected by detecting and monitoring anatomical features of user's eye 129 in the image data to determine various regions of a vehicle a user is currently looking at, such as a user looking at a graphical user interface (e.g., display 126), a region of a graphical user interface (e.g., region 133a or 133b of the display 126), other regions (not shown) such as windows, mirrors, steering wheel, seat, or other systems of a vehicle) based on measuring anatomical features of the eye. In embodiments, any suitable software and/or hardware that can capture image data and identify gaze and determine a target of the gaze may be used by image processing 114 and/or computer 116, such as glint detection and location based techniques using software and/or hardware packages/systems developed by Veoneer or Seeing Machines, for performing gaze detection.
https://worldwide.espacenet.com/publicationDetails/biblio?II=9&ND=3&adjacent=true&locale=en_EP&FT=D&date=20210311&CC=US&NR=2021072831A1&KC=A1

Intelligent escalation strategy for autonomous vehicle
An autonomous vehicle, system and method of operating an autonomous vehicle. The system includes a processor for operating an external condition awareness module, a driver driving behavior awareness module and an escalator module: The external condition awareness module is configured to determine an intelligent escalation factor based on an external condition of an environment and driving traffic conditions of the autonomous vehicle. The driver driving behavior awareness module is configured to generate a behavior disciplining factor based on a behavior history of a driver of the autonomous vehicle. The escalation module is configured to generate an escalation signal to alert the driver based on the intelligent escalation factor and the behavior disciplining factor, a driver attention level and a speed of the vehicle.
https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=10913464B1&KC=B1&FT=D&ND=3&date=20210209&DB=&locale=en_EP

APTIV TECH LTD
METHOD AND SYSTEM FOR DETERMINING AWARENESS DATA
Priority date:
2019-08-29

TOYOTA MOTOR ENGINEERING & MFG NORTH AMERICAN INC
VEHICLE FOR DETECTION OF IMPAIRED DRIVERS OF OTHER VEHICLES
Priority date:
2019-08-30

GM GLOBAL TECH OPERATIONS
SYSTEMS AND METHODS FOR EYE-TRACKING DATA COLLECTION AND SHARING
Priority date:
2019-08-27

HONDA MOTOR CO LTD
SYSTEM AND METHOD FOR CONTROLLING AN AUTONOMOUS CARRIAGE BASED ON USER INTENTIONS
Priority date:
2019-09-03

APTIV TECH LTD 2021-03-04
METHOD AND SYSTEM FOR DETERMINING AWARENESS DATA
A computer-implemented method for determining awareness data includes determining occlusion information related to a surrounding of a vehicle, determining a viewing direction of an occupant of the vehicle, and determining awareness data representing the occupant's awareness of the surrounding based on the occlusion information and the viewing direction.
https://worldwide.espacenet.com/publicationDetails/description?CC=US&NR=2021061287A1&KC=A1&FT=D&ND=4&date=20210304&DB=&locale=en_EP

AUTOMATED PACING OF VEHICLE OPERATOR CONTENT INTERACTION
In one example, a computing device includes one or more user input detection components, and one or more processors configured to receive an indication of a first user input detected by the one or more user input detection components, responsive to receiving the indication of the first user input, adjust a level of an attention buffer at a defined rate; responsive to determining that the level of the attention buffer satisfies a first threshold, prevent further interaction with a user interface of the computing device, responsive to determining that an indication of a second user input has not been received within a time period, adjust a level of the attention buffer, and responsive to determining that the level of the attention buffer satisfies a second threshold, allow further interaction with the user interface.
https://worldwide.espacenet.com/publicationDetails/description?CC=US&NR=2021070221A1&KC=A1&FT=D&ND=3&date=20210311&DB=&locale=en_EP

TOYOTA MOTOR ENGINEERING & MFG NORTH AMERICAN INC
VEHICLE FOR DETECTION OF IMPAIRED DRIVERS OF OTHER VEHICLES
Priority date:
2019-08-30

GM GLOBAL TECH OPERATIONS
SYSTEMS AND METHODS FOR EYE-TRACKING DATA COLLECTION AND SHARING
Priority date:
2019-08-27

HONDA MOTOR CO LTD
SYSTEM AND METHOD FOR CONTROLLING AN AUTONOMOUS CARRIAGE BASED ON USER INTENTIONS
Priority date:
2019-09-03

Toyota 2021-03-04
VEHICLE FOR DETECTION OF IMPAIRED DRIVERS OF OTHER VEHICLES
According to various embodiments of the disclosed technology, a vehicle may detect impaired drivers of other vehicles. In some embodiments, a first vehicle, comprises a hardware processor; and a non-transitory machine-readable storage medium encoded with instructions executable by the hardware processor to perform a method to determine whether a driver of a second vehicle is impaired, the method comprising: collecting information concerning the second vehicle from one or more sensors mounted on the first vehicle; determining a driving behavior of a driver of the second vehicle based on the information collected by the first vehicle; comparing the determined driving behavior of the driver of the second vehicle with a baseline driving behavior; determining whether the driver of the second vehicle is impaired based on the comparing; and taking one or more actions responsive to determining that the driver of the second vehicle is impaired.
https://worldwide.espacenet.com/publicationDetails/biblio?II=17&ND=3&adjacent=true&locale=en_EP&FT=D&date=20210304&CC=US&NR=2021061098A1&KC=A1

HONDA MOTOR CO - 2021-03-04
SYSTEM AND METHOD FOR CONTROLLING AN AUTONOMOUS CARRIAGE BASED ON USER INTENTIONS
A system and method for controlling an autonomous carriage based on user intentions that include receiving data associated with a user that uses the autonomous carriage to transport at least one occupant. The system and method also include analyzing the data associated with the user to determine at least one intention of the user and analyzing a scene associated with a current point of interest location of the autonomous carriage. The system and method further include determining at least one travel path to be followed by the autonomous carriage during autonomous operation that is based on the at least one intention of the user and the scene associated with the current point of interest of the autonomous carriage.

GM - 2021-03-04
SYSTEMS AND METHODS FOR EYE-TRACKING DATA COLLECTION AND SHARING
A method for collecting and mapping eye movement data to vehicle data includes providing a vehicle having a plurality of sensors configured to capture vehicle characteristic data, an eye-movement tracking system configured to capture eye movement data, a wireless communication system, and a controller in communication with the plurality of sensors, the eye movement tracking system, and the wireless communication system, receiving the eye movement data and the vehicle characteristic data, analyzing the eye movement data and the vehicle characteristic data to temporally correlate the eye movement data and the vehicle characteristic data and generate a matched dataset, determining a predicted vehicle maneuver from the matched dataset, and transmitting the predicted vehicle maneuver to a nearby vehicle using V2X communication vehicle using V2X communication.

TLS-- Is the Light trap similar to what have seen described previously in a GM patent?

ENHANCED AUGMENTED REALITY EXPERIENCE ON HEADS UP DISPLAY
Embodiments are disclosed for display configurations for providing an augmented reality heads up display. In one example, a method of operating a display system includes adjusting an output of image light from a display to pass through an optical element positioned between the display and at least one micro lens array, including impinging light upon a transparent plane to generate a three-dimensional image on a continuous plane that is based on a user focal point determined by an eye-tracking module.
https://worldwide.espacenet.com/publicationDetails/biblio?II=29&ND=3&adjacent=true&locale=en_EP&FT=D&date=20210311&CC=US&NR=2021070176A1&KC=A1
https://www.freepatentsonline.com/20210070176.pdf

AUTO-ZERO RECEIVER WITH INTEGRATED DFE, VGA AND EYE MONITOR
An apparatus includes a first half-cell, a second half-cell, a multiplexer and a decision feedback equalizer. The first input stage may be configured to present a first differential input to the first auto-zero stage and the second auto-zero stage. The second input stage may be configured to present a second differential input to the third auto-zero stage and the fourth auto-zero stage. The multiplexer may be configured to receive a first output from the first auto-zero stage, receive a second output from the third auto-zero stage and present a decision feedback input comprising one of the first output and the second output. The decision feedback equalizer may be configured to generate a feedback signal in response to the decision feedback input and present the feedback signal to the first feedback buffer and the second feedback buffer.
https://worldwide.espacenet.com/publicationDetails/biblio?II=3&ND=3&adjacent=true&locale=en_EP&FT=D&date=20210304&CC=US&NR=2021067385A1&KC=A1
https://www.freepatentsonline.com/20210067385.pdf

CLOSED EYE DETERMINATION DEVICE
A closed eye determination device includes an eye opening degree detection unit that detects a degree of eye opening of a driver from each of a series of face images of a driver in time series in a latest certain period of time being acquired by a driver monitor camera, a local minimum value extraction unit that extracts a local minimum value of the degree of eye opening from a change in time series of the degree of eye opening in the certain period of time, a reference lower limit value-setting unit that sets, as a reference lower limit value of the degree of eye opening, a local minimum value in order corresponding to a blinking number of the driver in the certain period of time in order from the smallest local minimum value among local minimum values of the degree of eye opening in the certain period of time, a threshold value setting unit that sets a closed eye determination threshold value, based on the reference lower limit value, and a closed eye determination unit that determines that an eye of the driver is closed when the degree of eye opening detected from an image acquired by the driver monitor camera after the certain period of time is less than or equal to the closed eye determination threshold value.
https://worldwide.espacenet.com/publicationDetails/biblio?II=2&ND=3&adjacent=true&locale=en_EP&FT=D&date=20210311&CC=US&NR=2021070306A1&KC=A1
https://www.freepatentsonline.com/20210070306.pdf
https://patents.justia.com/patent/20210070306

DRIVER ASSISTANCE APPARATUS AND METHOD THEREOF
A driver assistance apparatus includes an external camera disposed at a vehicle so as to have an outer field of view of the vehicle, configured to obtain image data on the outer field of view of the vehicle; an internal camera disposed inside the vehicle to grasp a drivers gaze on board the vehicle, configured to obtain the drivers gaze data; and a controller including at least one processor configured to process the image data and the gaze data. The controller may be configured to grasp the driver's gaze based on the gaze data, and based on a determination that the driver is in a careless condition, to control at least one of a control timing of a steering device and a lateral distance limit value for operating the steering device to be changed.
https://worldwide.espacenet.com/publicationDetails/biblio?II=4&ND=3&adjacent=true&locale=en_EP&FT=D&date=20210311&CC=US&NR=2021070359A1&KC=A1
https://www.freepatentsonline.com/20210070359.pdf

https://seeingmachines.springboard.com.au/jobtools/jncustomsearch.searchResults?in_organid=18900&in_jobDate=All

SYSTEMS AND METHODS FOR CONTEXT AND OCCUPANT RESPONSIVE USER INTERFACES IN VEHICLES
The progression of technology in vehicles has enhanced the driver's as well as passenger's experience. A sizable portion of the progression is the evolution of the human-machine interface. Nowadays, incorporating several user interfaces within a single vehicle is the standard. Accordingly, improving an occupant's interaction with these user interfaces is fundamental to cultivating the optimum occupant experience. The presently disclosed technology fulfills this objective by creating customized user interfaces for a vehicle. Each customized user interface is formed through the fusion of data from sensors within and around the vehicle tracking the occupant as well as vehicle interactions with each other and the environment. The wealth of information obtained simultaneous advances each individual occupant's experience by modifying associated user interfaces in accordance with the occupant's identified wants and needs.

[0038] FIG. 2 illustrates an example architecture for implementing customized user interfaces in accordance with one embodiment of the systems and methods described herein. Referring now to FIG. 2, in this example, customized vehicle dynamic display system 200 may include an occupant display customizing circuit 210, plurality of sensors 252, and a plurality of vehicle systems 240. Sensors 252 and vehicle systems 240 can communicate with occupant display customizing circuit 210 via a wired or wireless communication interface. Although sensors 252 and vehicle systems 240 are depicted as communicating with occupant display customizing circuit 210, they can also communicate with each other as well as with other vehicle systems. Occupant display customizing circuit 210 can be implemented as an electronic control unit (ECU) or as part of an ECU such as, for example electronic control unit 50. In other embodiments, occupant display customizing circuit 210 can be implemented independently of the ECU.
https://worldwide.espacenet.com/publicationDetails/biblio?II=23&ND=3&adjacent=true&locale=en_EP&FT=D&date=20210304&CC=US&NR=2021064393A1&KC=A1
https://www.freepatentsonline.com/20210064393.pdf

SYSTEM AND METHOD FOR PROVIDING UNSUPERVISED DOMAIN ADAPTATION FOR SPATIO-TEMPORAL ACTION LOCALIZATION
A system and method for providing unsupervised domain adaption for spatio-temporal action localization that includes receiving video data associated with a surrounding environment of a vehicle. The system and method also include completing an action localization model to model a temporal context of actions occurring within the surrounding environment of the vehicle based on the video data and completing an action adaption model to localize individuals and their actions and to classify the actions based on the video data. The system and method further include combining losses from the action localization model and the action adaption model to complete spatio-temporal action localization of individuals and actions that occur within the surrounding environment of the vehicle.
https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2021027066A1&KC=A1&FT=D&ND=3&date=20210128&DB=&locale=en_EP
https://www.freepatentsonline.com/20210027066.pdf

SYSTEM AND METHOD FOR CONTROLLING AN AUTONOMOUS CARRIAGE BASED ON USER INTENTIONS
A system and method for controlling an autonomous carriage based on user intentions that include receiving data associated with a user that uses the autonomous carriage to transport at least one occupant. The system and method also include analyzing the data associated with the user to determine at least one intention of the user and analyzing a scene associated with a current point of interest location of the autonomous carriage. The system and method further include determining at least one travel path to be followed by the autonomous carriage during autonomous operation that is based on the at least one intention of the user and the scene associated with the current point of interest of the autonomous carriage.
https://worldwide.espacenet.com/publicationDetails/biblio?II=12&ND=3&adjacent=true&locale=en_EP&FT=D&date=20210304&CC=US&NR=2021064048A1&KC=A1
https://www.freepatentsonline.com/20210064048.pdf

IMAGE PROCESSING FOR EYE LOCATION IDENTIFICATION
In various embodiments, methods, systems, and vehicles are provided for locating an eye of an occupant of a vehicle. In an exemplary embodiment, a system is provided that includes: (i) a camera configured to generate a camera image of an occupant for a vehicle; and (ii) a processor coupled to the camera and configured to at least facilitate: (a) performing one or more Fourier transforms of the camera image; and (b) identifying a location for an eye of the occupant of the vehicle, using a phase model generated via the one or more Fourier transforms.
https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2021065401A1&KC=A1&FT=D&ND=3&date=20210304&DB=&locale=en_EP
https://www.freepatentsonline.com/20210065401.pdf

SYSTEMS AND METHODS FOR VEHICLE OPERATOR INTENTION PREDICTION USING EYE-MOVEMENT DATA
A method for controlling an automotive vehicle includes providing a first actuator configured to control acceleration and braking of the first vehicle, a second actuator configured to control steering of the first vehicle, and a controller in communication with the first and second actuators, the controller configured to selectively control the first and second actuators in an autonomous mode along a first trajectory according to an automated driving system, receiving eye movement data and vehicle characteristic data from a second vehicle using V2X communication, determining a predicted vehicle maneuver of the second vehicle from the eye movement data and the vehicle characteristic data, determining a trajectory adjustment for the first vehicle to the predicted vehicle maneuver of the second vehicle, and automatically controlling the first and second actuators to implement the trajectory adjustment.
https://worldwide.espacenet.com/publicationDetails/biblio?II=73&ND=3&adjacent=true&locale=en_EP&FT=D&date=20210304&CC=US&NR=2021061276A1&KC=A1
https://www.freepatentsonline.com/20210061276.pdf

SYSTEMS AND METHODS FOR EYE-TRACKING DATA COLLECTION AND SHARING
A method for collecting and mapping eye movement data to vehicle data includes providing a vehicle having a plurality of sensors configured to capture vehicle characteristic data, an eye-movement tracking system configured to capture eye movement data, a wireless communication system, and a controller in communication with the plurality of sensors, the eye movement tracking system, and the wireless communication system, receiving the eye movement data and the vehicle characteristic data, analyzing the eye movement data and the vehicle characteristic data to temporally correlate the eye movement data and the vehicle characteristic data and generate a matched dataset, determining a predicted vehicle maneuver from the matched dataset, and transmitting the predicted vehicle maneuver to a nearby vehicle using V2X communication.

[0043] Typically, vehicles, whether autonomous or semi-autonomous, do not have a way to predict the maneuvers of surrounding autonomous, semi-autonomous, or driver-operated vehicles. The systems and methods discussed herein enable real-time capture and matching of eye-movement data that may be shared with surrounding vehicles using V2X communications. The eye-movement data may be used to improve operator- or vehicle-intention predictions and/or to improve vehicle control strategies.

[0052] In various embodiments, the correlated gaze position and duration data and vehicle data is analyzed by the eye-movement data analysis system 24 of the controller 22 of the vehicle 10. This analysis includes, in some embodiments, use of a prediction model. The prediction model analyzes a percentage of the eye gaze tracking and vehicle data as training datasets to predict an intended maneuver and performs validation of the prediction model using additional eye gaze tracking data and vehicle data as acquired to refine the prediction of the intended maneuver. In various embodiments, the prediction model is housed in the originating vehicle 10. In various embodiments, the prediction model is housed in the receiving vehicle 10, that is, a nearby vehicle to the originating vehicle that receives the gaze position and duration data and vehicle data from the originating vehicle 10.
https://worldwide.espacenet.com/publicationDetails/biblio?II=72&ND=3&adjacent=true&locale=en_EP&FT=D&date=20210304&CC=US&NR=2021061277A1&KC=A1
https://www.freepatentsonline.com/20210061277.pdf