GM GLOBAL TECH OPERATIONS Patent 2019-10-1718 Oct 2019 20:34
METHODS AND SYSTEMS FOR PROCESSING DRIVER ATTENTION DATA
Methods and systems are provided for processing attention data. In one embodiment, a method includes: receiving, by a processor, object data associated with at least one object of an exterior environment of the vehicle; receiving upcoming behavior data determined from a planned route of the vehicle; receiving gaze data sensed from an occupant of the vehicle; processing, by the processor, the object data, the upcoming behavior data, and the gaze data to determine an attention score associated with an attention of the occupant of the vehicle; and selectively generating, by the processor, signals to at least one of notify the occupant and control the vehicle based on the attention score.
The technical field generally relates to methods and systems for processing attention data associated with a driver of a vehicle, and more particularly to methods and systems for processing attention data using vehicle perception data and behavior plan data.
Gaze detection systems generally include one or more cameras that are pointed at the eyes of an individual and that track the eye position and gaze direction of the individual. Vehicle systems use gaze detection systems to detect the gaze direction of a driver. The gaze direction of the driver is then used to detect the driver's attentiveness to the road ahead of them, or the driver's general attention to a feature inside the vehicle.
For example, some vehicle systems use the gaze direction of a driver to determine if the driver is inattentive to the road and to generate warning signals to the driver. In another example, some vehicle systems determine that the driver is looking in the direction of a particular control knob or switch of the vehicle and can control that particular element (e.g., turn it on, etc.) based on the determination. In each of the examples, the vehicle systems make a general determination of where the driver is looking and do not make a determination of what the driver is looking at (i.e. what is grasping the attention of the driver). In certain driving conditions, such as urban driving conditions, the driver attention will be based on the current driving conditions. For example, if the vehicle is stopped at stop sign, the driver may look left and then right. In another example, if the vehicle is about to make a turn, the driver attention will be in the direction of the upcoming turn.
Accordingly, it is desirable to provide improved methods and systems for detecting the attention of a driver based on the driving conditions. In addition, it is desirable to provide methods and system for making use of the information determined from the detected attention of the driver to the particular point or object. Furthermore, other desirable features and characteristics of the present invention will become apparent from the subsequent detailed description and the appended claims, taken in conjunction with the accompanying drawings and th