IBM 2019-12-2627 Mar 2020 06:30
BLENDED AUTONOMOUS DRIVING SYSTEM (Blended, a term used by Toyota to describe Guardian/Chauffeur system. Guardian for all ?)
Methods, systems, and computer program products for blended autonomous driving are presented. Aspects include receiving vehicle environment data associated with a vehicle. Driver data associated with a driver of the vehicle is received and analyzed to determine a driver alertness level. The vehicle environment data is analyzed to identify a potential event and a first action for the potential event is initiated based on a determination that the driver alertness level is below a threshold.
[0025] In one or more embodiments, the vehicle environment data 206 can be collected from sensors on or around a vehicle. Any type of sensor can be used to collect the vehicle environmental data 206 including, but not limited to, cameras, LIDAR, sonar sensor, Doppler effect sensors, and the like. In one or more embodiments of the invention, the driver assistance system 212 can control the sensors and communicate the vehicle environment data 206 to the controller. In one or more embodiments of the invention, the controller 202 receives the vehicle environment data 206 and creates an integrated information layer that represents the driving related environment surrounding the vehicle. This layer can be referred to as the autonomous driving layer (ADL). The driver data 204 can be collected from sensors including cameras that detect and track a driver's gaze. In one or more embodiments of the invention, an array of cameras can be utilized to determine the direction of the driver's gaze, the three dimensional (3D) positioning of the driver's eyes within the cabin of the vehicle, and any obstructions to the driver's gaze in the plane of the windshield of the vehicle. From this driver data 204, the controller 202 can calculate an ideal vision cone for the driver and subtracts obstructions allowing for an estimate of the driver's awareness (alertness). This vision cone subtracting out obstructions can be referred to as the driver awareness level (DAL).
[0026] In one or more embodiments of the invention, by taking a geometric intersection of the autonomous driving layer (e.g., vehicle environment data 206) and the vision cone for the driving in the driver awareness level, the controller 202 can generate vehicle referenced patch containing a subset of entities which both the driver assistance system 212 and the human driver are likely aware of. For example, the vehicle environment data 206 might show a stop sign in front of the vehicle. By intersecting the driver's vision cone (taken from the gaze detection) with the vehicle environment data 206, the controller 202 can determine that the driver is aware of the stop sign as it is in the driver's field of vision.
Also see points 27/29/30
https://worldwide.espacenet.com/publicationDetails/description?CC=US&NR=2019389455A1&KC=A1&FT=D&ND=3&date=20191226&DB=&locale=en_EP#