Member Info for johnchucka

SYSTEM FOR DETECTING THE FACE OF A DRIVER AND METHOD ASSOCIATED THERETO
A system for detecting the face of a vehicle driver comprises an instrument cluster for the driver including a carrier and an dashboard directed towards the driver and covered by a glass, said dashboard being embedded in the carrier; an image capture device comprising a camera configured to capture sequential images of the driver's gaze; and a controller configured to analyze the driver's gaze; at least one intrinsic element of the instrument cluster defines a reflecting surface configured to directly reflect the sequential images of the driver's gaze such as a glossy plastic, a chrome-plated element, a display screen or the dashboard glass; the camera comprises a field of view oriented towards the reflecting surface so as to indirectly capture the images of the driver's gaze.
https://worldwide.espacenet.com/publicationDetails/biblio?II=7&ND=3&adjacent=true&locale=en_EP&FT=D&date=20200409&CC=US&NR=2020110950A1&KC=A1#

GAZE DETECTION APPARATUS AND CONGESTION CONTROL METHOD THEREOF
A gaze detection apparatus of the present invention may include an infrared LED of emitting infrared light, an infrared camera of photographing eyes of a driver based on light which is reflected from the eyes of the driver by the infrared light emitted from the infrared LED, and a gaze detection unit of determining whether the driver gazes the infrared camera based on an image of the eyes photographed by the infrared camera, and at least one of the infrared LED and the infrared camera is installed on each of a plurality of vehicle-mounted devices, and operates to emit the infrared light to the driver from each vehicle-mounted device, photograph the driver within a corresponding light emission period, and detect whether the driver gazes based on photographed information, and the vehicle-mounted devices are under a congestion control so that the light emission periods of the infrared light emitted therefrom are not overlapped with each other.
https://worldwide.espacenet.com/publicationDetails/biblio?II=4&ND=3&adjacent=true&locale=en_EP&FT=D&date=20200409&CC=US&NR=2020110463A1&KC=A1#

Hi S2020, Keeping well thanks as I hope you and your family are.
I'm posting as I find so Patents not necessarily linked.
Interesting to note the change/evolution in language and terms.
Both CAT and SEE using 'attention' or 'alertness' rather than fatigue and/or distraction in this case and also we also have 'attention rays' rather than infrared etc so language is preparing for the 'mass application' imo

DRIVER ATTENTION STATE ESTIMATION
System for estimating an attention state of a subject within a scene, including: an imaging camera to capture digital images of the subject and one or more light sources configured to illuminate the subject during a period in which the digital images are captured; a processor configured to process the captured images and generate subject attention data of the subject; processor to: (i) generate a primary visual attention ray of the subject from current subject attention data; (ii) generate a distribution of visual attention rays having an origin common to the primary visual attention ray; (iii) project the visual attention rays onto a digital representation of the scene having a plurality of predefined regions of interest; (iv) determine an intersection of the projected visual attention rays with one or more of the regions of interest; and (v) based on the intersection, estimate an attention state of the subject's attention.
https://worldwide.espacenet.com/publicationDetails/biblio?II=0&ND=3&adjacent=true&locale=en_EP&FT=D&date=20200402&CC=WO&NR=2020061650A1&KC=A1#

DRIVING ASSISTANCE DEVICE, DRIVING ASSISTANCE METHOD, AND RECORDING MEDIUM
Provided is a driving assistance device comprising: a movement destination detection part which detects a mobile body movement destination direction; a gaze direction detection part which detects the gaze direction of the driver of the mobile body; and a drive mode control part which allows changing from an autonomous driving mode to a manual driving mode if an angle based on the movement destination direction and the gaze direction is within a prescribed range.
https://worldwide.espacenet.com/publicationDetails/biblio?II=3&ND=3&adjacent=true&locale=en_EP&FT=D&date=20200402&CC=WO&NR=2020066568A1&KC=A1#

Handling glare in eye tracking
Embodiments are disclosed for eye tracking systems and methods. An example eye tracking system comprises a plurality of light sources and a camera configured to capture an image of light from the light sources as reflected from an eye. The eye tracking system further comprises a logic device and a storage device storing instructions executable by the logic device to acquire frames of eye tracking data by iteratively projecting light from different combinations of light sources of the plurality of light sources and capturing an image of the eye during projection of each combination. The instructions may be further executable to select a selected combination of light sources for eye tracking based on a determination of occlusion detected in the image arising from a transparent or semi-transparent optical structure positioned between the eye and the camera and project light via the selected combination of light sources for eye tracking. The system ensures that the eye tracking is allowed to be performed without unacceptable occlusion of eye glints from glares caused by glasses.
https://worldwide.espacenet.com/publicationDetails/biblio?II=0&ND=3&adjacent=true&locale=en_EP&FT=D&date=20200327&CC=NZ&NR=724321A&KC=A#

SYSTEM AND METHOD FOR FOVEATED SIMULATION
A system includes a head mounted display (HMD), a processor, and a memory. The HMD is configured to generate sensor data indicative of a gaze vector of a user and a position of the user. The processor is configured to communicate with the HMD. The memory is coupled to the processor and stores instructions that, when executed by the processor, cause the processor to obtain data indicating the gaze vector of the user and the position of the user. The instructions also cause the processor to determine a component vector for a virtual component of a virtual reality simulator based on the position of the user and a position of the virtual component. The instructions further cause the processor to calculate an alignment value based on the gaze vector and the component vector, and adjust a simulation setting of the virtual component based on the alignment value.

[0016] The disclosed embodiments provide systems and methods for foveated simulation. Foveated simulation can be used with virtual reality applications and augmented reality applications. Foveated simulation reduces computational resources of virtual components of the virtual reality applications and the augmented reality applications outside of a gaze fixation point of a user. The gaze fixation point of the user may be determined by a gaze tracking system located within a head mounted display.

[0017] High fidelity simulation for virtual reality applications and augmented reality applications requires computation load split between simulation and rendering the visual scene (e.g., a virtual environment or an augmented environment). By reducing the computational load outside of the gaze fixation point for both simulation as well as rendering, significant computational performance gains can be attained. The additional computational resources can be used to increase the visual frame rate, reduce motion sickness, and/or improve visual quality, which increases user immersion in the virtual or augmented reality application.
https://worldwide.espacenet.com/publicationDetails/biblio?II=0&ND=4&adjacent=true&locale=en_EP&FT=D&date=20200227&CC=US&NR=2020068190A1&KC=A1#

January 15, 2018
https://www.trustedreviews.com/news/qualcomm-packing-snapdragon-tech-honda-jaguar-land-rover-vehicles-3367900

An evolving Qualcomm patent application from 2013 made all the more interesting due to SEE collaboration.

SYSTEMS AND METHODS FOR DEVICE INTERACTION BASED ON A DETECTED GAZE
Systems and methods are provided that allow a user to interact with a device using gaze detection. In the provided systems and methods, the gaze detection is initiated by detecting a triggering event. Once gaze detection has been initiated, detecting a gaze of a user may allow the user to activate a display component of the device, pass a security challenge on the device, and view content and alerts on the device. The gaze detection may continue looking for the user's gaze and keep the display component of the device activated as long as a gaze is detected, but may deactivate the display component of the device once a gaze is no longer detected. To conserve power the gaze detection may also be deactivated until another triggering event is detected.

[0015] FIG. 1 is a diagram illustrating a processing device 100, consistent with some embodiments. Processing device 100 may be a mobile device such as a smartphone such as an iPhone™ or other mobile device running the iOS™ operating system, the Android™ operating system, a BlackBerry™ operating system, the Microsoft® Windows® Phone operating system, Symbian™ OS, or webOS™. Processing device 100 may also be a tablet computer, such as an iPad™ or other tablet computer running one of the aforementioned operating systems. Processing device 100 may also be PCs or laptops or netbooks, set-top boxes (STB) such as provided by cable or satellite content providers, or video game system consoles such as the Nintendo® Wii™, the Microsoft® Xbox 360™, or the Sony® PlayStation™ 3, or other video game system consoles. According to some embodiments, processing device 100 may be implemented using any appropriate combination of hardware and/or software configured for, among other things, displaying information to a user, detecting a proximity of an object such as a user, and detecting a face and a gaze of a user. In particular, processing device 100 may include any appropriate combination of hardware and/or software having one or more processors and capable of reading instructions stored on a non-transitory machine-readable medium for execution by the one or more processors for, among other things, displaying information to a user, detecting a proximity of an object such as a user, and detecting a face and a gaze of a user. Some common forms of machine-readable media includes, for example, floppy disk, flexible disk, hard disk, magnetic tape, any other magnetic medium, CD-ROM, any other optical medium, punch cards, paper tape, any other physical medium with patterns of holes, RAM, PROM, EPROM, FLASH-EPROM, any other memory chip or cartridge, and/or any other medium from which one or more processors or computer is adapted to read.
https://tinyurl.com/tq7cpk7

SYSTEMS AND METHODS FOR INTERACTIVE IMAGE CARICATURING BY AN ELECTRONIC DEVICE
TECHNICAL FIELD
[0001] The present disclosure relates generally to electronic devices. More specifically, the present disclosure relates to systems and methods for interactive image caricaturing by an electronic device.

BACKGROUND
[0002] In the last several decades, the use of electronic devices has become common. In particular, advances in electronic technology have reduced the cost of increasingly complex and useful electronic devices. Cost reduction and consumer demand have proliferated the use of electronic devices such that they are practically ubiquitous in modern society. As the use of electronic devices has expanded, so has the demand for new and improved features of electronic devices. More specifically, electronic devices that perform new functions and/or that perform functions faster, more efficiently or with higher quality are often sought after.

[0003] Some electronic devices (e.g., cellular phones, smartphones, digital cameras, camcorders, computers, etc.) capture and edit pictures or images. For example, a smartphone may capture an image with an integrated image sensing device.

[0004] While capturing and editing pictures or images may be beneficial, such processes often are time-consuming and laborious. As can be observed from this discussion, systems and methods that add new and/or improved features of image editing may be beneficial.
https://worldwide.espacenet.com/publicationDetails/description?CC=HU&NR=E046808T2&KC=T2&FT=D&ND=3&date=20200330&DB=&locale=en_EP#

Eye Detail #64

SYSTEM AND METHOD FOR EGOCENTRIC-VISION BASED FUTURE VEHICLE LOCALIZATION
A system and method for egocentric-vision based future vehicle localization that include receiving at least one egocentric first person view image of a surrounding environment of a vehicle. The system and method also include encoding at least one past bounding box trajectory associated with at least one traffic participant that is captured within the at least one egocentric first person view image and encoding a dense optical flow of the egocentric first person view image associated with the at least one traffic participant. The system and method further include decoding at least one future bounding box associated with the at least one traffic participant based on a final hidden state of the at least one past bounding box trajectory encoding and the final hidden state of the dense optical flow encoding.

[0045] Referring again to FIG. 1, the vehicle camera system 116 may include one or more cameras 118 that are positioned at one or more areas of the surrounding environment of the vehicle 102. In an exemplary embodiment, the surrounding environment of the vehicle 102 may be defined as a predetermined area located in around (front/sides/behind) the vehicle 102 (e.g., road environment in front, sides, and/or behind of the vehicle 102) that may be included within the vehicle's travel path.

[0046] The one or more cameras 118 of the vehicle camera system 116 may be disposed at external front portions of the vehicle 102, including, but not limited to different portions of the vehicle dashboard, vehicle bumper, vehicle front lighting units, vehicle fenders, and the windshield. In one embodiment, the one or more cameras may be configured as RGB cameras that may capture RGB bands that are configured to capture rich information about object appearance, as well as relationships and interactions between the vehicle 102 and objects within the surrounding environment of the vehicle 102 which may include one or more traffic participants. The one or more cameras 118 may be configured to capture the egocentric FPV images (e.g., images, videos) of the surrounding environment of the vehicle 102 in one or more resolutions. For example, the one or more cameras 118 may be configured to capture video clips of a front facing surrounding environment of the vehicle 102 with 1920×1200 resolutions and 10 fps.
https://worldwide.espacenet.com/publicationDetails/description?CC=US&NR=2020086858A1&KC=A1&FT=D&ND=3&date=20200319&DB=&locale=en_EP#

VIDEO AND/OR IMAGE MAPPING SYSTEM
A method for capturing video and/or images for a mapping system includes, in a vehicle, wirelessly receiving a request from a remote server for videos and/or images. The request specifies a location and a heading for the videos and/or images. The method includes comparing a vehicle location and a vehicle heading to the location and heading of the request. If a match occurs, recording a video and/or an image corresponding to the location and heading and uploading the video and/or image to the remote server.

[0015]
Some passenger vehicles, such as car sharing and ride sharing vehicles, are equipped with camera modules that point inwards and outwards.

The camera modules can be used to monitor driving behavior, accidents, local traffic and / or other events. In some examples, the camera modules also include a global positioning system (GPS), an inertial sensor, and / or a cellular data module. When a vehicle collision occurs, video and / or images are uploaded to the manufacturer or another server for review. Some vehicles are also equipped with a transceiver (e.g. B. a telematics system such as OnStar®) that can communicate with a remote server and / or can provide additional telemetric information about the vehicle from a distance, such as speed, course, location, diagnostic data, mileage, fuel level, etc.
[0016]
Map creation services such as Google Maps and / or Apple Maps are based on specialized vehicles that capture video and / or images along roads or paths. The videos and / or images provide a street view at a destination. The process of capturing video and / or images is time consuming and is relatively expensive due to the number of streets. Furthermore, the videos and / or images need to be updated as the streets and their surroundings change over time.
[0031]
Vehicle 200 also includes one or more outward-facing cameras 220. In some examples, outboard cameras 220 include a GPS 222 and / or an inertial sensor 226. Vehicle 200 may also include one or more inward cameras 230. The vehicle 200 includes a display and input device 234. In some examples, display and input device 234 includes a touchscreen monitor, although other types of display and / or input devices can be used. For example, the display and input device 234 of car sharing or ride sharing applications can be used to display boarding locations, directions to the boarding locations or destinations, alternative routes that include points of interest, or other information.
http://translationportal.epo.org/emtp/translate/?ACTION=description-retrieval&COUNTRY=DE&ENGINE=google&FORMAT=docdb&KIND=A1&LOCALE=en_EP&NUMBER=102019114709&OPS=ops.epo.org/3.2&SRCLANG=de&TRGLANG=en

The parallel Patent Linkage between GM and Honda would suggest the DMS partnership/collaboration already agreed imo.

VEHICULAR MONITORING DEVICE
In this vehicular monitoring device, an imaging unit 2 captures an image of the driver of a vehicle. A driving state measurement unit 70 analyzes the image captured by the imaging unit 2 and measures a plurality of driving states including the eye opening degree of the driver. A travel state determination unit 71 determines the travel state of the vehicle. An alarm determination unit 72 uses the driving states and the travel state as a basis to determine whether to activate an alarm device 5. When a statistical amount calculated from time series data for the eye opening degree acquired from the driving state measurement unit 70 is outside of a predetermined normal determination reference range, the driving states other than the eye opening degree are normal, and the travel state is determined to be normal, the alarm determination unit 72 causes the driving state measurement unit 70 to perform eye opening degree detection processing again.
https://worldwide.espacenet.com/publicationDetails/biblio?II=3&ND=3&adjacent=true&locale=en_EP&FT=D&date=20200326&CC=WO&NR=2020059835A1&KC=A1#

https://www.bloomberg.com/news/videos/2020-04-01/china-s-handset-use-took-5-weeks-to-return-to-normal-says-qualcomm-ceo-video?linkId=85695148

Michael McCormack@M_McCormackMP

Australian truckies are working hard to deliver critical supplies across the nation during #COVID19au.
We’ve found a common sense solution to recent restrictions enabling them to continue accessing roadside food, rest stops & bathrooms to manage fatigue & get on with their jobs.
https://twitter.com/i/status/1245242392611033088

https://vimeo.com/399733860

Ford engineers work from home on Mustang Mach-E development
https://ww.electrek.co/2020/03/30/ford-engineers-work-from-home-on-mustang-mach-e-development/#aprd

[0073] Once a comprehensive impairment score has been calculated as discussed below, the comprehensive impairment score may be used to sort the insurance policy of the vehicle operator 106 into a comprehensive impairment level group with the policies of other vehicle operators with similar comprehensive impairment scores. The comprehensive impairment level groups may be set to follow a normal distribution; however, the comprehensive impairment level groups may also be set to follow any other known distribution model. There may be any number of comprehensive impairment level groups (e.g., ten comprehensive impairment level groups), and the groups may or may not be evenly distributed along the normal curve. Each of the groups may be assigned an insurance policy rate increase or decrease amount. For example, if there are ten comprehensive impairment level groups where Comprehensive Impairment Level Group 1 includes policies of vehicle operators associated that have the highest comprehensive impairment scores (indicating a high level of impairment) and Comprehensive Impairment Group 10 includes policies that have the lowest comprehensive impairment scores, then policies grouped in Comprehensive Impairment Level Groups 1-3 may be associated with an insurance rate increase (e.g., $300, $200, and $100, respectively), Comprehensive Impairment Level Groups 4-6 may not be associated with an increase or decrease, and Comprehensive Impairment Level Groups 7-10 may be associated with an insurance rate decrease (e.g., -$100, -$200, and -$300, respectively). This information on insurance rate adjustments based upon calculated risk related to vehicle operator emotional state may be conveyed to customers or prospective customers, providing an incentive for emotional state management and a disincentive for risky vehicle operation behavior.

Vehicle operator emotion management system and method
The method, system, and computer-readable medium facilitates monitoring a vehicle operator during the course of vehicle operation to determine whether the vehicle operator is in an emotionally impaired state (e.g., aggressive or agitated) and presenting appropriate stimuli (e.g., music or sound recordings) to the vehicle operator when impairment is detected. The vehicle operator, the environment surrounding the vehicle, or forces acting on the vehicle may be monitored using a variety of sensors, including optical sensors, accelerometers, or biometric sensors (e.g., skin conductivity, heart rate, or voice modulation). When the vehicle operator is determined to be in an emotionally impaired state, stimuli are selected to improve the emotional state of the vehicle operator. The selection is based on sensor data and data regarding prior responses of the vehicle operator to various stimuli. After selection, the stimuli are presented to the vehicle operator while monitoring continues.

[0034] The GPS unit 206 may use “Assisted GPS” (A-GPS), satellite GPS, or any other suitable global positioning protocol (e.g., the GLONASS system operated by the Russian government) or system that locates the position the mobile device 110 or on-board computer 114. For example, A-GPS utilizes terrestrial cell phone towers or Wi-Fi hotspots (e.g., wireless router points) to more accurately and more quickly determine location of the mobile device 110 or on-board computer 114 while satellite GPS generally are more useful in more remote regions that lack cell towers or Wi-Fi hotspots. The front and back image capture devices 218 and 222 may be built-in cameras within the mobile device 110 or on-board computer 114 or may be peripheral cameras, such as webcams, cameras installed inside the vehicle 108, cameras installed outside the vehicle 108, etc., that are communicatively coupled with the mobile device 110 or on-board computer 114. The front image capture device 218 may be oriented toward the vehicle operator 106 to observe the vehicle operator 106 as described below. The back image capture device 222 may be oriented toward the front of the vehicle 108 to observe the road, lane markings, or other objects in front of the vehicle 108. Some embodiments may have both a front image capture device 218 and a back image capture device 222, but other embodiments may have only one or the other. Further, either or both of the front image capture device 218 and back image capture device 222 may include an infrared illuminator 218i, 222i, respectively, to facilitate low light or night image capturing. Such an infrared illuminator 218i, 222i may be automatically activated when light is insufficient for image capturing.
https://worldwide.espacenet.com/publicationDetails/description?CC=US&NR=10593182B1&KC=B1&FT=D&ND=3&date=20200317&DB=&locale=en_EP#