Member Info for johnchucka

COGNITIVE TUNNELING MITIGATION DEVICE FOR DRIVING
A driver monitor method and system for mitigating cognitive tunneling in a vehicle includes in-cabin video cameras, a heart rate monitor, an audio-visual device, and processing circuitry that detects eye gaze direction, eye lid position, and head position using images from the in-cabin video cameras, and measures heart rate variability using the heart rate monitor. A machine learning device uses the eye gaze direction, eye lid position, head position, and heart rate variability to predict whether a driver is transitioning into a cognitive tunneling state or a fatigue state. The audio-visual device outputs one audio-visual cue to mitigate the cognitive tunneling state and outputs a different cue to mitigate the fatigue state. The machine learning device learns by performing a reinforcement learning algorithm in which the audio-video device outputs a verification request and receives a response to the verification request that is fed back to the machine learning device.
https://worldwide.espacenet.com/publicationDetails/biblio?II=0&ND=3&adjacent=true&locale=en_EP&FT=D&date=20220421&CC=US&NR=2022118985A1&KC=A1
https://www.freepatentsonline.com/20220118985.pdf

MULTIPLE IN-CABIN CAMERAS AND LIGHTING SOURCES FOR DRIVER MONITORING
A control system, computer-readable storage medium and method of preventing occlusion of and minimizing shadows on the driver's face for driver monitoring. The system includes a steering wheel, a plurality of fiberscopes arranged evenly spaced around the steering wheel, and one or more video cameras arranged at remote ends of the plurality of fiberscopes. Distal ends of the fiberscopes emerge to a surface of the steering wheel through holes that are perpendicular to an axis of rotation of the steering wheel. Each of the distal ends of the fiberscopes includes a lens. The system includes a plurality of light sources and an electronic control unit connected to the one or more video cameras and the light sources.
https://worldwide.espacenet.com/publicationDetails/biblio?II=0&ND=3&adjacent=true&locale=en_EP&FT=D&date=20220421&CC=US&NR=2022121866A1&KC=A1
https://www.freepatentsonline.com/20220121866.pdf
https://uspto.report/patent/app/20220121866#:~:text=MULTIPLE%20IN-CABIN

METHOD FOR CONTROLLING AUTOMOBILE AND AUTOMOBILE SYSTEM
A system and method control an automobile by decelerating the automobile at a first deceleration using a braking mechanism in response to detecting that a parking brake switch is turned on, a second deceleration which is smaller than the first deceleration, in response to not detecting that the parking brake switch is turned on and determining that the driver is incapacitated, and a third deceleration which is smaller than the first deceleration, in response to determining that an SOS switch is turned on, detecting that the parking brake switch is changed from on to off, and not determining that the driver is incapacitated.

[0023] In addition, the driver incapacitation determination step according to the first aspect may include a driver eye opening degree measurement step of measuring an eye opening degree of the driver, and a driver consciousness determination step of determining that the driver is incapacitated when a ratio of an eye opening time within a certain period of time is less than a predetermined ratio based on the eye opening degree measured in the driver eye opening degree measurement step.
https://www.freepatentsonline.com/20220105908.pdf
https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2022105908A1&KC=A1&FT=D&ND=3&date=20220407&DB=&locale=en_EP

METHOD FOR ACTIVATING SAFETY FEATURES UPON DETECTION OF DRIVER IMPAIRMENT
A system that can detect a driver's condition and as a result, activates one or more of the manually disabled safety features and substantially reduces chances of an accident. Additional actions to alert the driver can occur including, but not limited to, vibration of seats, pedals, and steering wheel, pumping the brakes, blasting the radio could occur. A method includes detecting driver condition of a driver, enabling one or more vehicle safety features of a vehicle and overriding disabled one or more vehicle safety features if: driver impairment is detected while detecting driver condition, and vehicle safety features have been disabled by the driver or a passenger.

FIG. 1 illustrates an example vehicle which includes one or more safety features, such as, but not limited to, airbags, antilock brakes, traction control, electronic stability control, accident avoidance systems, tire pressure monitors, lane keep assist, or emergency braking. As shown in FIG. 1, the driver or passenger can disable one or more of the safety features.

The system includes a detection device to detect the condition of a driver. In one or more embodiments, the detection device includes camera and/or driver-facing dashboard camera. In a further embodiment, the detection device includes computer vision. Computer vision techniques include, but are not limited to, eye tracking, face recognition and tracking, blink rate detection, and eye openness detection. The detection device detects whether the driver is impaired, for example drowsy, dizzy, or falling asleep, for example as shown in FIG. 2. Upon detection of impairment of the driver, the system can re-enable the safety features for the driver.
https://patents.justia.com/patent/20220105952
https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2022105952A1&KC=A1&FT=D&ND=3&date=20220407&DB=&locale=en_EP
https://www.freepatentsonline.com/20220105952.pdf

System and method for providing infrared interior lighting for an airplane video surveillance system
FIG. 1 illustrates a block diagram of a system 100 that includes a computing apparatus 102 that controls a lighting system 150 to illuminate an interior of a cabin 122 for an airplane video surveillance system (VSS) 120 that includes a VSS camera 121. While the computing apparatus 102, lighting system 150, and VSS 120 are all shown within the cabin 122, aspects of the present disclosure enable one or more components of the computing apparatus 102 and VSS 120 to be located outside of the cabin 122 in a different location of the airplane or on a remote server (e.g. a cloud-based server). In some configurations, the VSS camera 121 is coupled to the cabin lighting controller 116, which detects when the VSS camera 121 needs a particular amount of illumination and controls the IR illumination level according to the needs of the VSS camera 121.

NUI (natural user interface ) technology enables a user to interact with the computing apparatus 102 in a natural manner, free from artificial constraints imposed by input devices such as mice, keyboards, remote controls and the like. Examples of NUI technology that are provided in some examples include but are not limited to those relying on voice and/or speech recognition, touch and/or stylus recognition (touch sensitive displays), gesture recognition both on screen and adjacent to the screen, air gestures, head and eye tracking, voice and speech, vision, touch, gestures, and machine intelligence. Other examples of NUI technology that are used in some examples include intention and goal understanding systems, motion gesture detection systems using depth cameras (such as stereoscopic camera systems, IR camera systems, red green blue (RGB) camera systems and combinations of these), motion gesture detection using accelerometers/gyroscopes, facial recognition, three dimensional (3D) displays, head, eye and gaze tracking, immersive augmented reality and virtual reality systems and technologies for sensing brain activity using electric field sensing electrodes (electro encephalogram (EEG) and related methods).
https://www.freepatentsonline.com/20200107419.pdf
https://patents.justia.com/patent/11297700

SALIENCY BASED CAPTURE OR IMAGE PROCESSING
A device for image capture comprises a memory and one or more processors coupled to the memory and configured to: receive, during a preview mode or a recording, a first image, generate a first saliency map indicative of relative saliency of different regions within the first image, wherein the relative saliency of the different regions is indicative of a likelihood of attracting viewer gaze, generate one or more additional images based on manipulating pixels in the first image, generate one or more additional saliency maps indicative of relative saliency of different regions within the one or more additional images, and determine, during the preview mode or the recording, a camera setting based on the first saliency map and the one or more additional saliency maps.
https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2022100054A1&KC=A1&FT=D&ND=3&date=20220331&DB=&locale=en_EP
https://www.freepatentsonline.com/20220100054.pdf

TLS,
Perhaps Ford have hired Yuval Noah Harari ;)

Chassis Input Intention Prediction Via Brain Machine Interface And Driver Monitoring Sensor Fusion
A sensor-fusion approach of using Brain Machine Interface (BMI) to gain a higher resolution perspective of chassis input control is described according to the present disclosure. Traditional chassis control inputs, such as steering wheel, brake and driver state monitoring sensors can calculate input but often cannot well predict intent. By interpreting well known motor command signals, it can become clear how much chassis input the driver was intending to provide. The BMI may monitor motor cortex to identity when a muscular movement is imminent, such as the movement of the arms to grasp the steering wheel. This combination would enable faster and more precise intent calculation. Additionally, information from driver wearable devices may be used to supplement the determination. This allows for a faster response and well as better integration with the driver.
https://worldwide.espacenet.com/publicationDetails/biblio?II=0&ND=4&adjacent=true&locale=en_EP&FT=D&date=20220303&CC=US&NR=2022063631A1&KC=A1
https://www.freepatentsonline.com/20220063631.pdf

LANE CHANGE MANEUVER INTENTION DETECTION SYSTEMS AND METHODS
In various embodiments, methods, systems, and vehicles are provided controlling a vehicle. In an exemplary embodiment, a method includes: monitoring an eye gaze of a driver of the vehicle; monitoring current traffic conditions surrounding the vehicle; predicting an intention of the driver to perform a lane change maneuver based on the eye gaze, a history of the eye gaze of the driver, and the current traffic conditions; and controlling, by the processor, the vehicle based on the predicted intention of the driver to perform a lane change maneuver.
https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2022089163A1&KC=A1&FT=D&ND=3&date=20220324&DB=&locale=en_EP
https://www.freepatentsonline.com/20220089163.pdf
https://patents.justia.com/patent/20220089163

SYSTEM AND METHOD FOR PROVIDING A DESIRED VIEW FOR A VEHICLE OCCUPANT
A system, method and computer program product for providing a desired camera view of interest for a vehicle occupant. The method includes obtaining, by the least a first interior view camera, at least a first interior view of the face and/or the head of the vehicle occupant determining, based on the at least first interior view, at least any of a gaze direction and a head direction of the vehicle occupant for understanding where the vehicle occupant is looking, determining, that the view of interest for the vehicle occupant is, at least partly, within the at least first exterior view of the at least first exterior view camera, and displaying the at least first exterior view to the vehicle occupant via the at least first display.
https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2022080890A1&KC=A1&FT=D&ND=3&date=20220317&DB=&locale=en_EP
https://www.freepatentsonline.com/20220080890.pdf

VEHICLE CONTROL SYSTEM
Aspects of the present disclosure relate to a control system, system and method for controlling a transition between a first driving mode and a second driving mode of a vehicle. The present disclosure relates to receiving image data of an occupant of the vehicle; quantifying one or more characteristics of the occupant's gaze based at least in part on the received image data, the one or more characteristics being indicative of the occupant's attention to a non-driving task; determining a transition profile for transitioning between the first driving mode and the second driving mode based at least in part on the one or more characteristics of the occupant's gaze; and generating and outputting a control signal to transition from the first driving mode to the second driving mode, the control signal comprising instructions for controlling one or more vehicle systems in accordance with the determined transition profile.
https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2022058408A1&KC=A1&FT=D&ND=3&date=20220224&DB=&locale=en_EP
https://www.freepatentsonline.com/20220058408.pdf

SYSTEMS AND METHODS FOR INFORMATION AGGREGATION AND EVENT MANAGEMENT IN A VEHICLE
System, methods, and other embodiments described herein relate to improving event management in a vehicle by aggregating information sources. In one embodiment, a method includes selecting unfiltered events, from a stream of events that are classified and filtered, and a display medium according to a decision policy associated with an operator. The method also includes communicating the unfiltered events selected for the display medium. The method also includes adapting the decision policy according to collected tracking information of operator attention associated with the unfiltered events and reward values associated with the tracking information.
https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2022032938A1&KC=A1&FT=D&ND=3&date=20220203&DB=&locale=en_EP
https://www.freepatentsonline.com/20220032938.pdf

Musk tweeting about Reiner Fuellmich Grand Jury would be interesting.

https://paine.tv/listen-are-moderna-and-pfizer-the-next-enrons-former-blackrock-hedge-fund-guru-edward-dowd-paints-grim-picture-for-big-pharmas-vax-kings-while-big-insurance-appears-prepped-to-go-to-war-with/

https://twitter.com/DowdEdward

https:// paine.tv/listen-are-moderna-and-pfizer-the-next-enrons-former-blackrock-hedge-fund-guru-edward-dowd-paints-grim-picture-for-big-pharmas-vax-kings-while-big-insurance-appears-prepped-to-go-to-war-with/

https://twitter.com/DowdEdward

INSURANCE FEE SETTING SYSTEM
An insurance fee setting system includes: a driving analysis server that is connected to a rear distance sensor, which is attached to a second vehicle, by a communication line, and that analyzes a driving state of a driver of a first vehicle that is a contract vehicle of an automobile insurance, based on detected data of the rear distance sensor; and an insurance fee setting server that sets an insurance fee of the automobile insurance in which the driver is under contract, based on the driving state of the driver input from the driving analysis server.
https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2022028007A1&KC=A1&FT=D&ND=3&date=20220127&DB=&locale=en_EP
https://www.freepatentsonline.com/20220028007.pdf

TECHNIQUES FOR UTILIZING A MOBILE DEVICE AS A PROXY FOR A VEHICLE
Techniques described herein include utilizing a mobile device as a proxy receiver for a vehicle such that a driver of the vehicle can be presented driving assistance information based on messages received by the mobile device. The mobile device can determine that it is temporally located with the vehicle. If so, the mobile device can be configured to receive messages from other entities (e.g., vehicles, roadside units, traffic signals, and the like) in a vehicle-to-everything network. On reception, the mobile device may determine whether a received data message is relevant to the vehicle. In response to determining that the data message is, in fact, relevant to the vehicle, the mobile device may provide driving assistance information that is generated based at least in part on the information provided in the received data message.
https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2022028264A1&KC=A1&FT=D&ND=3&date=20220127&DB=&locale=en_EP
https://www.freepatentsonline.com/20220028264.pdf

VEHICULAR CONTROL SYSTEM WITH HANDOVER PROCEDURE FOR DRIVER OF CONTROLLED VEHICLE
A vehicular control system includes at least one processor that processes image data captured by a forward viewing camera and radar data captured by a forward sensing radar sensor. With the system controlling driving of the vehicle, the system determines a triggering event that requires driving of the vehicle to be handed over to a driver of the vehicle before the vehicle encounters an event point, and the system (i) determines a total action time until the vehicle encounters the event, (ii) estimates a driver take over time for the driver to take over control and (iii) estimates a handling time for the driver to control the vehicle to avoid encountering the event point. Based on the determined and estimated times, the system (i) requests the driver take over control of the vehicle or (ii) controls the vehicle to slow down and stop the vehicle before the event point.

[0033] In accordance with an aspect of the system of the present invention, a vehicle with automated driving feature SAE Level 3 may have a subsystem to detect the driver's ability to take over, and is capable to do an estimation of the time it will take the driver to take over control of the vehicle (estimated driver recovery time EDRT), see FIGS. 2, 3 and 4. The system may have in-cabin sensors and optionally the sensing information of smartphones and optionally the sensors of wearables or implants of the driver to monitor whether the driver is attentively driving or which non driving related activities he or she is doing or how far he or she is distracted and optionally which health condition system he or she is in. The estimated hand over time may be picked out of a look up table of previous mass screening results of the typical time the specific non driving activity is taking. Upon the underrun of one or more specific or combined health or distraction parameters, the system may assume the driver is unable to take over (or recover) the vehicle (see case in FIG. 2).

[0048] The system may utilize aspects of head and face direction and position tracking systems and/or eye tracking systems and/or gesture recognition systems (such as to determine the driver attentiveness or the like). Such head and face direction and/or position tracking systems and/or eye tracking systems and/or gesture recognition systems 5may utilize aspects of the systems described in U.S. Publication Nos. US-2016-0137126; US-2015-0352953; US-2015-0296135; US-2015-0294169; US-2015-0232030; US-2015-0022664; US-2015-0015710; US-2015-0009010 and/or US-2014-0336878, which are hereby incorporated herein by reference in their entireties.
https://worldwide.espacenet.com/publicationDetails/description?CC=US&NR=2022026904A1&KC=A1&FT=D&ND=3&date=20220127&DB=&locale=en_EP
https://www.freepatentsonline.com/20220026904.pdf

ELECTRONIC DEVICE, INFORMATION PROCESSOR, ESTIMATION METHOD, AND ESTIMATION PROGRAM
An electronic device 10 comprises an imaging unit 11, a line-of-sight detecting unit 12, and a control unit 14. The imaging unit 11 generates an image corresponding to a scene by imaging. The line-of-sight detecting unit detects the line of sight of a subject relative to the scene. The control unit 14 functions as a first estimating unit 15 and a second estimating unit 16. The first estimating unit 15 can estimate a line-of-sight prediction map on the basis of the image. The second estimating unit 16 can estimate biological information relating to the awakening degree of the subject on the basis of the line-of-sight prediction map and the line of sight of the subject.

0008]
The estimation program from the fourth aspect is based on the computer, an imaging unit that generates an image corresponding to the scene by imaging, a line-of-sight detection unit that detects the target person's line of sight to the scene, and the image and the line of sight. It functions as a control unit that estimates the arousal level of the target person, and the control unit is constructed from learning data in which the relationship between the learning image and the line of sight of the learning target person with respect to the learning image is machine-learned. A first estimation unit capable of estimating a line-of-sight prediction map showing the probability of the line-of-sight at each position constituting the image based on the image, and the first estimation unit estimated based on the learning image. The relationship between the learning gaze prediction map, the gaze of the learning subject with respect to the learning image, and the biological information regarding the arousal degree of the learning subject is constructed by the learning data obtained by machine learning, and the gaze prediction map is used. It functions as a second estimation unit capable of estimating biological information regarding the degree of arousal of the subject based on the line of sight of the subject.
https://worldwide.espacenet.com/publicationDetails/biblio?CC=WO&NR=2022014353A1&KC=A1&FT=D&ND=3&date=20220120&DB=&locale=en_EP

GAZE DETECTION USING ONE OR MORE NEURAL NETWORKS
Apparatuses, systems, and techniques are described to determine locations of objects using images including digital representations of those objects. In at least one embodiment, a gaze of one or more occupants of a vehicle is determined independently of a location of one or more sensors used to detect those occupants.
https://worldwide.espacenet.com/publicationDetails/description?CC=US&NR=2022026987A1&KC=A1&FT=D&ND=3&date=20220127&DB=&locale=en_EP
https://www.freepatentsonline.com/20220026987.pdf