Member Info for johnchucka

VEHICULAR INTERIOR REARVIEW MIRROR ASSEMBLY WITH DRIVER MONITORING CAMERA AND DRIVER BREATH ANALYZER

A vehicular alcohol sensing system includes an air sensing device disposed at a vehicular component disposed at an interior portion of a vehicle. The air sensing device captures sensor data representative of a sample of air at the vehicular component. A driver monitoring camera is disposed in the vehicle and captures image data representative of at least a head region of a driver of the vehicle. The vehicular alcohol sensing system, based on processing by a data processor of sensor data captured by the air sensing device and based on processing by an image processor of image data captured by the driver monitoring camera, determines an alcohol level of the driver's breath. The vehicular alcohol sensing system, responsive to determining that the alcohol level of the driver's breath is above a threshold alcohol level, prevents operation of the vehicle.

https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2024017610A1&KC=A1&FT=D&ND=3&date=20240118&DB=&locale=en_EP

https://www.freepatentsonline.com/20240017610.pdf

MULTI-PERSPECTIVE THREE-DIMENSIONAL FLOATING IMAGE DISPLAY WITH TOUCH FUNCTION

047 . In an exemplary embodiment, an orientation of each of the plurality of beam splitters 18 is fixed. Thus, when the beam splitters 18 are in the extended position 34 angular orientation vertically and horizontally relative to the support shaft 36A, 36B, 36C is fixed. Alternatively, in another exemplary embodiment, an orientation of each of the plurality of beam splitters 18 is adjustable. Referring to FIG. 4, the beam splitter 18 is pivotally mounted onto the support shaft 36 wherein the beam splitter 18 is pivotal horizontally about an axis as shown by arrow 44. Referring to FIG. 5, the beam splitter 18 is pivotally mounted onto the support shaft 36 wherein the beam splitter 18 is vertically pivotal, as indicated by arrow 46. Adjustability of the beam splitter 18 allows the beam splitter 18 to be positioned according to the position of the passenger 14 within the vehicle compartment 20, and according to the height of the passenger 14, ensuring that the system 10 can be customized to accommodate passengers of different size and seating position/orientation preferences. In addition, adjustability of the orientation of the beam splitter 18 allows the perceived location of the floating image 12 to be adjusted according to the passenger's preferences.

In an exemplary embodiment, each of the plurality of beam splitters 18 is equipped with head tracking capability, wherein an orientation of each of the plurality of beam splitters 18 changes automatically in response to movement of a head of a passenger 14. Referring to FIG. 2, the support shaft 36A is attached to a pivotal motor 48 in communication with a monitoring system 49 within the vehicle. Monitoring systems within a vehicle include cameras that monitor head and eye movement of a driver/passenger within the vehicle. A camera 50 of a driver/passenger monitoring system is mounted within the vehicle compartment 20 and adapted to monitor head and eye movement of the passenger 14. The motor 48 receives information from the camera 50 and in response to detection of head/eye movement by the passenger 14, pivots the support shaft 36A, and the beam splitter 18A, as indicated by arrow 52, to change the orientation of the beam splitter 18A, as indicated by arrow 44 in FIG. 4. Likewise, a motor may be adapted to pivotally change the orientation of the beam splitter 18, as shown in FIG. 5, wherein the motor receives information from the camera 50 of a driver/passenger monitoring system 49, and in response to detection of head/eye movement by the passenger 14, pivots the beam splitter 18, as indicated by arrow 46 in FIG. 5.

https://www.freepatentsonline.com/20230408841.pdf

https://worldwide.espacenet.com/publicationDetails/biblio?II=53&ND=3&adjacent=true&locale=en_EP&FT=D&date=20231221&CC=US&NR=2023408841A1&KC=A1

https://patents.justia.com/patent/20230408841

VEHICULAR DRIVING ASSIST SYSTEM WITH DRIVER MONITORING

A vehicular driving assist system includes (i) a forward-viewing camera disposed at a windshield of a vehicle viewing forward of the vehicle through the windshield and (ii) an in-cabin camera disposed at an interior rearview mirror assembly in an interior cabin of the vehicle and viewing at least a steering wheel of the vehicle. The forward-viewing camera and the in-cabin camera are operable to capture image data. Image data captured by the forward-viewing camera is transferred from the forward-viewing camera to an electronic control unit (ECU) and is processed at the ECU for at least one advanced driver assistance system or to determine a hazardous condition ahead of the vehicle. Processing by the vehicular driving assist system of image data captured by the in-cabin camera determines that at least one hand of a driver of the vehicle is not on the steering wheel of the vehicle

https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2023406342A1&KC=A1&FT=D&ND=3&date=20231221&DB=&locale=en_EP

https://www.freepatentsonline.com/20230406342.pdf

IN-VEHICLE MULTIMODAL VIOLENCE DETECTION FOR SHARED VEHICLES AND SELF-DRIVING SHUTTLES

An in-vehicle violence detection system includes a speech and non-speech audio recognition module capturing occupant threat words and non-speech audio events. In-vehicle accelerometers generate data analyzed in a shaking movement recognition module. A heart rate and breathing rate detection module measures physiological changes in occupant heart rates and breathing rhythms. An in-vehicle semantic scene recognition module analyzes occupant non-verbal interactions. Occupant threat indicators including an audible threat indicator are generated by the speech and non-speech audio event recognition module. Visual threat indicators are generated by the in-vehicle semantic scene recognition module. Physiological threat indicators are generated by the heart rate and breathing rate detection module. Vibration-based threat indicators are generated by the shaking movement recognition module. The four threat indicators are fused to estimate a threat level, consolidated by incorporating contextual information including a vehicle location and time. Different actions are taken based on the consolidated threat level.

The speech and audio event recognition module 16 analyzes patterns, volume, and the like of the detected occupant speech and generates audio-based threat indicators 30. The shaking motion movement module 20 analyzes acceleration, amplitudes and directions of occupant motions and generates vibration-based threat indicators 32. The in-vehicle semantic scene recognition module 24 analyzes differences in occupant positions or occupant head or limb positions over time as a changing semantic scene and generates vision-based threat indicators 34. The heart rate and breathing rate detection module 28 analyzes data generated by the in-vehicle radar devices 26 whose outputs are used to generate occupant physiological-based threat indicators 36.

https://www.freepatentsonline.com/20230391344.pdf

https://patents.justia.com/patent/20230391344

https://worldwide.espacenet.com/publicationDetails/biblio?II=5&ND=3&adjacent=true&locale=en_EP&FT=D&date=20231207&CC=US&NR=2023391344A1&KC=A1

METHOD FOR COMBATING DROWSINESS OF A DRIVER OF A MOTOR VEHICLE AND ELECTRONIC COMPUTING DEVICE

Technologies and techniques for combating drowsiness of a driver of a motor vehicle. A calculation rule is used in which a fatigue progression curve, that represents a fatigue development of the driver over time, can be generated based on a parameter set, and specific values for the parameter set are determined for a route ahead. The fatigue progression curve for the route ahead may be determined via the calculation rule using the determined values for the parameter set, and the fatigue progression curve is analyzed. A countermeasure may be initiated depending on a result of the analysis, in which countermeasure at least one value of a variable parameter of the parameter set is specifically changed.

[0028]

In the first method, the driver's current tiredness is estimated.

For this purpose, the control unit arranged in the motor vehicle receives a variety of information via a sensor system in the motor vehicle.

The control device can, for example, be part of an infotainment system and/or a central computer of the motor vehicle.

The control unit can receive data from steering wheel operation as information in order to understand steering behavior.

Alternatively or additionally, the control unit can receive data from an interior camera about detected eyes of the driver, including the degree of opening of the eyes, via the sensors.

Alternatively or additionally, the control unit can receive data about the use of the gas and/or brake pedal.

Furthermore, the control device can receive data from driver assistance systems of the motor vehicle in the form of statistics about driving maneuvers that are detected as critical, such as tailgating or lane departure.

Alternatively or additionally, the control unit can receive data about the driver, such as height, weight and/or driving experience.

Alternatively or additionally, the control unit may receive data from an oxygen or carbon dioxide sensor as part of the air conditioning system.

The data can be processed by the control unit as singular values and/or as values over time.

https://translationportal.epo.org/emtp/translate/?ACTION=description-retrieval&COUNTRY=EP&ENGINE=google&FORMAT=docdb&KIND=A2&LOCALE=en_EP&NUMBER=4287153&OPS=ops.epo.org/3.2&SRCLANG=de&TRGLANG=en

https://www.freepatentsonline.com/20230391284.pdf

VISION MODULE FOR MONITORING A DRIVER OF A VEHICLE AND METHOD FOR MANUFACTURING A VISION MODULE FOR MONITORING A DRIVER OF A VEHICLE

A vision module (1) for monitoring a driver (5) of a vehicle (2) and a method for manufacturing a vision module (1) for monitoring a driver (5) of a vehicle (2). The vision module (1) has at least a camera sub-assembly (10) positioned inside an outer housing (7). The outer housing (7) is defined by a housing cover (8) and a housing base (9). A housing part (20) for the camera sub-assembly (10) has a spherical outer topology (21). A mounting structure (30) is in cooperation with the spherical outer topology (21) of the camera sub-assembly (10) for setting a spatial angular orientation of the camera sub-assembly (10). A receptacle (16) of the housing base (9) receives the mounting structure (30). The housing cover (8) is mounted to the housing base (9) and holds the mounting structure (30) in a defined position in the outer housing (7).

https://worldwide.espacenet.com/publicationDetails/biblio?II=0&ND=3&adjacent=true&locale=en_EP&FT=D&date=20231207&CC=US&NR=2023396862A1&KC=A1

https://www.freepatentsonline.com/20230396862.pdf

Autonomous vehicle mode during unsafe driving conditions

A system and method for automatically engaging an autonomous driving mode in a vehicle is disclosed. The method includes monitoring a driver and switching to the autonomous driving mode if an unsafe driving condition is detected. The method can include monitoring biometric data. The method can also include monitoring behavioral data using one or more kinds of vehicle sensors. The system and method ensure a vehicle is safely driven even if a driver experiences a health episode that could leave them unable to safely operate the vehicle.

https://worldwide.espacenet.com/publicationDetails/description?CC=US&NR=11809184B1&KC=B1&FT=D&ND=3&date=20231107&DB=&locale=en_EP

https://www.freepatentsonline.com/11809184.pdf

VEHICULAR DRIVER MONITORING SYSTEM WITH ALERT TO OTHER VEHICLES

A vehicular driver monitoring system includes a camera disposed at an interior cabin of a vehicle. Electronic circuitry of an ECU includes an image processor for processing image data captured by the camera. The camera views at least a head region of a driver of the vehicle and is operable to capture image data. Based on processing at the ECU of the captured image data, the vehicular driver monitoring system determines an attentiveness level of the driver. Responsive to determination that the attentiveness level of the driver is below a threshold level of attentiveness, the vehicular driver monitoring system alerts a person exterior the vehicle of the determined inattentive driver.

https://worldwide.espacenet.com/publicationDetails/biblio?II=2&ND=3&adjacent=true&locale=en_EP&FT=D&date=20231116&CC=US&NR=2023368548A1&KC=A1

https://www.freepatentsonline.com/20230368548.pdf

USING GESTURES TO CONTROL MACHINES FOR AUTONOMOUS SYSTEMS AND APPLICATIONS

Approaches for an advanced AI-assisted vehicle can utilize an extensive suite of sensors inside and outside the vehicle, providing information to a computing platform running one or more neural networks. The neural networks can perform functions such as facial recognition, eye tracking, gesture recognition, head position, and gaze tracking to monitor the condition and safety of the driver and passengers. The system also identifies and tracks body pose and signals of people inside and outside the vehicle to understand their intent and actions. The system can track driver gaze to identify objects the driver might not see, such as cross-traffic and approaching cyclists. The system can provide notification of potential hazards, advice, and warnings. The system can also take corrective action, which may include controlling one or more vehicle subsystems, or when necessary, autonomously controlling the entire vehicle. The system can work with vehicle systems for enhanced analytics and recommendations.

https://worldwide.espacenet.com/publicationDetails/biblio?II=1&ND=3&adjacent=true&locale=en_EP&FT=D&date=20231109&CC=US&NR=2023356728A1&KC=A1

https://www.freepatentsonline.com/20230356728.pdf

INFORMATION PROCESSING DEVICE, INFORMATION PROCESSING SYSTEM, AND INFORMATION PROCESSING METHOD

An acquisition unit acquires vehicle information and a moving image frame as image information captured by an imaging unit from a database. A recognition unit recognizes opening and closing of an eye of a driver, a direction of a face, and a gaze point. An extraction unit extracts, from among the captured images acquired by the acquisition unit, a captured image in which the eye is closed and the face is facing forward in a predetermined range.

https://worldwide.espacenet.com/publicationDetails/biblio?II=0&ND=3&adjacent=true&locale=en_EP&FT=D&date=20231109&CC=US&NR=2023356720A1&KC=A1

https://www.freepatentsonline.com/20230356720.pdf

SYSTEMS AND METHODS FOR DRIVER STATE CONDITIONED VISUAL SIGNALS

Systems and methods for use of operator state conditions to generate, adapt or otherwise produce visual signals relaying information to the operator are disclosed. A monitoring system may observe and analyze a vehicle operator to determine an operator state. The monitoring system may transmit the observed driver state to an operator alert system that generates, conditions and controls the transmission of signals to the operator.

https://worldwide.espacenet.com/publicationDetails/biblio?II=0&ND=3&adjacent=true&locale=en_EP&FT=D&date=20231109&CC=US&NR=2023356736A1&KC=A1

https://www.freepatentsonline.com/20230356736.pdf

VEHICULAR CONTROL SYSTEM THAT LIMITS DRIVER DISTRACTIONS WHILE THE VEHICLE IS MOVING

A vehicular control system includes an electronic control unit (ECU) disposed at a vehicle. The ECU includes electronic circuitry and associated software. The electronic circuitry of the ECU is operable to receive transmissions and to transmit signals. The vehicular control system, responsive to receiving at the ECU at least one transmission indicative of one or more mobile devices at an interior cabin of the vehicle, determines location of the one or more mobile devices at the interior cabin of the vehicle. Responsive to determination that a determined mobile device is located at a driver seat region of the interior cabin of the vehicle, and responsive to determination that the vehicle is moving at a speed above a threshold speed, the vehicular control system transmits a blocking signal to at least partially disable operation of the determined mobile device located at the driver seat region of the interior cabin.

https://worldwide.espacenet.com/publicationDetails/biblio?II=3&ND=3&adjacent=true&locale=en_EP&FT=D&date=20231102&CC=US&NR=2023353670A1&KC=A1

https://www.freepatentsonline.com/20230353670.pdf

DRIVING SKILL ESTIMATION DEVICE

A driving skill estimation device includes a gaze direction detection unit and a driving skill estimation unit. The gaze direction detection unit is configured to detect a gaze direction of a driver who drives a vehicle. The driving skill estimation unit is configured to estimate driving skill of the driver based on a vertical change in the gaze direction detected by the gaze direction detection unit.

https://worldwide.espacenet.com/publicationDetails/biblio?II=4&ND=3&adjacent=true&locale=en_EP&FT=D&date=20231102&CC=US&NR=2023351777A1&KC=A1

https://www.freepatentsonline.com/20230351777.pdf

Method for Operating an Assistance System of an at Least Temporarily Autonomously Operable Vehicle

An assistance system influences an asleep and/or awake state of a vehicle occupant to at least temporarily take over a vehicle guidance function by detecting the asleep and/or awake state of the vehicle occupant using a detection device to generate takeover capability information, detecting, receiving, and/or generating destination arrival information, at least temporarily influencing the asleep and/or awake state of the vehicle occupant by an influencing device, such that there is a defined minimum takeover capability of the vehicle occupant to take over a vehicle guidance function for the vehicle occupant for at least a portion of the journey and/or travel time at least over a portion of the journey and/or travel time.

https://worldwide.espacenet.com/publicationDetails/biblio?II=5&ND=3&adjacent=true&locale=en_EP&FT=D&date=20231026&CC=US&NR=2023339518A1&KC=A1

https://www.freepatentsonline.com/20230339518.pdf

In-Vehicle Occupant Monitoring and Calming System

This document describes one or more aspects of an in-vehicle occupant monitoring and calming system. In one example, the system includes a processor that receives occupant data from occupancy-monitoring sensors (e.g., microphones, cameras, radar sensors, ultrasonic sensors) of a vehicle. Based on the occupant data, the processor can determine whether the occupant is distressed and provide an image or video of the occupant to the driver. The processor can also display driver-selectable options to calm the distressed occupant. The options can include playing an audio or video file for the occupant, adjusting the ambient lighting of the vehicle, or rocking or gently vibrating the occupant's seat. In this way, the described system can monitor vehicle occupants and automatically display a video of the distressed occupant to the driver. In addition, the driver can calm the distressed occupant without removing their attention from driving.

https://worldwide.espacenet.com/publicationDetails/biblio?II=3&ND=3&adjacent=true&locale=en_EP&FT=D&date=20231026&CC=US&NR=2023339366A1&KC=A1

https://www.freepatentsonline.com/20230339366.pdf

VISUAL SEARCH IN REAL WORLD USING OPTICAL SEE-THROUGH HEAD MOUNTED DISPLAY WITH AUGMENTED REALITY AND USER INTERACTION TRACKING

Techniques can conduct online visual searches through an augmented reality (AR) device having an optical see-through head mounted display (HMD). An apparatus identifies a portion of an object in a field of view of the HMD based on user interaction with the HMD. The portion includes searchable content, such as a barcode. The user interaction may be an eye gaze or a gesture. A user interaction point in relation to the HMD screen is tracked to locate a region of the object that includes the portion and the portion is detected within the region. The apparatus captures an image of the portion. The identified portion of the object does not encompass the entirety of the object. Accordingly, the size of the image is less than the size of the object in the field of view. The apparatus transmits the image to a visual search engine.

https://worldwide.espacenet.com/publicationDetails/biblio?II=10&ND=3&adjacent=true&locale=en_EP&FT=D&date=20231026&CC=US&NR=2023342388A1&KC=A1

https://www.freepatentsonline.com/20230342388.pdf

VEHICULAR DRIVER MONITORING SYSTEM WITH CUSTOMIZED OUTPUTS

A vehicular driver monitoring system includes an electronic control unit (ECU) disposed at a vehicle and a driver monitoring camera viewing a head of a driver present in the vehicle. Via processing at the ECU of image data captured by the driver monitoring camera and provided to the ECU, at least one selected from the group consisting of (i) driver drowsiness is detected and (ii) driver attention is detected. Responsive to detection of driver drowsiness and/or detection of driver attention, the vehicular driver monitoring system may generate an output. The output generated by the vehicular driver monitoring system may include an output selected from the group consisting of (i) a visual output viewable by the driver of the vehicle, (ii) an audible output generated by an audio device in the vehicle and (iii) a haptic output generated by a haptic device in contact with the driver of the vehicle.

https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2023334879A1&KC=A1&FT=D&ND=3&date=20231019&DB=&locale=en_EP

https://www.freepatentsonline.com/20230334879.pdf

METHOD, DEVICE, AND SYSTEM OF MEASURING EYE CONVERGENCE ANGLE

An electronic device capable of determining an eye convergence angle using a magnetometer sensor is provided. The magnetometer sensor is capable of reporting angle readings in three dimensions that is aligned with an eye gaze direction of each eye of a user. The magnetometer which is incorporated into the device can fit into a human eye like a contact lens and determine the angle of the gaze direction of both eyes with respect to an object within a field of view. By obtaining this eye convergence angle for an object, it is possible to accurately detect depth information. The electronic device also functions as a digital contact lens that can automatically adjust the focal point of the object to provide the user with a clear vision. The electronic device also includes a display that provides the user with additional information about the object.

https://worldwide.espacenet.com/publicationDetails/biblio?II=2&ND=3&adjacent=true&locale=en_EP&FT=D&date=20231019&CC=US&NR=2023333648A1&KC=A1

https://www.freepatentsonline.com/20230333648.pdf

Shown below is global light vehicle production from 2004-2028, using Philip Koopman's Vehicle Operational Modes. I'm a big fan of Koopman's taxonomy as an alternative to SAE #J3016 as it removes the uncertainty of the machine-to-human #handover. Simply put, who is liable when someone dies? Alex Roy from Johnson & Roy describes "Roy's Razor" as an unambiguous test of "Can I fall asleep in the back of the vehicle?" [caveat: without anyone dying]

The conclusion using Koopman's definitions and Roy's Razor is that there is no trend to #autonomous operation in privately-owned passenger vehicles. Yes, including Tesla. The word salad Mercedes-Benz AG dishes up when asked about #DrivePilot #liability merely reinforces the key issue: When someone dies with an unsupervised system in operation, the legal consequences will inevitably fall on the person in the driver's seat. These systems will generate lots of headlines then.

We've seen supervised automation systems like General Motors #SuperCruise and Ford Motor Company #BlueCruise for a couple of years. Yes there is a trend, but that's hard to avoid when coming from zero. There's unbelievable amounts of PR about these systems as #OEMs manipulate J3016 to play "Level Wars," as evidenced by Mercedes.

But there are underlying questions: Do consumers even want these systems? Are they willing to pay a monthly subscription for them? The diffusion of innovations theory suggests innovators will, and probably early adopters too. But the majority? No one knows.

Koopman's taxonomy also includes #driverassistance. That's systems like automatic emergency braking #AEB and lane keeping #LKAS. Think of this as short duration (1-3s) longitudinal or lateral assistance. No one talks about these systems because the PR hype is elsewhere. But driver assistance is where the global #regulatory efforts for road #safety are focused. This is where Euro #NCAP, Global NCAP and EU #GSR come in. Hence this is where the volume lies.

Information in the public domain suggests Valeo has an early #innovation lead. Its Smart Safety 360 combines interior and exterior #vision with #radar and #ultrasonic sensing. Magna International may be working on a similar solution, as it swallows Veoneer's entire active safety business, and has known partnerships with Mobileye and Seeing Machines.

#Autonomous operation replaces humans as drivers, while driver assistance makes human drivers safer. But as a #convenience feature, supervised automation achieves neither. Success for suppliers rests on those which read the regulatory winds and focus their product development plans accordingly. #Automakers, tier-1s and #semiconductor and #component suppliers must choose their driver assistance and #driver #monitoring #roadmaps extremely carefully.

https://www.linkedin.com/feed/update/urn:li:activity:7119634310084587520/

General Motors keeps coming for Apple. This is part of the move away from #CarPlay. Which #silicon provider is going to win from this effort? That'll be Qualcomm.

https://news.gm.com/newsroom.detail.html/Pages/news/us/en/2023/oct/1012-software.html