Member Info for johnchucka

METHOD AND APPARATUS FOR PREVENTION OF UNINTENDED LANE CHANGE MANEUVER IN AN ASSISTED DRIVING SYSTEM
The present application relates to a method and apparatus for prevention of unintended lane change maneuver in an ADAS equipped motor vehicle performed by a sensor for detecting a driver engagement level, a memory operative to store the driver engagement level, a user interface for providing a user alert in response to an alert signal, a selector operative to generate a request for a lane change operation, and a processor operative to receive the request for the lane change operation, to compare the driver engagement level to a threshold engagement level, and to generate the alert signal in response to the driver engagement level being less than the threshold engagement level.

To avoid accidental lane changes, the proposed system and method of the current disclosure teach a methodology to determine a dynamically calculated driver engagement score in order to gauge driver's awareness. In response to the driver engagement score, the methodology may deliver varying degrees of warning to a driver prior to initiating automated lane change maneuver, providing an increased time window for driver to react and override automated maneuver in case of accidental initiation. Alert methodology may vary depending on the amount of time that driver had been looking away from the road. The longer a driver has been disengaged and more complicated the current road conditions, the longer it would take for driver to be able to assess the situation.

The proposed method utilizes a driver monitoring system (DMS) to continuously monitor driver attention zone and construct driver engagement score to differentiate accidental vs. intentional turn signal activation. After a turn signal state transition indicates lane change request, the current driver engagement score is considered. If High, for example when the driver is paying attention, then no additional warning may be required beyond standard. A medium attention score may trigger an elevated level of alert. Low engagement score may trigger a high alert level or may prevent lane change from occurring all together. The exemplary method is operative to trigger dynamically adjustable levels of alert to driver prior to executing lane change maneuver, depending on current engagement score, to increase driver awareness and provide additional buffer time for overriding lane change in case of accidental activation.
https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2021061300A1&KC=A1&FT=D&ND=3&date=20210304&DB=&locale=en_EP
https://patents.justia.com/patent/20210061300

VIEWPOINT POSITION DETERMINATION DEVICE, VIEWPOINT POSITION DETERMINATION METHOD, AND VIEWPOINT POSITION DETERMINATION PROGRAM
This viewpoint position determination device (20) determines a viewpoint position (EL) of a driver (P) of a vehicle (1), the viewpoint position being supplied for display control of a display image by a vehicular display device (192) that displays the display image superimposed on the foreground visible through a front windshield (4) of the vehicle (1). This viewpoint position determination device is provided with a drive information acquisition unit (252) and a viewpoint determination processing unit (254). The driver information acquisition unit acquires driver information corresponding to identification results of the driver on board the vehicle. The viewpoint determination processing unit determines the viewpoint position to be supplied for display control of the display image, such determination performed on the basis of: a viewpoint database (251) that stores viewpoint positions and driver information that are mutually associated; and the driver information acquired by the driver information acquisition unit.
https://worldwide.espacenet.com/publicationDetails/biblio?CC=WO&NR=2021039317A1&KC=A1&FT=D&ND=3&date=20210304&DB=&locale=en_EP
https://www.freepatentsonline.com/WO2021039317A1.pdf

OPERATION CONTROL DEVICE, OPERATION CONTROL METHOD, AND STORAGE MEDIUM
An operation control device includes a line-of-sight detector configured to detect a line of sight of a driver of a vehicle on the basis of an image of an interior of the vehicle captured by an imaging device provided in the vehicle, a hand state detector configured to detect a hand state of the driver on the basis of the image, a driving state determiner configured to determine whether the detected hand state is a first state in which it is estimated that a driving operation of the vehicle is being performed or a second state in which it is estimated that the driving operation is not being performed, a traveling state detector configured to detect a traveling state of the vehicle, and an operation restrictor configured to restrict reception of an operation on an operator including a display device arranged within the vehicle.
https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2021053440A1&KC=A1&FT=D&ND=3&date=20210225&DB=&locale=en_EP
https://www.freepatentsonline.com/20210053440.pdf

New AVCC website which includes Nissan which maybe a new addition and some Nissan / Apple news.

https://www.avcconsortium.org/avcc-experiences-exciting-growth-and-progress-addresses-key-compute-challenges-to-autonomous-vehicle-mass-market-success/

Nissan 'ready to join Apple Car project'
https://www.macworld.co.uk/news/nissan-apple-car-3801619/

Audi used in Lear tech promo.

https://www.lear.com/technology/e-systems

Method and System for Proactively Adjusting Vehicle Occupant Biometric Monitor in View of Upcoming Road Conditions
A method and system include a biometric monitor monitoring an occupant of the vehicle and a vision detector detecting a condition of an upcoming road segment. A controller determines an adjustment to the biometric monitor for the biometric monitor to counteract an expected effect that the condition of the upcoming road segment will have on the biometric monitor in monitoring the occupant when the vehicle drives over the upcoming road segment. The controller adjusts the biometric monitor according to the adjustment such that the biometric monitor is adjusted in monitoring the occupant according to the adjustment as the vehicle drives over the upcoming road segment. The controller may determine an adaptation to a suspension assembly of the vehicle for the suspension assembly to counteract the expected effect and adapt the suspension assembly according to the adaptation. The adjustment to the biometric monitor is modified accordingly.

[0014] A system for a vehicle having a vision detector configured to detect a condition of an upcoming road segment is provided. The system includes a biometric monitor configured to monitor an occupant of the vehicle. The system further includes a controller in communication with the biometric monitor and the vision detector. The controller configured to determine an adjustment to the biometric monitor for the biometric monitor to counteract an expected effect that the condition of the upcoming road segment will have on the biometric monitor in monitoring the occupant of the vehicle when the vehicle drives over the upcoming road segment and to adjust the biometric monitor according to the adjustment such that the biometric monitor is adjusted in monitoring the occupant of the vehicle according to the adjustment as the vehicle drives over the upcoming road segment.
https://worldwide.espacenet.com/publicationDetails/description?CC=US&NR=2021031777A1&KC=A1&FT=D&ND=3&date=20210204&DB=&locale=en_EP

'People don’t take trips, trips take people'.
John Steinbeck, Travels with Charley: In Search of America
https://www.goodreads.com/quotes/1311410-people-don-t-take-trips-trips-take-people

Perhaps ??
https://www.flysbyairport.com/
https://en.wikipedia.org/wiki/American_Airlines

AID FOR A DRIVER WITH IMPAIRED FIELD OF VIEW
The disclosed subject matter generally relates to alerting a vehicle driver having impaired eye sight of an object present in a portion of a field of view of the driver where the driver has impaired eye sight. With embodiments of the present disclosure, a driver with impaired eye sight may be provided with an alert when an object is present in a portion of a field of view of the driver where the driver has impaired eye sight. In this way may drivers who otherwise may feel uncomfortable driving due to impaired eye sight in parts of their field of view, be provided with an aid for safely driving the vehicle. This provides for improved quality of life for the person who may be able to safely drive the vehicle, and also for an improved safety when the person drives the vehicle.
https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2021055566A1&KC=A1&FT=D&ND=3&date=20210225&DB=&locale=en_EP
https://www.freepatentsonline.com/20210055566.pdf

SYSTEM AND METHOD FOR DIALOG SESSION MANAGEMENT
A robot or other conversational agent determines whether a human interlocutor has ceded the conversational floor by detecting the absence of a particular speech characteristic such as the introduction of filler speech at the end of an utterance, and the presence of a characteristic physical behaviour, such as the interlocutor returning their gaze to a focal point of the conversion, such as the robots face, during a specified time window after the end of the utterance. Where this combination of characteristics is detected, the robot can determine that the conversational floor is open and that a response may be appropriate. This may trigger a conversational response for example via voice or text.
https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2021056966A1&KC=A1&FT=D&ND=3&date=20210225&DB=&locale=en_EP

SYSTEMS AND METHODS FOR IMPROVING VISUAL SCANNING BEHAVIOR ASSOCIATED WITH CONTROLLING A VEHICLE
System, methods, and other embodiments described herein relate to improving visual scanning behavior of an operator in a vehicle with a vehicle display. In one embodiment, a method includes, in response to detecting a transition to a manual mode of operating the vehicle, identifying, using at least one sensor of the vehicle, objects in a present operating environment around the vehicle according to a visual profile of the operator. The method also includes controlling the vehicle display to selectively render one or more graphic elements according to at least a gaze score.

[0017] Accordingly, in one embodiment, a visual attention system identifies objects in a present operating environment around the vehicle according to a visual profile of the operator. For example, in one embodiment, the visual attention system identifies objects by analyzing dynamic vehicle data to determine objects in the present operating environment having classifications that are similar to the vehicle profile. In one arrangement, the visual profile includes a gaze behavior of the operator when the operator was previously driving at a defined performance level. For example, the gaze behavior indicates a focus of eyes of the operator on a particular set of target objects, such as road signs, vehicles, lane markers, pedestrians, etc. Further, the gaze behavior can also indicate how long the eyes are trained on the road as opposed to an interior of the vehicle. In one or more arrangements, the visual attention system generates a gaze score that characterizes deviations of a present gaze behavior from the gaze behavior of the visual profile.

[0018] Therefore, in efforts to bring the visual scanning behavior of the operator back to a threshold level, the visual attention system, in one embodiment, controls a vehicle display to selectively render one or more graphic elements according to at least the gaze score. For example, the visual attention system renders the one or more graphic elements in the vehicle display (e.g., in an augmented reality manner via a HUD) in response to a transition to the manual mode until the gaze score satisfies a stability threshold. In one arrangement, the visual attention system can, for example, overlay graphics in the vehicle display at locations coinciding with perimeters of the objects, and selectively flash the graphics. Therefore, in one embodiment, the visual attention system provides visual stimulus to encourage the operator to visually scan in a manner similar to when the operator was manually driving at the defined performance level. In this way, the visual attention system can facilitate ramping the visual scanning behavior of the operator in an accelerated timeframe, thus enhancing safety.
https://worldwide.espacenet.com/publicationDetails/description?CC=US&NR=2021053586A1&KC=A1&FT=D&ND=3&date=20210225&DB=&locale=en_EP

INFRARED LIGHT SOURCE PROTECTIVE SYSTEM
https://worldwide.espacenet.com/publicationDetails/biblio?II=5&ND=3&adjacent=true&locale=en_EP&FT=D&date=20210224&CC=EP&NR=3782438A1&KC=A1
https://register.epo.org/application?number=EP19788201&lng=en&tab=doclist

Re-Post from 26 Dec 2020 about Data Glasses ..maybe relevant.



Many of VW HUD related patents include Data Glasses;

https://worldwide.espacenet.com/searchResults?ST=singleline&locale=en_EP&submitted=true&DB=&query=%09KLEEN+ANDRO

Seeing machines patent CIRCULAR LIGHT ELEMENT FOR ILLUMINATION OF CORNEA IN HEAD MOUNTED EYE-TRACKING which had references to (018) Google Glass™. This patent has been 'abandoned' .

The lead patent referred to in the rejection was;
ESSILOR INT , |DEVICES AND METHODS FOR DETERMINING THE POSITION OF A CHARACTERIZING POINT OF AN EYE AND FOR TRACKING THE DIRECTION OF THE GAZE OF A WEARER OF SPECTACLES.

Essilor acquired Gentex in 1995 https://en.wikipedia.org/wiki/Essilor

SEE partnership with Qualcomm the talk of partnerships with Google and Apple. All these companies have Data Glasses in development.

https://www.msn.com/en-gb/money/technology/apple-glasses-release-date-price-news-leaks-and-what-we-know-so-far/ar-BB15Qki2

https://venturebeat.com/2020/05/26/qualcomm-expects-all-in-one-5g-xr-viewers-in-1-4-years-glasses-in-5-10/

Though Google pulled its consumer version of the AR glasses, it has been experimenting with enterprise versions for businesses, such as Samsung and Volkswagen, to use in industries including logistics and manufacturing.

That’s why it is releasing a new version, named Google Glass Enterprise Edition 2, which will cost $999 . The new glasses are built on the Qualcomm Snapdragon XR1 platform, featuring a more powerful processing unit and a new artificial intelligence (AI) engine. Google says this will enable enhanced performance and advanced machine learning capabilities.
https://www.standard.co.uk/tech/google-glass-2019-new-glass-enterprise-2-a4147226.html

DIGITAL MIRROR SYSTEMS FOR VEHICLES AND METHODS OF OPERATING THE SAME
Digital mirror systems for vehicles and methods of operating the same are disclosed. An example vehicle control system includes:a driver monitoring system including a head position determiner to determine at least one of a location of a head, an orientation of the head, or an eye gaze point of the head; a digital mirror system including a region-of-interest (ROI) detector to identify an ROI based on the at least one of the location of the head, the orientation of the head, or the eye gaze point of the head, and a cropper to extract a portion of a first image corresponding to the ROI to form a second image, the first image representing an area exterior to the vehicle; and a display within an interior area of the vehicle to present the second image
https://worldwide.espacenet.com/publicationDetails/biblio?II=5&ND=3&adjacent=true&locale=en_EP&FT=D&date=20210218&CC=US&NR=2021049389A1&KC=A1
https://www.freepatentsonline.com/20210049389.pdf

DRIVING SUPPORT APPARATUS, CONTROL METHOD OF VEHICLE, AND NON-TRANSITORY COMPUTER-READABLE STORAGE
MEDIUM
A driving support apparatus in a vehicle, includes: an information acquisition unit configured to acquire peripheral information of the vehicle; a risk prediction unit configured to predict a risk region on the periphery of the vehicle using the peripheral information; a sight line specifying unit configured to specify a position of a sight line of a driver of the vehicle in the peripheral information; and a control unit configured to switch driving support control based on a degree of deviation between the risk region predicted by the risk prediction unit and the position of the sight line specified by the sight line specifying unit.

[0052] The learned model here is a model obtained by a machine learning method such as a CNN (Convolutional Neural Network) using the data of the driving history of a skilled driver. A detailed description of the learning method will be omitted here, and it is assumed that a known method can be applied. As the data of the driving history of the skilled driver, which is used here as learning data, a pair of an image (a front image of the vehicle or the like) acquired in the vehicle during traveling by the skilled driver and the position information of the sight line of the skilled driver for the image is used. That is, the learned model according to this embodiment is generated based on various kinds of targets (including traffic participants such as a vehicle and a person) located on the periphery of the self-vehicle included in the image and the position of the sight line of the skilled driver in a situation in which the presences of the targets are recognized. When the learned model is applied to an image of the vehicle in a certain situation, the position of the sight line of the skilled driver in the image is output. Note that to generate a learned model, a large load is applied. Hence, the model is generated in advance and held in a storage unit in the vehicle 1.

[0053] With the above-described processing, the position of the sight line of the skilled driver in a certain traveling situation is estimated. The position of the sight line is shown in the region 301. In this embodiment, the region 301 will be described as a “gazing point”. Note that the gazing point is not limited to a point and may be indicated by a range in which the sight line moves at a predetermined time interval. Also, in this embodiment, the driver of data to be used to perform learning will be expressed as a “skilled driver”. However, the attribute is not limited.
https://worldwide.espacenet.com/publicationDetails/mosaics?CC=US&NR=2021039638A1&KC=A1&FT=D&ND=3&date=20210211&DB=&locale=en_EP

Pilot Health and Alertness Monitoring, Communication and Safeguarding
The onboard computer system further includes an automatic control processor that automatically transfers control authority from the pilot to the autopilot and then issues an unfit pilot alert. Then a real-time audio/video/data connection is established between the pilot onboard the aircraft and a remote medical professional. The remote medical professional evaluates the medical fitness of the pilot and determines whether the pilot automated mitigations should be continued (pilot unfit for duty) or removed (pilot fit for duty).

[0040] Deviations from a pilot's baseline head and/or body posture, such as slouching and/or a head tilted toward the chest, may indicate fatigue. The biometric sensor suite 78 may also include one or more digital cameras that can detect information about the eyes of the pilot. For example, digital images may be processed to calculate various eye metrics, such as eye blink rate (i.e., how often the pilot blinks), eye movement (i.e., how much the pilot is looking around rather than staring in one direction), and/or eye closure amount (e.g., how much of the pilot's eyes are covered by his eye lids) of the pilot. Deviations in blink rate and/or a change in blink rate from a pilot's baseline measurements may indicate fatigue. Additional examples of fatigue indicators can include eyes fixing on one spot (e.g., not scanning the environment) more or less than a baseline amount and partially closed eye lids more or less than a baseline amount. The biometric sensor suite 78 may also include sensors that detect electrical activity of the pilot, such as sensors that detect the heart rate of the pilot by measuring electrical signals in the body that regulate heart beats. A heart rate sensor may be included in a wrist watch, chest strap, or the like. The heart rate sensor may also be incorporated into primary flight controls, such as a control yoke. Deviations in heart rates from a baseline level for a pilot may indicate fatigue. The biometric sensors 78a-78n can also include sensors to detect one or more of electroencephalography data, electro-oculography data, electromyography.
https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2021034053A1&KC=A1&FT=D&ND=3&date=20210204&DB=&locale=en_EP

Thanks TLS, Brilliant, forensic and much appreciated.

ASYNCHRONOUS TIME AND SPACE WARP WITH DETERMINATION OF REGION OF INTEREST
[0007] The techniques of this disclosure are directed to systems that permit time and space warping of a rendered frame to correct for the movement of head position and scene motion where the metadata that aids the time and space warping is determined by identifying a region of interest. Time and space warping using a region of interest reduces the effective motion-to-photon latency associated with the movement of the head position as well as the positional judder associated with rendering at a frame rate slower than the display refresh rate without requiring transmitting/receiving per-pixel depth data such as the depth buffer. Using metadata from a region of interest for time and space warping also reduces the positional judder and other display artifacts associated with other time space warping techniques. The region of interest may be determined based on eye tracking or content information. For example, a host device of a split-rendered system may generate a single depth plane for a region of interest of a scene to emphasize contribution from the region of interest. The value and parameters for the single depth plane may be determined based on eye-tracking information.

[0008] In one aspect, the metadata from a region of interest used to aid time and space warping may include metadata for sampling and filtering motion vectors of moving objects in a rendered frame. For example, a host device and a display device of a split-rendered system may determine a region of interest in an eye-buffer frame based on content or eye-tracking information. The host device may determine a motion vector grid size based on an analysis of the content within the region of interest.
https://worldwide.espacenet.com/publicationDetails/description?CC=US&NR=2021042985A1&KC=A1&FT=D&ND=3&date=20210211&DB=&locale=en_EP

SYSTEMS AND METHODS FOR IDENTIFYING POSE OF CAMERAS IN A SCENE
https://worldwide.espacenet.com/publicationDetails/inpadocPatentFamily?CC=US&NR=2019206084A1&KC=A1&FT=D&ND=5&date=20190704&DB=&locale=en_EP

STATE DETERMINATION DEVICE, DRIVING SUPPORT DEVICE, STATE DETERMINATION METHOD, AND DRIVING SUPPORT METHOD
A vehicle-mounted device 10 includes: a traveling support control unit 30 that senses that the driver is provided with guidance regarding the driving operation; a line-of-sight detection unit 32 that detects the direction of a driver's line-of-sight; a condition determination unit 33 that determines whether a gaze condition is satisfied, the gaze condition including: that, with respect to a preset gaze direction, the driver's line-of-sight faces the gaze direction until a first reference time elapses from when guidance is sensed; and that time during which the driver's line-of-sight faces the gaze direction is equal to or longer than a second reference time; and a driver state determination unit 34 that determines whether the driver is in a state of being able to drive based on the determination result of the condition determination unit 33.
https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2021039678A1&KC=A1&FT=D&ND=3&date=20210211&DB=&locale=en_EP

https://www.qualcomm.com/research/licensing/licensing-search