Member Info for johnchucka

VEHICLE SYSTEMS AND METHODS FOR DETECTING AND MITIGATING AN INCAPACITATED DRIVER
Jan 3, 2018 - Toyota
https://worldwide.espacenet.com/?locale=en_EP
Vehicle systems and methods for controlling a vehicle to mitigate the effects of an incapacitated driver are disclosed. In one embodiment, a vehicle includes one or more sensors, one or more processors, and one or more non-transitory memory modules communicatively coupled to the one or more processors. The memory modules store machine-readable instructions that, when executed, cause the one or more processors to receive one or more signals output by the one or more sensors and determine a driver of the vehicle is incapacitated based on the one or more signals output by the one or sensors. In response to determining the driver is incapacitated, the processors are caused to determine a specific type of incapacitation of the driver based on the one or more signals output by the one or more sensors. The processors may select an individual vehicle control profile based on the specific type of incapacitation.

The eye monitoring sensors 142 may generate eye signals indicative of one or more conditions of the driver's eyes that may indicate incapacitation. For example, the eye signals may indicate the driver 250 is drowsy from a lack of sleep based on eyelid position, eye blink and speed, and gaze direction. More specifically, when the driver 250 is drowsy the eye monitoring sensors 142 may detect that the driver's eyelids are drooping or have stayed closed for a longer duration of time than when he or she is alert. The eye monitoring sensors 142 may also detect that the driver's eyelids close and open at a slower velocity than when he or she is alert, or that the driver's gaze does not focus or turn to events are quickly when compared to when the driver 250 is alert.
In another example, when the driver 250 is intoxicated by alcohol or has ingested stimulants such as amphetamine, then the camera may detect the driver's pupils have a delayed or lack of reaction to light or are dilated. In still another example, the eye monitoring sensors 142 may detect that the driver's pupils are extremely constricted (which may be referred to as pinpoint pupils) and/or the eyes of the driver are rolling back, which may be indicative of opioid use. Although drowsiness, alcohol intoxication, stimulant intoxication, and opioid intoxication are described, it should be appreciated that the disclosure is not limited to determining only these specific types of driver incapacitation based on the conditions of the driver's eyes.
The biologic sensors 152 may generate one or more body signals that indicate the driver of the vehicle 100 may be incapacitated as well. For example, the body signal may indicate a relatively slow heart rate, stable pupil size, and a decreased respiration rate of the driver, which may indicate that the driver is incapacitated due to a lack of sleep or is drowsy. Alternatively, an increased heart rat

https://soundcloud.com/talking-iot-with-ericsson/5-nishant-batra-veoneer

Very Interesting summary from Nishant Batra, CTO, Veoneer covering Collaborative Active safety and Centralised safety/systems relationships which sounds very AVCC.
Crystal gazing the Electric, Autonomous, and Shared Future @18.30m
https://www.youtube.com/watch?v=RBoT-Qo8QBY

Why Veoneer is comparing cars with mobile phones.
"If you think of the phone as a car," Batra said, "OEMs have built traditional cars, where they have a cellphone that is run on a processor, but then each app is run on a separate processor."
"So, when they upgrade the operating system, all the apps stop working because they're on a separate processor," he continued. "So, then they have to upgrade all of the processors of each of the apps, and it doesn't work."
The automotive industry needs "an architectural revolution," he said -- a centralized, scalable electronics platform that allows the car's operating system as well as all of its "apps" to be upgraded seamlessly over the air.
Beyond benefiting suppliers such as Veoneer, that could help automakers offset reduced profit margins from costly technologies like electrification or autonomous driving.
"When OEMs can sell a car that is upgradeable, they'll be creating new revenue streams, not just a one-time sale," Batra said. "I can either charge you for all features for 10 years upfront, or I can have a business model where I can say, the car will upgrade next year, and I will charge you for some of the new features."
Batra noted that this will require automakers to work together to create a set of computing standards to reduce complexity and foster compatibility, and to allow open-source development. It will also lower the cost of design and production and reduce the need for complex and time-consuming validation.
While tech companies have been doing this for decades, he said, automakers and suppliers are just getting used to this way of working.
"In telecom, everything is standardized," he said. "In automotive, everything is bespoke, and bespoke creates cost, and that's a problem."
Batra said he saw positive trends.
"I won't say the revolution will happen tomorrow," he said. "The OEMs are starting to realize that they can't do everything, and that openness and standardization helps reduce their cost."
https://europe.autonews.com/blogs/why-veoneer-comparing-cars-mobile-phones

Most likely my Confirmation Bias is over heating but again this Veoneer patent looks to my untrained eyes to be describing a similar or related invention to the Bosch/Toyota/ Continental / 2019-11-14 patents I pointed out in Fri 10.16 post.
Veoneer
ENHANCED OBJECT DETECTION AND MOTION ESTIMATION FOR A VEHICLE ENVIRONMENT DETECTION SYSTEM 2019-11-14
A vehicle environment detection system (2) that includes at least one radar sensor arrangement (3) and at least one processing unit (4), where the radar sensor arrangement (3) is arranged to detect at least two radar detections (9, 10, 11) during at least two radar cycles. For each radar cycle, the processing unit (4) generates a detection list ({Dit}t=t0, . . . ,t0-N) including range (ri), azimuth angle (fi) and Doppler velocity (vi) for each of the radar detections (9, 10, 11). The processing unit (4) is further arranged to aggregate and store detection lists ({Dit}t=t0, . . . ,t0-N) from the radar cycles in a detection memory (12), and then to group the radar detections (9, 10, 11) in the detection lists ({Dit}t=t0, . . . ,t0-N) into consistently moving motion subsets (40, 41, 42) in a segmentation procedure. Each motion subset (40, 41, 42) corresponds to a certain target object (6, 7, 8).
https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2019346561A1&KC=A1&FT=D&ND=3&date=20191114&DB=&locale=en_EP#

S2020, I don't understand it much either so I could easily be posting complete rubbish but I am struck by how Patents which look to be describing similar innovations seem to come like buses.

CONTINENTAL AUTOMOTIVE SYSTEMS INC 2019-11-14
Three-Dimensional Point Cloud Generated by High-Resolution Flash LIDAR
https://worldwide.espacenet.com/publicationDetails/biblio?II=2&ND=3&adjacent=true&locale=en_EP&FT=D&date=20191114&CC=US&NR=2019347850A1&KC=A1#

CONTINENTAL AUTOMOTIVE SYSTEMS INC 2019-11-14
Three-Dimensional Point Cloud Generated by High-Resolution Flash LIDAR
A method of operating a vehicle image system supported by a vehicle is provided. The method includes receiving data from one or more sensors supported by the vehicle. The one or more sensors capture sensor data of objects in the surrounding environment of the vehicle. The method also includes receiving a storage indication from a user input device. The storage indication is indicative of storing the data from the one or more sensors in the non-transitory memory. The method also includes storing the data after receiving the storage indication and transmitting a command to one or more remote devices causing the one or more remote devices to generate a two-dimensional image or a three-dimensional object based on the received data.

Bosch 2019-11-14
DETERMINING A STATE OF THE SURROUNDING AREA OF A VEHICLE, USING LINKED CLASSIFIERS
A method for determining a state of the surrounding area of a vehicle includes: receiving sensor data of at least one surrounding-area sensor of the vehicle; feeding at least a first portion of the sensor data into at least one first classifier; generating an intermediate probability from the first portion of the sensor data, using the first classifier; feeding at least a second portion of the sensor data and the at least one intermediate probability into a second classifier; generating a final probability of the state of the surrounding area from the second portion of the sensor data and the at least one intermediate probability, using the second classifier.
https://worldwide.espacenet.com/publicationDetails/biblio?II=6&ND=3&adjacent=true&locale=en_EP&FT=D&date=20191114&CC=US&NR=2019347488A1&KC=A1#

Toyota 2019-11-14
ADAPTIVE DATA COLLECTING AND PROCESSING SYSTEM AND METHODS 2019-11-14
A vehicle that includes one or more sensors configured to output data and an electronic control unit. The electronic control unit is configured to receive first data from the one or more sensors at a first time, detect an object based on the first data received from the one or more sensors at the first time, classify the object into a classification based on the first data received from the one or more sensors at the first time, and receive second data from the one or more sensors at a second time. The second time is subsequent to the first time. The electronic control unit is further configured to select a proper subset of the second data for further processing based on the classification of the object, and track the object based on the proper subset of the second data selected for further processing.
https://worldwide.espacenet.com/publicationDetails/biblio?FT=D&date=20191114&DB=&locale=en_EP&CC=US&NR=2019347805A1&KC=A1&ND=4#

Industry consortium eyes standards for autonomous vehicle hardware
October 10, 2019 Junko Yoshida
https://www.embedded.com/industry-consortium-eyes-standards-for-autonomous-vehicle-hardware/

The interesting Linkage to these 2 patents is not only the Identical date and what sounds like a very similar process being described but also Christian Potthost, the Patent guy at Toyota has had an earlier patent assigned to Bosch.

Bosch 2019-11-14
DETERMINING A STATE OF THE SURROUNDING AREA OF A VEHICLE, USING LINKED CLASSIFIERS
A method for determining a state of the surrounding area of a vehicle includes: receiving sensor data of at least one surrounding-area sensor of the vehicle; feeding at least a first portion of the sensor data into at least one first classifier; generating an intermediate probability from the first portion of the sensor data, using the first classifier; feeding at least a second portion of the sensor data and the at least one intermediate probability into a second classifier; generating a final probability of the state of the surrounding area from the second portion of the sensor data and the at least one intermediate probability, using the second classifier.
https://worldwide.espacenet.com/publicationDetails/biblio?II=6&ND=3&adjacent=true&locale=en_EP&FT=D&date=20191114&CC=US&NR=2019347488A1&KC=A1#

Towards Safe Autonomous Driving: Capture Uncertainty in Deep Object Detectors
https://nikosuenderhauf.github.io/roboticvisionchallenges/assets/slides/IROS19/DiFeng.pdf

ADAPTIVE DATA COLLECTING AND PROCESSING SYSTEM AND METHODS 2019-11-14
A vehicle that includes one or more sensors configured to output data and an electronic control unit. The electronic control unit is configured to receive first data from the one or more sensors at a first time, detect an object based on the first data received from the one or more sensors at the first time, classify the object into a classification based on the first data received from the one or more sensors at the first time, and receive second data from the one or more sensors at a second time. The second time is subsequent to the first time. The electronic control unit is further configured to select a proper subset of the second data for further processing based on the classification of the object, and track the object based on the proper subset of the second data selected for further processing.
https://worldwide.espacenet.com/publicationDetails/biblio?FT=D&date=20191114&DB=&locale=en_EP&CC=US&NR=2019347805A1&KC=A1&ND=4#
Perception/ Toyota Research Institute/ Nov 2017 – Present
Perception in Autonomous Driving
https://www.linkedin.com/in/christian-potthast-73587372/

TLS, thumbscrews are old school distraction and diversion would be their way;)

I don't get the impression your an amateur TLS far from it . It's a shame you were not able to get to the CMD to have an interesting chat with John Noble and some of the other clever folk at SEE.

Yes I noted that Redindi . L7 actually posted an article rather than an opinion:) Glad to see he's back to himself again now.

TLS, So Lets take Toyota and GM out of my picture. Could we sensibly postulate that SEE maybe developing an expanded Inward and Outward camera after market Guardian product ? , G4 we could call it. The Data from that would be valuable.

TLS, further to your point regarding Guardian reference point 34 and Fig 3 make reference to it being offered or 'manufactured as an after-market product' and point 35 note that it processor 302 'may include system-on-chip technology'.
This is of interest as although I may be way off target one might optimistically imagine that IF this is all tied in to Toyota and AVCC and 'unprecedented collaboration' etc then what these patents are describing is the development of Guardian For all. I'm no doubt way of the mark but it's my working assumption at the present time.

[0034] Referring now to FIG. 3, there is illustrated a system level diagram of system 100. System 100 includes a central processing unit 300 including a processor 302, memory 304, a power source 306, a network interface 308 and a user input device 310. In the embodiments of a vehicle monitoring system, central processing unit 300 is preferably mounted within the vehicle dash or center console and can be integrated with an onboard vehicle computer system during manufacture. However, central processing unit 300 and system 100 as a whole may be manufactured as an after-market product and subsequently installed into vehicle in a modular manner.
[0035] Processor 302 may represent a conventional microprocessor or personal computer having hardware and/or software configured for processing image streams received from multiple cameras. By way of example, processor 302 may include system-on-chip technology and include a video processing pipeline for processing the stream of images from cameras 101-104. In one embodiment, processor 302 is integral with or in communication with a processor of an onboard vehicle computer system.
https://worldwide.espacenet.com/publicationDetails/description?CC=US&NR=2019266751A1&KC=A1&FT=D&ND=3&date=20190829&DB=&locale=en_EP#

Thanks TLS . If the Guardian data has more combined driver facing / forward facing applications uses like you suggest then I assume it's value to the company and leverage it offers is pretty significant. However, the patent linkage I was making by referring to SEE patent 'SYSTEM AND METHOD FOR IDENTIFYING A CAMERA POSE OF A FORWARD FACING CAMERA IN A VEHICLE' looks to me to be more sophisticated, involving multiple driver facing cameras fusion/aligned with for example as point 033 describes;
' the forward road scene or other views in or around the vehicle. Other exemplary camera locations of cameras include a rearview mirror, rear bumper, front bumper, vehicle roof and bonnet/hood',
This is why I was making the reference to the Toyota and GM patents that appear to me imo to be on a technically parallel plane to SEE in relation to patent evolution.
https://worldwide.espacenet.com/publicationDetails/description?CC=US&NR=2019266751A1&KC=A1&FT=D&ND=3&date=20190829&DB=&locale=en_EP#

If I wanted to make a case that the AVCC partners could be collaborating in developing a complimentary technological baseline system platform I could add this Conti patent (which comes around a week after the Toyota patent) but I'm conscious that I'm being extremely selective and guilty of AVCC confirmation Bias.
CONTINENTAL AUTOMOTIVE GMBH [DE]; CONTINENTAL AUTOMOTIVE SINGAPORE PTE LTD 2019-04-11
The invention relates to a display system in a vehicle, the system comprising: one
or more displays;at least one sensor configured to determine a user's line of sight;a controller configured to determine an active zone and a non-active zone of the one or more displays based on the user's line of sight,wherein the one or more displays are configured to operate the active zone at an enhanced level as compared to the non-active zone.There is further provided a controller configured to rank content displayed on one or more displays in a vehicle according to an attention score determined by at least one sensor configured to measure gaze of a user based on the user's line of sight; and a display system comprising the controller,wherein one of the displays is selected to display the highest ranked content.There is also provided a method of operating one or more displays in a vehicle using the disclosed display systems.
https://worldwide.espacenet.com/publicationDetails/biblio?CC=WO&NR=2019068754A1&KC=A1&FT=D&ND=3&date=20190411&DB=&locale=en_EP#

Possible SEE/Toyota/GM Joint technological/patent development within a two month timeframe.
Example

SEE 2019-08-29
SYSTEM AND METHOD FOR IDENTIFYING A CAMERA POSE OF A FORWARD FACING CAMERA IN A VEHICLE
'A method includes capturing images of a vehicle driver's face from a driver facing camera and images of a forward road scene from a forward facing camera. The images are analyzed to derive gaze direction data in a vehicle frame of reference. The gaze direction data are statistically collated to determine a frequency distribution of gaze angles. One or more peaks in the frequency distribution are identified and associated with corresponding reference points in the images to determine one or more reference gaze positions in the vehicle frame of reference. The one or more reference gaze positions are correlated with a position of the reference points in a forward facing camera frame of reference to to determine a camera pose of a forward facing camera in the vehicle frame of reference'.

GM 2019-10-17
METHODS AND SYSTEMS FOR PROCESSING DRIVER ATTENTION DATA
Methods and systems are provided for processing attention data. In one embodiment, a method includes: receiving, by a processor, object data associated with at least one object of an exterior environment of the vehicle; receiving upcoming behavior data determined from a planned route of the vehicle; receiving gaze data sensed from an occupant of the vehicle; processing, by the processor, the object data, the upcoming behavior data, and the gaze data to determine an attention score associated with an attention of the occupant of the vehicle; and selectively generating, by the processor, signals to at least one of notify the occupant and control the vehicle based on the attention score.

Toyota 2019-10-24
SYSTEM AND METHOD FOR DETECTING HUMAN GAZE AND GESTURE IN UNCONSTRAINED ENVIRONMENTS
'A system for gaze and gesture detection in unconstrained environments includes a 360-degree (omnidirectional) camera system, one or more depth sensors, and associated memory, processors and programming instructions to determine an object of a human user's attention in the unconstrained environment. The illustrative system may identify the object using eye gaze, gesture detection, and/or speech recognition. The system may generate a saliency map and identify areas of interest. A directionality vector may be projected on the saliency map to find intersecting areas of interest. The system may identify the object of attention once the object of attention is located'.

Possible SEE/Toyota Joint technological/patent development Example
SEE 2019-08-29
SYSTEM AND METHOD FOR IDENTIFYING A CAMERA POSE OF A FORWARD FACING CAMERA IN A VEHICLE
'A method includes capturing images of a vehicle driver's face from a driver facing camera and images of a forward road scene from a forward facing camera. The images are analyzed to derive gaze direction data in a vehicle frame of reference. The gaze direction data are statistically collated to determine a frequency distribution of gaze angles. One or more peaks in the frequency distribution are identified and associated with corresponding reference points in the images to determine one or more reference gaze positions in the vehicle frame of reference. The one or more reference gaze positions are correlated with a position of the reference points in a forward facing camera frame of reference to to determine a camera pose of a forward facing camera in the vehicle frame of reference'.

Toyota 2019-10-24
SYSTEM AND METHOD FOR DETECTING HUMAN GAZE AND GESTURE IN UNCONSTRAINED ENVIRONMENTS
'A system for gaze and gesture detection in unconstrained environments includes a 360-degree (omnidirectional) camera system, one or more depth sensors, and associated memory, processors and programming instructions to determine an object of a human user's attention in the unconstrained environment. The illustrative system may identify the object using eye gaze, gesture detection, and/or speech recognition. The system may generate a saliency map and identify areas of interest. A directionality vector may be projected on the saliency map to find intersecting areas of interest. The system may identify the object of attention once the object of attention is located'.