Member Info for johnchucka

SEE 025 'However, it will be appreciated that the invention has applications in broader context, particularly for applications involving the processing video sequences in real-time or near real-time'

APPLE INC 2020-01-09
PREDICTIVE, FOVEATED VIRTUAL REALITY SYSTEM
0002] BACKGROUND
[0003] Virtual reality (VR) allows users to experience and/or interact with an immersive artificial environment, such that the user feels as if they were physically in that environment. For example, virtual reality systems may display stereoscopic scenes to users in order to create an illusion of depth, and a computer may adjust the scene content in real-time to provide the illusion of the user moving within the scene. When the user views images through a virtual reality system, the user may thus feel as if they are moving within the scenes from a first-person point of view. Similarly, augmented reality (AR) combines computer generated information with real world images to augment, or add content to, a user's view of the world. The simulated environments of virtual reality and/or the enhanced content of augmented reality may thus be utilized to provide an interactive user experience for multiple applications, such as interacting with virtual training environments, gaming, remotely controlling devices or other mechanical systems, viewing digital media content, interacting with the internet, or the like.

[0004] However, conventional virtual reality and augmented reality systems may also suffer from latency problems potentially cause eyestrain, headaches, and/or nausea. For example, conventional virtual reality and augmented reality systems may involve significant lag times between the time a user looks in a particular direction and the time that the system is able to display the corresponding scene to the user. Additionally, the amount of image data required to be captured, generated and/or displayed to the user of a conventional virtual reality system may be so large as to affect the performance of the system (e.g., increased latency) and to increase the cost and/or size of the system.
https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2020012106A1&KC=A1&FT=D&ND=3&date=20200109&DB=&locale=en_EP#

SEEING MACHINES 2019-12-26
HIGH FRAME RATE IMAGE PRE-PROCESSING SYSTEM AND METHOD
[0025] Described herein is an image processing system and method. The system/method will be described with reference to the specific application of driver monitoring systems. However, it will be appreciated that the invention has applications in broader context, particularly for applications involving the processing video sequences in real-time or near real-time. One possible candidate for the invention is a 3-D motion capture system such as an Xbox Kinect. System overview

QUALCOMM INC 2019-09-12
APPARATUS AND METHOD FOR CONTROLLING AN AUGMENTED REALITY DEVICE
[0003] User interfaces for augmented reality on mobile device displays are not adequately intuitive. Traditional methods of interacting with augmented reality on a mobile device require users to point the device closely on the target to augment contents and touch the display of the mobile device for further control. This requires constant content switching between looking at the display and looking at real objects in real world scenes. Therefore, traditional methods of interacting with augmented reality are not adequately intuitive. As such, improved methods of interacting with augmented reality are needed to enhance efficiency as well as user experience and control.

[0004] With advanced mobile displays, such as head mounted optical devices configured to display content, the field of view is greatly expanded. Therefore, efficient processing techniques and heterogeneous user inputs for pointing to and augmenting objects of interest are valuable features for an augmented reality system.

[0005] In an aspect of the disclosure, an apparatus, a method, and a computer program product are provided. The apparatus detects an eye gaze on a first region in a real world scene, sets a boundary that surrounds the first region, the boundary excluding at least a second region in the real world scene, performs an object recognition procedure on the first region within the boundary, and refrains from performing an object recognition procedure on the at least the second region.

[0032] FIG. 4 illustrates a real world scene 400 being observed by a user through lenses 108 and 110 of the optical device 100. In FIG. 4, the user may gaze at the automobile 202 as the automobile 202 moves along the road 422 and the optical device 100 may detect the eye gaze of the user as the eye gaze follows the moving automobile 202. As shown in FIG. 4, the optical device 100 may initially set the boundary 409 on the region of the real world scene 400 corresponding to the detected eye gaze of the user. The optical device 100 may then track the eye gaze of the user to dynamically set the boundary 410 on the region of the real world scene 400 corresponding to the detected eye gaze of the user as the eye gaze follows the automobile 202. The optical device 100 may then perform an object recognition procedure on the region within the boundary 410 and may refrain from performing the object recognition procedure on regions outside the boundary 410.
https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2019278367A1&KC=A1&FT=D&ND=3&date=20190912&DB=&locale=en_EP#

Posted for reference.
Microsoft 2020-01-09
SYSTEMS AND METHODS FOR USING EYE GAZE TO BEND AND SNAP TARGETING RAYS FOR REMOTE INTERACTION
A method for improving user interaction with a virtual environment includes presenting the virtual environment to a user on a display, measuring a gaze location of a user's gaze relative to the virtual environment, casting an input ray from an input device, measuring an input ray location at a distal point of the input ray, and snapping a presented ray location to the gaze location when the input ray location is within a snap threshold distance of the input ray location.
https://patents.justia.com/patent/20200012341

It's all just copy and pastenting.

Terry, Telechips looks complimentary to SEE not competitive from a skim of the Patent titles.
https://worldwide.espacenet.com/searchResults?ST=singleline&locale=en_EP&submitted=true&DB=&query=telechips

S2020,
On the Microsoft patent page there are three new patents listed @2020-01-07 with no detail provided atm . One Patent is for a Controller the second is a Head set and Visor and the third is an Electronic Tablet. Just saying.
https://worldwide.espacenet.com/searchResults?ST=singleline&locale=en_EP&submitted=true&DB=&query=Microsoft+

It does look a bit like Lego designed it.

Qualcomm 2020-01-02
EXCHANGING AN HDR-COMBINED STREAM AND ASSOCIATED EXPOSURES BETWEEN A CAMERA SENSOR MODULE AND A VISION PROCESSING SYSTEM
[0001] Embodiments relate to exchanging a high-dynamic range (HDR)-combined stream between a camera sensor module and a vision processing system.

[0002] Typical camera sensors found in consumer applications such as phones and tablet computers output a single exposure per frame time, typically 10-14 bits per pixel. Camera sensors may be designed and configured to capture multiple exposures per frame time, whereby multiple exposures can be combined/merged together to form a high dynamic range (HDR) image stream. For example, wide or ultra-HDR sensors achieving at least 120 dB may be used for object detection in automotive systems, whereby an HDR image stream (e.g., 20-24 bits or lower, depending on whether companding is used) of at least 120 dB may be achieved via the merge of multiple (e.g., 3 or 4) such exposures.

[0003] In certain camera implementations, such as automotive systems, one or more camera sensors may be arranged separately from a vision processing system that performs various processing on the image data captured by the one or more camera sensors. Image signal processors (ISPs) of some vision processing systems do not support HDR-combining, in which case the HDR-combining may be performed by an on-sensor processing system integrated with each respective camera sensor, with the on-sensor processing system providing the HDR-combined stream of images to the vision processing system.

[0004] In systems where HDR-combining is performed by on-sensor processing systems integrated with the respective camera sensors, it is difficult to obtain individual exposure-specific statistics (e.g., exposure histograms, etc.) for calibrating the respective camera sensors. In particular, exposure-level information is lost when the exposures are merged to form the HDR-combined stream of images. Alternatively, the exposure-level information may be extracted by the integrated on-sensor processing systems, but this increases the costs and complexity of the camera sensors.
https://worldwide.espacenet.com/publicationDetails/description?CC=US&NR=2020007738A1&KC=A1&FT=D&ND=3&date=20200102&DB=&locale=en_EP#

Good morning TLS/ Shall we.
TLS
I'm also interested by the detail about the inward gaze /outward object awareness camera/data fusion and how it echoes or has close similarities to the descriptions we have seen in GM and Honda patents. How does this relate to a Samsung and SEE relationship in your opinion?

Shallwe,
Yes it might well be SE. It does describe a system which sounds pretty unsophisticated when compared to SEE technology.

GEELY HOLDING GROUP 2019-09-27
Method and system for judging attention of driver
Abstract The invention provides a method and a system for judging driver's attention, and relates to the field of vehicles. The method for judging the driver's attention first obtains the driver's eye-opening duration and the eye-gaze duration on the road for the first preset time, and then when the driver's eye-opening duration reaches the first The driver is determined to be awake when a preset threshold value is reached, and the driver is determined to be in a focused state when the length of time that the eye gazes on the road within the first preset time reaches the second preset threshold value. Finally, when the driver is awake and in a state of concentration, it is preliminarily determined that the driver is attentive. The present invention determines whether the driver's attention is focused by combining the driver's eye-opening time and the eye-gaze time on the road, improves the accuracy of the judgment system, meets higher-level functional safety requirements, and increases the driver's state Coverage.
http://translationportal.epo.org/emtp/translate/?ACTION=description-retrieval&COUNTRY=CN&ENGINE=google&FORMAT=docdb&KIND=A&LOCALE=en_EP&NUMBER=110287916&OPS=ops.epo.org/3.2&SRCLANG=zh&TRGLANG=en

[0039] These different analyzers interoperate in order to generate the baseline behavior model of occupant 140 mentioned above. In doing so, the analyzers shown may estimate the cognitive and/or emotional load of occupant 140 based on various physiological cues identified within the different types of physiological data captured. For example, and without limitation, neural data analyzer 408 could analyze brainwave patterns captured via neural sensor 208 and identify that occupant 140 is experiencing a spike in cognitive load. In another example, and without limitation, skin data analyzer 406 could analyze galvanic skin response data captured via skin sensor 206 and determine that occupant 140 has suddenly begun to perspire, thereby indicating an elevated emotional stress level. Although specific analyzers are shown within behavioral analyzer 300, persons skilled in the art will understand that any technically feasible type of data and analysis module may further be included therein in order to analyze any data captured via sensor array 110.

[0054] Occupant sensor system 100 identifies that occupant 140 suddenly turned their head and shifted their gaze, and then analyzes data captured via sensor array 110 to determine that occupant 140 has focused attention onto ball 800, which resides outside of autonomous vehicle 130. Occupant sensor system 100 attributes the sudden change in behavior associated with occupant 140 to the presence of ball 800. In this manner, occupant sensor system 100 determines that the source of the identified behavioral changes in occupant 140 resides outside of autonomous vehicle 130, and therefore may warrant changes to the navigation and/or driving of autonomous vehicle 130. Accordingly, autonomous vehicle 130 immediately brakes. In this example, autonomous vehicle 130 need not directly detect the ball, and may rely on the identified behavioral changes in situations where the ball is undetectable.

[0067] In sum, an occupant sensor system is configured to collect physiological data associated with occupants of a vehicle and then use that data to generate driving decisions and other vehicle operations. The occupant sensor system includes physiological sensors and processing systems configured to estimate the cognitive and/or emotional load on the vehicle occupants at any given time. When the cognitive and/or emotional load of a given occupant meets specific criteria, the occupant sensor system generates modifications to the navigation of the vehicle. In this manner, under circumstances where a human occupant of an autonomous vehicle recognizes specific events or attributes of the environment with which the autonomous vehicle maybe unfamiliar, the autonomous vehicle is nonetheless capable of making driving decisions based on those events and/or attributes.

[0027] As is shown, occupant 140 turns to look directly at an object 160 that resides on roadway 150. Object 160, in this example, is a box, although object 160 may also include objects that are typically undetectable by conventional sensor systems. Occupant sensor system 100 identifies that the head orientation of occupant 140 has diverged from a baseline head orientation. In response, occupant sensor system 100 analyzes sensor data captured via one or more outward facing sensors (potentially included in sensor array 110) and then identifies the presence of object 160. Occupant sensor system 100 then generates a modification to the steering of autonomous vehicle 130, thereby causing autonomous vehicles 130 to travel along trajectory 170 and avoid object 160.

[0030] Body sensor 200 may include optical sensors configured to determine the gesticulation and/or posture of occupant 140, musculature sensors configured to determine muscle contractions of occupant 140, breathing sensors configured to measure breathing rates of occupant 140, heart rate sensors configured to generate electrocardiogram readings of occupant 140, weight sensors configured to quantify the weight distribution of occupant 140, and any other technically feasible type of physiological sensor configured to measure any quantifiable aspects of the body of a human being. Head sensor 202 may include optical sensors, magnetic sensors, blood flow sensors, muscle contraction sensors, thermal sensors, radar sensors, and any other technically feasible type of physiological sensor via which the position and/or orientation of the head of a human being can be determined. Eye sensor 204 may include an eye gaze direction module, a vergence sensor, a pupillometry sensor, an optical depth sensor, and any other technically feasible type of physiological sensor via which the gaze direction and/or eye convergence distance of a human being can be determined. Skin sensor 206 may include a galvanic response monitor, a skin conduction sensor, a skin texture sensor, and any other technically feasible type of physiological sensor via which one or more attributes of the skin of a human being can be quantified. Neural sensor 208 may include a neural activity measurement device, a functional magnetic resonance imaging (FMRI) unit, an optogenetics module, and any other technically feasible type of physiological sensor via which any form of human neural activity can be quantified. Although specific types of sensors are shown within sensor array 110, persons skilled in the art will understand that any other technically feasible type of sensor may also be included in sensor array 110. Sensor array 110 captures real-time sensor data associated with occupants of autonomous vehicle 130, including occupant 140, and then transmits this data to computing device 120 for processing.

HARMAN INT IND 2020-01-02
CONTROLLING AN AUTONOMOUS VEHICLE BASED ON PASSENGER BEHAVIOR
An occupant sensor system is configured to collect physiological data associated with occupants of a vehicle and then use that data to generate driving decisions. The occupant sensor system includes physiologic sensors and processing systems configured to estimate the cognitive and/or emotional load on the vehicle occupants at any given time. When the cognitive and/or emotional load of a given occupant meets specific criteria, the occupant sensor system generates modifications to the navigation of the vehicle. In this manner, under circumstances where a human occupant of an autonomous vehicle recognizes specific events or attributes of the environment with which the autonomous vehicle maybe unfamiliar, the autonomous vehicle is nonetheless capable of making driving decisions based on those events and/or attributes.

[0024] In operation, sensor array 110 collects sensor data associated with occupant 140 and potentially other occupants of autonomous vehicle 130. The sensor data generally includes physiological data corresponding to occupant 140, including body position and articulation data, head position and orientation data, eye gaze direction data, skin characteristic data, neural activity data, and any other technically feasible type of data that can be captured in relation to a human being.

[0025] Computing device 120 processes this sensor data in order to characterize the behavior of occupant 140. In doing so, computing device 120 may generate an estimate of the cognitive and/or emotional load on occupant 140 at any given time. Computing device 120 then establishes a baseline behavior model of occupant 140 by analyzing the behavior of occupant 140 over a time span. Computing device 120 is configured to detect when the behavior of occupant 140 diverges from this baseline model. When behavioral divergence is detected, computing device 120 identifies a triggering event which may have caused the detected divergence in occupant behavior. Computing device 120 then determines whether the triggering event occurs inside of autonomous vehicle 130 or outside of autonomous vehicle 130. Triggering events occurring inside of autonomous vehicle 130 may be benign in nature, while triggering events occurring outside of autonomous vehicle 130 may warrant modifications to the driving of autonomous vehicle 130.
https://worldwide.espacenet.com/publicationDetails/description?CC=US&NR=2020003570A1&KC=A1&FT=D&ND=3&date=20200102&DB=&locale=en_EP#

S2020,
It is interesting that the SEE patent named it specifically as from my brief scan of posts those wild gamer kids who are down in the Xbox Kinect scene don't really appear to have a very positive things to say about it. So like you say why make reference to a sort of obsolete product unless you have plans for some sort of relaunch that will blow the gamers of their sofas which would be something to get excited about.
https://www.windowscentral.com/xbox-one-kinect-still-worth-buying-2018-lets-look-pros-and-cons

Xbox ™ Kinect mention in a Qualcomm Patent
SYSTEMS AND METHODS FOR DEVICE INTERACTION BASED ON A DETECTED GAZE 2019-04-03
[0019]
According to some embodiments, optical detection sensor module 122 may include a camera, such as a built-in front facing camera of processing device 100, or a camera built in to a coupled display or coupled peripheral camera device. Or communicate with them. The camera may be a visible light camera or a depth-sensitive camera such as Microsoft®. It can be an Xbox ™ Kinect ™ camera. In some embodiments, the optical detection sensor module 122 also includes infrared or other light-sensitive for detecting light reflected from the eye or certain features within the eye of the user 120 to track the eye of the user 120. Based eye tracker or may be in communication with them. According to some embodiments, the optical detection sensor module 122 may be configured to cause the sensor to capture frames of images, where the frames of the images detect a face in the frames of the images and when the face is detected. To detect a gaze from the face, it is processed within the module 122 or in some embodiments by the processing component 106. Face and gaze may be detected using one or more face and gaze detection algorithms stored in module 122 or any of the memories 108, 110, and 112. For example, a gaze may be detected by determining a detected face, such as the eye direction of the user 120. According to some embodiments, the optical detection sensor module 122 detects the face for use in determining whether to activate or deactivate the display component 114 and then detects the gaze of the user 120. 100, and / or to display an alert or message on display component 114. In some embodiments, the optical detection sensor module 122 is configured to detect the gaze based on the user 120 gazing at a predetermined object or area, such as the processing device 100 or the display component 114. Can be.
https://worldwide.espacenet.com/publicationDetails/biblio?CC=KR&NR=20150128967A&KC=A&FT=D&ND=3&date=20151118&DB=&locale=en_EP#

SEEING MACHINES LTD 2019-12-26
HIGH FRAME RATE IMAGE PRE-PROCESSING SYSTEM AND METHOD
[0025] Described herein is an image processing system and method. The system/method will be described with reference to the specific application of driver monitoring systems. However, it will be appreciated that the invention has applications in broader context, particularly for applications involving the processing video sequences in real-time or near real-time. One possible candidate for the invention is a 3-D motion capture system such as an Xbox Kinect. System overview
https://worldwide.espacenet.com/publicationDetails/description?CC=WO&NR=2019241834A1&KC=A1&FT=D&ND=3&date=20191226&DB=&locale=en_EP#

Posted for reference.
STATE FARM MUTUAL AUTOMOBILE INSURANCE COMPANY
Systems and methodologies for real-time driver gaze location determination and analysis utilizing computer vision technology July 9, 2019.
Patent number: 10343520
Abstract: The method, system, and computer-readable medium facilitates monitoring one or more eyes of a vehicle operator during a driving session to generate a plurality of gaze location logs with gaze location values. The gaze location value may be generated by determining a location of the vehicle operator's gaze, determining which area of the vehicle is associated with the gaze location, and assigning the gaze location value based on the area of the vehicle associated with the gaze location. The gaze location logs may be analyzed to determine the duration of the vehicle operator's gaze at each area of the vehicle. Based on the duration of the vehicle operators gaze, one or more recommendations to improve vehicle operator performance may be identified and communicated to the vehicle operator.

STATE FARM MUTUAL AUTOMOBILE INSURANCE COMPANY
Systems and methods for graduated response to impaired driving
Methods and systems for automatically detecting that a driver of a smart vehicle is impaired and subsequently performing a graduated response are provided. According to certain aspects, vehicle sensors may generate and transmit sensor data indicating that the driver of the smart vehicle is impaired. In response, the smart vehicle may analyze the data and determine a primary response to the indication of impairment. The primary response may be performed by the smart vehicle's control systems. Subsequently, the vehicle sensors may generate and transmit another set of sensor data indicating that the driver of the smart vehicle is impaired. In response, the smart vehicle may analyze the data and determine a secondary response to the indication of impairment. The secondary response may be performed by the smart vehicle's control systems.
https://patents.justia.com/patent/10525979

Thanks Terry.

Posting for reference: Calibration
Qualcomm
Sensor cross calibration Lab @48sec
https://www.youtube.com/watch?v=HsbnXxcRQSE

GM
THREE-DIMENSIONAL ALIGNMENT OF RADAR AND CAMERA SENSORS 2019-04-26
https://tinyurl.com/wrbb3oa

Bosch
Method for operating a driver assistance system for motor vehicles 2019-12-05
https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2019369234A1&KC=A1&FT=D&ND=3&date=20191205&DB=&locale=en_EP#

Seeing machines.
FORWARD FACING CAMERA IN A VEHICLE 2019-08-29

Continental
AN IMAGING DEVICE FOR MOTOR VEHICLE Conti 2019-07-11

Toyota
SYSTEMS AND METHODS OF PROCESSING AN IMAGE 2019-11-21
https://worldwide.espacenet.com/publicationDetails/biblio?II=6&ND=3&adjacent=true&locale=en_EP&FT=D&date=20191121&CC=US&NR=2019354780A1&KC=A1#

GM 2019-11-28
CONTROL SYSTEMS, CONTROL PROCEDURES AND CONTROLS FOR AN AUTONOMOUS VEHICLE 035

In the year some Xilinx and Continental Staff decided to migrate to Australia;
Continental Invests in Cellular-V2X Technology and Announces C-V2X Trials
Continental drives next-generation connected vehicle systems, building on decades-long experience with Telematics
Continental engages in field trials to validate Cellular-V2X technology with new Qualcomm® 9150 C-V2X chipset and Qualcomm® C-V2X Reference Design
Continental advocates for a fast roll out of V2X technologies
https://www.continental.com/en/press/press-releases/continental-invests-in-cellular-v2x-technology-and-announces-c-v2x-trials-96140

And then 2/3 years later;
Qualcomm Announces Multi-Tiered 3rd Generation Snapdragon Automotive ****pit Platforms.
“The automotive industry is the new frontier meant to benefit from the latest innovations in connected technologies, artificial intelligence, and infotainment, bringing drivers and passengers everywhere a next-generation user experience,” said Dr. Andree Zahir, senior vice president business unit infotainment & connectivity at Bosch. “We at Bosch are honored to pursue our work with Qualcomm Technologies in pushing the boundaries of in-vehicle experiences, combining our long-standing electronics expertise with the new Paramount, Premiere and Performance Snapdragon Automotive ****pit platforms.”
"Continental believes Qualcomm Technologies’ 3rd generation Snapdragon Automotive ****pit Platforms will be a perfect fit to fulfil the performance requirements needed for our high-performance ****pit computer platform, the Integrated Interior Platform,” said Uwe Schumacher, head of platform development, Division Interior, Continental. “Continental looks forward to continuing our joint efforts with Qualcomm Technologies in bringing advanced capabilities to next generation vehicles and looks forward to the launch of the Snapdragon Automotive ****pit Platforms as they will enable us to feature highly advanced functionalities, including high-end graphics across multiple in-vehicle displays.”
https://www.qualcomm.com/news/releases/2019/01/07/qualcomm-announces-multi-tiered-3rd-generation-snapdragon-automotive.
https://www.qualcomm.com/news/releases/2019/01/07/qualcomm-announces-multi-tiered-3rd-generation-snapdragon-automotive

Escovido,
Yes I was thinking along those lines.
Also maybe possible that Qualcomm have the DMS market in mind with their role out of cheap 5G Smart phones in India. All they'll need is a neat little phone docking holder to put it in.
https://telecom.economictimes.indiatimes.com/news/qualcomm-aims-to-drive-affordability-in-5g-next-year/72435016