Member Info for johnchucka

TLS,
dogfooding , that's one I have not heard.
I'm looking forward the new term for when your L4/5 car detects that you have an AD blocker switched on and parks you on the hard shoulder until you have watched five driver 'incentivised' AD's selected by the AI algo's based on your driving style , temperature and heartrate.

TLS,
dogfooding , that's one I have not heard. I

2+2=5 but the mention of Occula perhaps suggests it offers Occupant monitoring in a wider context.
Occula
https://uspto.report/TM/79290221

MEETING INSIGHT COMPUTING SYSTEM
A meeting insight computing system includes a meeting evaluation machine configured to collect quality parameters from meeting quality monitoring devices. The quality parameters each quantify meeting conditions during one or more previously-elapsed meetings and are usable to determine an overall quality score for each of the one or more previously-elapsed meetings. A graphical scheduling interface is configured to facilitate scheduling of an upcoming meeting at a designated meeting time, in a meeting location, and with one or more meeting participants. An insight generation machine is configured to report a meeting insight via the graphical scheduling interface. The meeting insight is based on the meeting time, the meeting location, the one or more meeting participants, and the quality parameters, and includes a recommendation to change one or more of the meeting time, meeting location, and meeting participants to improve a quality score of the upcoming meeting.

[0063] When included, input subsystem 608 may comprise or interface with one or more user-input devices such as a keyboard, mouse, touch screen, or game controller. In some embodiments, the input subsystem may comprise or interface with selected natural user input (NUI) componentry. Such componentry may be integrated or peripheral, and the transduction and/or processing of input actions may be handled on- or off-board. Example NUI componentry may include a microphone for speech and/or voice recognition; an infrared, color, stereoscopic, and/or depth camera for machine vision and/or gesture recognition; a head tracker, eye tracker, accelerometer, and/or gyroscope for motion detection and/or intent recognition; as well as electric-field sensing componentry for assessing brain activity.
https://tinyurl.com/y5n3gsve

12 October 2020
Seeing Machines extends its industry-leading DMS to Occupant Monitoring

The introduction of a wide field of view OMS will continue to support even the most challenging Euro NCAP DMS and semi-automated driving requirements which are traditionally achieved today with a narrow view (driver exclusive) camera system, while at the same time extending safety, comfort, and convenience features to passengers. OMS capabilities range from enabling more reliable and cost-effective passive safety systems to fully AI enabled interiors able to anticipate and care for the needs of both the driver and passenger(s).

Further, the approach, enabled by Seeing Machines's Occula® Neural Processing Unit (NPU) technology, allows a DMS to be expanded into a wide field of view interior camera system offering an array of additional high value interior and occupant sensing features with little increase in camera, illumination or embedded processing cost. This can be achieved with readily available and proven automotive image sensors and other components, greatly enhancing the value of the Company's existing product offering.
https://tinyurl.c

We did have that Microsoft Kinnect reference in one of the patents a while back (no time to look for it now).

Colin Barden
'Snapdragon Tech Summit Digital 2020 would be a great place for Qualcomm-Google to also confirm plans for eye-gaze controlled Android Automotive OS. Maybe this event is where many finally open their eyes to eye tracking'.

Like Microsoft seem to be doing with Gaze Gesture tracking?

ADAPTIVE INTERACTION MODELS BASED ON EYE GAZE GESTURES
The techniques disclosed herein provide improvements over existing systems by allowing users to efficiently modify an arrangement of a user interface of a communication session by the use of an eye gaze gesture. An eye gaze gesture input can be utilized to focus on particular aspects of shared content. In addition, an eye gaze gesture can be utilized to configure an arrangement of a user interface displaying multiple streams of shared content of a communication session. A focused view of shared content and customized user interface layouts can be shared with specific individuals based on roles and or permissions. In addition, the disclosed techniques can also select and display unique user interface controls based on an eye gaze gesture. In one illustrative example, a specific set of functionality can be made available to a user based on a type of an object that is selected using an eye gaze gesture.
https://worldwide.espacenet.com/publicationDetails/biblio?II=0&ND=3&adjacent=true&locale=en_EP&FT=D&date=20201126&CC=US&NR=2020371673A1&KC=A1

SYSTEM AND METHOD FOR TRUST PARAMETERS IN VEHICLE WARNING MESSAGES
[0095] The control module 1102 is coupled or interconnected to a plurality of vehicle sensors 1108. In an embodiment, the vehicle sensors 1108 are coupled to or interconnected with a plurality of systems and components of the vehicle 1100, including, e.g. an engine 1110, fuel system 1112, heating/cooling system 1114, braking system 1116, etc. The vehicle sensors 1108 may include various types of sensors to monitor the various systems and components of the vehicle 1100. For example, the vehicle sensors 1108 may include temperature sensors, pressure sensors, timers, clock, warnings, fuel levels, speedometer, RPMs, etc. Other types of vehicle sensors 1108 may also be implemented.

[0096] The control module 1102 may also be coupled to one or more services, such as a global positioning satellite (GPS) service 1120, traffic service 1122, navigation system 1124, on-board camera 1126, etc. The control module 1102 either through the V2X-UE 110 or other transceiver is also operable to receive information from one or more other vehicles or V2X-UEs 110, such as other vehicles, infrastructure, etc. The location module 1106 is operable to determine a location of the vehicle 1100 using one or more of the services or systems, such as the GPS service 1120, traffic service 1122, navigation system 1124 and/or on-board camera 1126.

[0097] The V2X-UE 110 receives incident information from the one or more vehicle sensors 1108 or services or other systems. Location information of the incident may be received from the location module 1106 or directly from the GPS service 1120, navigation system 1124 or other service. The V2X-UE 110 may also receive V2X messages from other vehicles or the V2X-AS 150 over the LTE or other cellular network. Based on information from these sources, the V2X-UE 110 may determine incident information and trust parameters including a trust value. The V2X-UE 110 may communicate the information to the control module 1102 to perform one or more actions, e.g. active braking, recalculate a route in the navigation system, provide a warning to the driver, etc.

[0098] FIG. 12 illustrates a schematic block diagram of an exemplary embodiment of a V2X-UE 110 in more detail. The V2X-UE 110 may be implemented in a vehicle, such as a car, bicycle, train, drone, plane, helicopter, ship, etc. The V2X-UE 110 may also be implemented in user equipment (UE) including a smart phone, smart tablet, laptop, smart watch, PC, TV or other device. Additional or alternative components and functions may be included within the V2X-UE 110 than illustrated herein. In addition, one or more of the functions and components shown herein may not be present or combined with other components or functions.
https://worldwide.espacenet.com/publicationDetails/description?CC=US&NR=2018322785A1&KC=A1&FT=D&ND=3&date=20181108&DB=&locale=en_EP

I have no idea if this is relevant but putting Nokia and Qualcomm into a search engine does bring up a good deal of collaboration.

https://www.moneycontrol.com/news/technology/nokia-9-3-pureview-gets-a-new-launch-timeline-tipped-to-feature-snapdragon-875-soc-6166741.html

https://www.nokia.com/about-us/news/releases/2020/11/18/nokia-elisa-and-qualcomm-achieve-5g-speed-record-in-finland/

Qualcomm Joins with Automotive Industry to Complete C-V2X Large-scale Capacity Test and Interoperability Demonstration
Over 100 Leading Automotive and Technology Companies Participate in Demonstrating C-V2X Technology Readiness and Industry Maturity while Accelerating C-V2X Commercialization in China
https://www.qualcomm.com/news/releases/2020/10/29/qualcomm-joins-automotive-industry-complete-c-v2x-large-scale-capacity-test

Posted with Phone Docking and the observation of numerous Nokia staff joining SEE in mind.

MULTI-CAMERA DEVICE
A method and apparatus is described comprising: obtaining first input data from a first camera of a multi-camera device; obtaining second input data from a second camera of the multi-camera device (wherein the second camera is orientated in a different direction to the first camera); defining a first region or object of interest for the first camera and/or a second region or object of interest for the second camera; tracking the first region or object of interest and/or the second region or object of interest; generating a first output data based on the first input data; generating a second output data based on the second input data; and generating a multi-camera output that includes the first and second output data.
https://worldwide.espacenet.com/publicationDetails/biblio?II=0&ND=3&adjacent=true&locale=en_EP&FT=D&date=20201126&CC=US&NR=2020374436A1&KC=A1
https://www.freepatentsonline.com/20200374436.pdf

Title , word and priority/close published date association coincidences/ synchronicity ?

Qualcomm 2020-11-19
DISTRIBUTED POSE ESTIMATION
Systems, methods, and computer-readable media are provided for distributed tracking and mapping for extended reality experiences. An example method can include computing, at a device, a pose of the device at a future time, the future time being determined based on a communication latency between the device and a mapping backend system; sending, to the mapping backend system, the pose of the device; receiving, from the mapping backend system, a map slice including map points corresponding to a scene associated with the device, the map slice being generated based on the pose of the device, wherein the map points correspond to the predicted pose; and computing an updated pose of the device based on the map slice.
Priority date:
2019-05-16
https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2020364901A1&KC=A1&FT=D&ND=3&date=20201119&DB=&locale=en_EP
https://www.freepatentsonline.com/20200364901.pdf

NVIDIA 2020-11-19
OBJECT POSE ESTIMATION
In an embodiment, a system provides object tracking and 6D pose estimations to a robot that performs different tasks such as manipulation and navigation. In an embodiment the 6D object pose is determined using a Rao-Blackwellized particle filtering framework, where the 3-D rotation and the 3-D translation of the object is decoupled. In an embodiment, the system provides the 3-D translation of an object along with a full distribution over the 3-D rotation. In an embodiment, the 3-D rotation is determined by discretizing the rotation space, and training an autoencoder network to construct a codebook of feature embeddings for the discretized rotations. In an embodiment, the system is able to track objects with arbitrary symmetries while also maintaining adequate posterior distributions.
Priority date:
2019-05-17
https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2020363815A1&KC=A1&FT=D&ND=3&date=20201119&DB=&locale=en_EP
https://www.freepatentsonline.com/20200363815.pdf

SYSTEMS AND METHODS FOR PLAYING VEHICLE MONITORED CONTENT IN A VEHICLE
In one embodiment, a safety system for playing vehicle monitored content in a vehicle while minimizing driver distraction is provided. When the driver selects a camera, such as a rear view camera, vehicle monitored content stream from the camera is displayed on a display in the vehicle. While the driver drives the vehicle, the eye-gaze of the driver is monitored. When the eye-gaze of the driver shows that the driver is looking at the display, a timer is started. The timer runs when the driver looks at the display. When the eye-gaze of the driver shows that the driver has looked at the road continuously for more than a threshold amount of time, the time associated with the vehicle monitored content is reset back to its initial value. If the timer runs out, indicating that the driver has been watching the vehicle monitored content too much without also looking at the road, the vehicle monitored content is stopped and the driver is prevented from watching the vehicle monitored content for some period of time.
https://tinyurl.com/yypuq79m
https://www.freepatentsonline.com/20200364476.pdf
https://patents.justia.com/patent/20200364476

Optimistic Enhanced Word Association?

Google
Enhanced Navigation Instructions with Landmarks Under Difficult Driving Conditions

SEE
PHONE DOCKING STATION FOR ENHANCED DRIVING SAFETY

Posting with Docking station in mind.

Enhanced Navigation Instructions with Landmarks Under Difficult Driving Conditions
[0031] In one example, the computing devices 202 may form a driving computing system incorporated into vehicle 100, for instance so that the vehicle may operate in a partially or fully autonomous driving mode. By way of example, a partially autonomous driving mode may be implemented as part of an advanced driver assistance system (ADAS), to provide adaptive cruise control or emergency braking. The driving computing system may capable of communicating with various components of the vehicle. For example, the computing devices 102 may be in communication with various systems of the vehicle, including a driving system including a deceleration system 112 (for controlling braking of the vehicle), acceleration system 114 (for controlling acceleration of the vehicle), steering system 116 (for controlling the orientation of the wheels and direction of the vehicle), signaling system 118 (for controlling turn signals), navigation system 120 (for navigating the vehicle to a location or around objects and/or providing navigation directions to a driver when operating in a manual or partially autonomous driving mode) and a positioning system 122 (for determining the position of the vehicle).

[0039] FIG. 2B illustrates one example of imaging device 200. The imaging device 200 may be part of the on-board perception system 124 of the vehicle. Or, alternatively, the imaging device 200 may be a self-contained or otherwise separate sensor unit. For instance, the imaging device 200 may be the driver's (or a passenger's) mobile phone, or it may be a wearable device (e.g., head-mounted display system, smartwatch, etc.) or other device (e.g., PDA, tablet, etc.) that can be mounted within the interior cabin of the vehicle.
The technology relates to factors regarding the external environment around a vehicle that are used to trigger enhanced driving directions for use by the driver. The factors can include issues such as adverse weather conditions, low light conditions and temporary obstacles or other obstructions that may prevent or reduce the ability of the driver to see street signs or other landmarks that are part of an initial set of driving directions. Upon determination of one or more relevant factors, the system is able to modify or otherwise enhances directions in real time. This allows the driver to be able to quickly and easily identify other visible landmarks and use such information to navigate to a desired destination. This approach employs one or more on-board cameras configured to detect objects and conditions in the environment adjacent to or otherwise nearby the vehicle, such as within line of sight of the vehicle's front end.
https://tinyurl.com/yy7vbjsn
https://www.freepatentsonline.com/20200349368.pdf

EYE GAZE BASED LIVELINESS AND MULTI-FACTOR AUTHENTICATION PROCESS
An authentication apparatus for a vehicle comprises a display device comprising a display screen configured to present display data and a scanning device configured to capture image data in a field of view. The field of view comprises a viewing region of the display device. The apparatus further comprises a controller configured to control the scanning device to capture the image data comprising a biometric data of a user and compare the biometric data of a user to an authentication template of the user. The controller is configured to validate a first authentication in response to the comparison indicating the biometric data of the user satisfies the authentication template. The controller is further configured to process a second authentication based on the image data. The second authentication comprises identifying a gaze direction of at least one eye of the user relative to a portion of the display screen.
https://worldwide.espacenet.com/publicationDetails/biblio?II=0&ND=3&adjacent=true&locale=en_EP&FT=D&date=20201112&CC=US&NR=2020353868A1&KC=A1
https://www.freepatentsonline.com/20200353868.pdf
https://patents.justia.com/patent/20200353868

And then Ebay recommend you a truck fragrance and dietary supplements based on the fart analyser results and then automatically opens the windows.

VEHICLE STATE BASED GRAPHICAL USER INTERFACE
An intelligent system, and its corresponding method, is disclosed that is capable of rendering a user interface operation version that is most appropriate given a certain state of the vehicle ensuring the driver of the vehicle continues to drive safely without distractions. The method disclosed herein provides for operating a user interface of a vehicle infotainment device or an in-car entertainment device, the user interface being operable to present one or more applications. The method comprises retrieving vehicle state input data, processing the vehicle state input data at the processing module to select one of a plurality of different user interface operation versions based on the vehicle state input data, and operating the user interface according to the selected user interface operation version by the user interface operation module.

In one embodiment the method comprises at least one application for operation in each of the different user interface versions, wherein the application is operable in different application versions, wherein each of the application versions is associated with a respective one of the different user interface operation versions. In one of many embodiments the application version comprises one of a light version, a medium version and a high version of the same application. The light version comprises basic user interface-UI complexity, the medium version comprises medium UI complexity and the high version comprises full-fledged UI complexity. The advantage of having different application versions of same application with different levels of user interface complexity or different levels of feature functionality is that it provides the driver an application version that is most suitable for the current driving condition without distracting him/her from the task of driving. For example, at high speed the method offers scope to the user to continue using an application albeit with an easier user interface that needs fewer driver inputs or interaction to function smoothly.
https://worldwide.espacenet.com/publicationDetails/inpadocPatentFamily?CC=US&NR=2020356386A1&KC=A1&FT=D&ND=3&date=20201112&DB=&locale=en_EP
https://patents.justia.com/patent/20200356386

PlusAI and Full Truck Alliance Strengthens Ties on L4 Implementation
High-speed road logistics can be the first scenes in the field of autonomous driving
On September 9th, PlusAI, a leading international autonomous driving technology company, and Full Truck Alliance announced another upgrade of their strategic cooperation. As Full Truck Alliance's exclusive autopilot technology partner, PlusAI has introduced pre-installed and mass-produced high-speed trunk auto-driving heavy trucks into its strategic cooperation with Full Truck Alliance. PlusAI will provide assistance through three dimensions, including business operation, vehicle sales, and L4 driverless technology, which is aim to help the logistics industry lower cost and increase efficiency.

PlusAI has helped FAW Jiefang recently to release an L3 level autonomous driving super heavy truck, containing: intelligence, safety, fuel-saving, reliability, and interconnection. Full Truck Alliance will carry out commercial operations based on this self-driving heavy truck. Currently, the Full Truck Alliance platform already has 9 million certified drivers and 4 million certified shippers, covering 339 cities across the country, with 110,000 routes, and the platform's annual combined transaction scale reaches CNY 800 billion.

According to Miao Tianye, Senior Vice President of Full Truck Alliance, “Manbang’s investment in PlusAI is a long-term strategic decision to make arrangements in advance for the unmanned driving that we expect to arrive in 2023."

The new model will be connected to the Full Truck Alliance's platform, using its excellent safety and fuel economy to help build a benchmark for customer service. And through optimizing supply matching and route design, collecting a large amount of real operating road test data, efficiently training the automatic driving software system, and using OTA remote update system to continuously improve vehicle performance.
https://equalocean.com/news/2020101014934

METHOD AND SYSTEM FOR DRIVING MODE SWITCHING BASED ON DRIVER'S STATE IN HYBRID DRIVING
The present teaching relates to method, system, and medium, for operating a vehicle. Real-time data related to the vehicle are received. A current mode of operation of the vehicle and a state of the driver present in the vehicle are determined. A first risk associated with the current mode of operation of the vehicle is evaluated based on the real-time data and the state of the driver in accordance with a risk model. In response to the first risk satisfying a first criterion, a second risk associated with switching the current mode to a different mode of operation of the vehicle is determined based on the state of the driver. The vehicle is switched from the current mode to the different mode when the second risk satisfies a second criterion.

[0084] By one embodiment, the sensor activator 1010 activates the in-situ sensors 1020 to detect the driver state. The in-situ sensors 1020 comprise a plurality of sensors including visual sensors, acoustic sensors, smell sensors, light sensors and the like that enable the detection of the state of the driver. For instance, the visual sensors included in the in-situ sensors 1020 may comprise a plurality of spatially distributed camera devices within the vehicle that are capable of processing and fusing images of a scene from a variety of viewpoints into some form more useful than the individual images. For example, the visual sensors may be configured to capture a pose of the driver (i.e., a posture/orientation of the driver in the driver seat). The pose information may be used to determine additional information such as a location of the driver's head with respect to a steering wheel, a direction in which the driver is looking (based on eye-tracking of the driver), etc. The information captured by the in-situ sensors 1020 is input into a driver detector unit 1030, which determines, for example, the driver's pose based on a driver detection model 1040.

[0085] Information detected by the driver detector unit 1030 e.g., the driver's pose may be input to a behavior feature detector 1050. The behavior feature detector 1050 may be configured to determine, based on a feature behavior model 1060, features associated with the detected pose of the driver. For instance, features such as whether the driver is sleeping, whether the driver is yawning, whether the driver feeling drowsy and/or vomiting and the like can be determined by the feature behavior detector 1050.
https://worldwide.espacenet.com/publicationDetails/description?CC=US&NR=2020353926A1&KC=A1&FT=D&ND=3&date=20201112&DB=&locale=en_EP
https://www.freepatentsonline.com/20200353926.pdf

Not sure Redindi, but I'd worry about waving a pedestrian across the road just in case I bought a fridge.

In some configurations, the processor 702 is, or is included in, a system-on-chip (“SoC”) along with one or more of the other components described herein below. For example, the SoC may include the processor 702, a GPU, one or more of the network connectivity components 706, and one or more of the sensor components 708. In some configurations, the processor 702 is fabricated, in part, utilizing a package-on-package (“PoP”) integrated circuit packaging technique. The processor 702 may be a single core or multi-core processor.

The processor 702 may be created in accordance with an ARM architecture, available for license from ARM HOLDINGS of Cambridge, United Kingdom. Alternatively, the processor 702 may be created in accordance with an x86 architecture, such as is available from INTEL CORPORATION of Mountain View, Calif. and others. In some configurations, the processor 702 is a SNAPDRAGON SoC, available from QUALCOMM of San Diego, Calif., a TEGRA SoC, available from NVIDIA of Santa Clara, Calif., a HUMMINGBIRD SoC, available from SAMSUNG of Seoul, South Korea, an Open Multimedia Application Platform (“OMAP”) SoC, available from TEXAS INSTRUMENTS of Dallas, Tex., a customized version of any of the above SoCs, or a proprietary SoC.

The memory components 704 include a random access memory (“RAM”) 714, a read-only memory (“ROM”) 716, an integrated storage memory (“integrated storage”) 718, and a removable storage memory (“removable storage”) 720. In some configurations, the RAM 714 or a portion thereof, the ROM 716 or a portion thereof, and/or some combination of the RAM 714 and the ROM 716 is integrated in the processor 702. In some configurations, the ROM 716 is configured to store a firmware, an operating system or a portion thereof (e.g., operating system kernel), and/or a bootloader to load an operating system kernel from the integrated storage 718 and/or the removable storage 720.