Member Info for johnchucka

SYSTEMS AND METHODS TO ENFORCE A CURFEW

The disclosure is generally directed to systems and methods to enforce a curfew upon a driver. In an example method, a processor makes a determination whether a vehicle operated by a driver is located inside a geofence during a curfew. The processor reports to user a violation of the curfew if the vehicle is not located inside the geofence during the curfew. The processor may also report an expected curfew violation (based on a speed and/or a distance evaluation of the vehicle) when the vehicle is unable to enter the geofence before a start of the curfew. If the vehicle is located inside the geofence during the curfew, the processor bestows privacy to a travel history of the driver. The travel history is associated with travel by the driver outside the geofence at times other than the curfew.

https://worldwide.espacenet.com/publicationDetails/biblio?II=39&ND=3&adjacent=true&locale=en_EP&FT=D&date=20230608&CC=US&NR=2023175850A1&KC=A1

https://www.freepatentsonline.com/20230175850.pdf

SYSTEM AND METHOD FOR DETERMINING OBJECT-WISE SITUATIONAL AWARENESS

A system and method for determining object-wise situational awareness that includes receiving data associated with a driving scene of a vehicle, an eye gaze of a driver of the vehicle, and alerts that are provided to the driver of the vehicle. The system and method also includes analyzing the data and extracting features associated with dynamic objects located within the driving scene, the eye gaze of the driver of the vehicle, and the alerts provided to the driver of the vehicle. The system and method additionally includes determining a level of situational awareness of the driver with respect to the each of the dynamic objects based on the features. The system and method further includes communicating control signals to electronically control at least one component of the vehicle based on the situational awareness of the driver.

https://worldwide.espacenet.com/publicationDetails/biblio?II=1&ND=3&adjacent=true&locale=en_EP&FT=D&date=20230615&CC=US&NR=2023182745A1&KC=A1

https://www.freepatentsonline.com/20230182745.pdf

METHODS AND DEVICES FOR TRIGGERING VEHICULAR ACTIONS BASED ON PASSENGER ACTIONS

Autonomous driving system methods and devices which trigger vehicular actions based on the monitoring of one or more occupants of a vehicle are presented. The methods, and corresponding devices, may include identifying a plurality of features in a plurality of subsets of image data detailing the one or more occupants; tracking changes over time of the plurality of features over the plurality of subsets of image data; determining a state, from a plurality of states, of the one or more occupants based on the tracked changes; and triggering the vehicular action based on the determined state.

[0022] The following methods and devices use in-vehicle passenger monitoring data which is captured with a one or more in-vehicle data acquisition devices (e.g. a camera providing RGB, depth, and/or infrared data) and apply a spatio-temporal analysis modeling scheme to trigger vehicular actions. These methods and devices provide accurate and quick mechanisms to recognize a driver's state, for example, in order to take precautionary measures, such as providing an appropriate distance from a vehicle located in front or providing a notification to the driver of the vehicle. Each recognized state may be associated with a corresponding time value which reflects the driver's reaction time. Based on this time value, a theoretical safe distance to any externally detected objects (e.g. other vehicles) may be calculated and the appropriate vehicular action may be triggered.

https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2023174065A1&KC=A1&FT=D&ND=3&date=20230608&DB=&locale=en_EP

https://www.freepatentsonline.com/20230174065.pdf

VEHICULAR PERSONALIZED ADAPTIVE CRUISE CONTROL SYSTEM THAT CONTROLS A VEHICLE IN ACCORDANCE WITH PARAMETERS FOR AN IDENTIFIED DRIVER

A vehicular personalized adaptive cruise control system includes a forward-viewing camera viewing forward through a windshield of a vehicle, and an electronic control unit disposed at the vehicle. When the vehicle is operating in an adaptive cruise control mode, the system controls driving of the vehicle. When the equipped vehicle is not operating in the adaptive cruise control mode, a driver present in the vehicle drives the vehicle. The system identifies the driver via processing of image data captured by a cabin monitoring camera. When the identified driver drives the vehicle with the vehicle not operating in the adaptive cruise control mode, the system determines and stores personalized parameters for the identified driver. With the identified driver present in the vehicle, and when the vehicle is operating in the adaptive cruise control mode, the system uses the determined personalized parameters.

https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2023174052A1&KC=A1&FT=D&ND=3&date=20230608&DB=&locale=en_EP

https://www.freepatentsonline.com/20230174052.pdf

VEHICULAR DRIVER MONITORING SYSTEM

A vehicular driver monitoring system includes an interior electrochromic rearview mirror assembly and a camera disposed at the interior electrochromic rearview mirror assembly behind and viewing through an electrochromic mirror reflective element into the interior cabin of the vehicle. Supplemental sources of near infrared illumination are integrated into the mirror assembly that, when powered to emit near infrared light, illuminate at least the driver-side front seating area within the interior cabin of the vehicle. Presence of the camera is not readily apparent to an occupant of the vehicle. The camera at least (a) views the driver-side front seating area of the equipped vehicle and (b) views a passenger-side front seating area of the equipped vehicle. The driver of the equipped vehicle is monitored via processing at the processor of image data captured by the camera.

https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2023177885A1&KC=A1&FT=D&ND=3&date=20230608&DB=&locale=en_EP

https://www.freepatentsonline.com/20230177885.pdf

Https://www.linkedin.com/feed/update/urn:li:activity:7072168353011752960/

headlines were made this week with nvidia becoming the first chip company to achieve a $1 trillion valuation. what wasn't widely reported was a partnership between nvidia and mediatek for #automotive #socs focused on #incabin applications. nvidia is bringing #gpu and #ai expertise. but why partner with mediatek? is nvidia stepping back from auto? let's dive in.

nvidia's #auto #strategy has been focused on #autonomous driving, with an inexorable rise in processing performance of its chips. xavier (30 #tops), orin (254 tops), atlan (1000 tops, and dropped) and thor (2000 tops). but there is no trend to autonomous operation in privately-owned passenger vehicles. take an honest look at cruise and waymo in san francisco, and there isn't much progress on #robotaxis either. they work until they don't.

nvidia now looks to be focusing resources on generative ai rather than automotive. with autonomous driving stalled, it has a portfolio that's too powerful, too expensive and consumes too much power for the #digital #****pit. so it looks to be going after generative ai, while providing critical gpu and ai #ip to mediatek to go for the ****pit. that's smart.

nvidia's move tells us this: automotive has pivoted from driving technology to ****pit technology. #automakers, tier 1s and #tech companies that want to succeed in automotive now need to be focused primarily on the ****pit. that trend has been looming. it is now here.

who's in the lead in the digital ****pit? qualcomm. by an absolute mile. while just about everyone else was mesmerized by #selfdriving, qualcomm was selected by all the major global automakers to provide its ****pit #applications #processors.

cars and trucks aren't "smartphones on wheels" but the ****pit is now integrating automotive-grade ip that has more in common with a smartphone than an engine or abs controller. the winning suppliers in ****pit applications processors will be tech companies with a vast waelth of expertise in smartphone processors. that's qualcomm and mediatek. but isn't nvidia.

despite the trillion-dollar valuation, nvidia knew it couldn't compete with qualcomm in the ****pit, so partnered with mediatek, who can. the ****pit battle lines are now drawn: qualcomm vs. mediatek. it is going to be epic.

what about the fruit company? they find themselves on the other side of the “embedded vs. plugged-in” applications processor debate to qualcomm and mediatek. sure, apple is a powerful player with a loyal following. but the graphic below shows the constituent parts of a successful ****pit strategy, and the automakers want to provide advanced #user #experiences leading to products and services they can charge subscriptions for. what they don't want to do is gift dashboard real estate to apple. meaning carplay's days are numbered.

https://www.linkedin.com/feed/update/urn:li:activity:7070662902910726144/

VEHICULAR DRIVER MONITORING SYSTEM

A vehicular driver monitoring system includes a driver monitoring camera disposed at an interior rearview mirror assembly of a vehicle. The driver monitoring camera views a driver of the vehicle when the driver is driving the vehicle. The driver monitoring camera captures image data. An image processor is operable to process image data captured by the driver monitoring camera. The vehicular driver monitoring system determines driver performance based at least in part on (i) image processing by the image processor of image data captured by the driver monitoring camera, (ii) a vehicle characteristic and (iii) a condition exterior of the equipped vehicle. The vehicle characteristic includes at least one selected from the group consisting of (a) vehicle speed, (b) vehicle acceleration and (c) vehicle orientation.

https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2023166660A1&KC=A1&FT=D&ND=3&date=20230601&DB=&locale=en_EP

https://www.freepatentsonline.com/20230166660.pdf

Https://www.linkedin.com/in/colin-barnden-1081376/

the ford motor company capital markets day didn't make any specific references to ford's #****pit #strategy. thus with the information available, bmw group still looks to be far in the lead with next generation #incabin experiences. we got some clues from its concept i vision dee shown below, which looks set to go into production in 2025 as the #neueklasse (new 3-series). we need to go a long way back to ces 2020 (pre-covid!) to find the details of what is coming.

techcrunch had the scoop: (https://lnkd.in/e4fz3k4w) and the key components are:

1. gaze detection system, which can also track what you’re looking at outside of the car and then present relevant information about it. #eyegaze judged to be supplied by seeing machines.

2. simplifying the driver’s interaction with the car’s system, including #touch, #gesture and #speech recognition. speech judged to be supplied by cerence inc., gesture from seeing machines.

3. a head-up display #hud that covers the entire front-end windscreen, which essentially makes the car a big #augmentedreality #ar screen on wheels. judged to be supplied by valeo.

based on subsequent developments, the 2025 neue klasse is likely to be the first production vehicle using the qualcomm #snapdragon #ride #flex #soc, with automated driving stack supplied by arriver. the #adas #domain #controller is judged to be supplied by valeo. bmw has already adopted google's #android automotive #os #aaos for the ****pit.

so what is bmw doing that is different to most other oems? it is buying in almost every part of the #tech stack for the vehicle. it is even lead development partner for qualcomm's arriver automated driving #software.

ford, general motors, mercedes-benz ag, toyota motor corporation, volkswagen group, and volvo cars have all attempted (or are attempting) to do aspects of the driving or ****pit tech stack in-house, with varying results and in some cases long delays. not so bmw, which instead has turned to a small number of world-class technology and software suppliers and rested on their expertise to build its technology #ecosystem. this week we saw renault group is following exactly the same approach, interestingly also working with valeo.

we hear a lot about the future of the software defined vehicle #sdv. for some #automakers, software will instead be a disaster. bmw and renault look to be doing something different and focusing their resources onto vehicle design and customer experiences and leaving #technology development to tech companies.

the key lesson here for automakers? don't reinvent the wheel.

device and method for evaluating skills

the invention relates to a method for evaluating technical and non-technical skills of an operator comprising: - a step of collecting endogenous data relating to physical manifestations of the operator, and exogenous data relating to the context of a session; - steps implemented by data processing modules of: - correlating the collected data in order to connect endogenous data to exogenous data; - using the correlated data to detect observable behaviour data comprising at least one triggering event parameter and one action parameter; - analysing the observable behaviour data according to predefined analysis sequences, each predefined analysis sequence being specific to a skill to be evaluated, and comprising a triggering event parameter and an action parameter characterising an expected observable behaviour according to a predefined situation, the analysis generating a measurement indicator; - evaluating the behaviours of the operator, by comparing an observed behaviour with an expected reference behaviour; - evaluating each skill of the operator depending on the results of the behaviour evaluations.

[0034]

in the present description, the term “endogenous data” designates the physical parameters or manifestations coming from the operator, i.e. the pilot, and/or from the team of operators, i.e. his crew.

for example, gaze or pupil tracking, detection of a particular posture, gesture recognition, analysis of communications or manipulative actions on a real or simulated platform can be considered as data endogenous.

the term "exogenous data" characterizes, for its part, all the data related to the context such as avionics data from the platform, elements related to the scenario and the scenario of the operator's know-how or the team of operators or the weather forecast displayed.

overall, all the exogenous data come from the platform.

in addition, the platform represents the cabin housing the operator or the team of operators.

thus, in the context of a training situation requiring a simulation of a flight situation, the platform represents the measurement device hosting the operator or the operator team.

conversely, in the context of a real flight situation, the platform then represents the ****pit of the aircraft in which the operator or the team of operators evolves.

[0038] more specifically, the endogenous data collected during step 102 represent elementary events detected by the evaluation method 100 and observation parameters (brief eye movement, eye path), manipulation detected on the platform such as tactile actions carried out by the pilot on his platform, on his on-board instruments or even communication with voice parameters, lexicon used, locution.

https://worldwide.espacenet.com/publicationdetails/biblio?cc=wo&nr=2022171563a1&kc=a1&ft=d&nd=3&date=20220818&db=&locale=en_ep

https://www.freepatentsonline.com/wo2022171563a1.pdf

VEHICULAR CONTROL SYSTEM WITH HANDOVER PROCEDURE FOR DRIVER OF CONTROLLED VEHICLE

A vehicular control system includes a forward-viewing camera, a forward-sensing sensor and an in-cabin-sensing sensor. With the system controlling driving of the vehicle, the system determines a triggering event that triggers handing over driving of the vehicle to a driver of the vehicle before the vehicle encounters an event point associated with the triggering event. The vehicular control system (i) determines a total action time available before the vehicle encounters the event point, (ii) estimates a driver takeover time for the driver to take over control of the vehicle and (iii) estimates a handling time for the driver to control the vehicle to avoid encountering the event point. Responsive to the vehicular control system determining that the estimated driver takeover time is less than the difference between the determined total action time and the estimated handling time, control of the vehicle is handed over to the driver of the vehicle.

https://worldwide.espacenet.com/publicationDetails/biblio?II=7&ND=3&adjacent=true&locale=en_EP&FT=D&date=20230525&CC=US&NR=2023161343A1&KC=A1

https://www.freepatentsonline.com/20230161343.pdf

VEHICULAR OCCUPANT MONITORING SYSTEM USING CENTRALIZED CAMERA WITH EXPANDED VIEW

A vehicular vision system includes a camera disposed within a cabin of a vehicle equipped with the vehicular vision system and positionable to view within an interior cabin of the vehicle and positionable to view exterior of the vehicle through at least one window of the vehicle. The system includes an actuator disposed at the vehicle and electrically operable to rotate the camera about an axis relative to the vehicle. Multiple frames of image data captured by the camera as the camera rotates about the axis are processed at an ECU for a plurality of vehicle functions. Respective frames of image data of the multiple frames of captured image data are processed for respective vehicle functions of the plurality of vehicle functions based on respective viewing directions of the camera when the respective frames of image data are captured by the camera.

https://worldwide.espacenet.com/publicationDetails/biblio?II=6&ND=3&adjacent=true&locale=en_EP&FT=D&date=20230525&CC=US&NR=2023162463A1&KC=A1

https://www.freepatentsonline.com/20230162463.pdf

VEHICULAR PRISMATIC INTERIOR REARVIEW MIRROR ASSEMBLY WITH DRIVER MONITORING CAMERA

A vehicular interior rearview mirror assembly includes a mirror head adjustably attached at a mounting base. The mirror head includes a prismatic mirror reflective element having a wedge-shaped, reflector-coated glass substrate having a front side and a rear side separated by a thickness of the glass substrate, with the thickness of the glass substrate varying between a lower edge region of the glass substrate and an upper edge region of the glass substrate. A driver monitoring camera is accommodated by the mirror head and views through the prismatic mirror reflective element. A refraction-compensating element is disposed between a lens of the driver monitoring camera and the rear side of the glass substrate of the prismatic mirror reflective element. The refraction-compensating element is a wedge-shaped element that offsets refraction of light that passes through the wedge-shaped, reflector coated glass substrate of the prismatic mirror reflective element.

https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2023158955A1&KC=A1&FT=D&ND=3&date=20230525&DB=&locale=en_EP

https://www.freepatentsonline.com/20230158955.pdf

https://patents.justia.com/patent/20230158955

Interior Camera System for a Self Driving Car

The technology provides an interior camera sensing system for self-driving vehicles. The sensor system includes image sensors and infrared illuminators to see the vehicle's cabin and storage areas in all ambient lighting conditions. The system can monitor the vehicle for safety purposes, to detect the cleanliness of the cabin and storage areas, as well as to detect whether packages or other objects have been inadvertently left in the vehicle. The cameras are arranged to focus on selected regions in the vehicle cabin and the system carries out certain actions in response to information evaluated for those regions. The interior space is divided into multiple zones assigned different coverage priorities. Regardless of elude size or configuration, certain actions are performed according to various ride checklists and the imagery detected by the interior cameras. The checklists include pre-ride, mid-ride, and post-ride checklists.

https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2023150440A1&KC=A1&FT=D&ND=3&date=20230518&DB=&locale=en_EP

https://www.freepatentsonline.com/20230150440.pdf

SYSTEM AND METHOD OF MANAGING A DRIVER TAKE-OVER FROM AN AUTONOMOUS VEHICLE BASED ON MONITORED DRIVER BEHAVIOR

A method of managing operator take-over of autonomous vehicle. The method includes gathering information on an external surrounding of the autonomous vehicle; analyzing the gathered information on the external surrounding of the autonomous vehicle to determine an upcoming traffic pattern; gathering information on an operator of the autonomous vehicle; analyzing the gathered information on the operator of the autonomous vehicle to determine an operator behavior; predicting an operator action based on the determined upcoming traffic pattern and the determined operator behavior; and initiating a predetermined vehicle response based on the predicted operator action. The predicting the operator action includes comparing the determined upcoming traffic pattern with a similar historic traffic pattern and retrieving a historical operator action in response to the similar historical pattern.

https://worldwide.espacenet.com/publicationDetails/biblio?II=8&ND=3&adjacent=true&locale=en_EP&FT=D&date=20230518&CC=US&NR=2023150552A1&KC=A1

https://www.freepatentsonline.com/20230150552.pdf

https://patents.justia.com/patent/20230150552

VEHICULAR VISION SYSTEM

A vehicular vision system includes an interior-viewing camera disposed in a vehicle and viewing a driver of the vehicle, and a forward-viewing camera disposed at the vehicle and viewing at least forward of the vehicle. Responsive to image processing of image data captured by the interior-viewing camera, at least one selected from the group consisting of (i) position of the driver's head is determined and (ii) direction that the driver's eyes are viewing is determined. Responsive to image processing of image data captured by the forward-viewing camera and to image processing of image data captured by the interior-viewing camera, an object present exterior of the equipped vehicle and viewable by the driver is detected.

https://worldwide.espacenet.com/publicationDetails/biblio?II=2&ND=3&adjacent=true&locale=en_EP&FT=D&date=20230518&CC=US&NR=2023150430A1&KC=A1

https://www.freepatentsonline.com/20230150430.pdf

the state of the art for high-fidelity #eyetracking is in the #aviation sector. this week we have seen a licensing agreement between seeing machines and collins aerospace for the development of eye tracking in commercial aviation to detect and mitigate #pilot #fatigue. the system is explained in more depth in this video: https://lnkd.in/evixvyhi

the image below shows the role of robust, high-fidelity eye tracking working in combination with a head-up display #hud. the white cross and purple tracer line show the real-time location of the pilot's eye gaze. from this data, instrument scan glance pattern analysis can be developed, leading to high level signals such as #workload, #attention and #engagement. these signals are vital not only for pilot training, but also for crew management in the #****pit.

this #technology, when transferred from the flight deck to the car ****pit, gives an insight into the future of the #automotive industry. robust, high-fidelity eye tracking combined with an augmented reality hud provides the foundations for revolutionary new products and services upon which new business models can be built. we don't know the specifics yet, but #incabin subscriptions will be for #interactive and #immersive #services powered by eye tracking, not for heated seats.

#automakers and tier one suppliers wanting to develop these great digital experiences need to understand the role of eye tracking and #ar hud. bmw group looks to be in a league of its own already with the concept i vision dee, and we'll see more in the 2025 #neueklasse.

#oems must get their eye tracking #strategy and feature set right, not relegate the function to #gsr #ncap minimums.

Seize, Owlcam make interior monitoring systems for vehicles just like the one featured in the Qualcomm clip. I can't find an Owlcam clip that shows the green square driver head position so that maybe new and/or specific to Qualcomm. You may well not be missing anything but it looks to me like a great place and opportunity to add SEE OMS tech.

https://www.youtube.com/@owlcam152

Https://www.youtube.com/watch?v=w_e7I0ZJqxo