Member Info for johnchucka

Ford, VW-backed Argo AI is shutting down

Ford said in its third-quarter earnings report released Wednesday that it made a strategic decision to shift its resources to developing advanced driver assistance systems, and not autonomous vehicle technology that can be applied to robotaxis. The company said it recorded a $2.7 billion non-cash, pretax impairment on its investment in Argo AI, resulting in an $827 million net loss for the third quarter.
https://techcrunch.com/2022/10/26/ford-vw-backed-argo-ai-is-shutting-down/

Exclusive: Tesla faces U.S. criminal probe over self-driving claims
https://www.reuters.com/legal/exclusive-tesla-faces-us-criminal-probe-over-self-driving-claims-sources-2022-10-26/

Determination of Gaze Direction
A method for estimating a gaze direction of a user includes acquiring an image of a face of the user, determining an approximate gaze direction based on a current head pose and a relationship between head pose and gaze direction, determining an estimated gaze direction based on detected eye features, determining a precise gaze direction based on glint position and eye features, and combining the approximate gaze direction and at least one of the estimated gaze direction and the precise gaze direction to provide a corrected gaze direction.
https://worldwide.espacenet.com/publicationDetails/description?CC=US&NR=2022335648A1&KC=A1&FT=D&ND=3&date=20221020&DB=&locale=en_EP
https://www.freepatentsonline.com/20220335648.pdf

TAGGING OBJECTS WITH FAULT OVERRIDE PATTERNS DURING CALIBRATION OF VEHICLE SENSING SYSTEMS
A vision sensing system of a vehicle comprising a camera, an object detection module, and a calibration module. The object detection module is configured to detect a first object in data received from the camera. The calibration module is configured to calibrate the object detection module to detect the first object in the presence of a second object that obstructs a view of the camera and that includes a predetermined pattern sensed by the camera. A driver monitoring system for a vehicle comprises a camera and a driver monitoring module. The camera is arranged proximate to a steering wheel of the vehicle to monitor a face of a driver of the vehicle. The driver monitoring module is configured to detect an obstruction between the camera and the face of the driver and to ignore the obstruction in response to the obstruction including a predetermined pattern sensed by the camera.
https://worldwide.espacenet.com/publicationDetails/biblio?II=0&ND=3&adjacent=true&locale=en_EP&FT=D&date=20221013&CC=US&NR=2022327319A1&KC=A1
https://www.freepatentsonline.com/20220327319.pdf

EYES-ON-ROAD DETECTION
A computer includes a processor and a memory storing instructions executable by the processor to receive data indicating a gaze direction of an occupant of the vehicle; determine whether the gaze direction is in a permitted area defined by a boundary, the permitted area being in a forward direction of travel of the vehicle; laterally adjust the boundary of the permitted area based on a speed of the vehicle and based on data indicating turning of the vehicle; and control the vehicle based on whether the gaze direction is in the permitted area.
https://worldwide.espacenet.com/publicationDetails/biblio?II=5&ND=3&adjacent=true&locale=en_EP&FT=D&date=20221013&CC=US&NR=2022324457A1&KC=A1
https://www.freepatentsonline.com/20220324457.pdf

TRAVEL CONTROLLER AND METHOD FOR TRAVEL CONTROL
A travel controller detects, from an image representing the face of a driver of a vehicle, an act of the driver checking surroundings of the vehicle, records a time at which the act of checking is detected, and suggests to the driver a lane change for the vehicle to change a travel lane to an adjoining lane. In the case that the act of checking is detected in a precheck period before a suggestion time at which the lane change is suggested, the travel controller makes the vehicle execute the lane change regardless of whether the act of checking is detected in a post-suggestion check period after the suggestion time of the lane change.

[0023] The driver monitoring camera 3 is an example of a driver capturing unit for generating a face image representing a face region of the driver of the vehicle. The driver monitoring camera 3 includes a two-dimensional detector constructed from an array of optoelectronic transducers, such as CCD or C-MOS, having sensitivity to infrared light, a focusing optical system that forms an image of a target region on the two-dimensional detector, and a light source that emits infrared light. The driver monitoring camera 3 is mounted, for example, in a front area in the interior of the vehicle and oriented toward the face of the driver sitting on the driver's seat. The driver monitoring camera 3 irradiates the driver with infrared light every predetermined capturing period (e.g. 1/30 to 1/10 seconds), and outputs an image showing the driver's face.

[0032] The detection unit 431 may detect the driver's act of checking when the horizontal angle between the driver's face orientation angle detected from a face image and the travel direction of the vehicle 1 is greater than a predetermined angle threshold. In this case, the detection unit 431 inputs the face image into a facial part classifier that has been trained to detect predetermined facial parts, such as the inner and outer canthi and the corners of the mouth, thereby identifying the positions of the predetermined parts included in the face image. The detection unit 431 further compares the positions of the predetermined parts detected from the face image with a three-dimensional model of a standard face. Then, the detection unit 431 detects the face orientation angle of the three-dimensional model at which the position of each part best fits that of the corresponding part detected from the face image, as the face orientation angle of the face image.
https://worldwide.espacenet.com/publicationDetails/biblio?II=0&ND=3&adjacent=true&locale=en_EP&FT=D&date=20220922&CC=US&NR=2022297714A1&KC=A1
https://www.freepatentsonline.com/20220297714.pdf

DRIVER MONITORING DEVICE, DRIVER MONITORING METHOD, AND DRIVER MONITORING-USE COMPUTER PROGRAM
The driver monitoring device includes a processor configured to detect an opening/closing state of eyes of a driver of a vehicle based on a facial image in which a face of the driver is shown, judge whether the driver has fallen asleep based on the opening/closing state of the eyes, and judge whether the driver is talking. The processor is configured not to judge that the driver has fallen asleep while it is judged that the driver is talking.
https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2022309808A1&KC=A1&FT=D&ND=3&date=20220929&DB=&locale=en_EP
https://www.freepatentsonline.com/20220309808.pdf
https://patents.justia.com/patent/20220309808

Method and System for Collaborative Task-Based Allocation Between Human and Autonomous Systems
Various systems described herein may perform three interconnected functions: 1) monitor an operator or pilot's physiological state; 2) assesses when the operator is experiencing one or more anomalous states; and 3) mitigate risks by a combination of dynamic, context-based unilateral or collaborative dynamic function allocation of operational tasks. At a high level, a monitoring process may receive high data-rate sensor values from psychophysiological sensors, e.g., eye-tracking, electrocardiogram, electroencephalography, amongst others. An assessment process may obtain these values or derivatives thereof and perform a classification. In one embodiment, a classification may be developed using machine learning algorithms. A mitigation process may invoke a collaboration protocol, which may be referred to as a DFACCto protocol, which, based on context, causes one or more autonomous operation modules to perform one or more tasks that the human operator or pilot would otherwise routinely execute absent implementation of the protocol.

FIG. 1 provides a high level block diagram of the system 100 of certain illustrated embodiments. At base, the system 100 includes one or more human operators 105, a vehicle (may be physical vehicle or a partial or fully-simulator vehicle) 110, a crew state monitoring (CSM) module 115, a vehicle status determination module 120, a DFACCto module 125, and an adaptable autonomous system 130. FIG. 1 is not intended to limit the system. One skilled in the art recognizes that additional components, modules, subsystems, systems and functionality may be added to the system and/or combined with those identified in FIG. 1. Additionally, certain components and/or functionality shown separately, may be consolidated in a single processor and/or physical manifestation. For example, although illustrated separately, the adaptable autonomous system 130 may be part of the vehicle 110. In the case of simulator embodiments, the vehicle may be a vehicle simulator, which one skilled in the art will recognize may have different configurations and components to simulate desired situations. The interconnected functions referenced above are applicable to both simulation and real-world operations. Certain alternative and exemplary embodiments are further described herein.
https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2022306143A1&KC=A1&FT=D&ND=3&date=20220929&DB=&locale=en_EP
https://www.freepatentsonline.com/20220306143.pdf
https://patents.justia.com/patent/20220306143

Patent Issue Notification
DRIVER ATTENTION STATE ESTIMATION
https://worldwide.espacenet.com/publicationDetails/biblio?II=0&ND=4&adjacent=true&locale=en_EP&FT=D&date=20211202&CC=US&NR=2021374443A1&KC=A1
https://register.epo.org/documentView?number=US.201917280591.A&documentId=1-1-US++172805910WP1+

METHODS AND SYSTEMS FOR AUTONOMOUS PATH PLANNING TRIGGERED BY FREEWAY RUBBERNECKING
A method for autonomous path planning triggered by freeway rubbernecking includes obtaining gaze directions of drivers of a plurality of connected vehicles in a region of a road. The method also includes determining whether an average speed of the plurality of connected vehicles in the region is less than a predetermined speed. The method further includes controlling mobility of one or more of the plurality of connected vehicles in response to determining that the gaze directions of one or more drivers of the plurality of connected vehicles deviate from the moving direction of the connected vehicles and determining that the average speed of the connected vehicles is less than the predetermined speed.

Intelligent vehicle features, such as autonomous driving, adaptive cruise control (ACC), and cooperative adaptive cruise control (CACC), allow a vehicle to navigate a road with minimal assistance from its driver. They may also allow the vehicle to coordinate its navigation with other vehicles on the road. If a vehicle with such features can detect or gather sufficient data to allow for the detection of increased traffic congestion due to rubbernecking, the vehicles can utilize these intelligent features to coordinate with other vehicles to thereby mitigate the effects of rubbernecking. For example, upon detection of increased traffic congestion due to rubbernecking, vehicles may activate ACC/CACC, as illustrated in FIG. 4. Upon detection of increased traffic congestion due to rubbernecking, a vehicle may also move itself into another lane where there are fewer vehicles, as illustrated in FIG. 8. A vehicle may also increase the level of autonomous driving to maintain proper driving while the driver is distracted. The systems may utilize vehicle-to-vehicle (V2V), vehicle-to-everything (V2X), or other forms of communications to facilitate such coordination. Accordingly, disclosed herein are alternative methods for preventing, in real-time, traffic congestion and potential collisions caused by rubbernecking.
https://worldwide.espacenet.com/publicationDetails/biblio?II=0&ND=3&adjacent=true&locale=en_EP&FT=D&date=20220929&CC=US&NR=2022306122A1&KC=A1
https://www.freepatentsonline.com/20220306122.pdf
https://patents.justia.com/patent/20220306122

PERSONALIZED CALIBRATION FUNCTIONS FOR USER GAZE DETECTION IN AUTONOMOUS DRIVING APPLICATIONS
In various examples, systems and methods are disclosed that provide highly accurate gaze predictions that are specific to a particular user by generating and applying, in deployment, personalized calibration functions to outputs and/or layers of a machine learning model. The calibration functions corresponding to a specific user may operate on outputs (e.g., gaze predictions from a machine learning model) to provide updated values and gaze predictions. The calibration functions may also be applied one or more last layers of the machine learning model to operate on features identified by the model and provide values that are more accurate. The calibration functions may be generated using explicit calibration methods by instructing users to gaze at a number of identified ground truth locations within the interior of the vehicle. Once generated, the calibration functions may be modified or refined through implicit gaze calibration points and/or regions based on gaze saliency maps.
https://worldwide.espacenet.com/publicationDetails/description?CC=US&NR=2022300072A1&KC=A1&FT=D&ND=3&date=20220922&DB=&locale=en_EP
https://www.freepatentsonline.com/20220300072.pdf

[0014] In yet another embodiment, the step or operation of alerting the driver of the change in the condition(s) after transmission of the signal to the computing device, can further involve steps or logical operations for establishing a wireless connection between the computing device and a radio system of the vehicle; and providing an audible alert from the computing device indicative of the change in the condition(s) via the radio system. In still another embodiment, the step or operation of monitoring a condition external to the vehicle while the vehicle is in operation and the driver of the vehicle is located in the driver seat of the vehicle, can further include a step or operation o monitoring the condition(s) with a camera (e.g., video camera, HD camera, 360 degree video camera, etc.) that communicates with the computing device. In some embodiments, the video camera may be integrated with the computing device (e.g., a tablet computing device video camera, smartphone video camera, etc.), while in other embodiments, the camera may be a standalone camera positioned within the vehicle to monitor the condition(s) and which communicates via a wireless connection with the computing device (e.g., tablet computing device, smartphone, smartwatch, integrated in-vehicle computing system, etc.).

VEHICLE MONITORING SYSTEM FOR PROVIDING ALERTS TO DRIVERS
[0045] In another embodiment, the camera 19 may be implemented as a standalone camera that communicates wirelessly with the computing device 21 via wireless communications as described in greater detail herein. FIG. 2(b) illustrates an example camera 19, which may be located in an optimal location with the vehicle for monitoring conditions external to the vehicle, in accordance with another embodiment. In the FIG. 2(b) implementation, the camera 19 may communicate wirelessly with the computing device 21. One non-limiting example of a video camera which may adapted for use as, for example, camera 19 shown in FIG. 2(b) is disclosed in U.S. Patent Application Publication No. 20140047143 entitled “Wireless video camera and connection methods including a USB emulation,” which issued on Feb. 13, 2014 and is incorporated herein by reference in its entirety.

[0046] Camera 19 may also be implemented as, for example, a so-called dashcam or dash cam. A dashcam (dashboard camera) is an onboard camera that attaches to the vehicle's interior windscreen by either a supplied suction cup mount or an adhesive-tape mount. It can also be positioned on top of the dashboard or attached to the rear-view mirror with a special mount. It continuously records the road ahead while the vehicle is in motion. Various types of dashcam can be implemented as camera 19, ranging from basic video cameras to those capable of recording parameters such as date/time, speed, G-forces and location. In some embodiments, camera 19 may be implemented as a wearable video camera that monitors conditions external to the vehicle or within the vehicle. Such a video camera may be, for example, a lapel camera worn by a the vehicle driver and/or a passenger.

[0054] FIG. 5 illustrates a method 50 for tracking driver activity, in accordance with an alternative embodiment. It can be appreciated that in some embodiments, the disclosed monitoring method/system can be modified to monitor not just external conditions or activities, but the activity of the driver itself in order to track, for example, driver inattentiveness. As depicted at block 52, a step or logical operation can be implemented for tracking and recording in a memory of a computing system data indicative of the number of times the driver is alerted to a change a condition. Then, as shown at block 54, a step or logical operation can be implemented to periodically retrieve such data from the memory, and as shown at block 56, transmit such data wirelessly from the computing system to a central repository for further storage and analysis. Such data may be useful, for example, for insurance companies.
https://worldwide.espacenet.com/publicationDetails/description?CC=US&NR=2022281383A1&KC=A1&FT=D&ND=4&date=20220908&DB=&locale=en_EP
https://www.freepatentsonline.com/20220281383.pdf

'We've taken something like an AI technology, and we've put it to good use. Video surveillance and AI, you know it can be a dark thing if you're not careful with the way you're using it and we're always trying to create positive outcomes with technology, and we think that's part of the ingredients to being a successful business'.

Tim Edwards.
https://www.youtube.com/watch?v=jeaCM4vAQA0

MODIFICATION OF TRANSPORT FUNCTIONALITY BASED ON CARBON FOOTPRINT
To encourage users to improve their carbon footprint, a transport may be provided with an enhanced operating manner in response to external events that lower the carbon footprint of one or more occupants of the transport. Events, such as lowering the energy consumption of a person's home dwelling, may be communicated to the transport and trigger an enhanced mode in the transport, such as an enhanced driving mode (e.g. sport mode) or an enhanced charging mode.

Consideration of environmental impacts extends not only to individuals, but to groups, e.g. families, teams, classes, and also to commercial entities such as companies. Thus, a company desiring to be a good corporate citizen may reduce or offset their negative environmental impacts not only by direct actions (e.g. reducing fossil fuel power consumption), but also by encouraging or incentivizing employees, contractors, suppliers and customers to reduce their own carbon footprints.

The instant application recognizes that a transport can be considered an integral component of a person's carbon footprint. A transport can provide a hub for integrating information relating to environmental impacts and carbon footprint considerations of a system that includes the transport, one or more users of the transport, and the broader environments of those one or more users. Events that occur independent of the transport and that produce a carbon footprint benefit for one or more occupants or users of a transport can be received into the transport and displayed. These events can trigger operational changes of the transport that may benefit one or more users of the transport, i.e. as a reward for taking action that reduces the occupant's carbon footprint. That is, as a result of the external events, the transport may be operated in an enhanced manner. Events that are independent of the transport may include events that occur within an occupant's dwelling, office, or at other external sources, as will be described below.
https://worldwide.espacenet.com/publicationDetails/biblio?II=3&ND=3&adjacent=true&locale=en_EP&FT=D&date=20220922&CC=US&NR=2022297546A1&KC=A1
https://patents.justia.com/patent/20220297546
https://www.freepatentsonline.com/20220297546.pdf

I'm interested in what TLS has to say about the GM patent below as this patent gave me the opposite impression to that made by Scoinsy and given the strong ties to Qualcomm my money is on the moat widening.
PREDICTIVE DRIVER ALERTNESS ASSESSMENT / https://worldwide.espacenet.com/publicationDetails/biblio?II=0&ND=3&adjacent=true&locale=en_EP&FT=D&date=20220915&CC=US&NR=2022289151A1&KC=A1

CONSCIOUSNESS STATE DETERMINATION SYSTEM AND AUTONOMOUS DRIVING APPARATUS
A consciousness state determination system comprises a first image-taking section which is mounted on a vehicle and takes images of a driver of the vehicle, an electronic control unit which executes a consciousness state determination process of determining whether the driver is conscious, based on a first image corresponding to the image of the driver taken by the first image-taking section, and a mobile terminal carried by the driver. The electronic control unit is configured to determine whether the driver is conscious, based on terminal-side information corresponding to information acquired by the mobile terminal when a predetermined condition that a reliability level of a determination result obtained from the consciousness state determination process is presumably low, becomes satisfied.
https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2022301323A1&KC=A1&FT=D&ND=3&date=20220922&DB=&locale=en_EP
https://www.freepatentsonline.com/20220301323.pdf

AIRSPACE MANAGEMENT SYSTEMS AND METHODS
A method for managing air traffic in one or more sectors of a controlled airspace is disclosed, including defining a first sector configuration of at least two adjacent sectors in the airspace, each sector being assigned to a station controller in an air traffic control station and a communication channel. The method includes monitoring, for each sector, an anticipated level of air traffic controller workload over a selected time interval, and detecting a difference greater than a pre-selected threshold in anticipated levels of air traffic controller workload in the two adjacent sectors over the selected time interval. The method includes redefining the first sector configuration into a second sector configuration of the two adjacent sectors, such that the difference in controller workload in the two adjacent sectors is below the threshold, and then implementing the second sector configuration.

[0019] Any combination of computer-readable media may be utilized. Computer-readable media can be a computer-readable signal medium and/or a computer-readable storage medium. A computer-readable storage medium may include an electronic, magnetic, optical, electromagnetic, infrared, and/or semiconductor system, apparatus, or device, or any suitable combination of these. In the context of this disclosure, a computer-readable storage medium may include any suitable non-transitory, tangible medium that can contain or store a program for use by or in connection with an instruction execution system, apparatus, or device.
https://worldwide.espacenet.com/publicationDetails/biblio?CC=US&NR=2022292993A1&KC=A1&FT=D&ND=3&date=20220915&DB=&locale=en_EP
https://www.freepatentsonline.com/20220292993.pdf

INTERIOR REARVIEW MIRROR ASSEMBLY WITH DRIVER MONITORING SYSTEM
A vehicular interior rearview mirror assembly includes a mirror head having an interior mirror reflective element. The mirror reflective element has a mirror transflector that transmits near-IR light incident thereon, transmits visible light incident thereon and reflects visible light incident thereon. The mirror assembly includes a camera disposed within the mirror head and viewing through the mirror transflector. The camera includes an imaging sensor having a quantum efficiency (QE) of at least 15% for near-infrared (near-IR) light having a wavelength of 940 nm. The mirror assembly further includes first, second and third near-IR illumination sources disposed within the mirror head and operable to emit near-IR light that passes through the mirror transflector. The near-IR illumination sources are at respective angles relative to a planar front surface of the mirror reflective element and, when powered, illuminate respective in-cabin regions for a driver monitoring function or an occupant detection function.
https://worldwide.espacenet.com/publicationDetails/biblio?CC=WO&NR=2022187805A1&KC=A1&FT=D&ND=3&date=20220909&DB=&locale=en_EP
https://www.freepatentsonline.com/WO2022187805A1.pdf

AIRCRAFT AND METHOD OF CONTROLLING
A method of controlling an aircraft includes tracking, using at least one sensor, one of an input by a pilot or a biometric parameter of a first pilot during flight of the aircraft. The method also includes determining a lack of attention by the pilot or a depth of sleep of the pilot based on the biometric parameter.

[0021] The tracking system 100 can include at least one imaging module 102 and at least one audio module 104. The imaging module 102 can include an image sensor 103 configured to sense visual information about a pilot or co-pilot, such as eyes being open or closed, a direction of gaze, or a facial state such as eyebrows raised or lowered, by way of non-limiting examples and provide an output signal based thereon. The imaging module 102 or the flight control computer 22 can also be in signal communication with any of the flight displays 52, such as to display a visual indication based on the sensed visual information from the imaging module 102.
https://worldwide.espacenet.com/publicationDetails/description?CC=US&NR=2022291680A1&KC=A1&FT=D&ND=3&date=20220915&DB=&locale=en_EP
https://www.freepatentsonline.com/20220291680.pdf