RE: JOYSON SAFETY SYSTEMS31 May 2019 22:32
Description.
[0086] One or more of the occupant information parameters can be analyzed to determine an occupant state. The occupant state can include, for example, whether the occupant's eyes are open or closed, whether or not the occupant is looking at the road, the center console, or elsewhere, whether or not the occupant is distracted, the relative alertness of the occupant, the occupant's emotion(s) (e.g., angry, sad, happy, excited, nervous, afraid, etc.), the occupant's physical condition (e.g., sleepy, hungry, ill, impaired, etc.), and/or the occupant's demeanor (e.g., posture, eating, drinking, giving verbal commands, completing manual tasks, direction of eye gaze, interested, etc.), and the like. Accordingly, analyzing the occupant information parameter to determine the occupant state can include determining that the position and/or orientation of the occupant head and/or eyes are deviated from a predetermined position. Analyzing the occupant information parameter may also include determining that the position and/or orientation of the occupant head and/or eyes are deviated from the predetermined position for at least a predetermined amount of time. Other examples include, assessing the occupant's visual distraction level (e.g., occupant state) through monitoring the occupant's eye/pupil vectors relative to the position of the windshield (e.g., occupant information parameter). Features of the mouth, such as corners and average separation of the lips, can be monitored to determine when a particular occupant is speaking, and audio signals captured in the vehicle may be correlated with the mouth features by a speech recognition system (e.g., such as used in hand's free processing systems) to filter out speech from unintended occupants and/or background noise. Monitoring the motion of the noise and/or mouth can be used to infer an estimate of respiration rate, which can be used, for example, to assess if the occupant has stopped breathing, or if respiration rate is elevated, which can occur during certain perturbed emotional states or medical emergencies. Monitoring the luminance of the face can be used to assess the appearance of sweat beads, which can be used to assess the occupant's comfort (e.g., determine if the climate controls should be adjusted) and/or fitness level (e.g., occupant is ill and/or experiencing a medical event). In addition, the intensity of the light source 122 may be altered to compensate for ambient light, to minimize the visibility of the light source 122, and/or to adjust for the skin tone of the occupant within the imaging area. Spectral analysis of the signal collected from the camera can be used to derive and/or estimate physiological response such as skin heating/cooling and/or electrocardial activity and rates. A wide range of occupant information parameters can be monitored to derive or estimate a wide range of occupant states, which, for example, can be used to establish unique health and behavior charact