RE: PANASONIC IP MAN CO LTD 2020-02-2021 Feb 2020 07:11
[0096] In this embodiment, the physiological feature extraction unit 171 includes one or more feature extraction units and extracts at least one or more features that indicate the physiological state of the driver. For example, as illustrated in Fig. 4 , the physiological feature extraction unit 171 has a face image extraction unit 181, an eye opening ratio detection unit 182, an eye opening ratio feature extraction unit 183, an eye blink detection unit 184, an eye blink feature extraction unit 185, a head position detection unit 186, a head position feature extraction unit 187, a respiratory sound detection unit 188, a respiration feature extraction unit 189, a heart rate fluctuation detection unit 190, a heart rate fluctuation feature extraction unit 191, a blood pressure fluctuation detection unit 192, a blood pressure fluctuation feature extraction unit 193, a body movement detection unit 194, and a body movement feature extraction unit 195.
[0097] For example, the physiological feature extraction unit 171 uses the face image extraction unit 181 to the head position feature extraction unit 187 and may thereby extract an eye opening ratio feature, an eye blink feature, or a head position feature, which is related to the visual system physiological information of the driver, from an image which is photographed by the in-vehicle camera 161 and includes the driver, as the physiological information feature. Specifically, the face image extraction unit 181 consecutively acquires the image data from the in-vehicle camera 161 and extracts a face image region of the driver from the image data. The eye opening ratio detection unit 182 extracts the image region of the eye from the face image region extracted by the face image extraction unit 181, thereafter detects the upper and lower eyelids, and detects the eye opening ratio that indicates the opening degree of the eyelids, that is, the eye from the shapes of the eyelids. The eye opening ratio feature extraction unit 183 calculates an eye opening ratio feature, which is the average value, standard deviation, maximum value, minimum value, or the like of the eye opening ratio in a prescribed unit time, from the fluctuation pattern in the eye opening ratio that is detected by the eye opening ratio detection unit 182. Further, the eye blink detection unit 184 extracts the image region of the eye from the face image region extracted by the face image extraction unit 181, thereafter detects the upper and lower eyelids, and detects a blink (eye blink) from the movement of the upper and lower eyelids. The eye blink feature extraction unit 185 calculates an eye blink feature, which is the average value, standard deviation, or the like of the eye blink frequency or the eye blink time in a prescribed unit time. In addition, the head position detection unit 186 detects the fluctuation pattern in the head position of the driver based on the position in the image in the face image region extracted by the face i