HONEYWELL INT INC [US] - 2026-03-125 Jun 2026 10:57
PILOT ASSESSMENT BASED ON COGNITIVE NEURAL DATA
0009] FIG. 2 is a diagram of an eye-tracker system in accordance with disclosed embodiments;
[0018] Disclosed embodiments use neural brain sensors (e.g., functional magnetic resonance imaging (fMRI), electro-encephalogram (EEG), functional near-infrared spectroscope (FNIR)), physiological sensors (e.g., heart rate monitor), behavioral sensors (e.g., eye tracker) and AI/ML to output an internal monologue of the pilot. The output is paired with training simulator (e.g., training vehicles, simulators, virtual reality) data related to specific tasks in order to collect and qualitatively assess the internal dialogues relationship to any cognitive skills and also the degree to which those skills are used by the pilot throughout the task.
[0021] In one example, a pilot uses a flight simulator to perform an aircraft take-off. That pilot is equipped with sensor to measure brain activity which outputs to an AI model trained on similar data from pilots during other aircraft operations. As the simulated aircraft takes-off, the AI model would output the pilot's verbalized thought (“10 degree pitch, 3 degree rate rotation, gear up . . . jeez . . . sidewind is strong”), which is transcribed and then associated with simulator avionics panel data and behavior sensor (eye tracker) data. Based on the words that are transcribed, the qualitative data can be labeled into skills according to how the information is being used by the pilot. Using the previous transcript, the system would associate the internal monologue to the cognitive skill of “collection” of pitch and degree rotation information from the avionic instruments, the cognitive skill of “estimation” of how much the pilot needs to pull back on the yoke to nose-up into the 3-degree pitch, and the skill of “prediction” to assess the how much the sidewind will push them off flightpath.
https://worldwide.espacenet.com/publicationDetails/description?CC=US&NR=20260073809A1&KC=A1&FT=D&ND=3&date=20260312&DB=&locale=en_EP
https://www.freepatentsonline.com/20260073809.pdf