George Frangeskides, Chairman at ALBA, explains why the Pilbara Lithium option ‘was too good to miss’. Watch the video here.
Continued.....
Eyes in the sky:
As all technologies continue to evolve, it is the interface with the human element that must be continually monitored and assessed and adapted. Unlike our digital creations, humans are not designed to operate at peak performance for 24 hours each day and seven days per week. It may be some time until the Seeing Machines technology is incorporated on flightdecks around the world, but there is no doubt that this Australian company is at the cutting edge in the way that it is addressing certain human aspects of operating in aviation, not the least of which is recognising and managing fatigue. Rather than drawing a hypothesis, this technology is going directly to the source – the human – and monitoring performance very closely under a range of conditions, timeframes and environments. The subtle movement of the eye as it busily scans across flight instruments to draw the maximum amount of data has not previously been tracked. And that same eye may hold the earliest clues to a decrease in performance as fatigue insidiously draws down upon the eyelids. Moving forward means that new solutions must be found to the new challenges that inevitably arise. In the case of human performance in aviation, the key may actually lie in looking very, very closely.
***END OF****
Continued....
The technology identifies what the pilots are looking at, be that the speed tape, altitude, approach guidance, flight mode annunciations (FMA) and the like at any given point in time during a flying sequence. This information can be further used to identify breakdowns in instrument scans, missed information and even crew interaction from a CRM perspective. Potential fatigue issues are another growing field of concern within aviation as pilots, air traffic controllers, employers and regulators seek to manage their resources in the safest possible manner. The nature of flight operations means that flightcrew regularly perform complex, safety-critical tasks using highly sophisticated aircraft systems. Furthermore, irregular schedules, long duty periods, early start times, and flying during the body’s ‘Window of Circadian Low’ are all part and parcel of a career in aviation. Through using the Seeing Machines technology to better understand their pilots’ alertness and fatigue state in real time, during flight, the data can in turn be employed by companies to evaluate the effectiveness of various aspects of their operation. They can review their schedule and crew trip design, validate that their FRMS is performing as expected, and identify and mitigate against systemic operational fatigue risks. The growth of the aviation industry over the coming decades does not solely impact airlines and pilots. Air traffic controllers are also affected by the increasing demand on their skill-set, growth in air traffic and rostering patterns that may seem at odds with the human’s natural desire to sleep when the sun sets. In the air traffic control sphere, Seeing Machines’ Operator Alertness System can help air navigation service providers and controllers assess alertness and attention state in live operations and consequently provide valuable and timely data to air traffic controller teams. Again, like the pilots, this can potentially support air traffic controllers with more effective resourcing scheduling and decisions. The potential uses for the Seeing Machines technology in aviation are broad in their range, but quite precise in the data that can be collected. It is apparent that through this data there is the opportunity to optimise the performance of the pilot or air traffic controller as well as the environment in which they work.
Continues......
Continued....
"There have also been multiple flights during which pilot alertness data has been gathered. Emirates, through its Human Factors Group and Emirates Training College, has shown significant interest and commitment to a collaboration with Seeing Machines. The collaboration to date has seen multiple data collections in both part task trainers and more recently in the A380 full-flight simulator. In addition to the partnership with Emirates, there is work underway with several other carriers, expanding to include rotary-wing work, and more recently Seeing Machines says there has been interest in the development of military applications, specifically in the ab-initio pilot training space. The findings from the first part of the project were primarily focused on the use of the equipment, the methods for data collection and how to use that data. This demonstrated the potential of eye-tracking for pilot training, understanding the requirements of different procedures and to analyse events that occurred from a pilot performance perspective. The second part, recently carried out, was still focused on the use of equipment and data. From this we expect data from specific flight scenarios that will contribute important information about pilot performance in these scenarios. The data collection was conducted with a view to certain questions. Where is the pilot looking, and does it matter? What does a good scan pattern look like and can you train that? How important is monitoring, do you train how to monitor and in turn, how do you monitor that? And critically, can you detect fatigue during operations? The areas where such data and the associated technology could potentially be utilised with pilots and air traffic controllers are far-reaching, including recruitment, assessment and training, monitoring skills, and fatigue-related impacts. Seeing Machines has the potential to supply aviation training providers and instructors with intelligent data that can be used in the selection, training and assessment of pilot candidates, as well as in the continuing training of line pilots.
Continues.....
Continued...
"in real time and returns a comprehensive model of the face that includes the coordinates of all facial features, their current state and their rate of change. This includes a very accurate measure of blink rate and eyelid aperture. ‘Eye gaze tracking’ is the measurement of where the pilot is looking. By directing a safe, invisible light source at a subject’s eye and then using a special camera to track the glint, it can be interpreted to precisely ascertain where or what the subject is looking at. Combining this information with an accurate understanding of the flightdeck involved, gaze tracking can be used in real time (or recorded and played back) to help assess exactly how the subject is processing their visual surrounds. Although eye-tracking and related data on its own will not prevent the impact from these identified problems, they stand to provide a new, relevant and rich data source to supplement and optimise the current aviation recruitment, training, and assessment processes with an underlying alignment to safety.
Seeking answers:
As with any new form of technology in the aviation sphere, there is a significant process of data collection, analysis and trials involved in developing the system. Seeing Machines has been conducting this proof-of-concept data collection across a range of flight and air traffic control environments. These include full-flight simulators with multiple carriers and operators from UAE, US, and Asia Pacific, and the training and operational consoles of Australian and UK and Europe-based air navigation service providers.
Continues......
The following words are the Aviation Australia July 2018 word for word after a brief introduction to who Seeing Machines are.
Obviously it was better formatted with the odd picture etc, happy reading.
------------------------------------------
"The emerging aviation business within Seeing Machines is under the stewardship of general manager Patrick Nolan, and already the company relates that there is strong interest from manufacturers, carriers and operators alike. From the company’s perspective, it is seeking to leverage its existing core capability and systems to build solutions that support applications in aircraft, simulators, and consoles that are typically used in air traffic control and unmanned aerial systems (UAS) operations.
How does it work?
If most communication is non-verbal it would seem that a pilot’s face can also relay information without a word being spoken. Each renewal of a medical certificate calls for testing of the eye’s ability to see, but there may be more to be learnt than merely how far away a pilot can spot an aircraft, or how well they can read the fine print on a chart. We have all felt the slow blinking of the eyes and ultimately the head nods as fatigue begins to bite as we sit watching Netflix. Similarly, pilots have felt the speed and efficiency of their instrument scan affected by an extended absence from flying, or even a change of cockpit and flight panel design. Conversely, what happens to our scan under periods of high workload? These issues, and others, raise the question whether we can monitor and quantify such behaviour as it develops? Furthermore, is there the ability to train these behaviours, or even intervene? These are some of the answers that Seeing Machines is seeking. The technology being trialled to date is non-intrusive, fully automatic and camera-based and does not require the user to wear any form of hardware or sensors. The current prototype solution being used for pilot and crew training support is a simple (non-integrated) and temporary after-market installation of a small camera and two infrared light sources. The camera is typically placed between the two key instruments, the primary flight display and navigation display, while the light sources are placed on the outer points of the instruments. The arrangement is replicated for both the captain’s and first officer’s positions. There is additional computing equipment required to run the system, capture data and to provide real-time tracking displays but that is not visible to the pilot. The technology detects and locates a human face and then tracks in real time without any need for calibration prior to use. It gathers a variety of accurate head and eye-related data, measures, and metrics including precise gaze-tracking, microsleep detection and very accurate measures of pupil diameter. To track the head and eyelids, the system provides precise detection and measurement of the frontal area and sides of a subject’s face and hea
https://issuu.com/home/read/7dpmrufhm94
If you are able to view this first page I will send the links for the following 2 pages. If not I will try and. Copy and paste the digital art keep somehow if possible. A BIG article.
Interesting research paper released just last week titled: 'Eye-Tracking Study to Enhance
Usability of Molecular Diagnostics
Reports in Cancer Precision
Medicine'
Note this sentence within it:
"Eye-tracking was used to capture the visual scan-
ning patterns of participants. A remote desktop
stationary eye-tracker from Seeing Machines
that samples at 60 Hz with an accuracy of 0.5- to
1-degree range was used."
Part of 'Conclusion' to research:
"This study demonstrates the use of specific usability techniques (eye tracking and think-aloud pro-
tocols) to help clinical laboratories improve MDX report design in a precision oncology
treatment setting."
I am sure this the joint military and civilian aviation project and name, 'Beef' mentioned in his list of highlights from the Ken interview.
https://www.thalesgroup.com/en/australia/press-release/onesky-benefit-air-travellers
Research and Paper that SEE were involved in - released November 2017
https://www.google.co.uk/url?sa=t&source=web&rct=j&url=http://journals.sagepub.com/doi/pdf/10.1177/1541931213601547&ved=2ahUKEwjQ4KCOz6bcAhUFSsAKHdCjBgsQFjAAegQIAhAB&usg=AOvVaw3ohjhMtW4W0ShLCmjEHcE5
I wonder if SEE come become involved with this big project.
https://www.thalesgroup.com/en/worldwide/press-release/australia-and-thales-deploy-worlds-largest-air-traffic-control-system
I know they need more staff, but this still could happen and what with passenger planes coming in and out all the time. Surely SEE Tech can help here.
https://www.google.com.au/amp/www.dailymail.co.uk/news/article-5823415/amp/Air-traffic-controllers-falling-asleep-job.html
Came across this little summary of him. Note the last comment.
'Skills and experience'
Director of FTSE 250, AIM and private companies, and chairman of AIM companies and private companies.
Chief executive and entrepreneur with a track record of steering successful corporate innovation, growth and globalisation in multiple sectors.
Significant experience in mergers and acquisitions, IPOs and financial markets in the UK, US and Asia.