Threat and error management
{{short description|Safety management approach}}
{{distinguish|Error management (psychology)|Threat management (computer security)}}
In aviation safety, threat and error management (TEM) is an overarching safety management approach that assumes that pilots will naturally make mistakes and encounter risky situations during flight operations. Rather than try to avoid these threats and errors, its primary focus is on teaching pilots to manage these issues so they do not impair safety. Its goal is to maintain safety margins by training pilots and flight crews to detect and respond to events that are likely to cause damage (threats) as well as mistakes that are most likely to be made (errors) during flight operations.{{cite journal|last1=Dekker|first1=Sidney|last2=Lundström|first2=Johan|title=From Threat and Error Management (TEM) to Resilience|journal=Journal of Human Factors and Aerospace Safety|date=May 2007|page=1|accessdate=6 October 2015|url=https://www.researchgate.net/publication/228399040}}
TEM allows crews to measure the complexities of a specific organization's context — meaning that the threats and errors encountered by pilots will vary depending upon the type of flight operation — and record human performance in that context.{{cite journal|last1=Maurino|first1=Dan|title=Threat and Error Management (TEM)|journal=Coordinator, Flight Safety and Human Factors Programme - ICAO. Canadian Aviation Safety Seminar (CASS)|date=18 April 2005|page=1|accessdate=6 October 2015|url=http://www.skybrary.aero/bookshelf/books/515.pdf}} TEM also considers technical (e.g. mechanical) and environmental issues, and incorporates strategies from Crew Resource Management to teach pilots to manage threats and errors.
The TEM framework was developed in 1994 by psychologists at University of Texas based on the investigation of accidents of high capacity Regular Public Transport (RPT) airlines.{{cite web|last1=Banks|first1=Ian|title=Threat & Error Management (TEM) SafeSkies Presentation|accessdate=19 October 2015|url=https://www.casa.gov.au/sites/g/files/net351/f/_assets/main/lib100030/banks-tem.pdf}} However, an evaluation method was needed to identify threats and errors during flight operations and to add information to existing TEM data. A Line Operations Safety Audit (LOSA) serves this purpose and involves the identification and collection of safety-related information — on crew performance, environmental conditions, and operational complexity — by a highly trained observer.{{cite journal|last1=Earl|first1=Laurie|last2=Murray|first2=Patrick|last3=Bates|first3=Paul|title=Line Operations Safety Audit (LOSA) for the management of safety in single pilot operations (LOSA:SP) in Australia and New Zealand|journal=Aeronautica (Griffith University Aerospace Strategic Study Centre)|date=2011|issue= 1|page=2|url=https://www.researchgate.net/publication/50811533}}{{cite journal|last1 = Thomas|first1 = Matthew|title = Operational Fidelity in Simulation-Based Training: The Use of Data from Threat and Error Management Analysis in Instructional Systems Design.|journal = Proceedings of SimTecT2003: Simulation Conference|date = 2003|page = 2|accessdate = 19 October 2015|url = http://www.unisanet.unisa.edu.au/staff/MatthewThomas/Paper/Thomas_OperationalFidelity.pdf}} LOSA data is used to assess the effectiveness of an organization's training program and to find out how trained procedures are being implemented in day-to-day flights.
Importance of TEM
Threat and error management is an important element in the training of competent pilots that can effectively manage in-flight challenges.{{cite book | last=Martin | first=Wayne L. | title=Crew Resource Management | chapter=Crew Resource Management and Individual Resilience | publisher=Elsevier | year=2019 | doi=10.1016/b978-0-12-812995-1.00007-5 | pages=207–226}} Many strategies have been developed (e.g. training, teamwork, reallocating workload) that were focused on improving on stress, fatigue, and error. Flight crew training stressed the importance of operational procedures and technical knowledge, with less emphasis placed on nontechnical skills, which became isolated from the real-world operational contexts.{{cite journal|last1=Thomas|first1=Matthew|title=Predictors of Threat and Error Management: Identification of Core Nontechnical Skills and Implications for Training Systems Design|journal=The International Journal of Aviation Psychology|date=2004|volume=14|issue=2|pages=207–231|doi=10.1207/s15327108ijap1402_6|s2cid=15271960|accessdate=24 October 2015|url=https://www.researchgate.net/publication/228977150}} Safety training, including TEM, is important because a crew's nontechnical (safety) knowledge helps more in managing errors effectively than crews' familiarization with operations through experience.{{cite journal|last1=Thomas|first1=Matthew|last2=Petrilli|first2=Renee|title=Crew Familiarity: Operational Experience, NonTechnical Performance, and Error Management|journal=Aviation, Space, and Environmental Medicine|date=Jan 2006|volume=77|issue=1|accessdate=25 October 2015|url=http://www.unisanet.unisa.edu.au/staff/matthewthomas/paper/thomas_familiarity.pdf}} Candidates who are shortlisted during selection and training processes must demonstrate analytical and coordination capabilities.{{cite journal|last1=Sexton|first1=J. Bryan|last2=Thomas|first2=Eric|last3=Helmreich|first3=Robert|title=Error, Stress, and Teamwork in Medicine and Aviation: Cross Sectional Surveys|journal=British Medical Journal|date=March 2000|volume=320|issue=7273|pages=745–749|doi=10.1136/bmj.320.7237.745|pmid=10720356|pmc=27316|url=}} Possessing these nontechnical skills allows pilots and crew members to carry out their duties efficiently and effectively.
Components of TEM
The following components are methods that help provide data for the TEM.
=LOSA observation training=
Training for LOSA experts includes two sessions: education in procedural protocols, and TEM concepts and classifications.{{cite journal|last1 = Earl|first1 = Laurie|last2 = Bates|first2 = Paul|last3 = Murray|first3 = Patrick|last4 = Glendon|first4 = Ian|last5 = Creed|first5 = Peter|title = Developing a Single-Pilot Line Operations Safety Audit: An Aviation Pilot Study|journal = Aviation Psychology and Applied Human Factors|date = 2012|volume = 2|pages = 49–61|accessdate = 24 October 2015|url = https://www.researchgate.net/publication/263917559|doi=10.1027/2192-0923/a000027|hdl = 10072/49214|hdl-access = free}} A LOSA trainee is taught to find data first and then code them later for both sessions, during which a crew member must exhibit "LOSA Etiquette" — ability to notify the pilot as to why he or she was not able to detect an error or threat after a flight. The pilot's responsibilities include his or her opinions on what safety issues could have had an adverse impact on their operations. A LOSA trainee must then record the specific responses of the pilot and thereafter code performance using behavioral markers. The order of the recording is as follows: a) record visible threats; b) identify error types, crew's responses, and specific outcomes; and c) use CRM behavioral markers to rate crew.{{cite journal|last1=Leva|display-authors=etal|first1=M.C.|title=The advancement of a new human factors report – 'The Unique Report' – facilitating flight crew auditing of performance/operations as part of an airline's safety management system|journal=Ergonomics|date=August 2008|volume=53|issue=2|pages=164–183|doi=10.1080/00140130903437131|pmid=20099172|s2cid=32462406}}
Observers will finally record a pilot's overall response on a 4-point Likert scale: 1) poor, 2) marginal, 3) good, and 4) outstanding. The data are then quantified and tabulated as exemplified by the following format:
Planning and execution of performance
class="wikitable" | |||
Task | Task Description | Comments | Rating |
---|---|---|---|
Monitor cross-check | Active monitoring of crews | Situational awareness maintained | rowspan="3" style="border:1px gray; border-bottom:1px gray; padding:5px; vertical-align:top;"| Outstanding |
SOP briefing | Carried out necessary briefings | Thorough understanding of procedures | |
Contingency Management | Communicate strategies | Good management of threats and errors. |
class="wikitable" | |||
Identified Threats | Managed | Mismanaged | *Frequency (N) |
---|---|---|---|
Air Traffic Control | 17 | 2 | 19 |
Airline Operational Pressure | 9 | 0 | 9 |
Weather | 6 | 6 | 12 |
Frequency is the total number of threats that occurred and is denoted by N.
=Categories of the LOSA=
LOSA identifies three main categories that must be recorded:
- Errors include procedural errors (mistakes or inadequacy of attention towards a task at hand), and violation of SOP (intentional or unintentional). Although crew members are encouraged not to be afraid of admitting their mistakes, they must be able to criticize themselves since the learning process helps them understand the potential danger presented other crew members.
- Undesired Aircraft States are aircraft configurations or circumstances that are caused either by human error or by external factors. The management of unintended states is vital since they can result in serious aircraft accidents. For example, navigation problems on the cockpit display may lead a pilot to make an incorrect decisions, potentially causing injuries or fatality to passengers and crew members alike.
=Safety change process=
Safety change process (SCP), which is part of LOSA, is a formal mechanism that airlines can use to identify active and latent threats to flight operations.{{cite journal|title=Line Operations Safety Audit (LOSA)|journal=ICAO Journal|date=2002|issue=First Edition|pages=25–29|accessdate=18 November 2015|url=http://www.skybrary.aero/bookshelf/books/2494.pdf}} It is a guideline that communicates in detail what is an imminent threat to current operations or who is causing the threat. In the past, SCP data were based on investigation of accidents or incidents, experiences, and intuitions but nowadays SCP focuses more on the precursors to accidents. There are several steps involved in conducting SCP:
{{chart top|Safety Change Process (SCP) model}}
{{chart/start|align=center}}
{{chart| | | | |Mea|-|Ana|-|Lis| |Mea=1. Collect safety issues (LOSA expert)|Ana=2. Conduct detailed analysis of Risks/data|Lis=3. Identify improvement strategies}}
{{chart| | | | | |!| | | | | | | |!| |}}
{{chart| | | | |Rem| |Safety Change Process| |Risk| |Rem=8. Revise any changes|Safety Change Process=Safety Change Process|Risk=4. Risk Analysis|}}
{{chart| | | | | |!| | | | | | | |!| |}}
{{chart| | | | |Time|-|Imp|-|Sel| |Time=7. Observe the impact of changes|Imp=6. Apply changes to operations|Sel=5. Funding of changes}}
{{chart/end}}
{{chart bottom}}
An unnamed airline conducted base-line observations from 1996 to 1998 using the defined SCP and LOSA data to improve its organization's safety culture and the results were positive. The crew error-trapping rate was significantly increased to 55%, meaning that crews were able to detect about 55% of the errors they caused. A 40% reduction in errors related to checklist performance and a 62% reduction in unstabilized approaches (tailstrikes, controlled flight into terrain, runway excursions, etc.) were observed. A proper review and management of SCP and LOSA data can prevent further disasters in flight operations.