Since the 1980s, automating various flight management operations has contributed to a profound improvement in air transport safety and effectiveness. But a related human issue — automation dependency — has emerged as a significant challenge to further improvements in safety levels. Automation can contribute to diminishing manual flying skills and increasing complacency, as pilots avail themselves of automatic flight management and navigation systems to aid much of their decision-making.
In some cases, pilots don’t fully understand the automatic processes controlling their sophisticated aircraft. The ironic enquiry “What’s it doing now?” is sometimes heard in the cockpit, as pilots struggle to figure out the actions of the “automatics”, as these systems are referred to on the flight deck.
Crucial as this is in the cockpit, automation dependency is equally problematic in many businesses today, whenever there is a disconnect between what managers think is going on and what is actually happening. The automation in question is not just technological, but also pervades the processes, algorithms, and reporting on which managers rely to inform their decision-making.
Aviation is addressing this phenomenon as a major problem and is seeking solutions. We suggest that many companies should do the same before their “business automatics” put them at risk of losing control.
Reminds me of this aviation classic, a 1997 talk by an American Airlines pilot: The Children of Magenta.