Several checklist-based methods have been proposed to help pilots manage startle in unexpected situations. In the current experiment, we tested how pilots reacted to using such a method, which featured the mnemonic COOL: Calm down – Observe – Outline – Lead. Using a motion-based simulator outfitted with a non-linear aerodynamic model of a small twin-propeller aircraft, twelve pilots practiced using the COOL method before performing four test scenarios involving startling events. Application of the full method in the test scenarios was high (90-100%), and pilots rated the method on average as useful (4 on a 1-5 point Likert scale). The first two steps of the method were seen as the “core” of the method. However, pilots also displayed difficulty with prioritizing dealing with immediate threats over executing the method. The results are promising, but they also warn us to be cautious when introducing a startle management method.@en

Recent studies and accident investigations show the detrimental effects of startle and (automation) surprise on flight crew performance in terms of cognitive reasoning and sensemaking. Previous research conducted at Delft University of Technology shows a positive effect of training variability on crew performance in surprising tasks related to training, but in case of novel, unrelated surprising tasks, training methods remain to be investigated. Other recent studies and proposals suggest to use checklist-based training methods to prepare pilots for puzzling and surprising scenarios, but effects on flight crew performance have yet to be published. Therefore a simulator-based, between-subjects experiment was conducted to explore the effects of a four-item checklist-based training on pilot performance. Training elements focused on managing stress and enhancing situation awareness, as well as improving sensemaking and decision-making processes. It was expected that trained pilots would exhibit better overall performance in test scenarios involving off-nominal, surprising situations. Nevertheless, results indicated no significant difference in pilot response to an initial disturbance, but did show significant performance improvement in scenarios involving a second, ensuing upset compared to the baseline group. This suggests that checklist-based training methods offer a structured problem-solving approach, resulting in better response to consecutive disturbances in select scenarios.