The situation

Commercial pilots rely on extensive paper-based manuals and electronic systems to manage flight procedures, especially during abnormal and emergency situations. In high-stakes conditions like a system failure, navigating these static documents can increase mental workload, slow down decision-making and affect the safety, efficiency and comfort of the flight.

Despite existing and valuable onboard electronic systems, pilots still need to reference multiple documents scattered across devices or formats often without contextual relevance.

Team, role and responsibilities

I joined the Human-Centered Design institute at Florida Tech as a research intern to work under the supervision of a pilot instructor/Ph.D. student and her mentor. My goal was to better understand:

1. The challenges pilots are facing onboard, especially when it comes to procedures they have to follow throughout a flight, and

2. How we might create a system that supports pilots with the right operational information, at the right time, in the right format, without increasing cognitive load.

Uncovering the deeper needs

I first talked with expert pilots to better understand the key challenges at hand. Key needs emerged from the various discussions:

1. Replacing static, linear documents with an interactive system usable during flight

2. Delivering context-sensitive information based on real-time aircraft parameters

3. Supporting situation awareness in both normal and abnormal scenarios, and

4. Ensuring tangibility and integration within cockpit workflows.

Prototyping the solution

I developed a knowledge representation structure that connected pilot actions, sensor data, and procedural logic. I then developed an iPad-based prototype to support this structure (OCSIS - Onboard Context-Sensitive Information System). Features included 1) the digitization of flight procedures, 2) a dynamic color system, aligned with Airbus's ECAM color system (cyan = to do, amber = postponed, green = done), and 3) real-time procedural updates triggered by flight data.

Pilot-in-the-loop simulations and evaluations

I synchronized OCSIS with our on-site airbus A320 simulator sensor data to unlock realistic interaction levels. We then physically integrated our prototype in the cockpit to compare its effect against current paper documentation and systems. I designed pilot-in-the-loop simulations and human factors evaluations to assess specifically pilots' situation awareness and workload. I also included usability assessments.

Two main scenarios were chosen:

1. A flaps malfunction: the pilot was asked to set the flaps to a certain level during the approach phase. However, the airplane itself was not able to act on the command and triggered an abnormal situation in the cockpit;

2. A fuel leak: at some point during the flight, a fuel leak happened and triggered an abnormal situation in the cockpit.

The impact

• ↓ Pilot Workload: Across all tested malfunctions, OCSIS reduced average pilot workload vs. paper documentation and current systems

• ↑ Situation Awareness: OCSIS increased pilots' awareness of malfunctions

• ↑ Usability: Pilots found the system easy to use, well integrated, and valuable: “provides the right info at the right time”

• In debriefings, OCSIS was recognized as a credible step forward in cockpit documentation and safety system design

• The prototype was formally presented at the 19th Triennial Congress of the IEA (Melbourne) as a new model for tangible, context-aware cockpit tools