Assessment of fatigue in personnel during sustained operations using ‘SOAP’ – Sustained Operational Assessment Profile
How to cite this article: Butola MS, Dahiya YS, Rao BK. Assessment of fatigue in personnel during sustained operations using ‘SOAP’ – Sustained Operational Assessment Profile. Butola MS, Dahiya YS, Rao BK. Indian J Aerosp Med 2020;64(1):2-7.
Sustained operations are the future of any advanced Air Force, which involve round the clock flying operations over a prolonged period. Such operations have the potential of disrupting normal sleep cycle and may cause fatigue among aircrew and ground duty personnel. It is well known that fatigue among crew member is a significant risk to aerospace safety. The present study was hence undertaken to quantify the subjective fatigue and its effects, among the personnel involved in a simulated exercise using Sustained Operations Assessment Profile (SOAP).
Material and Methods:
SOAP questionnaire, a validated tool, was used for data collection. In the first phase, 1521 personnel involved in the exercise, including aircrew as well as ground duty tradesmen completed the SOAP questionnaires twice during the simulated sustained military operation. The subjective ratings were statistically analyzed using the Wilcoxon matched paired test. The two levels of repeated measures being mean SOAP scores on day 2 and that on day 5. In the second phase, to ascertain differences in the subjective ratings of SOAP among different streams of pilots, data were recorded during another simulated sustained operation after 6 months. A total of 140 aircrew responded to the SOAP questionnaire during 6 days of sustained operations. SOAP score was acquired on day 1 and day 6 of the operations in the second phase.
A total of 3042 completed SOAP responses were analyzed. There was a significant increase in ratings of the three cardinal dimensions of SOAP among all personnel. The aircrew rated the subjective effects higher than maintenance or administrative support group. Among the aircrew, the fighter pilots rated significantly higher as compared to transport or helicopter aircrew.
The study revealed significant changes in the cardinal dimensions of SOAP among the aircrew who were routinely not involved in shift work (especially fighter pilots). Scientifically designed “shift work” may be an effective strategy to mitigate effects of fatigue during sustained operations, hence, needs to be practiced as a routine by combat Air Force units.
Although fatigue has graduated to be the most deliberated problem in military aviation over the years, it still remains underreported. Largely because, its entity is still not well defined, its signs are not easily noticeable and appreciable, but its effects still remain potentially catastrophic.
To date, most research data are on transmeridian international operations, where aircrew fly across several time zones. There has been comparatively little research on fatigue in pilots flying during sustained or continuous operations, where the flying starts early in the day and finishes late at night. This can disrupt normal sleep routines and cause fatigue. It is not only the aircrew who are affected by the phenomenon but also the ground duty personnel and the maintenance crew involved in such operations (directly or indirectly) are equally susceptible to fatigue. It is well known that a fatigued crew member is likely to be working at a compromised efficiency and is more likely to commit errors which may result in accident/incident. Sustained operations are the future of any advanced Air Force and fatigue is a significant risk to aerospace safety during such operations. A study was hence undertaken to quantify the subjective fatigue and its effects, among the personnel involved in an exercise, simulating sustained operations for 5 days using Sustained Operations Assessment Profile (SOAP).
MATERIAL AND METHODS
A total of 1521 aircrew and ground crew at various IAF stations completed the SOAP questionnaires during the first phase of the study. In the second phase, 140 aircrew participated in the study.
The SOAP has been used to measure changes in self-report of cognitive, affective, and arousal dimensions of sustained operations. The SOAP questionnaire was developed by the US Air Force Armstrong Research Laboratory to measure fatigue in military and civilian personnel engaged in sustained operations. It is a reliable and validated assessment tool to quickly record subjective responses across three broad dimensions of interest, i.e., cognitive, affective, and arousal dimension of personnel involved in such operations. It is a paper and pencil questionnaire, where the subject responds to 90 items (questions) on a 1–5 scale that requires 4–5 min approximately to complete. Ten broad scales of the test include three from cognitive dimensions, namely, poor concentration, boredom, and slowed reactions; three from affective dimensions, namely, anxiety, depression, and irritability; and four from arousal dimensions, namely, fatigue/low energy, poor sleep, work frustration, and physical discomfort. Each of these ten scales further includes nine items that represent related aspects of each dimension. Therefore, the total score for each scale, for example, concentration, could range from 9 (if each item was scored as a “1”) to 45 (if each item was scored as a “5”).
SOAP profile was completed twice during the simulated sustained military operation on two phases. In the first phase, the sustain operation was for 8 days, and in the second phase, it was for 6 days. In the first phase, the SOAP questionnaire was filled up after 48 h of commencement of the exercise and once again at the end of 5 days of sustained operation. In the second phase, to ascertain differences in the subjective ratings of SOAP among different streams of pilots, data were recorded during another simulated sustained operation carried out after 6 months of initial exercise. In this phase, a total of 140 aircrew responded to the SOAP questionnaire during 6 days of sustained operations. SOAP score was acquired on day 1 and day 6 of the operations. The subjects were asked to rate their subjective responses on a scale of 1–5 to obtain subjective measures of concentration, boredom, slowed reactions, anxiety, depression, irritability, fatigue, poor sleep, work frustration, and physical discomfort.
The data were analyzed using non-parametric statistical methods, Wilcoxon matched paired test. The two levels of repeated measures being mean SOAP scores on day 2 and that on day 5. The significance level was kept at P < 0.05.
In the first phase, 3042 SOAP responses from 1521 personnel were analyzed. Day 2 responses were taken as “baseline” as it took at least 48 h before the full flying operations commenced for the exercise. The mean score for the three cardinal dimensions of the SOAP on day 2 and day 5 is presented in Table 1 and Figure 1. The mean score for each of the 10 scales (measures of concentration, boredom, slowed reaction, anxiety, depression, irritability, fatigue, poor sleep, work frustration, and physical discomfort) is given in Table 2 and Figure 2. There were statistically significant differences (P < 0.05) between the SOAP scores of three cardinal dimensions over 5 days of sustained operations for all personnel.
|n=1521||Day 2||Day 5||Wilcoxon matched paired test|
SD: Standard deviation
|n=1521||Day 2||Day 5|
SOAP: Sustained operations assessment profile, SD: Standard deviation
To determine differences in the subjective ratings more comprehensively, the data of all personnel (n = 1521) were combined broadly into four groups, namely, Aircrew, Administrative Support Group, Air Traffic Controller (including Fighter Controllers), and Maintenance Support Group. The probability associated with a Wilcoxon paired t-test was obtained for the mean scores of SOAP scales between day 2 and day 5 of the sustained operations. Table 3 presents the statistical differences (P levels) in the mean SOAP scores of cardinal dimensions of various trades combined in the above-mentioned groups.
|Aircrew||ASG||ATC and FC||MSG|
ASG: Admin Support Group, ATC: Air Traffic Controller, FC: Fighter Controllers, MSG: Maintenance Support Group, SOAP: Sustained operations assessment profile
The responses from 190 aircrew were analyzed separately for the SOAP scale ratings. The aircrew included pilots (from three streams, namely, fighter, transport, and helicopter), flight gunners, and flight engineers. The mean scores and SD for the 10 SOAP scales are presented in Table 4 and Figure 3.
|n=190||Day 2||Day 5||Wilcoxon matched paired test|
SOAP: Sustained operations assessment profile, SD: Standard deviation
Table 5 presents the statistical differences (P levels) in the mean SOAP scores for the 10 scales of various trades (other than aircrew) combined in the above-mentioned groups.
|ASG||ATC and FC||MSG|
ASG: Admin support group, ATC: Air traffic controller, FC: Fighter controllers, MSG: Maintenance support group, SOAP: Sustained operations assessment profile
The statistical differences between the mean scores of various SAOP scales obtained in the second phase, on day 1 and day 6 of the sustained operation among the different streams of the aircrew are shown in Table 6.
Effect of sustained operation
The statistically significant differences in the subjective SOAP ratings of day 2 and day 5 of the simulated sustained operations signify cumulative effects on cognition, affect, and arousal of the personnel involved in these operations. The confounding effects of other stressors on the subjective ratings have been ruled out in the study. The prime adverse environmental factor in India is heat stress. Heat stress during sustained operations may have similar effects on the dimensions of SOAP ratings.[1-4] Since the experimentation was carried out in the month of November, which is a thermally comfortable weather period in India, heat stress due to weather can be confidently discounted for confounding the findings of the study.
The simulated sustained operations continued for 8 days, which included the continuous operational deployment of various complements of the fleet. The detailed information of the operations, being restricted, has not been described in the results. However, it is worth mentioning that all personnel were detailed for their qualification specific duties. During sustained operations, the tradesmen and aircrew commenced “shift work” whenever operationally feasible. However, it cannot be denied that due to operational necessities, some of the tradesmen would have been detailed to work beyond their normal tour of duty.
During the sustained operations, to ensure maximum availability of “flying fit” aircrew, only non-pharmacological measures for fatigue and alertness management such as good sleep hygiene and adequate sleep/rest before the mission and scientific rostering of aircrew for flying were employed. “Adequate rest” was ensured for the aircrew as per the extant flying orders, including “flight duty time limitation” (FDTL). In addition, the well-known “strategic cockpit napping” (in transport aircraft and dual cockpit fighter aircraft) and activity breaks[5-7] were prescribed and practiced by the aircrew. The flying missions during the sustained operations period were short-haul missions; therefore, fatigue, tiredness, or boredom inherent to long-haul or ultra-long-haul flying sorties were not present.[7,8] None of the units resorted to pharmacological fatigue management, i.e., use of Go and NoGo pills (modafinil and zolpidem, respectively).
In the study, mean response scores of all the personnel (n = 1521) over 5 days of sustained operations indicated accumulated, statistically significant, increase in all dimensions of SOAP, namely, cognition, affect, and arousal.
Beneficial effect of shift work
On fine-grained analysis of SOAP scores, over 5 days of sustained operations among the personnel of different trades/ branches, it was revealed that the personnel from trades such as Air Traffic Controllers and Aircraft Maintenance Crew, the SOAP rating scores were not significantly increased. This statistically backed finding can be explained by the routine working philosophy of these branches of IAF, wherein the personnel of these trades are routinely involved in “shift work.” Hence, the sustained operations and continuous manning did not result in statistically significant changes in any of the dimensions of SOAP. On the contrary, the Administrative Support Group, Flying Branch, and Air Defense revealed a statistically significant increase in SOAP ratings. Once again, the answer lies in the working philosophy of these branches in IAF. These branches do not routinely follow a “shift work” culture; hence, sustained operations have resulted in statistically significant adverse effects on cognition, affect, and arousal of the personnel. There is enough literature available to support that circadian disruption (that happens when individuals initially break into “shift” work) is a major cause of aircrew fatigue.[9-11]
Although, personnel from trades such as Air Traffic Controllers and Aircraft Maintenance Crew who did not reveal statistically significant differences in the cardinal dimensions of SOAP scores, there were significant changes in certain SOAP scales, namely, poor concentration, irritability, work frustration, fatigue, and poor sleep, which are reasonable due to the perceived or actual work pressure during such operations and long working hours.
Fine-grained analysis of pilots’ ratings
All aircrew (all pilots, flight engineers, flight gunners, etc.) showed significantly higher subjective response after 5 days of sustained operations in all the 10 SOAP scales. To further understand this observation, aircrew from various streams (namely, fighter, transport, and helicopter) responded to the SOAP questionnaire during subsequent simulated sustained operations exercise organized after 6 months of the original study. In this study, 140 aircrew from all the three streams responded to the 90 sustained operations profile questions over 6 days of sustained operations. The analysis revealed that the pilots from transport and helicopter stream did not show statistically significant differences in any of the SOAP scales, whereas fighter pilots experienced a statistically significant increase in their SOAP scores. The possible explanation of this observation finds basis in the basic differences in the operational tasking of various streams of aircraft. The transport and helicopter aircrew are routinely involved in long working hours with multiple takeoffs and landings; therefore, these aircrew may be better adapted to long working hours and sustained operations as compared to fighter aircrew.
The study revealed significant changes in various dimensions of SOAP during simulated sustained operations among the personnel who are routinely not involved in shift work (including fighter pilots). Shift work is an important alertness management tool to mitigate effects of fatigue, hence, needs to be practiced as a routine by combat Air Force units. The limited opportunities for “rest” during sustained military operations need to be gainfully utilized to reduce the pre-load of fatigue. The implications of other nonpharmacological techniques for fatigue management also need to be understood and rehearsed frequently.
Declaration of patient consent
Participant’s consent not required as participant’s identity is not disclosed or compromised.
Financial support and sponsorship
Conflicts of interest
There are no conflicts of interest.
- Moffett Field, CA: NASA; 2000.Crew Factors in Flight Operations XII: A Survey of Sleep Quantity and Quality in On-board Crew Rest Facilities, Report No. NASA/TM-2000-20961
- [Google Scholar]
- Aviat Space Environ Med. 2003;74:1072-7.Perceived fatigue for short-and long-haul flights: A survey of 739 airline pilots.
- [Google Scholar]
- Flight Saf Dig. 2005;24:1-60.Lessons from the dawn of ultra-long-range flight.
- [Google Scholar]