Journal of Medical Internet Research
JMIR Publications
image
Augmented Reality Learning Environment for Basic Life Support and Defibrillation Training: Usability Study
DOI 10.2196/14910, Volume: 22, Issue: 5,

Table of Contents

Highlights

Notes

Abstract

BackgroundBasic life support (BLS) is crucial in the emergency response system, as sudden cardiac arrest is still a major cause of death worldwide. Unfortunately, only a minority of victims receive cardiopulmonary resuscitation (CPR) from bystanders. In this context, training could be helpful to save more lives, and technology-enhanced BLS simulation is one possible solution.ObjectiveThe aim of this study is to assess the feasibility and acceptability of our augmented reality (AR) prototype as a tool for BLS training.MethodsHolo-BLSD is an AR self-instruction training system, in which a standard CPR manikin is “augmented” with an interactive virtual environment that reproduces realistic scenarios. Learners can use natural gestures, body movements, and spoken commands to perform their tasks, with virtual 3D objects anchored to the manikin and the environment. During the experience, users were trained to use the device while being guided through an emergency simulation and, at the end, were asked to complete a survey to assess the feasibility and acceptability of the proposed tool (5-point Likert scale; 1=Strongly Disagree, 5=Strongly Agree).ResultsThe system was rated easy to use (mean 4.00, SD 0.94), and the trainees stated that most people would learn to use it very quickly (mean 4.00, SD 0.89). Voice (mean 4.48, SD 0.87), gaze (mean 4.12, SD 0.97), and gesture interaction (mean 3.84, SD 1.14) were judged positively, although some hand gesture recognition errors reduced the feeling of having the right level of control over the system (mean 3.40, SD 1.04).ConclusionsWe found the Holo-BLSD system to be a feasible and acceptable tool for AR BLS training.

Keywords
Eysenbach, Vaughn, Padilha, Ingrassia, Mormando, Giudici, Strada, Carfagna, Lamberti, and Bottino: Augmented Reality Learning Environment for Basic Life Support and Defibrillation Training: Usability Study

Introduction

Sudden cardiac arrest is a major cause of death in adults in developed countries [1]. As such, basic life support (BLS) is a fundamental aspect of the emergency response system. Survival rates are higher when bystanders are able to deliver early cardiopulmonary resuscitation (CPR) and defibrillation [2]. Unfortunately, although laypeople and health care providers are increasingly trained, only a minority of cardiac arrest survivors receive bystander CPR. Therefore, despite major gaps that still exist in the delivery of optimal care [3], training plays a pivotal role in saving lives [4].

The standard approach to BLS training of laypeople involves classroom-based courses consisting of skill demonstrations, hands-on practice, and lectures given by a certified trainer [5]. Simulation with manikins allows trainees to acquire and practice skills without the risk of harming the patient [6]. Debriefing provides an important learning moment in simulation sessions, as it gives participants the opportunity to critically reflect on decisions and actions performed and to learn from mistakes [7]. Although it is still a matter of debate how simulation realism influences learning outcomes [4], the importance of elements of stress and cognitive load in education has been proven, and they should be factored into the instructional design [8]. Self-directed learning systems are an effective alternative to the standard approach, which, according to multiple studies reported by the American Heart Association guidelines, show no statistical difference in learning outcomes compared with instructor-led courses [5].

In the context of self-instruction approaches, emerging technologies allow people to build new cognitive structures [7], and technology-enhanced simulation offers new models for training, which are associated with better knowledge, improved skills acquisition, and a moderate effect on patient outcomes [9]. One such emerging technology is augmented reality (AR), which enhances the user’s perception by overlaying virtual objects (or “holograms”) on the real-world environment [10]. AR is being applied across various disciplines in health care education including anatomy classes and surgical training [11-13]. In their integrative review, Zhu et al [14] reported that AR could improve health care education by reducing failure rates and improving accuracy.

In this study, we investigated the use of AR as an innovative technology for BLS training. The aim of this study is to assess feasibility and acceptability of Holo-BLSD, our AR prototype tool for CPR training.

Methods

Development

Holo-BLSD was developed jointly by the SIMNOVA simulation center (Novara, Italy) and the Department of Computer Engineering of Politecnico di Torino, in collaboration with Logosnet’s e-REAL Immersive Simulation Labs in Lugano, Switzerland. The app uses Microsoft’s HoloLens device, a wearable headset for AR experiences, and meets the recent American Heart Association guidelines [2]. Holo-BLSD can be used in different real environments, and its contents can be adapted to where the system is being used: virtual elements can be placed and anchored in the desired position.

Since the majority of potential users are likely to have little or no experience with AR apps or the HoloLens, Holo-BLSD provides a specific training session to help users get acquainted with the system. During interaction training, all interaction types are introduced individually with detailed instructions that include vocal and visual clues.

After the interaction training, users can begin the BLS training. Holo-BLSD guides users step-by-step through the resuscitation procedure of an adult experiencing cardiac arrest. The simulated activities include the following: scene safety, in which any potential hazard should be removed; responsiveness check, performed by shaking and calling the victim; activation of local emergency medical services by using a public phone booth and interacting with a simulated operator; automated external defibrillator (AED) retrieval by asking a witness to find an AED; CPR, using a real manikin torso and superimposing a person’s full body using AR (Figure 1); use of AED, once available, by directing pad placement and delivery of shock, if recommended. All generated data are logged, and a feedback sheet can be generated, allowing trainees and instructors to intuitively identify errors and strengths of the performance, thus supporting debriefing sessions and enabling the creation of a library of training events.

A trainee using the HoloLens device (above) and AR displayed in the trainee’s field of view (below).
Figure 1
A trainee using the HoloLens device (above) and AR displayed in the trainee’s field of view (below).

Participants were recruited on a voluntary basis during a national simulation-based training event for medical residents [15]. The selection of subjects represents a convenience sample, and medical background was not a required inclusion criterion. Experiments took place at the SIMNOVA Simulation Center in Novara, Italy.

The experience was divided into three phases, in which volunteers (1) learned how to use the device through the interaction training session, (2) performed a BLS simulation using the Holo-BLSD app and a standard torso manikin, and (3) filled out the evaluation questionnaire.

Software Evaluation

Participants completed a survey of 61 questions divided across six categories (user input, system output, system usability, fidelity of simulation, immersivity, likeability), and graded on a scale from 1 (strongly disagree) to 5 (strongly agree). The complete questionnaire can be found in Multimedia Appendix 1.

The results are presented with relative percentages for each of the five possible grades and summarized as mean and standard deviation. Given the explorative nature of the study, we did not plan any statistical inference tests.

Feasibility

Feasibility was assessed using the user input scale (interaction with gaze and gestures); the system output scale (quality of the display and sound); and the system usability scale [16], which is a standardized tool to evaluate interfaces based on the ISO 9241-400 guidance on ergonomic factors.

Acceptability

The remaining scales of the survey (fidelity, immersion, and likeability) were designed to assess acceptability.

Ethics and Statistical Analysis

Written informed consent was obtained from all participants, and the study results were presented in aggregate with no identifiers. The study was conducted in accordance with the principles of the Declaration of Helsinki. Descriptive statistics were calculated using Microsoft Excel (Version 2003, Microsoft Corporation).

Results

This study involved 26 participants whose characteristics are summarized in Table 1.

Feasibility

Responses to the feasibility scale are shown in Multimedia Appendices 2 and 3 and aggregated data for the system usability scale are presented in Table 2. The cognitive load required to operate the HoloLens was minimal (mean 1.77, SD 0.86) and no high physical effort was required (mean 1.19, SD 0.40). Users felt confident using the software (mean 3.62, SD 1.06). Voice (mean 4.48, SD 0.87), gaze (mean 4.12, SD 0.97), and gesture interaction (mean 3.84, SD 1.14) were evaluated positively. Words and symbols (mean 4.70, SD 0.56) and audio instructions (mean 4.43, SD 0.79) were easy to understand. Users were most critical of the quality of the display (mean 2.45, SD 1.47), although they rated it as appropriate for the function (mean 3.62, SD 1.17). Finally, users rated the system as easy to use (mean 4.00, SD 0.94).

Acceptability

Responses to the acceptability scale are summarized in Multimedia Appendices 4-6. The sensorial information provided by the AR gave participants the impression of physically being in the scenario (mean 3.52, SD 0.95). Users reported that the experience was pleasant (mean 4.13, SD 0.81) and enjoyable (mean 4.65, SD 0.57) and that the virtual contents were realistic (mean 3.74, SD 1.05). Users judged the system as capable of providing real benefit as a training tool (mean 4.22, SD 0.67).

Table 1
Respondents’ demographics and characteristicsa.
CharacteristicParticipants, n (%)

Gender

Male16 (62)


Female10 (38)

Age group (years)

20-2915 (58)


30-399 (35)


40-490 (0)


50-592 (8)

Practice type

Resident19 (73)


Physician3 (12)


Nurse1 (4)


Other




Space system engineer1 (4)


Designer1 (4)


Secretary1 (4)
Specialtyb

Emergency medicine7 (32)


Anesthesiology6 (27)


General surgery2 (9)


Internal medicine1 (5)


Pediatrics1 (5)


Cardiology1 (5)


Not specified4 (18)

aPercentages may not add up to 100 due to rounding.
bOnly applicable to residents and physicians.
Table 2
Aggregated data for the system usability scale.

QuestionStrongly Disagree (%)Disagree (%)Neither (%)Agree (%)Strongly Agree (%)Mean (SD)
System Usability Scale (SUS)

I think that I would like to use this system frequently0.011.523.138.526.93.81 (0.98)
I found the system unnecessarily complex48.036.012.04.00.01.72 (0.84)
I thought the system was easy to use0.07.719.238.534.64.00 (0.94)
I think that I would need the support of a technical person to be able to use this system15.419.230.823.111.52.96 (1.25)
I found the various functions in this system were well integrated0.03.830.842.323.13.85 (0.83)
I thought there was too much inconsistency in this system26.934.623.111.53.82.31 (1.12)
I would imagine that most people would learn to use this system very quickly0.03.826.934.634.64.00 (0.89)
I found the system very cumbersome to use32.024.028.08.08.02.36 (1.25)
I felt very confident using the system0.023.111.546.219.23.62 (1.06)
I needed to learn a lot of things before I could get going with this system57.726.911.50.03.81.65 (0.98)
ISO 9241-400

The HoloLens device is too bulky or too heavy19.242.33.826.97.72.62 (1.30)
The mental effort (concentration) required to operate the device was very high46.234.615.43.80.01.77 (0.86)
The physical effort required to operate the device was very high80.819.20.00.00.01.19 (0.40)
Arm and hands/fingers fatigue was very high76.919.23.80.00.01.27 (0.53)
Eye fatigue was very high42.323.119.27.77.72.15 (1.29)
Head fatigue was very high38.538.515.40.07.72.00 (1.13)
I would be comfortable using the device for long time15.415.430.834.63.82.96 (1.15)

Discussion

Principal Findings

Experts are paying increased attention to the realism and scenario design of CPR training. The physical features of manikins and simulators by themselves are insufficient in suspending learners’ disbelief and positively influencing learning outcomes [4]. Despite ongoing advances in resuscitation science, cardiac arrest survival rates remain suboptimal and the educational efficiency of caregivers is still critical, as highlighted in 2003 [17] and 2018 [3]. Education facilitated through technology has been identified as a strategy to improve the effectiveness of BLS training. We developed the Holo-BLSD app using Microsoft’s HoloLens technology as an AR self-instruction learning environment for training and assessment of CPR and AED use, by using high definition holograms to immerge trainees in realistic scenarios, and a standard low-cost torso manikin to deliver tactile feedback. In this pilot study, we measured the feasibility and acceptability of our first prototype of the training app.

An excessive cognitive load may impair participants’ perceptions and performance, decreasing attention and problem-solving skills [6], and physical effort and fatigue may reduce user enjoyment of the experience. Despite these conditions, users rated the system as easy to use and they judged the learning experience as pleasant and enjoyable. Volunteers reported that the mental effort required to operate the device was minimal. Similarly, users indicated that the head-mounted display was comfortable. Unlike other head-mounted displays, such as the Google Glass used in Chaballout’s study [6], no delay between the real and virtual environment was experienced.

Some users noted that ambient light affected the quality of the holograms and made visual instructions difficult to interpret. Users judged the lack of peripheral view, which is known to increase cognitive load [18], as a major limitation. The assembled environment was considered complex enough to be of use, allowing users to focus on the tasks without leaving them disoriented. It is worth noting that trainees found the virtual contents realistic, stating that the system could provide a real benefit as a training tool and help practitioners be more effective.

In this study, we presented preliminary evidence that validated the Holo-BLSD app as a BLS training tool. Additional studies comparing traditional instructor-led training with low and high-fidelity simulation or other models will be useful.

Limitations

The limitations of the study are the small number of participants, which makes it difficult to draw clear conclusions about the benefit of the proposed technology on learning outcomes. Nevertheless, this study was intended to provide a proof of concept and to measure the feasibility and acceptability of AR technology in a life support simulation. To this end, positive user responses indicate that future studies are warranted.

Conclusions

AR is in the early stages of application within health care education, but it has enormous potential. In this study, we presented Holo-BLSD, an AR system for BLS training that offers realistic haptic feedback through a manikin and a virtual scenario that can be easily reconfigured to generate different situations, including extreme and dangerous ones. We found the proposed application to be feasible and acceptable as a tool for self-instruction training. The positive outcomes of this preliminary study make this prototype worthy of future testing.

Notes

Conflicts of Interest: None declared.

Appendices

Appendix

Complete user questionnaire.

User input.

System of output.

Fidelity of simulation.

Immersion.

Likeability.

Abbreviations

AED

automated external defibrillator

AR

augmented reality

BLS

basic life support

CPR

cardiopulmonary resuscitation

References

1 

    Yeung J, Okamoto D, Soar J, Perkins GD. AED training and its impact on skill acquisition, retention and performance--a systematic review of alternative training methods. Resuscitation 2011. 6 82: 6, pp.657-64, doi: 10.1016/j.resuscitation.2011.02.035

2 

    Kleinman ME, Brennan EE, Goldberger ZD, Swor RA, Terry M, Bobrow BJ, Gazmuri RJ, Travers AH, Rea T. Part 5: Adult Basic Life Support and Cardiopulmonary Resuscitation Quality: 2015 American Heart Association Guidelines Update for Cardiopulmonary Resuscitation and Emergency Cardiovascular Care. Circulation 2015. 1103 132: 18 Suppl 2, pp.S414-35, doi: 10.1161/CIR.0000000000000259

3 

    Cheng A, Nadkarni VM, Mancini MB, Hunt EA, Sinz EH, Merchant RM, Donoghue A, Duff JP, Eppich W, Auerbach M, Bigham BL, Blewer AL, Chan PS, Bhanji F, American Heart Association Education Science Investigators;on behalf of the American Heart Association Education SciencePrograms Committee‚ Council on Cardiopulmonary‚ Critical Care‚ PerioperativeResuscitation; Council on CardiovascularStroke Nursing;Council on Quality of CareOutcomes Research. Resuscitation Education Science: Educational Strategies to Improve Outcomes From Cardiac Arrest: A Scientific Statement From the American Heart Association. Circulation 2018. 807 138: 6, pp.e82-e122, doi: 10.1161/CIR.0000000000000583

4 

    Hazinski MF, Nolan JP, Aickin R, Bhanji F, Billi JE, Callaway CW, Castren M, de CAR, Ferrer JME, Finn JC, Gent LM, Griffin RE, Iverson S, Lang E, Lim SH, Maconochie IK, Montgomery WH, Morley PT, Nadkarni VM, Neumar RW, Nikolaou NI, Perkins GD, Perlman JM, Singletary EM, Soar J, Travers AH, Welsford M, Wyllie J, Zideman DA. Part 1: Executive Summary: 2015 International Consensus on Cardiopulmonary Resuscitation and Emergency Cardiovascular Care Science With Treatment Recommendations. Circulation 2015. 1020 132: 16 Suppl 1, pp.S2-39, doi: 10.1161/CIR.0000000000000270

5 

    Bhanji F, Donoghue AJ, Wolff MS, Flores GE, Halamek LP, Berman JM, Sinz EH, Cheng A. Part 14: Education: 2015 American Heart Association Guidelines Update for Cardiopulmonary Resuscitation and Emergency Cardiovascular Care. Circulation 2015. 1103 132: 18 Suppl 2, pp.S561-73, doi: 10.1161/CIR.0000000000000268

6 

    Chaballout B, Molloy M, Vaughn J, Brisson IR, Shaw R. Feasibility of Augmented Reality in Clinical Simulations: Using Google Glass With Manikins. JMIR Med Educ 2016. 307 2: 1, pp.e2, doi: 10.2196/mededu.5159

7 

    Bigi E, Bressan F, Cabrini L, Gasperini CLa simulazione in medicina 2013. Milano Raffaello Cortina Editore, pp.978-88

8 

    Beckers SK, Biermann H, Sopka S, Skorning M, Brokmann JC, Heussen N, Rossaint R, Younker J. Influence of pre-course assessment using an emotionally activating stimulus with feedback: a pilot study in teaching Basic Life Support. Resuscitation 2012. 3 83: 2, pp.219-26, doi: 10.1016/j.resuscitation.2011.08.024

9 

    Cook DA, Hatala R, Brydges R, Zendejas B, Szostek JH, Wang AT, Erwin PJ, Hamstra SJ. Technology-enhanced simulation for health professions education: a systematic review and meta-analysis. JAMA 2011. 907 306: 9, pp.978-88, doi: 10.1001/jama.2011.1234

10 

    Hugues O, Fuchs P, Nannipieri OFurht B. New Augmented Reality Taxonomy: Technologies and Features of Augmented Environme. Handbook of augmented reality 2011. New York Springer, pp.850

11 

    Thomas RG, John NW, Delieu JM. Augmented reality for anatomical education. J Vis Commun Med 2010. 3 33: 1, pp.6-15, doi: 10.3109/17453050903557359

12 

    Botden SMBI, Jakimowicz JJ. What is going on in augmented reality simulation in laparoscopic surgery?. Surg Endosc 2009. 8 23: 8, pp.1693-700, doi: 10.1007/s00464-008-0144-1

13 

    Ogawa H, Hasegawa S, Tsukada S, Matsubara M. A Pilot Study of Augmented Reality Technology Applied to the Acetabular Cup Placement During Total Hip Arthroplasty. J Arthroplasty 2018. 12 33: 6, pp.1833-1837, doi: 10.1016/j.arth.2018.01.067

14 

    Zhu Egui, Hadadgar Arash, Masiello Italo, Zary Nabil. Augmented reality in healthcare education: an integrative review. PeerJ 2014. 2: , pp.e469, doi: 10.7717/peerj.46925071992

15 

    Ingrassia PL, Franc JM, Carenzo L. A novel simulation competition format as an effective instructional tool in post-graduate medical education. Adv Simul (Lond) 2018. 3: , pp.17, doi: 10.1186/s41077-018-0075-4

16 

    Bangor A, Kortum PT, Miller JT. An Empirical Evaluation of the System Usability Scale. International Journal of Human-Computer Interaction 2008. 730 24: 6, pp.574-594, doi: 10.1080/10447310802205776

17 

    Chamberlain DA, Hazinski MF, European Resuscitation CouncilAmerican Heart AssociationHeartStroke Foundation of CanadaAustralia New Zealand Resuscitation CouncilResuscitation Council of Southern AfricaConsejo Latino-Americano de Resuscitación. Education in resuscitation. Resuscitation 2003. 10 59: 1, pp.11-4314580733

18 

    Baumeister J, Ssin SY, ElSayed NAM, Dorrian J, Webb DP, Walsh JA, Simon TM, Irlitti A, Smith RT, Kohler M, Thomas BH. Cognitive Cost of Using Augmented Reality Displays. IEEE Trans Vis Comput Graph 2017. 12 23: 11, pp.2378-2388, doi: 10.1109/TVCG.2017.2735098
https://www.researchpad.co/tools/openurl?pubtype=article&doi=10.2196/14910&title=Augmented Reality Learning Environment for Basic Life Support and Defibrillation Training: Usability Study&author=Gunther Eysenbach,Jacqueline Vaughn,Miguel Padilha,Pier Luigi Ingrassia,Giulia Mormando,Eleonora Giudici,Francesco Strada,Fabio Carfagna,Fabrizio Lamberti,Andrea Bottino,&keyword=augmented reality,cardiopulmonary resuscitation,automated external defibrillators,&subject=Short Paper,Short Paper,