Journal List > Healthc Inform Res > v.25(4) > 1136695

Choi, Kim, Yoon, Yoo, Won, Kim, Kang, Yoon, Hwang, Shin, Sim, and Cha: Effect of Watch-Type Haptic Metronome on the Quality of Cardiopulmonary Resuscitation: A Simulation Study

Abstract

Objectives

The aim of this study was to test the applicability of haptic feedback using a smartwatch to the delivery of cardiac compression (CC) by professional healthcare providers.

Methods

A prospective, randomized, controlled, case-crossover, standardized simulation study of 20 medical professionals was conducted. The participants were randomly assigned into haptic-first and non-haptic-first groups. The primary outcome was an adequate rate of 100–120/min of CC. The secondary outcome was a comparison of CC rate and adequate duration between the good and bad performance groups.

Results

The mean interval between CCs and the number of haptic and non-haptic feedback-assisted CCs with an adequate duration were insignificant. In the subgroup analysis, both the good and bad performance groups showed a significant difference in the mean CC interval between the haptic and non-haptic feedback-assisted CC groups—good: haptic feedback-assisted (0.57–0.06) vs. non-haptic feedback-assisted (0.54–0.03), p < 0.001; bad: haptic feedback-assisted (0.57–0.07) vs. non-haptic feedback-assisted (0.58–0.18), p = 0.005—and the adequate chest compression number showed significant differences— good: haptic feedback-assisted (1,597/75.1%) vs. non-haptic feedback-assisted (1,951/92.2%), p < 0.001; bad: haptic feedbackassisted (1,341/63.5%) vs. non-haptic feedback-assisted (523/25.4%), p < 0.001.

Conclusions

A smartwatch cardiopulmonary resuscitation feedback system could not improve rescuers' CC rate. According to our subgroup analysis, participants might be aided by the device to increase the percentage of adequate compressions after one minute.

I. Introduction

The survival rate from cardiac arrest remains poor despite ongoing efforts to improve the ‘chain of survival’ over the past 50 years [1234]. The delivery of high-quality cardiopulmonary resuscitation (CPR), while ensuring chest compression of adequate rate and depth, and allowing full chest recoil, was found to provide a significant survival benefit in previous studies [56]. Although the American Heart Association (AHA) and European Resuscitation Council (ERC) guidelines clearly define how to achieve effective CPR in basic life support (BLS) and advanced cardiac life support (ACLS) [789], maintaining good quality of CC in the field has been reported to be challenging [10].
Therefore, various types of feedback or prompt devices have been introduced to improve the quality of cardiac compression (CC) [11121314]. The most updated AHA and ERC guidelines recommend using audiovisual feedback devices during CPR training to improve skill acquisition and retention [1516]. In the review of interventions to improve CPR quality, not only audiovisual feedback devices but also mobile phones with BLS software or applications also showed favorable outcomes in improving the quality of bystander CPR in the prehospital setting [17]. However, these feedback devices are not as effective as expected in crowded and noisy environments, especially in the hospital setting [18].
Recently, a feedback system using a smartwatch was introduced as a substitute [192021]. Haptic feedback using vibrations from a smartwatch can be more effectively applicable than an audiovisual feedback device in the crowded and noisy environments of emergency settings [22]. In addition, smartwatches can give feedback according to each rescuer and can be worn without disturbing the rescuer's movement.
Although previous studies have demonstrated smartwatches as potential feedback devices for high-quality CC, the outcomes are diverse in terms of CPR quality [192021]. Furthermore, most of these studies have used either visual or audiovisual feedback in laypersons or medical students. Our study aimed to test the effect of haptic feedback using a smartwatch in the delivery of CC by professional healthcare providers. We hypothesized that haptic feedback using a smartwatch would increase the quality of CPR performed by professional healthcare providers.

II. Methods

1. Study Design

We designed a prospective, randomized, controlled, standardized simulation study to determine the effect of a haptic device on CPR quality. The study was approved by the Institutional Review Board of Samsung Medical Center (No. 2018-12-014-001).

2. Study Participants

Twenty participants were recruited from the study site by posting recruitment information on the employee notice board. Medical professionals who were either BLS or ACLS certified were eligible for study participation. Informed consent was obtained from all the participants.

3. Study Protocol

The study was performed with a case-crossover design. On the first visit, the participants were randomly assigned into two groups. The first group performed 2 minutes of continuous CC according to the AHA guidelines with the device (the haptic-first group), and the other group was asked to perform without it (the control-first group). Then, the participants were summoned 1 week later (washout period) to perform CPR as the other group. The study process is illustrated in Figure 1.

4. Description of the Devices

An Ambu Man Basic CPR Manikin was used to collect and store the performance data. The R package ‘peakPick’ was used to detect peaks and intervals of CCs from the performance data. The haptic device used was a Galaxy Gear S3 frontier smartwatch (Samsung Electronics Inc., Seoul, Korea) with a metronome application (Galaxy Store app Wearable Metronome), which is worn at the wrist to provide information with constant metronome-like vibrations at the rate of 110/min (Figure 2). Only the haptic feedback system of the metronome application was used in this study.

5. Measures

We collected information on demographic factors, such as age, sex, job, and CPR experience. As outcome measures, the total number of CCs was counted during 2 minutes. The participants were assigned to two groups according to their CC performance. The 10 best performing participants without the haptic feedback device were defined as the good performance group (GPG), and the next 10 best performing participants were defined as the bad performance group (BPG). Thirty-second intervals in a sequence were demarcated as quartiles 1Q, 2Q, 3Q, and 4Q.

6. Primary Outcome

The primary outcome was the percentage of the number of adequate rate of CC, defined as 100–120/min, with the haptic feedback device. The total number of CCs was counted during 2 minutes, and between 0.5 and 0.6 seconds for one compression was defined as an adequate duration.

7. Secondary Outcome

The secondary outcome was a comparative rate of CC and adequate duration between the good and bad performance groups; data obtained at each 30-second quartile were analyzed.

8. Data Analyses

We described the demographic factors and CPR experience in the two groups. The data were analyzed with the Mann– Whitney U test, χ2 test, Fisher exact test, or generalized estimation equation (GEE) as appropriate. p-values of <0.05 were considered statistically significant. The statistical analysis was executed using SAS version 9.4 (SAS Institute, Cary, NC, USA) and R3.5.1. The odds ratio and 95% confidence intervals (CIs) were estimated from the GEE models that included the main variable and covariates. The primary analysis used to examine the haptic device was the main variant of interest. We examined the following four models: model 1, unadjusted analysis between the haptic and control groups; model 2, adjusted analysis between the haptic and control groups; model 3, adjusted as model 2 with additional adjustment for the quality group; and model 4, adjusted as model 3 with additional adjustment for the 4 quartiles.

III. Results

Twenty participants were recruited and then randomized into two groups. Two of the participants were paramedics, 8 were nurses, and 10 were physicians. None of the participants was excluded. The demographic characteristics of the participants are summarized in Table 1. No significant differences were found between the two groups regarding sex, age, and experiences.

1. Primary Outcome

The CC performance results are shown in Table 2. The mean interval of the haptic and non-haptic feedback-assisted CCs did not show a significant difference, and the adequate chest compression number did not show a significant difference. Figure 3 shows a comparison of the timeline graphs of CCs for each participant and the fitted values of the haptic and non-haptic feedback-assisted CCs. The timeline graphs of CCs for each participant were more consistent with the haptic feedback device.
In the subgroup analysis between the good and bad performance groups, the mean intervals of the haptic and nonhaptic feedback-assisted CCs—good: haptic feedback-assisted (0.57–0.06) vs. non-haptic feedback-assisted (0.54–0.03), p < 0.001; bad: haptic feedback-assisted, (0.57–0.07) vs. non-haptic feedback assisted (0.58–0.18), p = 0.005—and the adequate chest compression number showed significant differences—good: haptic feedback assisted (1,597/75.1%) vs. non-haptic feedback assisted (1,951/92.2%), p < 0.001; bad: haptic feedback assisted (1,341/63.5%) vs. non-haptic feedback assisted (523/25.4%), p < 0.001. Figure 4 shows a comparison of the timeline graphs of CCs for each participant and the fitted values of the good and bad performance groups between the haptic and non-haptic feedback-assisted CCs. The fitted values in the bad performance group were more consistent with the haptic feedback device.
In another subgroup analysis, the haptic feedback-assisted CCs showed a generally higher quality from 1Q to 4Q, but no statistically significant difference was found in 4Q, unlike in 1Q and 2Q (Table 2). The mean CC interval and adequate chest compression numbers with and without haptic assistance were the following, respectively: in 1Q, 0.56–0.05 and 0.55–0.09 (p = 0.016), and 834/76% and 746/67.2% (p < 0.001); in 2Q, 0.57–0.06 and 0.55–0.08 (p < 0.001), and 749/70.7% and 635/58.6% (p < 0.001); in 3Q, 0.57–0.08 and 0.56–0.15 (p = 0.073), and 719/68.5% and 602/56.6% (p < 0.001); and in 4Q, 0.58–0.07 and 0.57–0.18 (p = 0.849), and 637/61.4% and 575/57.8% (p = 0.11).

2. Secondary Outcome

In the GEE analysis, the unadjusted odds ratio for the haptic feedback device assistance shown in model 1 (Table 3) was 1.502 (95% CI, 0.712–3.168). Model 2 shows the adjusted odds ratio (AOR) of the quality group and its positive impact. The AORs were 1.71 (95% CI, 0.69–4.24) and 6.80 (95% CI, 3.04–15.19) for the GPG and BPG, respectively. The AORs for 2Q, 3Q, and 4Q in comparison with 1Q were 0.67 (95% CI, 0.51–0.88), 0.59 (0.41–0.87), and 0.50 (0.32–0.78), respectively. The adjustment for the quality group had a mixed impact on the odds ratio (model 2 vs. model 3) (Table 3). When the haptic feedback device was used, the GPG had a negative impact (AOR = 0.25; 95% CI, 0.11–0.59), but the BPG had >500% increase in the likelihood of CC of adequate duration (AOR = 5.34; 95% CI, 2.16–13.18). In the haptic group, the AOR for the GPG in comparison with the BPG was 1.74 (95% CI, 0.56–5.41). In the control group, the AOR for the GPG in comparison with the BPG was 36.80 (95% CI, 14.24–95.12).
The AORs for 2Q, 3Q, and 4Q in comparison with 1Q were 0.63 (95% CI, 0.47–0.85), 0.55 (0.37–0.83), and 0.45 (0.28–0.73), respectively. Moreover, both the quality and quartile were adjusted in model 4 (Table 3). Each quartile had a positive impact when the haptic feedback device was used (1Q: AOR = 1.74, 95% CI, 0.65–4.65; 2Q: AOR = 1.96, 95% CI, 0.75–5.11; 3Q: AOR = 1.97, 95% CI, 0.77–5.01; 4Q: AOR = 1.29, 95% CI, 0.46–3.62). Both quality groups showed a lower probability of high-quality CC in the time sequence. In the GPG, the AORs for 2Q, 3Q, and 4Q in comparison with 1Q were 0.71 (95% CI, 0.50–1.02), 0.63 (0.6–1.12), and 0.43 (0.21–0.89), respectively. In the BPG, the AORs for 2Q, 3Q, and 4Q in comparison with 1Q were 0.63 (95% CI, 0.40–0.99), 0.56 (0.33–0.95), and 0.582 (0.332–1.020), respectively.

IV. Discussion

This study demonstrated the capability of a smartwatch using a haptic feedback system for CC. No statistically significant difference in the mean CC duration or the proportion of CCs of adequate duration was found between the two groups. However, the haptic feedback device-assisted group showed less standard deviation than the non-haptic feedback device-assisted group. The compression rates without CPR feedback devices were significantly faster than the recommended guidelines [23]. In our study, a large number of participants in the non-haptic feedback device-assisted group tended to perform CCs at a faster or slower rate than that recommended in the guidelines or the haptic feedback device-assisted group. This result implies that CPR quality could be homogeneously controlled by using a smartwatch with real-time feedback, and that it is not affected by rescuer experience or the quality of performance.
Previous studies did not show a significant difference in the CC rate in novice rescuers [2024]. Moreover, even for healthcare professionals, the quality of CPR was suboptimal [25]. In a subgroup analysis, the authors found that the use of the haptic feedback system of a smartwatch significantly increased the proportion of CCs of adequate duration, especially in the poor performance group. To maintain a homogenously good quality of CC during the entire CPR duration, improving the quality CC in the poor performance group might have great clinical importance.
Recently, the use of smartphones as feedback systems to improve the quality of CC has been introduced in several manikin studies [26]. Rescuers need to grasp the smartphone in the palm when performing CC, which may cause errors in the accelerometers depending on their grasping methods [26]. On the other hand, rescuers usually wear smartwatches on the wrist; therefore, if they wear smartwatch, they might overcome the limitations of smartphones. Thus, smartwatches might be better performing feedback devices than smartphones in real-world situations.
The intensity of vibration of smartwatches might vary according to the manufacturer and cannot be customized. The individual perception of vibration might also vary [27]. Excessive intensity of vibration might interfere with CC performance, and a too weak intensity of vibration might not be perceived. Therefore, further investigation in needed to customize and optimize the intensity of vibration via smartwatches for individual users for better CC performance.
This study had several limitations. First, because this was a simulation study on a manikin, the performance of the compressors would be better than that in real-world clinical practice. The authors assumed the feedback from the watch using vibration would be well delivered even in hectic, noisy environments; however, various features in real-world CPR may interfere with compressor performance.
Second, the AHA guideline recommends a 5- to 6-cm depth and full chest recoil in each compression. The participants were familiar with the guidelines but were reminded again of the guidelines before the study. However, the correct hand position, posture, depth, and chest recoil during CCs were not measured in this study.
Third, the participants in this study were recruited from the emergency department of the study site and were all active healthcare professionals with extensive experience in real-world CPR. Therefore, the performance of compressors might be better than that in real-world. Moreover, the baseline characteristic of the participants, such as their height, weight, or athletic performance were not collected, which may have influenced the quality of CPR.
Finally, this study was conducted for healthcare professionals with hands-only CPR with a compression rate range from 100 to 120 per minute. Therefore, the results might not be applicable in the situation of performing compression to ventilation at a 30:2 ratio.
In conclusion, a CPR feedback system using a smartwatch could not improve rescuers CC performance in terms of the ideal range of CC rate in adherence with the CPR guidelines of the ERC or AHA. In subgroup analysis, the initial compression period of one minute after starting CC might be helpful using a smartwatch to increase the percentage of adequate compression.

Figures and Tables

Figure 1

CONSORT flow diagram for the study.

hir-25-274-g001
Figure 2

The smartwatch screen displays the rate of 110/min.

hir-25-274-g002
Figure 3

Comparison of the timeline graphs of cardiac compressions (CCs) in each participant and the fitted values of the haptic and non-haptic feedback-assisted CCs.

hir-25-274-g003
Figure 4

Comparison of the timeline graphs of cardiac compressions (CCs) in each participant and the fitted values of the good and bad performance groups between the haptic and non-haptic feedback-assisted CCs.

hir-25-274-g004
Table 1

Demographic characteristics of the participants

hir-25-274-i001

Values are presented as mean ± standard deviation or number (%).

BLS: basic life support, ACLS: advanced cardiovascular life support, EMT: emergency medical technician.

Table 2

Results for cardiac compression performance

hir-25-274-i002

Values are presented as mean ± standard deviation or number (%).

Comparative rate of CC and adequate duration between the good and bad performance groups; data obtained at each 30-second quartile were analyzed.

CC: cardiac compression.

Table 3

Results from the generalized estimating equation model

hir-25-274-i003

Model 1, unadjusted analysis between the haptic and control groups; Model 2, adjusted analysis between the haptic and control groups; Model 3, adjusted as Model 2 with additional adjustment for the quality group; and Model 4, adjusted as Model 3 with additional adjustment for the 4 quartiles; OR: odds ratio, CI: confidence interval, CC: cardiac compression, GPG: good performance group, BPG: bad performance group.

Notes

Conflict of Interest No potential conflict of interest relevant to this article was reported.

References

1. Abella BS, Alvarado JP, Myklebust H, Edelson DP, Barry A, O'Hearn N, et al. Quality of cardiopulmonary resuscitation during in-hospital cardiac arrest. JAMA. 2005; 293(3):305–310.
crossref
2. Eisenberg MS, Mengert TJ. Cardiac resuscitation. N Engl J Med. 2001; 344(17):1304–1313.
crossref
3. Rea TD, Crouthamel M, Eisenberg MS, Becker LJ, Lima AR. Temporal patterns in long-term survival after resuscitation from out-of-hospital cardiac arrest. Circulation. 2003; 108(10):1196–1201.
crossref
4. Daya MR, Schmicker RH, Zive DM, Rea TD, Nichol G, Buick JE, et al. Out-of-hospital cardiac arrest survival improving over time: Results from the Resuscitation Outcomes Consortium (ROC). Resuscitation. 2015; 91:108–115.
crossref
5. Feneley MP, Maier GW, Kern KB, Gaynor JW, Gall SA Jr, Sanders AB, et al. Influence of compression rate on initial success of resuscitation and 24 hour survival after prolonged manual cardiopulmonary resuscitation in dogs. Circulation. 1988; 77:240–250.
crossref
6. Meaney PA, Bobrow BJ, Mancini ME, Christenson J, de Caen AR, Bhanji F, et al. Cardiopulmonary resuscitation quality: [corrected] improving cardiac resuscitation outcomes both inside and outside the hospital: a consensus statement from the American Heart Association. Circulation. 2013; 128(4):417–435.
crossref
7. Kleinman ME, Brennan EE, Goldberger ZD, Swor RA, Terry M, Bobrow BJ, et al. Part 5: Adult basic life support and cardiopulmonary resuscitation quality: 2015 American Heart Association Guidelines Update for Cardiopulmonary Resuscitation and Emergency Cardiovascular Care. Circulation. 2015; 132(18 Suppl 2):S414–S435.
8. Link MS, Berkow LC, Kudenchuk PJ, Halperin HR, Hess EP, Moitra VK, et al. Part 7: Adult advanced cardiovascular life support: 2015 American Heart Association Guidelines Update for Cardiopulmonary Resuscitation and Emergency Cardiovascular Care. Circulation. 2015; 132(18 Suppl 2):S444–S464.
9. Perkins GD, Olasveengen TM, Maconochie I, Soar J, Wyllie J, Greif R, et al. European Resuscitation Council Guidelines for Resuscitation: 2017 update. Resuscitation. 2018; 123:43–50.
crossref
10. Wik L, Kramer-Johansen J, Myklebust H, Sorebo H, Svensson L, Fellows B, et al. Quality of cardiopulmonary resuscitation during out-of-hospital cardiac arrest. JAMA. 2005; 293(3):299–304.
crossref
11. Kirkbright S, Finn J, Tohira H, Bremner A, Jacobs I, Celenza A. Audiovisual feedback device use by health care professionals during CPR: a systematic review and meta-analysis of randomised and non-randomised trials. Resuscitation. 2014; 85(4):460–471.
crossref
12. Martin P, Theobald P, Kemp A, Maguire S, Maconochie I, Jones M. Real-time feedback can improve infant manikin cardiopulmonary resuscitation by up to 79%: a randomised controlled trial. Resuscitation. 2013; 84(8):1125–1130.
crossref
13. Oh J, Song Y, Kang B, Kang H, Lim T, Suh Y, et al. The use of dual accelerometers improves measurement of chest compression depth. Resuscitation. 2012; 83(4):500–504.
crossref
14. Yu BG, Oh JH, Kim Y, Kim TW. Accurate measurement of chest compression depth using impulseradio ultra-wideband sensor on a mattress. PLoS One. 2017; 12(8):e0183971.
crossref
15. Bhanji F, Donoghue AJ, Wolff MS, Flores GE, Halamek LP, Berman JM, et al. Part 14: Education: 2015 American Heart Association Guidelines Update for Cardiopulmonary Resuscitation and Emergency Cardiovascular Care. Circulation. 2015; 132(18 Suppl 2):S561–S573.
16. Greif R, Lockey AS, Conaghan P, Lippert A, De Vries W, Monsieurs KG, et al. European Resuscitation Council Guidelines for Resuscitation 2015: Section 10. Education and implementation of resuscitation. Resuscitation. 2015; 95:288–301.
crossref
17. Chen KY, Ko YC, Hsieh MJ, Chiang WC, Ma MH. Interventions to improve the quality of bystander cardiopulmonary resuscitation: a systematic review. PLoS One. 2019; 14(2):e0211792.
crossref
18. Abella BS, Edelson DP, Kim S, Retzer E, Myklebust H, Barry AM, et al. CPR quality improvement during inhospital cardiac arrest using a real-time audiovisual feedback system. Resuscitation. 2007; 73(1):54–61.
crossref
19. Gruenerbl A, Pirkl G, Monger E, Gobbi M, Lukowicz P. Smart-watch life saver: smart-watch interactive-feedback system for improving bystander CPR. In : Proceedings of the 2015 ACM International Symposium on Wearable Computers; 2015 Sep 7-11; Osaka, Japan. p. 19–26.
20. Ahn C, Lee J, Oh J, Song Y, Chee Y, Lim TH, et al. Effectiveness of feedback with a smartwatch for highquality chest compressions during adult cardiac arrest: a randomized controlled simulation study. PLoS One. 2017; 12(4):e0169046.
crossref
21. Song Y, Chee Y, Oh J, Ahn C, Lim TH. Smartwatches as chest compression feedback devices: a feasibility study. Resuscitation. 2016; 103:20–23.
crossref
22. Reeder B, David A. Health at hand: a systematic review of smart watch uses for health and wellness. J Biomed Inform. 2016; 63:269–276.
crossref
23. Lu TC, Chang YT, Ho TW, Chen Y, Lee YT, Wang YS, et al. Using a smartwatch with real-time feedback improves the delivery of high-quality cardiopulmonary resuscitation by healthcare professionals. Resuscitation. 2019; 140:16–22.
crossref
24. Lee J, Song Y, Oh J, Chee Y, Ahn C, Shin H, et al. Smartwatch feedback device for high-quality chest compressions by a single rescuer during infant cardiac arrest: a randomized, controlled simulation study. Eur J Emerg Med. 2019; 26(4):266–271.
crossref
25. Abella BS, Sandbo N, Vassilatos P, Alvarado JP, O'Hearn N, Wigder HN, et al. Chest compression rates during cardiopulmonary resuscitation are suboptimal: a prospective study during in-hospital cardiac arrest. Circulation. 2005; 111(4):428–434.
crossref
26. Song Y, Oh J, Chee Y. A new chest compression depth feedback algorithm for high-quality CPR based on smartphone. Telemed J E Health. 2015; 21(1):36–41.
crossref
27. Lundstrom R, Stromberg T, Lundborg G. Vibrotactile perception threshold measurements for diagnosis of sensory neuropathy: description of a reference population. Int Arch Occup Environ Health. 1992; 64(3):201–207.
TOOLS
ORCID iDs

Boram Choi
https://orcid.org/0000-0001-9244-604X

Taerim Kim
https://orcid.org/0000-0002-8149-1205

Sun Young Yoon
https://orcid.org/0000-0002-4320-2388

Jun Sang Yoo
https://orcid.org/0000-0003-3696-3813

Ho-Jeong Won
https://orcid.org/0000-0001-8196-0879

Kyunga Kim
https://orcid.org/0000-0002-0865-2236

Eun Jin Kang
https://orcid.org/0000-0002-6324-1448

Hee Yoon
https://orcid.org/0000-0002-1297-9813

Sung Yeon Hwang
https://orcid.org/0000-0002-1352-3009

Tae Gun Shin
https://orcid.org/0000-0001-9657-1040

Min Seob Sim
https://orcid.org/0000-0001-6645-3684

Won Chul Cha
https://orcid.org/0000-0002-2778-2992

Similar articles