Journal List > Healthc Inform Res > v.20(3) > 1075700

Park and Lee: Effects of My Child's Safety Web-Based Program for Caregivers of Children with Cancer in South Korea

Abstract

Objectives

The purposes of this study were to develop a Web-based education program, My Child's Safety, which includes patient safety education and information on the diagnosis, treatment, and management for caregivers of children with cancer, and to examine the efficacy of the My Child's Safety program in promoting the caregivers' awareness of patient safety.

Methods

A one-group pre- and post-test design was adopted. The participants were the caregivers of children with cancer and were recruited from one pediatric hemato-oncology unit of a tertiary university hospital in a large metropolitan city of South Korea. They were asked to review the Web-based program for patient safety and then complete questionnaires developed to measure the awareness of patient safety among the caregivers.

Results

In the study, the total score of the caregivers' awareness of patient safety had increased significantly after Web-based self-learning patient safety education. Also caregivers' awareness of their right to ask and know about procedures and treatments during hospitalization had increased after the program was used.

Conclusions

The Web-based patient safety education program effectively improved the awareness of patient safety and the awareness of the right to know and ask about procedures and treatments during hospitalization among the caregivers. Family caregivers were less likely to ask healthcare professionals questions related to safety.

I. Introduction

The report from the Institute of Medicine, To Err is Human: Building a Safer Health System [1], pointed out the fact that up to 98,000 people die annually as the result of medical errors in the healthcare settings of the United States. This report dramatically increased concern regarding medical errors and patient safety; therefore, healthcare professionals, along with organizations, have been making increased efforts to improve patient safety by implementing new approaches and practices [2].
Until now, the healthcare system in the United States received a grade of 'B-' [3] in patient safety and medical errors, which are still prevalent. Many experts in patient safety were not sure whether the previously mentioned efforts actually improved patient safety or not [2]. Changing the system in healthcare settings and educating healthcare professionals were not effective and had limitations in reducing medical errors [4,5]. Experts in patient safety realized that patients may play a critical role in improving safety by defending themselves [4,5]. However, patients have been traditionally regarded as passive recipients of care and little was known about the role of patients, even though patients' involvement in the healthcare process at any time point can promote their safety [4].
Medical errors in pediatric inpatient setting occurred at similar rates as those observed in adults, but they were more than twice as likely to cause harm [6] due to the susceptibility and vulnerability inherent in pediatric patients. Children diagnosed with cancer face numerous complicated and intensive treatments, including chemotherapy, radiation therapy, and repeated hospitalization for several years. During these processes, family caregivers have to make the most difficult decisions and are fully in charge of their offspring's care both at home and in the hospital. However, Schwappach [5] found that patients or caregivers who perceive their knowledge as insufficient may be less likely to be proactive in patient safety behaviors. Caregivers of children with cancer, thus, require detailed information on diagnosis, treatment, and self-care of cancer, as well as education on patient safety to become active partners.
The number of Internet users in Korea has increased to 78% in 2012 [7]. Among various education approaches, Web-based health education targeting patients and caregivers has several advantages. The advantages of the Web-based approach are that patients and/or caregivers can receive up-to-date health information anytime and anywhere [8]. A systematic review on Web-based interventions [9] found that this approach had positive effects on patient empowerment in disease-specific self-efficacy, but still more research is needed to know how the involvement of patients and caregivers could improve safety.
Several studies on patient safety education have been conducted among healthcare providers, such as medical and nursing students, physicians, and nurses [10,11]; however, to our knowledge, there has been no Web-based patient safety program for the caregivers of children with cancer. Therefore, patient safety education using an innovative Web-based approach among caregivers, who can play a critical role as vigilant partners of their child's safety, is necessary.
The aims of this study were 1) to develop a Web-based education program, My Child's Safety, which includes patient safety education and information on the diagnosis, treatment, and management for caregivers of children with cancer, and 2) to examine the efficacy of the My Child's Safety program in promoting the caregivers' awareness of patient safety.

II. Methods

1. Design, Sample, and Setting

The efficacy of the My Child's Safety program was examined by using a one-group pre- and post-test design. The subjects who participated in the study were the caregivers of children with cancer and were recruited from one pediatric hemato-oncology unit of a tertiary university hospital in a large metropolitan city of South Korea. The eligibility criteria of caregivers were that they were 1) taking care of a child with cancer, 2) able to read and speak Korean, and 3) able to access Internet. The sample size was calculated using Cohen's formula [12] and G*Power software [13] based on significance level (α = 0.05), effect size (d = 0.5), power (1-β = 0.8) and paired t-test. The estimated total sample size was 27 and the number of participants in the study was 29; therefore, we decided to proceed with the study because it had a large enough sample.

2. Procedure

1) Recruitment and consent process

After we received permission for recruitment from the unit manager and patients' physicians, we posted and distributed flyers to the potential eligible participants (caregivers). When they expressed an interest in participating in the study, we briefly explained the study and scheduled an appointment for the consent process and study orientation. During the consenting, we provided thorough information on the study (e.g., the purpose, procedures, potential benefits and risks, and the participants' rights to withdrawal at any time during research process) to the potential participants.

2) Study orientation

After obtaining written informed consent, we provided instruction on how to use the program, including the program link, how to sign-up and log-in, outline of content, and how to submit online questionnaires.

3) Data collection procedure

The data collection period was from April 25, 2010 to May 15, 2010. After the participants signed up for the online program, they completed the online pre-test questionnaire. The pre-test questionnaire included 1) the demographic characteristics of a participant and a patient, 2) the caregivers' awareness of patient safety, and 3) the caregivers' awareness of the right to ask and know about procedures and treatments during hospitalization. Then, they used two modules during two weeks. Once the participants completed the two modules, they submitted the post-test questionnaire, which included the same items except demographics.

3. Instruments

1) Caregivers' awareness of patient safety

The questionnaire was developed to identify how caregivers perceive their children's safety. The instrument was developed based on the contents of the Speak Up module [14] and literature search. Five experts, who had more than 10 years each of clinical experience in tertiary hospitals, reviewed and validated the questionnaire. Items were measured with a 5-point Likert scale. The discussion and decision on items were based on the characteristics of the study site: a hemato-oncology unit in a tertiary hospital.
Exploratory factor analysis (EFA) was conducted to see how many factors are necessary to explain the inter-relationships among a set of indicators of patient safety in the developed questionnaire [15]. The EFA used principal components analysis, followed by varimax rotation, using eigenvalues [16] and scree plot [17] to determine factors that would be independent. Ten components were identified by eigenvalues greater than one rule, and 7 components were identified by scree plot. Items with a factor loading score lower than 0.40 were eliminated. Items with loading higher than 0.40 across multiple dimensions were eliminated. Dimensions with only one or two items were eliminated. After examination of the data, a seven-component model was considered as the most suitable solution with 33 items. The extracted dimensions were checked to see if they differed from the conceptual framework that we supposed. The final scale compositions and item factor loadings after an EFA are presented in Table 1.
This measure was found to have acceptable to good internal consistency (0.74), and the subsections also were found to have good to fair internal consistency. The Cronbach's α coefficients for the four subsections were lower than 0.70, which is considered acceptable for new scales [18].

2) Caregivers' awareness of the right to ask and know about procedures and treatments during hospitalization

This measure included eight items assessing the level of awareness among caregivers of their right to ask and know about their children's care. This measure is a modified version of the Patient's Right to Know and Self-Determination survey [19]. The original survey has 27 items and five sections, but the patients' awareness of the right to ask and know (8 items) was selected for the study. The items were measured with a 5-point Likert scale, and a higher score indicates that the person has more awareness of the patient's right to know. Cronbach's α was 0.78 in the study of Ahn et al. [19]. This measure has been shown to have good internal consistency in this study (0.73).

4. Description of My Child's Safety Program for Caregivers

Two modules of the My Child's Safety program were developed by system development life cycle (SDLC), such as system analysis, design, development, and evaluation process. Two learning modules were patient safety education for caregivers and pediatric hemato-oncology caregiver education.

1) Analysis phase

(1) Module 1: Issues on patient safety and tips to prevent medical errors in children

First, learning objectives and requirements were defined, and then the module was developed based on contents from the Speak Up Initiatives [14] and the Agency for Healthcare Research and Quality's tips for patients & consumers [20]. The researchers selected and modified the contents that were applicable to the target population. Then, the expert panel reviewed the contents and validated the contents in terms of the actual conditions in the Korean hospital setting. The expert panel consisted of eleven experts: one faculty member of the nursing school who has expertise in patient safety and ten registered nurses who were actively involved in hemato-oncology patients' care for at least three years.

(2) Module 2: Caregiver education on pediatric hemato-oncology

The patient and caregiver education materials were originally developed with the input of physicians and nurses working in the designated unit, which included booklets on patient care in hospital and at home. The researchers and the expert panel updated and added relevant contents based on recent literature and publications to match with the program.

2) Design phase

Upon completion of content development, we populated the contents on the website with a Web designer. Each module included specific learning objectives and structured learning content with external Web links to other relevant health sites for further information (Table 2).

3) Development phase

According to the learning objectives on child's safety issues, all content was developed in Korean and at a 6th grade reading level and reviewed by the same expert panel used to develop the patient safety module. The expert panel revised the first Web-based education program and provided feedback. Based on the feedback, the second version of the Web-based education program was developed.

4) Evaluation phase

To ensure that the program would be usable for the target population, three volunteer caregivers in the hemato-oncology unit participated in the usability testing of the program. Based on the comments from the usability testing, the content was revised and finalized. Figures 1 through 4 (Figure 1,2,3 and 4) show screen shots of the program.

III. Results

1. Participants

Participants included 29 caregivers (male 17.2%) of children with cancer, such as leukemia (34.5%), neuroblastoma (24.1%), or osteosarcoma (13.8%). Caregivers were an average of 38.0 years of age and patients were an average of 6.9 years. More than half of the caregivers were housewives (55.2%) and only 31.0% of them had received education about patient medication and disease from the hospital (Table 3).

2. Improvements in Caregivers' Awareness of Patient Safety

The results suggest that the My Child's Safety program can increase awareness of patient safety and the right to know among caregivers of children with cancer. The total score of caregivers' awareness of patient safety had increased significantly after they had used the patient safety program module (t = 8.51, p = 0.001) (Table 4). Six categories (paying attention, education, asking for help, knowledge on medication, selection of hospital, and participation in treatment) had significantly increased after the program was used. Among the seven categories, only the asking questions category did not show significant improvement (t = 1.957, p = 0.060).

3. Improvements in Caregivers' Awareness of Right to Ask and Know about Procedures and Treatments during Hospitalization

Caregivers' awareness of their right to ask and know about procedures and treatments during hospitalization has increased after they had used the program (t = 2.346, p = 0.026) (Table 5). According to the subscale analysis, there were trends for improvement in two items: knowing the results of the medical treatments received (t = 1.797, p = 0.083) and providing health information to build strong relationships between patients and healthcare providers (t = 1.860, p = 0.073). One item showed significant improvement: asking about how long the healthcare for my child will take (t = 4.063, p = 0.001). The rest of the five items showed improvement in mean score; however, the changes were not statistically significant.

IV. Discussion

Patient safety has become a major concern among public and healthcare organizations worldwide, including Korea. However, few studies have been conducted regarding patient safety in Korea [21], and the importance of patient and caregiver education has not been emphasized until now. To the best of our knowledge, the My Child's Safety program is the first Web-based program developed for patient safety of children with cancer in South Korea. This study demonstrated that a Web-based program for patient safety effectively improved caregivers' awareness of patient safety and their rights to ask healthcare professionals questions.
Web-based intervention was proven to be a cost-effective method to deliver specific health interventions to patients [22]. Previous studies on patient education using printed materials showed minimal changes related to health-related behaviors [23]. However, patients who have received Web-based educational intervention reported better outcomes than patients who received traditional education, such as face-to-face sessions [24]. Patient-centered patient safety intervention has not been widely studied, but one study on patient safety intervention among patients reported the feasibility and acceptability of face-to-face intervention [25]. Considering the effectiveness of Web-based interventions in previous patient education, utilizing an online program will provide more promising results.
The importance of patients' contributions to their safety and the prevention of errors [25] has been emphasized for more than a decade in other advanced countries. For example, there have been many initiatives in patient safety and regarding patients as partners for patient safety outside of Korea. The representative examples are 1) Speak Up Initiatives, 2) Five Steps to Safer Health Care, 3) Your Role in Making Healthcare Safer, and 4) What You Can Do to Make Healthcare Safer. These initiatives developed various series of brochures and multimedia resources (e.g., video clips) for patients and caregivers. The contents included information on medical conditions and treatments but also encouraged patients and caregivers to challenge the traditional patient roles, such as asking their healthcare providers whether they have washed their hands or if they have double-checked the medications the patient received [14]. In addition, these initiatives started from the diverse organization level, and there have been many studies or campaigns promoted by hospital or by individual researchers [5].
After using the patient safety modules, six out of seven categories in the caregivers' awareness of patient safety were significantly improved. Consistently with this research, patients who watched an educational patient safety video felt significantly more comfortable talking with their healthcare workers about patient safety issues [26]. Moreover, patients' knowledge level on patient safety and their level of confidence to ask questions increased significantly after watching the video [26,27].
The category of 'asking questions' in the caregivers' awareness of patient safety was the only domain that did not show significant improvement. Previous studies have also reported similar results that patients felt that asking healthcare providers questions about patient safety was challenging. Patients who watched the patient safety video showed significantly increased confidence; however, they were not comfortable to ask healthcare providers about their medication [27]. In addition, patients were significantly more willing to ask doctors and nurses factual questions (e.g., treatment, recovery, and medication) than challenging questions (e.g., washing hands) [28]. However, when they received education from a doctor, patients were more willing to ask healthcare providers challenging questions [26,27]. These results suggest that patient safety education by healthcare professionals could increase patients' intent to participate in activities for preventing medical errors.
In this study, the mean score of the caregivers' awareness of the right to ask and know about procedures and treatment during hospitalization was 3.44 ± 0.58 after using the program. This was lower than the result obtained by Ahn et al. [19] from adult patients (4.14 ± 1.03). The difference in the population may explain the different results of the studies. Only a few studies on the patient's right to know have been conducted in Korea among adult patients [19,29], and there has been no previous study for child patients or their caregivers. While using My Child's Safety program, the participants could learn about their right to know about procedures and treatment but they may not put them into actual actions. One possible reason for the patients' or the caregivers' passive involvement is the relationship between oncology patients and physicians. According to Shin et al. [30], oncology patients have an average consultation time with their physician of about 7 minutes only. Patients or caregivers may be intimated by the healthcare providers' attitudes toward them such they are usually in a hurry and therefore may not have a chance to speak up. Thus, efforts need to be made among healthcare professionals, such as encouraging patients and caregivers to ask if they have any questions or concerns.
The current findings must be understood in the context of several important limitations. Using a convenience sample from one site may limit the generalizability of the study findings. Future research will be necessary to collect data from various geographical regions with larger sample sizes. This study did not control the exact time and frequency to visit the My Child's Safety program by caregivers; thus, future research adopted with a randomized control design is needed.
Despite the limitations we noted, the Web-based patient safety program effectively improved the awareness of patient safety and their right to ask and know among family caregivers. Family caregivers were less likely to ask healthcare professionals questions related to safety. Therefore, specific attention by healthcare professionals is required to increase awareness of patient safety and changing attitudes of family caregivers. Nurses could play an important role by providing positive reinforcement to caregivers to encourage their involvement. In addition, more attention should be paid to healthcare professionals' views on patient safety and caregivers' and patients' roles in preventing medical errors.

Figures and Tables

Figure 1
Homepage and introduction.
hir-20-199-g001
Figure 2
Online survey (pre- and post-questionnaires).
hir-20-199-g002
Figure 3
Module 2: Caregiver education on pediatric hemato-oncology (lab tests).
hir-20-199-g003
Figure 4
Module 2: Caregiver education on pediatric hemato-oncology (central line management).
hir-20-199-g004
Table 1
Exploratory factor analysis of caregivers' awareness of patient safety: scale compositions and item-factor loadings
hir-20-199-i001
Table 2
Overview of My Child'S Safety program
hir-20-199-i002
Table 3
Characteristics of caregivers and children with cancer
hir-20-199-i003

Values are presented as mean ± standard deviation or number (%).

Table 4
Differences on caregivers' awareness of patient safety between pre-test and post-test
hir-20-199-i004

Values are presented as mean ± standard deviation.

Table 5
Difference on the caregivers' awareness of the right to ask and know between pre-test and post-test
hir-20-199-i005

Values are presented as mean ± standard deviation.

aReverse coding.

Acknowledgments

This work was supported by the National Research Foundation of Korea grant funded by the Korean Government (NRF-2013S1A5A2A01014884).

Notes

No potential conflict of interest relevant to this article was reported.

References

1. Kohn LT, Corrigan J, Donaldson MS. To err is human: building a safer health system. Washington (DC): National Academy Press;1999.
2. Leape LL, Berwick DM. Five years after To Err Is Human: what have we learned? JAMA. 2005; 293(19):2384–2390.
3. Wachter RM. Patient safety at ten: unmistakable progress, troubling gaps. Health Aff (Millwood). 2010; 29(1):165–173.
crossref
4. Vincent CA, Coulter A. Patient safety: what about the patient? Qual Saf Health Care. 2002; 11(1):76–80.
crossref
5. Schwappach DL. Review: engaging patients as vigilant partners in safety: a systematic review. Med Care Res Rev. 2010; 67(2):119–148.
crossref
6. Walsh KE, Dodd KS, Seetharaman K, Roblin DW, Herrinton LJ, Von Worley A, et al. Medication errors among adults and children with cancer in the outpatient setting. J Clin Oncol. 2009; 27(6):891–896.
crossref
7. Korea Internet & Security Agency. 2012 Survey on the Internet usage executive summary [Internet]. Seoul, Korea: Korea Internet & Security Agency;c2014. cited at 2014 Jul 3. Available from: http://isis.kisa.or.kr/eng/board/index.jsp?pageId=040100&bbsId=10&itemId=321&pageIndex=1.
8. Uphold CR. Transitional care for older adults: the need for new approaches to support family caregivers. J Gerontol Geriatric Res. 2012; 1:e107.
crossref
9. Samoocha D, Bruinvels DJ, Elbers NA, Anema JR, van der Beek AJ. Effectiveness of web-based interventions on patient empowerment: a systematic review and meta-analysis. J Med Internet Res. 2010; 12(2):e23.
crossref
10. Wong BM, Levinson W, Shojania KG. Quality improvement in medical education: current state and future directions. Med Educ. 2012; 46(1):107–119.
crossref
11. Norsen L, Spillane LL. Partnering in interprofessional education to design simulation programs to promote collaboration and patient safety. Creat Nurs. 2012; 18(3):109–113.
crossref
12. Cohen J. Statistical power analysis for the behavioral sciencies. 2nd ed. Hillsdale (NJ): Lawrence Erlbaum Associates;1988.
13. Faul F, Erdfelder E, Lang AG, Buchner A. G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods. 2007; 39(2):175–191.
crossref
14. The Joint Commission. Speak Up Initiatives [Internet]. Oakbrook Terrace (IL): The Joint Commission;c2014. cited 2014 Jul 3. Available from: http://www.jointcommission.org/speakup.aspx.
15. Pett MA, Lackey NR, Sullivan JJ. Making sense of factor analysis : the use of factor analysis for instrument development in health care research. Thousand Oaks (CA): Sage;2003.
16. Kaiser HF. The application of electronic computers to factor analysis. Educ Psychol Meas. 1960; 20(1):141–151.
crossref
17. Cattell RB. The scree test for the number of factors. Multivariate Behav Res. 1966; 1(2):245–276.
crossref
18. Nunnally JC. Psychometric theory. 2nd ed. New York (NY): McGraw-Hill;1978.
19. Ahn SH, Kim YS, Yoo MS, Bang KS. A patient's right to know and self-determination. Korean J Med Ethics. 2009; 12(2):153–164.
crossref
20. Agency for Healthcare Research and Quality. Patients and consumers [Internet]. Rockville (MD): Agency for Healthcare Research and Quality;c2014. cited at 2014 Jul 3. Available from: http://www.ahrq.gov/patients-consumers/index.html.
21. Kim J, An K, Kim MK, Yoon SH. Nurses' perception of error reporting and patient safety culture in Korea. West J Nurs Res. 2007; 29(7):827–844.
crossref
22. Martorella G, Cote J, Racine M, Choiniere M. Web-based nursing intervention for self-management of pain after cardiac surgery: pilot randomized controlled trial. J Med Internet Res. 2012; 14(6):e177.
crossref
23. Fredericks S, Guruge S, Sidani S, Wan T. Postoperative patient education: a systematic review. Clin Nurs Res. 2010; 19(2):144–164.
crossref
24. Runge C, Lecheler J, Horn M, Tews JT, Schaefer M. Outcomes of a Web-based patient education program for asthmatic children and adolescents. Chest. 2006; 129(3):581–593.
crossref
25. Jha V, Winterbottom A, Symons J, Thompson Z, Quinton N, Corrado OJ, et al. Patient-led training on patient safety: a pilot study to test the feasibility and acceptability of an educational intervention. Med Teach. 2013; 35(9):e1464–e1471.
crossref
26. Anthony R, Miranda F, Mawji Z, Cerimele R, Davis R, Lawrence S. John M. The LVHHN patient safety video: patients as partners in safe care delivery. Jt Comm J Qual Saf. 2003; 29(12):640–645.
crossref
27. Davis RE, Pinto A, Sevdalis N, Vincent C, Massey R, Darzi A. Patients' and health care professionals' attitudes towards the PINK patient safety video. J Eval Clin Pract. 2012; 18(4):848–853.
crossref
28. Davis RE, Koutantji M, Vincent CA. How willing are patients to question healthcare staff on issues related to the quality and safety of their healthcare? An exploratory study. Qual Saf Health Care. 2008; 17(2):90–96.
crossref
29. Chun IH, Park K. Patient's cognition toward the disclosure of cancer diagnosis. Asian Oncol Nurs. 2013; 13(2):59–66.
crossref
30. Shin DW, Kim SY, Cho J, Sanson-Fisher RW, Guallar E, Chai GY, et al. Discordance in perceived needs between patients and physicians in oncology practice: a nationwide survey in Korea. J Clin Oncol. 2011; 29(33):4424–4429.
crossref
TOOLS
Similar articles