Abstract
Objectives
The purposes of this study were to develop a Web-based education program, My Child's Safety, which includes patient safety education and information on the diagnosis, treatment, and management for caregivers of children with cancer, and to examine the efficacy of the My Child's Safety program in promoting the caregivers' awareness of patient safety.
Methods
A one-group pre- and post-test design was adopted. The participants were the caregivers of children with cancer and were recruited from one pediatric hemato-oncology unit of a tertiary university hospital in a large metropolitan city of South Korea. They were asked to review the Web-based program for patient safety and then complete questionnaires developed to measure the awareness of patient safety among the caregivers.
Results
In the study, the total score of the caregivers' awareness of patient safety had increased significantly after Web-based self-learning patient safety education. Also caregivers' awareness of their right to ask and know about procedures and treatments during hospitalization had increased after the program was used.
Conclusions
The Web-based patient safety education program effectively improved the awareness of patient safety and the awareness of the right to know and ask about procedures and treatments during hospitalization among the caregivers. Family caregivers were less likely to ask healthcare professionals questions related to safety.
The report from the Institute of Medicine, To Err is Human: Building a Safer Health System [1], pointed out the fact that up to 98,000 people die annually as the result of medical errors in the healthcare settings of the United States. This report dramatically increased concern regarding medical errors and patient safety; therefore, healthcare professionals, along with organizations, have been making increased efforts to improve patient safety by implementing new approaches and practices [2].
Until now, the healthcare system in the United States received a grade of 'B-' [3] in patient safety and medical errors, which are still prevalent. Many experts in patient safety were not sure whether the previously mentioned efforts actually improved patient safety or not [2]. Changing the system in healthcare settings and educating healthcare professionals were not effective and had limitations in reducing medical errors [4,5]. Experts in patient safety realized that patients may play a critical role in improving safety by defending themselves [4,5]. However, patients have been traditionally regarded as passive recipients of care and little was known about the role of patients, even though patients' involvement in the healthcare process at any time point can promote their safety [4].
Medical errors in pediatric inpatient setting occurred at similar rates as those observed in adults, but they were more than twice as likely to cause harm [6] due to the susceptibility and vulnerability inherent in pediatric patients. Children diagnosed with cancer face numerous complicated and intensive treatments, including chemotherapy, radiation therapy, and repeated hospitalization for several years. During these processes, family caregivers have to make the most difficult decisions and are fully in charge of their offspring's care both at home and in the hospital. However, Schwappach [5] found that patients or caregivers who perceive their knowledge as insufficient may be less likely to be proactive in patient safety behaviors. Caregivers of children with cancer, thus, require detailed information on diagnosis, treatment, and self-care of cancer, as well as education on patient safety to become active partners.
The number of Internet users in Korea has increased to 78% in 2012 [7]. Among various education approaches, Web-based health education targeting patients and caregivers has several advantages. The advantages of the Web-based approach are that patients and/or caregivers can receive up-to-date health information anytime and anywhere [8]. A systematic review on Web-based interventions [9] found that this approach had positive effects on patient empowerment in disease-specific self-efficacy, but still more research is needed to know how the involvement of patients and caregivers could improve safety.
Several studies on patient safety education have been conducted among healthcare providers, such as medical and nursing students, physicians, and nurses [10,11]; however, to our knowledge, there has been no Web-based patient safety program for the caregivers of children with cancer. Therefore, patient safety education using an innovative Web-based approach among caregivers, who can play a critical role as vigilant partners of their child's safety, is necessary.
The aims of this study were 1) to develop a Web-based education program, My Child's Safety, which includes patient safety education and information on the diagnosis, treatment, and management for caregivers of children with cancer, and 2) to examine the efficacy of the My Child's Safety program in promoting the caregivers' awareness of patient safety.
The efficacy of the My Child's Safety program was examined by using a one-group pre- and post-test design. The subjects who participated in the study were the caregivers of children with cancer and were recruited from one pediatric hemato-oncology unit of a tertiary university hospital in a large metropolitan city of South Korea. The eligibility criteria of caregivers were that they were 1) taking care of a child with cancer, 2) able to read and speak Korean, and 3) able to access Internet. The sample size was calculated using Cohen's formula [12] and G*Power software [13] based on significance level (α = 0.05), effect size (d = 0.5), power (1-β = 0.8) and paired t-test. The estimated total sample size was 27 and the number of participants in the study was 29; therefore, we decided to proceed with the study because it had a large enough sample.
After we received permission for recruitment from the unit manager and patients' physicians, we posted and distributed flyers to the potential eligible participants (caregivers). When they expressed an interest in participating in the study, we briefly explained the study and scheduled an appointment for the consent process and study orientation. During the consenting, we provided thorough information on the study (e.g., the purpose, procedures, potential benefits and risks, and the participants' rights to withdrawal at any time during research process) to the potential participants.
After obtaining written informed consent, we provided instruction on how to use the program, including the program link, how to sign-up and log-in, outline of content, and how to submit online questionnaires.
The data collection period was from April 25, 2010 to May 15, 2010. After the participants signed up for the online program, they completed the online pre-test questionnaire. The pre-test questionnaire included 1) the demographic characteristics of a participant and a patient, 2) the caregivers' awareness of patient safety, and 3) the caregivers' awareness of the right to ask and know about procedures and treatments during hospitalization. Then, they used two modules during two weeks. Once the participants completed the two modules, they submitted the post-test questionnaire, which included the same items except demographics.
The questionnaire was developed to identify how caregivers perceive their children's safety. The instrument was developed based on the contents of the Speak Up module [14] and literature search. Five experts, who had more than 10 years each of clinical experience in tertiary hospitals, reviewed and validated the questionnaire. Items were measured with a 5-point Likert scale. The discussion and decision on items were based on the characteristics of the study site: a hemato-oncology unit in a tertiary hospital.
Exploratory factor analysis (EFA) was conducted to see how many factors are necessary to explain the inter-relationships among a set of indicators of patient safety in the developed questionnaire [15]. The EFA used principal components analysis, followed by varimax rotation, using eigenvalues [16] and scree plot [17] to determine factors that would be independent. Ten components were identified by eigenvalues greater than one rule, and 7 components were identified by scree plot. Items with a factor loading score lower than 0.40 were eliminated. Items with loading higher than 0.40 across multiple dimensions were eliminated. Dimensions with only one or two items were eliminated. After examination of the data, a seven-component model was considered as the most suitable solution with 33 items. The extracted dimensions were checked to see if they differed from the conceptual framework that we supposed. The final scale compositions and item factor loadings after an EFA are presented in Table 1.
This measure was found to have acceptable to good internal consistency (0.74), and the subsections also were found to have good to fair internal consistency. The Cronbach's α coefficients for the four subsections were lower than 0.70, which is considered acceptable for new scales [18].
This measure included eight items assessing the level of awareness among caregivers of their right to ask and know about their children's care. This measure is a modified version of the Patient's Right to Know and Self-Determination survey [19]. The original survey has 27 items and five sections,
but the patients' awareness of the right to ask and know (8 items) was selected for the study. The items were measured with a 5-point Likert scale, and a higher score indicates that the person has more awareness of the patient's right to know. Cronbach's α was 0.78 in the study of Ahn et al. [19]. This measure has been shown to have good internal consistency in this study (0.73).
Two modules of the My Child's Safety program were developed by system development life cycle (SDLC), such as system analysis, design, development, and evaluation process. Two learning modules were patient safety education for caregivers and pediatric hemato-oncology caregiver education.
First, learning objectives and requirements were defined, and then the module was developed based on contents from the Speak Up Initiatives [14] and the Agency for Healthcare Research and Quality's tips for patients & consumers [20]. The researchers selected and modified the contents that were applicable to the target population. Then, the expert panel reviewed the contents and validated the contents in terms of the actual conditions in the Korean hospital setting. The expert panel consisted of eleven experts: one faculty member of the nursing school who has expertise in patient safety and ten registered nurses who were actively involved in hemato-oncology patients' care for at least three years.
The patient and caregiver education materials were originally developed with the input of physicians and nurses working in the designated unit, which included booklets on patient care in hospital and at home. The researchers and the expert panel updated and added relevant contents based on recent literature and publications to match with the program.
Upon completion of content development, we populated the contents on the website with a Web designer. Each module included specific learning objectives and structured learning content with external Web links to other relevant health sites for further information (Table 2).
According to the learning objectives on child's safety issues, all content was developed in Korean and at a 6th grade reading level and reviewed by the same expert panel used to develop the patient safety module. The expert panel revised the first Web-based education program and provided feedback. Based on the feedback, the second version of the Web-based education program was developed.
To ensure that the program would be usable for the target population, three volunteer caregivers in the hemato-oncology unit participated in the usability testing of the program. Based on the comments from the usability testing, the content was revised and finalized. Figures 1 through 4 (Figure 1,2,3 and 4) show screen shots of the program.
Participants included 29 caregivers (male 17.2%) of children with cancer, such as leukemia (34.5%), neuroblastoma (24.1%), or osteosarcoma (13.8%). Caregivers were an average of 38.0 years of age and patients were an average of 6.9 years. More than half of the caregivers were housewives (55.2%) and only 31.0% of them had received education about patient medication and disease from the hospital (Table 3).
The results suggest that the My Child's Safety program can increase awareness of patient safety and the right to know among caregivers of children with cancer. The total score of caregivers' awareness of patient safety had increased significantly after they had used the patient safety program module (t = 8.51, p = 0.001) (Table 4). Six categories (paying attention, education, asking for help, knowledge on medication, selection of hospital, and participation in treatment) had significantly increased after the program was used. Among the seven categories, only the asking questions category did not show significant improvement (t = 1.957, p = 0.060).
Caregivers' awareness of their right to ask and know about procedures and treatments during hospitalization has increased after they had used the program (t = 2.346, p = 0.026) (Table 5). According to the subscale analysis, there were trends for improvement in two items: knowing the results of the medical treatments received (t = 1.797, p = 0.083) and providing health information to build strong relationships between patients and healthcare providers (t = 1.860, p = 0.073). One item showed significant improvement: asking about how long the healthcare for my child will take (t = 4.063, p = 0.001). The rest of the five items showed improvement in mean score; however, the changes were not statistically significant.
Patient safety has become a major concern among public and healthcare organizations worldwide, including Korea. However, few studies have been conducted regarding patient safety in Korea [21], and the importance of patient and caregiver education has not been emphasized until now. To the best of our knowledge, the My Child's Safety program is the first Web-based program developed for patient safety of children with cancer in South Korea. This study demonstrated that a Web-based program for patient safety effectively improved caregivers' awareness of patient safety and their rights to ask healthcare professionals questions.
Web-based intervention was proven to be a cost-effective method to deliver specific health interventions to patients [22]. Previous studies on patient education using printed materials showed minimal changes related to health-related behaviors [23]. However, patients who have received Web-based educational intervention reported better outcomes than patients who received traditional education, such as face-to-face sessions [24]. Patient-centered patient safety intervention has not been widely studied, but one study on patient safety intervention among patients reported the feasibility and acceptability of face-to-face intervention [25]. Considering the effectiveness of Web-based interventions in previous patient education, utilizing an online program will provide more promising results.
The importance of patients' contributions to their safety and the prevention of errors [25] has been emphasized for more than a decade in other advanced countries. For example, there have been many initiatives in patient safety and regarding patients as partners for patient safety outside of Korea. The representative examples are 1) Speak Up Initiatives, 2) Five Steps to Safer Health Care, 3) Your Role in Making Healthcare Safer, and 4) What You Can Do to Make Healthcare Safer. These initiatives developed various series of brochures and multimedia resources (e.g., video clips) for patients and caregivers. The contents included information on medical conditions and treatments but also encouraged patients and caregivers to challenge the traditional patient roles, such as asking their healthcare providers whether they have washed their hands or if they have double-checked the medications the patient received [14]. In addition, these initiatives started from the diverse organization level, and there have been many studies or campaigns promoted by hospital or by individual researchers [5].
After using the patient safety modules, six out of seven categories in the caregivers' awareness of patient safety were significantly improved. Consistently with this research, patients who watched an educational patient safety video felt significantly more comfortable talking with their healthcare workers about patient safety issues [26]. Moreover, patients' knowledge level on patient safety and their level of confidence to ask questions increased significantly after watching the video [26,27].
The category of 'asking questions' in the caregivers' awareness of patient safety was the only domain that did not show significant improvement. Previous studies have also reported similar results that patients felt that asking healthcare providers questions about patient safety was challenging. Patients who watched the patient safety video showed significantly increased confidence; however, they were not comfortable to ask healthcare providers about their medication [27]. In addition, patients were significantly more willing to ask doctors and nurses factual questions (e.g., treatment, recovery, and medication) than challenging questions (e.g., washing hands) [28]. However, when they received education from a doctor, patients were more willing to ask healthcare providers challenging questions [26,27]. These results suggest that patient safety education by healthcare professionals could increase patients' intent to participate in activities for preventing medical errors.
In this study, the mean score of the caregivers' awareness of the right to ask and know about procedures and treatment during hospitalization was 3.44 ± 0.58 after using the program. This was lower than the result obtained by Ahn et al. [19] from adult patients (4.14 ± 1.03). The difference in the population may explain the different results of the studies. Only a few studies on the patient's right to know have been conducted in Korea among adult patients [19,29], and there has been no previous study for child patients or their caregivers. While using My Child's Safety program, the participants could learn about their right to know about procedures and treatment but they may not put them into actual actions. One possible reason for the patients' or the caregivers' passive involvement is the relationship between oncology patients and physicians. According to Shin et al. [30], oncology patients have an average consultation time with their physician of about 7 minutes only. Patients or caregivers may be intimated by the healthcare providers' attitudes toward them such they are usually in a hurry and therefore may not have a chance to speak up. Thus, efforts need to be made among healthcare professionals, such as encouraging patients and caregivers to ask if they have any questions or concerns.
The current findings must be understood in the context of several important limitations. Using a convenience sample from one site may limit the generalizability of the study findings. Future research will be necessary to collect data from various geographical regions with larger sample sizes. This study did not control the exact time and frequency to visit the My Child's Safety program by caregivers; thus, future research adopted with a randomized control design is needed.
Despite the limitations we noted, the Web-based patient safety program effectively improved the awareness of patient safety and their right to ask and know among family caregivers. Family caregivers were less likely to ask healthcare professionals questions related to safety. Therefore, specific attention by healthcare professionals is required to increase awareness of patient safety and changing attitudes of family caregivers. Nurses could play an important role by providing positive reinforcement to caregivers to encourage their involvement. In addition, more attention should be paid to healthcare professionals' views on patient safety and caregivers' and patients' roles in preventing medical errors.
Figures and Tables
Acknowledgments
This work was supported by the National Research Foundation of Korea grant funded by the Korean Government (NRF-2013S1A5A2A01014884).
References
1. Kohn LT, Corrigan J, Donaldson MS. To err is human: building a safer health system. Washington (DC): National Academy Press;1999.
2. Leape LL, Berwick DM. Five years after To Err Is Human: what have we learned? JAMA. 2005; 293(19):2384–2390.
3. Wachter RM. Patient safety at ten: unmistakable progress, troubling gaps. Health Aff (Millwood). 2010; 29(1):165–173.
4. Vincent CA, Coulter A. Patient safety: what about the patient? Qual Saf Health Care. 2002; 11(1):76–80.
5. Schwappach DL. Review: engaging patients as vigilant partners in safety: a systematic review. Med Care Res Rev. 2010; 67(2):119–148.
6. Walsh KE, Dodd KS, Seetharaman K, Roblin DW, Herrinton LJ, Von Worley A, et al. Medication errors among adults and children with cancer in the outpatient setting. J Clin Oncol. 2009; 27(6):891–896.
7. Korea Internet & Security Agency. 2012 Survey on the Internet usage executive summary [Internet]. Seoul, Korea: Korea Internet & Security Agency;c2014. cited at 2014 Jul 3. Available from: http://isis.kisa.or.kr/eng/board/index.jsp?pageId=040100&bbsId=10&itemId=321&pageIndex=1.
8. Uphold CR. Transitional care for older adults: the need for new approaches to support family caregivers. J Gerontol Geriatric Res. 2012; 1:e107.
9. Samoocha D, Bruinvels DJ, Elbers NA, Anema JR, van der Beek AJ. Effectiveness of web-based interventions on patient empowerment: a systematic review and meta-analysis. J Med Internet Res. 2010; 12(2):e23.
10. Wong BM, Levinson W, Shojania KG. Quality improvement in medical education: current state and future directions. Med Educ. 2012; 46(1):107–119.
11. Norsen L, Spillane LL. Partnering in interprofessional education to design simulation programs to promote collaboration and patient safety. Creat Nurs. 2012; 18(3):109–113.
12. Cohen J. Statistical power analysis for the behavioral sciencies. 2nd ed. Hillsdale (NJ): Lawrence Erlbaum Associates;1988.
13. Faul F, Erdfelder E, Lang AG, Buchner A. G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods. 2007; 39(2):175–191.
14. The Joint Commission. Speak Up Initiatives [Internet]. Oakbrook Terrace (IL): The Joint Commission;c2014. cited 2014 Jul 3. Available from: http://www.jointcommission.org/speakup.aspx.
15. Pett MA, Lackey NR, Sullivan JJ. Making sense of factor analysis : the use of factor analysis for instrument development in health care research. Thousand Oaks (CA): Sage;2003.
16. Kaiser HF. The application of electronic computers to factor analysis. Educ Psychol Meas. 1960; 20(1):141–151.
17. Cattell RB. The scree test for the number of factors. Multivariate Behav Res. 1966; 1(2):245–276.
18. Nunnally JC. Psychometric theory. 2nd ed. New York (NY): McGraw-Hill;1978.
19. Ahn SH, Kim YS, Yoo MS, Bang KS. A patient's right to know and self-determination. Korean J Med Ethics. 2009; 12(2):153–164.
20. Agency for Healthcare Research and Quality. Patients and consumers [Internet]. Rockville (MD): Agency for Healthcare Research and Quality;c2014. cited at 2014 Jul 3. Available from: http://www.ahrq.gov/patients-consumers/index.html.
21. Kim J, An K, Kim MK, Yoon SH. Nurses' perception of error reporting and patient safety culture in Korea. West J Nurs Res. 2007; 29(7):827–844.
22. Martorella G, Cote J, Racine M, Choiniere M. Web-based nursing intervention for self-management of pain after cardiac surgery: pilot randomized controlled trial. J Med Internet Res. 2012; 14(6):e177.
23. Fredericks S, Guruge S, Sidani S, Wan T. Postoperative patient education: a systematic review. Clin Nurs Res. 2010; 19(2):144–164.
24. Runge C, Lecheler J, Horn M, Tews JT, Schaefer M. Outcomes of a Web-based patient education program for asthmatic children and adolescents. Chest. 2006; 129(3):581–593.
25. Jha V, Winterbottom A, Symons J, Thompson Z, Quinton N, Corrado OJ, et al. Patient-led training on patient safety: a pilot study to test the feasibility and acceptability of an educational intervention. Med Teach. 2013; 35(9):e1464–e1471.
26. Anthony R, Miranda F, Mawji Z, Cerimele R, Davis R, Lawrence S. John M. The LVHHN patient safety video: patients as partners in safe care delivery. Jt Comm J Qual Saf. 2003; 29(12):640–645.
27. Davis RE, Pinto A, Sevdalis N, Vincent C, Massey R, Darzi A. Patients' and health care professionals' attitudes towards the PINK patient safety video. J Eval Clin Pract. 2012; 18(4):848–853.
28. Davis RE, Koutantji M, Vincent CA. How willing are patients to question healthcare staff on issues related to the quality and safety of their healthcare? An exploratory study. Qual Saf Health Care. 2008; 17(2):90–96.