INTRODUCTION
Medical education trains students to become clinicians with strong technical and interpersonal skills that significantly impact patient outcomes. Research shows that stress in medical practice leads to clinician burnout and a loss of physician empathy, lower quality patient care, patient dissatisfaction, and increased medical errors and malpractice [1-4]. These declines in mood and attitude begin even as early as the third year of medical training [5]. Previous reviews have addressed the importance of reflective practice in the curriculum [6] and have looked at the effects of various methods of reflection as teaching tools in medical education, including literature courses and communication workshops [7,8]. In response to these findings, reflective practice is receiving increasing focus in medical schools across Canada and the United States due in part to the Accreditation Council for Graduate Medical Education (ACGME) and CanMeds competencies [9]. Yet there is a lack of convincing evidence in the literature [8]. One author lamented in a review on reflection that “the literature is replete with accounts of the possible benefits to practitioners and clients of using reflection in practice, yet this amounts to a rather scant evidence base” [10].
Previous papers classified as reviews on the topic of reflective writing in medical education exist [11,12], but do not exclusively review papers with quantitative outcomes. The potential for reflective writing to improve exam scores, clinical skills and diagnostic accuracy have been shown in recent studies [13,14]. These important clinical improvements may occur in addition to the touted potential to broaden students’ intellectual and emotional horizons [15]. Many of the studies reviewed, however, are not structured as reproducible given their design. To our knowledge, there are no currently existing systematic reviews of the literature on the emotional effects of reflective writing interventions on medical and healthcare students. This paper will address this deficit.
METHODS
Criteria for studies in this review
Types of studies are conference proceedings, abstracts, and full papers. Types of participants are students in all health occupations (dental, medical, nursing, pharmacy, and premedical). Types of interventions are interventions of interest were reflective and written (including journaling, diaries, blogs, and reports). Other forms of reflection such as art and music were excluded.
Types of outcome measures (1) primary outcome was a change in student wellness, aptitude and/or clinical skills; (2) secondary outcome was identification of strengths and weaknesses of various reflective writing interventions.
Study methods
Search strategy
A comprehensive systematic search was conducted in Medline and Cumulative Index to Nursing and Allied Health Literature (CINAHL). The electronic search included all English-language articles published until January 22, 2013. We did not include empathy-related terms in the search because doing so eliminated a body of articles that described the effect of reflective writing with different language.
Medline was searched using OvidSP interface on 22 January, 2013, for the period 1,949 to the week of 21 January, 2013. We searched for any reflective work-including written journals, reports or diaries-performed by students in health occupations. CINAHL was searched using EBSCOHost interface on 22 January, 2013, for the period 1982 to the week of 21 January, 2013. The search terms, similarly, included any reflection or reflective work performed by students in health occupations.
Study selection
Two reviewers (CF and IC) independently assessed all search results using inclusion criteria. The first round of screening was to exclude: strictly qualitative abstracts from non-health professional fields, articles without a written reflective component as opposed to other forms (drawing, music, etc.), absence of pre- or post-intervention measures. Articles without control groups were not excluded in this round. In our second round of screening, the remaining mixed methods papers were critiqued based on international collaborative guides for analyzing medical education interventions [16]. Each article’s question, rationale, objectives, study design, intervention, evaluation, and results were appraised. Outcomes of interest included quantifiable impact or efficacy of reflective writing exercises on student wellness, aptitude and/or clinical skills.
Data selection and management
Both investigators independently reviewed all search results from both rounds. After completion of the second round of screening, all accepted studies were combined and re-assessed by each reviewer for adherence to criteria. All articles that met inclusion criteria according to both reviewers were included in the final analysis. Key data extracted from each article was based on the criteria by Reed et al. [16]. The manuscript was checked according to preferred reporting items for systematic reviews and meta-analyses (PRISMA) and all topics were fulfilled.
RESULTS
Our search revealed 706 papers from Medline and 326 papers from CINAHL, totaling 1,032. The abstract analysis of all papers yielded 53 papers that were thought to meet inclusion criteria. Full manuscript review narrowed this to 8 final papers that quantified changes in empathy and patient interaction skills following an intervention that involved reflective writing. The eight papers that met final inclusion criteria are summarized in Tables 1 and 2. Of note, seven of these papers describe interventions in the United States, while 1 took place in Sweden. No studies of the Canadian population met inclusion criteria. The papers all staged interventions in students in the allied healthcare professions: four of the papers targeted medical students and the other four targeted pharmacy students.
Although all the included papers used reflective writing as an intervention, their approaches to its introduction differed. Two of the studies introduced reflective writing as an isolated update to a previously existing course [17,18]. In three other studies, reflection was one of several components instituted in a course’s renewed curriculum, or in a new course [19-21]. One study boldly randomized students to write monthly essays reflecting on hypothetical encounters in different styles: clinical reasoning or reflective point-of-view [22]. This was the only study in our review to run simultaneous randomized interventions as part of a medical school curriculum; no comment was made by the authors on strategies to enlist administrative leadership to support such important research.
In the analyzed studies, empathy was measured in student self-perception, patient feedback, and third-party observation. Many of the studies also used multiple metrics to strengthen their findings. Two of the papers used previously validated metrics: one for empathy and one for attitudes towards geriatric patients. These were the best objective indicators of the effects of the interventions on empathy. Another two papers used multiple choice exams without external validation focusing on communication skills. Although these papers did not directly measure empathy, it would be expected that communication skills would correlate with students’ investments in and compassionate care for their patients. Four papers looked for outcomes in student writing such as insight in an essay on a patient death, the level of reflection in essays, the cultural sensitivity in an essay, and a holistic evaluation of writing. Each of these directly or indirectly requires insight into the patient’s psyche-a key component of empathy. Finally, one paper measured its outcomes through a survey on satisfaction with the intervention and its effect on the students’ mindset. This self-reporting mechanism was the weakest metric, especially because the study lacked a control group for comparison.
Unfortunately, seven of these eight papers addressed only short-term outcomes of one year or less. The lone paper that examined long-term outcomes also only measured outcomes immediately following the intervention, but it was defined as a long-term outcome since the intervention took place over four years. None of the papers measured empathic changes after any significant latency period. This makes it difficult to accurately gauge profound changes compared to situational, performance-based empathy.
The composition of control groups was inconsistent across the papers. Half of the papers (4/8) used a control group that was composed of different subjects than the intervention group. Of these 4, half again (2/8) used a concurrent comparison group, while the other half (2/8) used a cohort control strategy where the results of a healthcare class after the implementation of a new curriculum change was measured against the results of the previous healthcare class. In the remaining papers, 3/8 (37.5%) used pre- and post-tests to compare the intervention. One study had no control group, which is a serious concern, but the conclusions drawn by this paper were adequately tempered to warrant inclusion in this review. Overall, limitations concerning control groups contributed to the shortcomings in study design that curb the conclusions that can be drawn from this review.
DISCUSSION
Despite the current popularity of reflective writing in medical education, there is very limited quantitative data that prove its impact on students’ educational experiences, clinical skills or future well-being. From our initial search, we yielded a total of 1,032 studies, of which only 8 fit our inclusion criteria. The data, although limited, did show improvements in students’ levels of empathy and respect for patients [20-23], ability to self-reflect [24], cultural competency [17,19], and communication skills [18].
The review revealed significant inconsistencies in study design. In evidence-based medicine, randomized controlled trials (RCTs) are the gold standard; in medical education, however, few interventions use this study design. Whether this discrepancy is based on inadequate resources, educational philosophy or ethics [25,26], the literature is full of observational studies and quasi-experimental methods [15,27,28]. The studies in this review were all unique reflective writing programs with no reproducible measurable outcome, which makes translation and application of these initiatives difficult. The 8 studies identified were completed at different institutions, limiting the opportunity to measure statistical power and generalizability. This review is limited by marked heterogeneity in study designs, each article applying its own intervention to unique populations with different definitions and measures of empathy. Methodological critique was therefore limited. In order to expand available literature, we did not limit studies to medical students and the data from other health professions may not be directly beneficial to medical students. These limitations make it very difficult to meet the need for evidence-based medical training.
Despite program variability, the review illustrated consistent, positive outcomes of self-reflection on student well-being and clinical skills. It is important to note that several of the papers identified reflective writing as both intervention and metric [24]. The pre- and post-internship reflective essays on patient counselling explored by Wallman et al. [24] is a strong example that showed a statistically significant difference in depth of reflection and empathy. Through the authors’ lens, reflective writing can be seen as both a test that teaches and measures empathy changes. Its use as a self-validating empathetic intervention in particular deserves further exploration.
Physician burnout negatively influences patient care, patient satisfaction, medical errors and malpractice [1-4]. Research has shown that loss of empathy and cynicism begins in the early years of medical training [5], yet none of the studies in this review measured students’ responses from the perspective of patients and patient-care. Short-term improvements were shown in student insight and empathy toward patients [17,19-23], and there is potential for long-term gains with improvements in study design. Finding reliable and effective early interventions in medical education that can mediate loss of compassion and burnout has the potential to profoundly improve health care.
The studies that met all of our inclusion criteria did not universally measure the same traits related to empathy, use the same scales, and/or structure the interventions in similar fashions for similar durations. As such, it is essential that future studies focus in on one or two empathy- or compassion-related signs and limited personal or professional outcomes to avoid measuring empathy as a colossal, complex phenomenon [29]. With all of these limitations in mind, it is still telling that all of the papers (8/8) showed an improvement in students’ empathy through the primary or secondary subset of metrics. All of the papers with multiple choice examinations showed an improvement in student scores in part or all of the examinations, and for those papers whose outcomes were measured with essays the students showed an increase in insight, empathy, or cultural sensitivity. Perhaps most interestingly to medical educators, the survey on student opinion had a majority of positive responses to the change in curriculum. These positive data support an argument for reflective writing in a medical curriculum. A specific methodology has yet to be agreed upon.
Despite the dearth of literature that demonstrates the impact of reflective writing on students’ clinical skills and performance, there is a wealth of studies that illustrate the improvement of student empathy. There is significant room for improvement in designing reflective writing interventions that are consistent with focused empathy outcomes to guide evidence-based medical curriculum. This would improve the quality of writing exercises that are growing in popularity among health professional programs. This research shows that health provider burnout begins early on in medical training and early reflective interventions targeted against compassion-loss can have profound potential on physician well-being and patient outcomes.