PDF
Citation
Print
Introduction
Background/rationale
Issues regarding the training environment of interns and residents who care for patients on the front line have regularly been raised. Previous research has found that residents’ training environment affects the safety of patients [1,2]. Out of a total of 105,628 physicians in South Korea, 13,636 (12.9%) trainees worked in medical institutions in 2019 [3]. In Korea, interns circulate across various departments for a year, and residents work to develop knowledge and skills in a specific field for 3 or 4 years. To contribute to securing patient safety and fostering excellent medical personnel by protecting the rights of residents, the Korean government legislated the Act for the Improvement of Training Conditions and Status of Medical Residents (Medical Resident Act) on December 3, 2015 based on a proposal made by Dr. Yong-ik Kim, a member of the National Assembly of Korea at that time [4]. This law was anticipated to improve the educational conditions of resident physicians and to provide a more favorable environment for high-quality resident training [5,6]. The Medical Resident Act and its relevant regulations specifically describe training conditions in terms of the curriculum, breaks, training programs, and remuneration, mainly covering the working environment (work hours of no more than 80 hours per week on average for 4 weeks, extended shifts of no more than 36 hours, and at least 10 hours of rest after an extended shift exceeding 16 hours) and the learning environment (designation and role of attending educators, development of training achievement goals, and annual assessment of training conditions). After 1 preparatory year, the Medical Resident Act was implemented at all training institutions, in all matters except for the work hour regulations, for which another preparatory year was allowed.
Historically, in the United States, the Libby Zion case helped alter work hour limitations and augmented supervisory requirements in residency training [7]. In the United States, the ACGME sought to improve health care by evaluating and improving the quality of residents' education through exemplary accreditation. Specifically, they emphasized limited duty hours, which averaged 80 hours per week [8]. The European Union has exempted the rules of working hours for trainees and now applies the same standard of up to 48 hours per week [9].
After the implementation of the Medical Resident Act, the Korean Intern Resident Association (KIRA) designed a project to check whether the working hours and training environment changed after the implementation of the Medical Resident Act. Therefore, nationwide intern-resident surveys were conducted starting in 2016.
Objectives
This study aimed to analyze the working and training environment of residents in South Korea before and after the implementation of the Medical Resident Act in 2017. Although this Act was enacted in December 2015, there was a grace period for enforcement. This study also investigated residents' satisfaction with their working hours and educational programs. Specifically, information was collected every year by surveys administered to residents from 2016 to 2019 on working conditions, learning environment, job satisfaction, and satisfaction with the learning environment. Working conditions included consecutive work shifts, rest after a consecutive shift (hours), average sleep hours daily in the previous week (hours), number of lunch breaks in the previous week, 24-hour periods without duty in the last 4 weeks (times/wk), vacation days actually taken last year (days), admitted patient load during regular shifts (number). and admitted patient load during consecutive shifts (number). The working burden of internal medicine and general surgery residents was added. The learning environment included the awareness of learning achievement goals (%), sufficient training for attending educators (Likert score), and confidence in practicing without supervision after training. Other aspects of the learning environment included non-essential work as a resident, the involvement of physician assistants (PAs), and a sense of educational deprivation due to PAs. Satisfaction with the working and learning environment included general satisfaction.
Methods
Ethics statement
As this study used anonymized secondary data, the Institutional Review Board of Korea University College of Medicine, after reviewing the concept and design of the study, waived the need for ethical approval (KUIRB-2019-0241).
Study design
This study presents the results of an annual cross-sectional survey study performed by the KIRA.
Setting
The surveys were done between September and October from 2016 to 2019. Survey questionnaires were dispatched to the subjects through email. Subjects responded on the website provided by the KIRA. The somewhat different questionnaire items were used each year. Data from respondents were collected and saved for analysis. Some of the same interns or residents were able to participate in the survey each year. However, due to the anonymity of the respondents, it was not possible to trace the responses of specific individuals.
Participants
Members of the KIRA, who were physicians enrolled in training programs run by accredited educational institutions in Korea (i.e., interns [postgraduate year 1, PGY 1] and residents [postgraduate years 2, 3, 4, or 5 [PGY 2, 3, 4, 5]) were invited to participate in the surveys (Table 1). There were no inclusion or exclusion criteria. All interns and residents were targeted for participation.
Table 1.
Characteristics of the participants in the national intern-resident survey (2016–2019) in Korea
Data sources/measurement
The survey questionnaire is available in Supplement 1. The survey items consisted of ordinal data of a 5-point Likert type scale (1, strongly disagree; 5, strongly agree) or binary nominal data. Among the original survey questions, we analyzed items that met the following 2 selecting conditons. First, items providing information about the working and learning environment of interns and residents were analyzed, as described in Tables 2–5. Second, the questionnaires of each year were different; therefore, items with a common meaning were selected for comparisons between years. The coding manual in Supplement 2 shows how the common items were matched.
Table 2.
Changes in trainees’ working hours
Values are presented as median (interquartile range) considering the skewness of the data distribution or number (%), unless otherwise stated. Comparisons are shown between years (‘a’, ‘b’, ‘c’, and ‘d’ denote no statistical significance if they are the same letter, and show statistical significance if they are different letters).
NA, not assessed.
Statistical significance was calculated using a)the Cochran–Armitage test or the Kruskal-Wallis test and Wilcoxon rank-sum test with the Bonferroni correction.
Items of the measurement tool (survey questionnaire)
Definition of training environment attributes
We analyzed questions that elicited information on attributes of the training environment for interns and residents, such as working hours, vacations, learning opportunities, and wellness.
Classification of institutions by type
Training hospitals and institutions were classified into 3 categories, as follows. Group A included 42 tertiary hospitals specializing in training, research, and critical patient care. Group B included other training hospitals with 100 or more physicians under training. Group C included the remaining general hospitals, comprising single-specialty hospitals such as ophthalmic or psychiatric hospitals, and other accredited organizations such as medical schools or research institutes with residency training programs.
Grouping of specialties
All 26 specialties currently accredited in Korea were regrouped into 5 categories in terms of similarities in a training context, such as workload or night shifts: internal medicine; general surgery; medical specialties other than internal medicine (pediatrics, neurology, psychiatry, and dermatology); surgical specialties other than general surgery (orthopedics, neurosurgery, plastic surgery, cardiothoracic surgery, ophthalmology, obstetrics and gynecology, and urology); and others (radiology, radiation oncology, nuclear medicine, laboratory medicine, preventive medicine, anesthesiology, rehabilitation, family medicine, and emergency medicine). Interns rotating within different specialties were grouped separately.
Working conditions
Lunch breaks, sleep time, the number of working hours throughout the day, and break hours were considered as part of training conditions. Weekly work hours, consecutive work shifts, and the working hours of each consecutive work shift were included. A consecutive work shift was considered a shift that included additional consecutive hours, such as requiring more consecutive work or work in the evening or on a holiday. Residents engaged in internal medicine and general surgery also provided the number of patients managed per day.
Learning environment
The learning environment included awareness of the achievement goals for training that are required to be presented to interns and residents (specified by specialty and year); whether the duties organized for trainees were actually related to those goals; and whether the trainees learned from the attending educators responsible for supervising them. As additional factors related to effective learning, non-physician duties, such as administrative paperwork, personal errands, and the activities of PAs, were considered. Satisfaction with working conditions and learning environment included general satisfaction.
Validity and reliability testing
The content validity was discussed by the executive members of the KIRA, including the co-authors, before making the questionnaires. They agreed that the items sufficed to evaluate changes in residents’ working conditions, learning environment, and satisfaction. Reliability testing was not done because the items consisted of a variable format, including Likert-scale items, binary items, and nominal items.
Bias
The proportion of respondents ranged from 20.8% to 34.5%. Therefore, there may have been response bias, although the number of responses was large.
Study size
A post hoc analysis using G*Power (Heinrich-Heine-Universität Düsseldorf, Düsseldorf, Germany; http://www.gpower.hhu.de/) showed that the power was 0.99 when the variables with the least number of cells (124 and 134) were compared with an effect size of 0.5 and alpha error probability of 0.05 [10].
Statistical methods
The outcomes of the annual survey among years were compared using the Kruskal-Wallis test. The Wilcoxon rank-sum test with the Bonferroni correction was performed for multiple comparisons between years. The Jonckheere-Terpstra test for 5-point Likert scale data and the Cochran-Armitage test for categorical data were used to identify statistically significant trends according to the year. All statistical analyses were conducted using IBM SPSS Statistics ver. 25.0 (IBM Corp., Armonk, NY, USA).
Results
Raw data of the responses without the identification of individual training institutions is available from Dataset 1. Statistical analysis of results is available from Supplement 3.
Participants
Of the total of 55,727 trainees enrolled in the KIRA, 15,029 interns and residents took part in the survey, and the number of survey participants increased year by year (from 2,984 in 2016 to 4,700 in 2019). Most of the participants worked in a tertiary hospital (67.0%–75.0%), and participants who responded to the survey had a similar distribution of characteristics among institutions and specialties (Table 1).
Changes in working hours
Although 23.9% of physicians trained in 2019 said they still worked continuously for more than 36 hours, they had breaks of 10 hours or more between such shifts; these breaks have gradually become more common. However, the number of lunch breaks per week decreased from 5 in 2017 to 4 in 2019. Across institutions, postgraduate years, and specializations, trainees worked overtime (90 hours a week) prior to the enforcement of the Medical Resident Act. The overall working hours tended to decrease, although interns worked the most (P<0.001, 114 hours in 2016, 88 hours in 2019) (Table 2, Fig. 1)
Fig. 1.
Weekly work hours of training physicians by institution, postgraduate year, and specialty. (A) By institution type (P-trend <0.01). (B) By postgraduate year (P-trend <0.01 except for *: P-trend=0.56). (C) By specialty (P-trend <0.01). Statistical significance was calculated using the Jonckheere-Terpstra test. Group A: tertiary hospitals; group B: general hospitals with 100 or more training physicians; group C: general hospitals with <100 training physicians, single-specialty hospitals, or other teaching institutions not classified in groups A or B. R, residency year; IM, internal medicine; GS, general surgery.
Change in the workload of internal medicine and general surgery residents
Residents were asked about the number of patients admitted during regular shifts and the number of patients admitted during extended shifts, and the results showed that the workload did not change (Table 3). However, internal medicine residents showed a decreased workload during extended shifts.
Table 3.
Number of patients admitted during regular shifts and the number of patients admitted during extended shifts of internal medicine and general surgery residents from 2016 to 2019
Values are presented as median (interquartile range) considering the skewness of the data distribution. Statistical significance was calculated using the Kruskal-Wallis test and Wilcoxon rank-sum test with the Bonferroni correction. Comparisons are shown between years (‘a’, ‘b’, ‘c’, and ‘d’ denote no statistical significance if they are the same letter, and show statistical significance if they are different letters).
NA, not assessed.
Changes in the learning environment
After the enforcement of the Medical Resident Act, awareness of tasks or program/work achievement goals significantly increased among interns and residents, especially interns (P<0.001, 29.2% in 2016 to 58.3% in 2018) (Table 4). Higher scores were given for the establishment of training programs to achieve these goals year by year, reflecting the gradual preparation of attending educators for sufficient training. In terms of current specialization training, trainees showed significantly positive responses regarding their future professional skills.
Table 4.
Aspects of the learning environment among residents from 2016 to 2019 in Korea
Values are presented as number (%) or median (interquartile range) considering the skewness of the data distribution, unless otherwise stated. Group A: tertiary hospitals; group B: general hospitals with 100 or more training physicians; group C: general hospitals with less than 100 training physicians, single-specialty hospitals, or other teaching institutions not classified in groups A or B. Comparisons are shown between years (‘a’, ‘b’, ‘c’, and ‘d’ denote no statistical significance if they are the same letter, and show statistical significance if they are different letters).
NA, not assessed; PGY, postgraduate year.
Statistical significance was calculated using a)the Cochran–Armitage test or the Kruskal-Wallis test and Wilcoxon rank-sum test with the Bonferroni correction.
Non-essential physician tasks and sense of educational deprivation due to the institution’s PAs
Non-essential physician tasks such as administrative paperwork or personal errands remained steady among interns—25.8% in 2016 versus 23.8% in 2019 (P<0.001) (Table 5). Although the number of institutions where PAs are involved in medical practice decreased, trainees’ overall sense of educational deprivation due to the institution’s employment of PAs increased from 17.5% in 2016 to 25.6% in 2018.
Table 5.
Trends in non-essential physician tasks and sense of educational deprivation due to the institution’s use of PAs from 2016 to 2019
Group A: tertiary hospitals; group B: general hospitals with 100 or more training physicians; group C: general hospitals with <100 training physicians, single-specialty hospitals, or other teaching institutions not classified in groups A or B. Statistical significance was calculated using the Cochran–Armitage test or the Jonckheere-Terpstra test.
PA, physician assistant; PGY, postgraduate year; NA, not assessed.
Satisfaction with the working environment
The changes from 2016 to 2019 are presented in Fig. 2A–C. Satisfaction with the working environment varied according to the type of institution, postgraduate year, and specialty.
Fig. 2.
Overall satisfaction with the working and training environment among training physicians during 2016–2019. (A–C) Working environment. (D–F) Learning environment. (A) By institution type (*P-trend=0.02). (B) By postgraduate year (*P-trend=0.02). (C) By specialty (*P-trend=0.046, **P-trend <0.01). (D) By institution type (P-trend <0.01). (E) By postgraduate year (P-trend <0.01 except for *P-trend=0.02). (F) By specialty (data for interns in 2018 were not assessed; P-trend <0.01 except for *P-trend=0.02 and **P-trend=0.01). Statistical significance was calculated using the Jonckheere-Terpstra test. Group A: tertiary hospitals; group B: general hospitals with 100 or more training physicians; group C: general hospitals with <100 training physicians, single-specialty hospitals, or other teaching institutions not classified in groups A or B. R, residency year; IM, internal medicine; GS, general surgery.
Discussion
Key results
The weekly working hours of residents decreased year by year. Interns worked the most (114 hours in 2016, 88 hours in 2019). It became increasingly common for residents to have 10 hours or more of break time. The frequency of having lunch breaks per week decreased from 5 in 2017 to 4 in 2019. Residents’ sense of educational deprivation due to PAs increased from 17.5% in 2016 to 25.6% in 2018. There was a more favorable learning environment. For example, residents’ awareness of tasks or program/work achievement goals increased from 29.2% in 2016 to 58.3% in 2018. Although residents’ satisfaction with working conditions varied, their satisfaction with the learning environment increased year by year.
Interpretation
Prior to the Medical Resident Act, intern and resident education was burdensome to the health and wellbeing of residents. However, within the 2-year period after the implementation of the Medical Resident Act, training institutions began to make changes to meet the new standards. Weekly work hours for training physicians decreased to 80.2 hours, and they were provided with more full days off-duty as well as guaranteed vacations (Table 2). The role of attending educators was better recognized by training physicians, who also reported gaining more confidence in their competencies in practicing medicine on their own (Table 4). However, reduced working hours resulted in increased work pressure, leading to a lack of lunch breaks or excessive patient loads during night shifts (Table 2). The activities of PAs were increasingly regarded as interfering with residents’ learning opportunities (Table 5). These overall changes appeared to have a limited effect on interns (Table 2).
Ensuring duty hour restrictions was a major aim of the Medical Resident Act and a major controversial issue. With the passing of the legislation, concerns were raised that it would be too difficult to reduce training physicians’ working hours given practical circumstances, such as general hospitals with an excessive patient load or smaller institutions with chronic workforce shortages [11]. However, the above results showed that working conditions gradually began to comply with the new standards, with more full days off-duty and guaranteed vacation time.
Despite some promising changes under the Medical Resident Act, the findings of this study showed that more than 20% of residents still experienced consecutive shifts exceeding 36 continuous hours. The residents’ high labor intensity for patient care significantly increased after the Medical Resident Act to the point that some residents now skip lunch (Table 2).
The Medical Resident Act also brought about changes in the learning environment. Residents became more aware of what they should achieve throughout the program, rather than merely serving as an assistant workforce (Table 4). Such awareness may in turn have motivated the various stakeholders involved in teaching, including training institutions and attending educators. This may have led to greater appreciation among residents concerning both their programs and their teachers.
Comparison with previous studies
A previous study compared the training environment between 2015 (1,793 people) and 2017 (1,768 people) before and after enactment of the Medical Resident Act. Residents worked more than 80 hours per week on average (2015, 92.4 hours; 2017, 87.3 hours). They worked twice as long as 36 hours in a consecutive shift (2015, 89.4 hours; 2017, 70.1 hours) [1,2]. According to the Medical Resident Act’s implementation in 2017, the Korean Society of Internal Medicine reorganized the training process based on competence. It strengthened the evaluation of training hospitals to overcome and normalize the crisis of internal medicine residency training [12]. Residents and faculty members of Chonnam National University Hospital agreed to the duty hour regulations of the Medical Resident Act, including a maximum duty of 80 hours per week (averaged over 4 weeks), a maximum consecutive shift length of less than 36 hours, and mandatory 10-hour breaks between shifts [13]. A survey of emergency medicine residents from 80 out of 97 training hospitals in 2013 showed that the average number of duty hours was 63.7±10.7 hours per week. Residents at 9 hospitals (11.3%) worked more than 80 hours per week on average [14]. According to a survey of 513 psychiatry residents in 2016 and 2017, the average working hours were distributed as follows: 35 (6.9%) worked for less than 9 hours; 188 (37.2%) worked for 9 to 11 hours; 185 (36.6%) worked for 11 to 13 hours; 57 (11.3%) worked for 13 to 15 hours; and 41 (8.1%) worked for more than 15 hours [15]. The above-described previous studies show the high labor intensity before implementation of the Medical Resident Act.
Recommendations for improvement of residents’ working and learning environment
Despite these promising results, further improvement is required. Graduate medical education in Korea remains process-oriented, focusing on the number of cases diagnosed, reports published, or conferences attended as the main trainee goals. Moreover, some specialties simply repeat the same goals for each training year, lacking milestones or evaluation tools. Furthermore, our study showed that the proportion of residents who reported non-essential work remained approximately 18%, which could be readily reduced with clearer learning objectives.
It is of concern that, in addition to reduced training hours, more interns and residents felt deprived of learning opportunities by PAs. Unlike in countries where PAs are regarded as a distinct profession, the members of which individually and actively practice medicine to certain extent, boundaries between different healthcare domains (e.g., physicians, nurses, radiologists, etc.) are strictly enforced in Korea; thus, only physicians are permitted to perform medical procedures or engage in certain types of clinical decision-making in patient care, such as prescribing medications, using ultrasonography, or performing surgery, whereas PAs are unlicensed to do so. It seems that using PAs may be a more attractive alternative after the Medical Resident Act from an administrative perspective, but further research is needed on its effects in terms of teaching and learning.
Limitation
The number of participants surveyed comprised approximately 20% of the total number of resident physicians and interns each year (more specific numbers are shown in Table 1). The small proportion of survey participants and the voluntary nature of responding to the survey imposed selection bias as a limitation of the study. Another limitation is the lack of knowledge of the details related to the current Act since the survey was commenced just before the enactment of the Act. Therefore, this study could not directly evaluate the degree of implementation of the Medical Resident Act. Based on the sample characteristics, with an apparent increasing trend over time, it appears that some of the same respondents repeated the survey across different years. Therefore, the samples in the different years were not independent. However, due to the anonymity of the survey, it was not possible to pair the responses from different years. The weakest point of these consecutive survey results originated from the use of different survey items each year. Therefore, only items with the same content were selected and compared. Some data were also missing from the 2019 survey.
Suggestion
Further studies should include residents in other specialties, which are observed less frequently, and people working in small institutions with chronic labor shortages. In the future, it will be necessary to conduct a detailed evaluation according to the Medical Resident Act for matters regarding exhaustion, sleep, and other issues related to the quality of training. The results would also be more valuable if questionnaires were also administered to evaluators. For the future success of the Medical Resident Act in Korea, the government and medical societies must provide political and financial support. In addition to facilitating the development of an outcome-based curriculum, it is also necessary to expand the hospital system to address problems related to the shortage of physicians and the more efficient allocation of patients within each hospital.
Conclusion
Significant changes have been made to residents’ working and learning environment after the legislation of the Medical Resident Act in Korea. To improve the quality of training, the Medical Resident Act in Korea attempted to reform training standards regarding the working and learning environments, and the results were successful.
XML Download