Advancements in the medical field directly impact national health levels. Within this framework, the caliber of medical school education is widely acknowledged as a crucial element in global health policies. The production of well-trained medical professionals is vital for bolstering a country’s health infrastructure and enhancing the provision of medical services. In light of this significant duty, Korea has been actively standardizing and enhancing medical school education by implementing accreditation standards since 2000 [1]. The Korean Institute of Medical Education and Evaluation (KIMEE) is at the forefront, serving as the principal body responsible for managing the evaluation and accreditation of medical education in Korea [2]. The Accreditation Standards of KIMEE 2019 (ASK2019) were developed to improve the medical school education standard and update the educational content to align with international benchmarks, notably the World Federation for Medical Education Global Standards for Quality Improvement [3]. There are 9 evaluation domains, 36 sub-areas, 92 basic standards, and 51 high-quality standards in ASK 2019. Compared to previous evaluation standards, although the total number of items has mainly remained consistent, there has been a noticeable expansion in evaluation areas and divisions, resulting in a more refined and comprehensive assessment framework [4]. The accreditation and evaluation process for medical schools in Korea includes a self-study by the school, collection, and review of self-study and student reports, an on-site visit, and a final decision on accreditation status. While numerous studies have indicated that the evaluation and accreditation system has positively influenced various aspects, such as curriculum development and the enhancement of student performance [5], a comprehensive analysis and understanding of these systems’ specific operational processes and outcomes still need to be improved.

Meta-evaluation has been an effective tool for assessing the accreditation process, as it critically examines the evaluation process itself [6]. In Korea, meta-evaluation methods have been used to assess university certification evaluations across various disciplines [7,8]. The KIMEE has conducted a meta-evaluation from 2011 until the second cycle of the third round of evaluation and certification of Korean medical schools.

Past meta-evaluations proved that the standards used to evaluate medical school accreditation were effective in promoting quality improvement and accountability in healthcare. However, they needed to catch up in capturing certain qualitative aspects that could not be measured with quantitative methods, indicating a notable gap in assessment. In light of this, a comprehensive meta-evaluation of the newly implemented ASK2019 was essential.

This study aimed to perform a comprehensive meta-evaluation of medical school accreditation and evaluation based on ASK2019 to identify areas for improvement and potential future directions. To achieve this goal, the study systematically collected and analyzed the insights and perceptions of a diverse group of stakeholders. This group included members of the self-assessment committee, the local visiting committee, administrative staff, and medical professors, all within the operational framework of ASK2019.

The Hanyang University Institutional Review Board (IRB no., HYUIRB 202307-011) approved this study, classifying it as low-risk and exempting it from the requirement for written consent because it utilizes anonymous email surveys that participants returned after giving consent.

This cross-sectional, national-level study involving stakeholders from 40 medical schools was conducted using an online survey.

From September 2022 to February 2023, over 5 months, letters requesting cooperation were sent to 40 medical schools in Korea, facilitated by the coordination and recommendation of the KIMEE. To collect survey responses, the KIMEE sent these letters to medical professors and administrative staff at the 40 medical schools. Surveys were also distributed to the site visit committee members and the self-evaluation committee via the email addresses registered with the KIMEE, ensuring a thorough data collection process. The research team acquired and analyzed anonymized data from the KIMEE.

The survey participants comprised 396 individuals, including professors from 40 national medical schools, members of self-evaluation committees with experience in medical school accreditation processes, and site visit committee members from the KIMEE who have participated in the evaluation and accreditation of medical schools. Additionally, administrative staff and faculty members from each medical school were part of the cohort. Participation in the survey was voluntary.

The research team developed the survey items collaboratively and subsequently refined through iterative discussions with the KIMEE’s Quality Improvement Committee. Experts experienced in accreditation to ensure the survey’s validity and reliability (Supplement 1). The survey encompassed various aspects of accreditation, such as its necessity, contribution to medical education, and perceptions of the KIMEE’s credibility, fairness, and objectivity. Additionally, it assessed the clarity and applicability of the accreditation standards and procedures. Responses were collected using a 6-point Likert scale for all items, and multiple-choice questions were employed to assess the positive outcomes of accreditation and the challenges encountered in preparing self-evaluation study reports. Context, input, process, and product evaluation criteria for the ASK2019 program are available in Supplement 2.

To minimize selection bias, we conducted surveys with one representative from each group: the self-evaluation study committee, the site visit committee, administrative staff, and faculty members from all 40 medical schools in South Korea.

Using G*Power (Heinrich-Heine-Universität Düsseldorf) [10] and assuming a medium effect size (F=0.25) [11] at a 0.05 significance level, at least 280 participants were needed for one-way analysis of variance (ANOVA) to ensure a statistical power of 0.95. Considering potential dropouts, this study recruited 300 participants.

Data analysis was conducted using IBM SPSS ver. 25.0 (IBM Corp.). The collected data comprised basic statistics, including mean and standard deviation. The t-test, one-way ANOVA, and the chi-square test were utilized to compare perceptions of medical education accreditation among 4 distinct groups: self-evaluation study committee members, site visit evaluators, general medical faculty, and medical school administrative staff.

After excluding missing data, the study included 332 participants. This cohort consisted of 172 self-evaluation study committee members, 28 site visit evaluators, 69 general professors from medical schools, and 64 administrative staff members from medical schools (Table 1).

This study aimed to explore the diverse perspectives of key stakeholders engaged in medical education accreditation in South Korea. These stakeholders included members of the self-evaluation study committee, site visit committee members, administrative staff, and medical professors. During the meta-evaluation process, a cross-sectional survey was administered. The findings revealed that members of the self-evaluation study committee and medical professors generally held positive views regarding the role of accreditation in enhancing medical education.

It is consistent with results from the post-second cycle meta-evaluation, which showed that medical school professors and staff involved in accreditation preparation acknowledged its importance in identifying and addressing institutional weaknesses [12].

However, this study highlighted several challenges, particularly for medical schools preparing for accreditation. These institutions encountered resource constraints during the data collection, analysis, and reporting phases, which are integral to meeting the established criteria and procedures [13,14]. Although the significance of accreditation in enhancing quality is widely acknowledged, there was a marked discrepancy in perceptions between the site visit committee members and the administrative staff. Addressing the divergence in viewpoints between evaluators and medical schools is an urgent issue that demands immediate attention to facilitate a smooth accreditation preparation process. Considering the critical role that administrative staff play in this preparation, it is essential to improve their working conditions to allow them to focus effectively on their duties. Furthermore, it is worth considering offering compensation for their significant contributions to the accreditation process.

The study also revealed a general skepticism among both site visit committee members and self-evaluation study committee members toward the essential and excellence criteria of accreditation, possibly due to a lack of clear understanding and guidance. Although the overall impact of accreditation on improving the quality of medical education was viewed positively, the responses concerning the basic and excellence criteria from self-evaluation study committee members and site visit evaluators were less favorable than those from the post-2nd cycle meta-evaluation.

Nevertheless, the self-evaluation study committee members noted a significant shift in their perception of the site visit evaluators’ professionalism, with a more positive outlook in this study than in the post-2nd cycle evaluation. Similarly, the accuracy and reliability of the reporting process were viewed more favorably.

To streamline and strengthen the medical education accreditation process, it is essential to broaden support by providing additional technical, financial, and human resources, thereby alleviating the burden on faculty members. The KIMEE should provide clear and detailed guidelines for accreditation to facilitate systematic preparation. Regular training sessions are important to improve stakeholders’ understanding and preparedness for the accreditation process. Promoting better collaboration and communication between medical schools and accreditation bodies is vital to align their goals. Introducing incentives can mitigate the perceived burden of accreditation, increase motivation, and foster a positive outlook [15-17]. Providing consistent feedback and continually refining standards and procedures are crucial to enhancing the effectiveness of the process. Finally, adopting a data-driven approach for ongoing meta-evaluation of the process will enable informed, evidence-based improvements.

The meta-evaluation reveals critical implications for Korea’s medical education accreditation for enhanced stakeholder communication and collaboration, simplification of accreditation procedures, and improved support for administrative staff. Addressing skepticism with more explicit guidelines and training is critical for a positive accreditation perception. These steps are vital for fostering a transparent, efficient accreditation process that uplifts medical education standards in Korea.

Using surveys can result in response bias because stakeholders may offer socially desirable responses or withhold their genuine opinions due to discomfort with the survey process. Furthermore, gathering data at a single time point can overlook the dynamic nature of perceptions, particularly when accreditation standards change. Reliance on self-reported surveys may also lead to bias, as participants might need to accurately report their behaviors or perceptions.

This study emphasizes the need for longitudinal research to understand the long-term effects of medical school accreditation on medical education quality and outcomes. It also points out the significance of analyzing resource allocation strategies to improve the efficiency of the accreditation process. It calls for an examination of the clarity and suitability of accreditation standards. Finally, the study stresses the importance of fostering an environment and culture that prioritizes continuous quality improvement in medical education by incorporating lessons learned from the accreditation process into continuous professional development.

The study sheds light on various stakeholders’ multifaceted perceptions of accreditation in medical education. Although there is a broadly positive attitude toward the essential nature and benefits of accreditation, differing opinions on the evaluation process, criteria, and the accrediting organization indicate a necessity for improved communication, the harmonization of expectations, and ongoing refinement of accreditation methods. These results highlight the significance of a cooperative approach to accreditation, one in which input from all parties is considered and integrated, fostering a transparent, equitable, and efficient process that ultimately elevates the standard of medical education.