Abstract
Purpose
In addition to dental education, a system for the evaluation and management of dental licensing and certification is required to meet the growing societal demand for more competent dentists. In this study, the Delphi technique was used to gather opinions from a variety of professionals on the problems of and remedies for the dental license management system in Korea.
Methods
Delphi surveys were conducted from April 2016 to October 2016 in South Korea. A variety of dental professionals were included and categorized into 3 groups according to their expertise as follows: the basic dentistry group, the clinical dentistry group, and the policy group. The Delphi technique was conducted in 3 rounds of e-mail surveys, each with different questions that probed with increasing depth on the dental license management system. In each successive round, the responses were categorized, scored on a Likert scale, and statistically analyzed.
Results
After categorizing the results of the first survey and ranking the results of the second survey using the Delphi technique, regulation by a licensing authority was found to be the most critical issue. This was followed by the license renewal system, continuing education, a tiered licensure system, improvement of foreign license approval, and utilization of retirees, in decreasing order of importance. The third Delphi survey showed a similar ranking, with regulation by a licensing authority being the major concern. Opinions regarding the dental license management system were provided as open-ended responses. The responses of the 3 groups showed statistically significant differences in the scores for the issue of regulation by a licensing authority. After re-grouping into the dentistry group and the policy group, the issue received a significantly higher score in the dentistry group.
Changes in the population and disease structure and the development of new medical technology have dramatically transformed the oral healthcare environment. This, in turn, has led to changes in medical policy and has increased the required expertise for dentists. Although it is essential that dentists receive formal dentistry education at a university in order to competently satisfy societal demands, a system for the evaluation and management of licensing and certification is also of utmost importance. Furthermore, a systematic management policy for dental licensing must be established to protect citizens and improve oral health in an age where healthcare personnel continue to move across borders. In this study, the Delphi technique was used to gather opinions from a variety of professionals, such as local practitioners, dental school professors, policy makers, and consumer representatives in order to gain an understanding of the problems of and remedies for the dental license management system.
When using the Delphi technique, it is important to carefully consider the participants’ representativeness, their professional knowledge, and the integrity of participation and answers; for this reason, the study sample was organized into the groups listed in Table 1. The study sample consisted of 21 participants and included professionals with experience at the Korea Health Personnel Licensing Examination Institute, local practitioners, basic dentistry professionals, clinical dentistry professionals, policy makers, medical experts, and humanities and social sciences-related dentistry professionals. The participants were grouped according to expertise, with 6 people in the basic dentistry group, 10 people in the clinical dentistry group, and 5 people in the policy group.
The selection of an appropriate number of rounds of surveying is a critical part of reaching a consensus using the Delphi technique. Three rounds of surveys are typically recommended to reach an agreement among experts, since the variation in responses is the greatest during the first 2 rounds. In this study, we followed this recommendation and conducted 3 rounds of e-mail surveys.
The first Delphi survey asked the participants about issues regarding the current dental license, the license management system, and potential improvements to the system. Open-ended questions were used to obtain a wide range of responses and opinions from the expert groups. Existing competency models of both the Korean Institute of Dental Education and Evaluation and the International Society of Dental Regulators were provided to encourage thinking about issues regarding dentist competencies [1,2] (Appendix 1).
The second Delphi survey asked the respondents to rate the importance of 6 issues categorized from the results of the first survey on a 5-point Likert scale (from 1 to 5). An open-ended question asking for additional opinions on dental license policy and management was also included (Appendix 2).
The third Delphi survey compiled the responses from the second survey, compared them to each individual expert’s responses, and asked the expert to provide modified responses as needed. Additionally, the respondents were asked to reevaluate the importance of the 6 issues (Appendix 3).
All 21 of the participants responded to all 3 surveys. Similar opinions acquired from the open-ended responses in the first survey were categorized into 6 issues according to the consensus of 4 researchers. The importance of each issue was determined by averaging the Likert scale scores from the second survey. The issues were ranked by weighting each averaged score (from rank 1 [5 points] to rank 5 [1 point]), multiplying the rank by the number of responses, and converting the product into a score out of a maximum of 100 points. The same method was used for the third survey, and its results were compared to those of the second survey. The non-parametric Kruskal-Wallis test was used to verify the differences in scores among expert groups for each issue. The Mann-Whitney test was then conducted on significant results from the Kruskal-Wallis test. SPSS ver. 12.0 (SPSS Inc., Chicago, IL, USA) was used for statistical analysis, with P< 0.05 considered statistically significant.
The categorized issues formed from the open-ended responses in the first survey were regulation by a licensing authority, continuing education, the license renewal system, a tiered licensure system, improvement of foreign license approval, and utilization of retirees. The number of responses for each issue is presented in Table 2. Raw data were available from Supplement 1.
According to the second Delphi survey, the issues were ranked in descending order as follows: regulation by a licensing authority, the license renewal system, continuing education, a tiered licensure system, improvement of foreign license approval, and utilization of retirees (Fig. 1). Regulation by a licensing authority was the most important issue, even in the rankings for potential improvements for the license management system, followed by continuing education, the license renewal system, a tiered licensure system, and improvement of foreign license approval (Fig. 2).
The third Delphi survey also showed that regulation by a licensing authority was considered the most important issue, and the rankings of the other issues did not differ significantly from those of the second survey (Table 3). Although the priority ranking did not change significantly, continuing education moved to a higher rank than a tiered licensure system (Table 4).
After 3 rounds of Delphi surveys, we found in all surveys that the participants identified regulation by a licensing authority as the most important area of concern, followed by the license renewal system, continuing education, and a tiered licensure system. The following conclusions were made based on the open-ended responses. First, many experts believed that the license regulation authority should be independent. Second, some experts voiced the opinion that clinical education of undergraduate students in dental school could be strengthened by implementing a tiered licensure system. Third, a majority of the experts agreed that the quality of continuing education required reform and acknowledged that such plans would require more investment. Fourth, concern was raised about the need for stringent restriction and mutual authentication of foreign licenses.
The results of the Delphi technique can change with the selection of the experts and the constituent ratio. Therefore, differences in responses among expert groups were analyzed to evaluate whether the research results could be standardized, irrespective of the expert group. The 21 experts who participated in this research were categorized into 3 groups: the clinical dentistry group, the basic dentistry group, and the policy group. In order to check whether there was a statistical difference in the priority ranking among the groups, the nonparametric Kruskal-Wallis test was conducted. The test showed that there was a statistically significant difference among the responses of the groups for the issue of regulation by a licensing authority (P<0.05). In order to verify these differences, the Mann-Whitney test was conducted. However, it yielded no significant results (P> .0167) (Tables 5 and 6). Furthermore, when the basic dentistry and clinical dentistry groups were combined into a single dentistry group, a significantly higher score was observed for the issue of regulation by a licensing authority than was observed in the policy group (Table 7). No significant differences were observed for the other issues (Table 5).
A license management system typically consists of granting, registration, and renewal of licenses; educational programs to ensure professionalism; and procedures through which public complaints regarding medical practices can be resolved [3]. In Korea, a dental license can currently be obtained by graduating from a dental university or a graduate school of dentistry that is approved by the Ministry of Health and Welfare and then passing a Korean dental licensing examination in the form of a paper-and-pencil test. Once the license is obtained, it can be re-issued every 3 years by completing a certain amount of supplementary education. However, there is no regulatory system other than the requirement to complete 8 hours of supplementary education annually. It is, therefore, impossible to verify a dentist’s qualifications for opening a local clinic or renewing a certification, or to take disciplinary action for the improper provision of dental treatment. It is unwise to have a system that relies solely on individual dentists, which may lead to an environment in which the quality of dental treatment is poorly managed. As the speed of technological advancement increases along with the movement of medical personnel overseas, the need to reform the outdated license management system grows.
In this study, we used the Delphi technique in order to gain a better understanding about reforms to the license management system. The results showed that experts from a variety of fields believed that establishing an independent license regulation authority is of the utmost importance. Experts within the field of dentistry appeared to believe this much more strongly than the policy experts. The reason for this difference in opinion is not clear; however, it is suspected that the experts who work in dental hospitals are more likely to experience unprofessional behavior by dentists, and, thus, they feel more strongly about the need for a regulation authority. In other countries, such as the United States, Australia, the United Kingdom, Germany, France, the Netherlands, Romania, Cyprus, Czech Republic, Denmark, Switzerland, Sweden, and Poland, licenses are managed independently and dentists can be warned, fined, or even have their licenses suspended if they exhibit improper behavior during the provision of dental treatment [4,5]. The establishment of an independent license regulation authority can ensure professionalism and protect that autonomy of dentists, provide citizens with quality dental services, and increase trust between dentists and patients. Despite reports on the need for a license regulation authority [3], current medical law does not allow a regulatory authority to operate. Thus, any such change to the current system must be accompanied by legislative reforms.
In addition to the establishment of a license regulation authority, other policies, such as a license renewal system, the strengthening of continuing education, and a tiered licensure system, were deemed necessary by the experts. A tiered licensure system is also a method in which the quality of dental services is managed, and in the United States, Germany, Japan, and China, there are tiered licensure systems for independent practice and running a hospital [4,6,7]. In Japan, a license for independent practice is granted after at least 1 year of clinical training at a hospital certified by the Ministry of Health, Labor, and Welfare, while in China, a license to run a hospital is granted by passing a dental skills evaluation or by proving at least 5 years of clinical experience in the same subject. Germany has a claim for health insurance that it uses in place of a license to run a hospital, which requires at least 1 year of experience as an assistant dentist. Of the countries considered in this research, only the United States requires a separate practical test to obtain a license for independent practice. However, it should be noted that the United States requires the practical test to be conducted by a state-level license management institution rather than a federal institution. Upon researching many different countries, we have found that while many countries have a separate hospital license system, there are no additional exams required by the government other than the national examination, and evidence of treatment experience is often required. Therefore, even if a hospital license system is implemented, it seems wiser to have a variety of evaluation methods, such as clinical education, testimonies of treated patients, and portfolios, rather than a simple examination to pass.
Notes
Authors’ contributions
Conceptualization: KNK, KKK. Methodology: DJC, JL. Formal analysis: JWC, JL. Investigation: JWC. Resources: DJC. Data curation: JL. Writing—original draft: JWC. Writing—review & editing: JL, KKK. Visualization: DJC, JL. Supervision: KNK, KKK. Project administration: KNK. Funding acquisition: KNK.
References
1. International Society of Dental Regulators. Consultation on International Society of Dental Regulators: dentist accreditation standards and dentist competencies [Internet]. Toronto (ON): International Society of Dental Regulators;2016. [cited 2017 Mar 30]. Available from: http://isdronline.org/Assets/DOCUMENTS/ISDR/ISDR_Consultations_Dentist_Accreditation_Standards_and_Dentist_Competencies.pdf.
2. Korean Institute of Dental Education and Evaluation. Dental education accreditation standards 2014 [Internet]. Seoul: Korean Institute of Dental Education and Evaluation;2014. [cited 2017 Mar 30]. Available from: http://kidee.org/Evaluation/kidee_20140423.pdf.
3. Huh S, Chung MH. Can a medical regulatory system be implemented in Korea? J Korean Med Assoc. 2013; 56:158–163. https://doi.org/10.5124/jkma.2013.56.3.158.
4. Council of European Dentists. EU manual of dental practice 2015 [Internet]. Brussels: Council of European Dentists;2015. [cited 2017 Mar 27]. Available from: http://www.cedentists.eu/library/eu-manual.html.
5. Kim KN, Kim KK, Lee JH, Choi DJ, Choi JW. Research on policies to train superior dentists: Korea Health Personnel Licensing Examination Institute policy research report. Seoul: Korea Health Personnel Licensing Examination Institute;Forthcoming 2016.
6. Kim NS, Jin BH, Jeong SY. Research report on reform plans for the license recognition system for foreign university graduates. Seoul: Korea Health Personnel Licensing Examination Institute;2014. Report No.: RE02-1412-00.
7. Shin JW, Kim KK, Lee JI, Kim KN, Yang SW. Quality assurance of dental care and appropriate supply of dentist in view of the increasing inflow of dental graduates from abroad. J Korean Dent Assoc. 2017; 55:7–20.
Table 1.
Table 2.
Table 3.
Table 4.
Table 5.
Table 6.
Basic dentistry group |
Clinical dentistry group |
|||
---|---|---|---|---|
Clinical dentistry group | Policy related group | Basic dentistry group | Policy related group | |
Exact significance (P) | 0.875 | 0.082 | 0.875 | 0.055 |
Table 7.
Regulation by licensing authoritya) | Continuing education | License renewal system | Leveled license system | Improvement of foreign license approval | Utilization of retirees | |
---|---|---|---|---|---|---|
P-value | 0.032 | 0.050 | 0.445 | 0.842 | 0.603 | 0.354 |
Appendices
Appendix 1.
First Delphi survey questionnaire
What do you consider to be problems and potential improvements for dental license policy and management? (Reference: Republic of Korea National Dentist Competency Model, International Society of Dental Regulators [ISDR] Dentist Competency Model)
<Reference> Core competency of dentists at a national level (Korean Institute of Dental Education and Evaluation, 2014)
1. Recognizing and abiding to social and ethical responsibilities as dental professionals
2. Self-development through recognizing the importance of active participation in life-long education
3. Ability to communicate effectively and cooperate with peers
4. Ability to acquire and apply dental knowledge and skills
5. Ability to diagnose patients by identifying their symptoms and medical histories to conduct proper tests
6. Ability to appropriately treat or prevent oral and facial diseases
7. Ability to handle emergencies in a dental hospital
<Reference> ISDR
Proposed ISDR dentist competencies
1. Professionalism
2. Diagnosis & treatment
3. Communication & collaboration
4. Oral health promotion
5. Practice management
Appendix 2.
Second Delphi survey questionnaire
1. The following opinions were voiced regarding issues and potential improvements in the current dental license system and management.
1) Regulation by a licensing authority: dentist quality management through a license maintenance and management institution, use of self-discipline to manage unethical behavior and licenses, and strengthening of the license quality control system after granting licenses.
2) Continuing education: requirement for the management of education score (includes online education) and an obligation to participate in clinical treatment in addition to 8 hours of supplementary education annually, including an ethics education oath process.
3) License renewal system: the license renewal system must be strengthened (license can be maintained very easily now), reissuing of licenses after a certain period of time, signing of a pledge when reissuing a license and notice of confiscation upon the breaking of the pledge, the need to separate dental staff with a medical history, and implementation of a license registration policy.
4) Tiered licensure system: a tiered licensure system that can ensure an appropriate treatment capability is required, the dentist qualification test and hospital license test should be differentiated, hospital license should be only granted after a period of on-site experience, and differentiation between certification and license (separation of general dentistry, integrated dentistry, and other specializations) is required.
5) Improvement of foreign license approval: it is necessary to reform license standards for foreigners who graduated from dental universities abroad, such as from the United States, Japan, and Western Europe, including potential methods such as mutual recognition or disallowance of obtaining domestic licenses.
6) Utilization of retirees: a plan to use retired medical personnel is required.
2. Please check your level of agreement for each choice, and prioritize the options from 1 to 5
3. Please state any additional areas of improvement and/or other opinions here
Appendix 3.
Third Delphi survey questionnaire
1. According to the results of the second Delphi survey, the level of agreement and priority ranking regarding problems of and potential improvements to the dentist license policy and management areas are as follows:
1, regulation by a licensing authority; 2, continuing education; 3, license renewal system; 4, tiered licensure system; 5, improvement of foreign license approval; 6, utilization of retirees.
1, regulation by a licensing authority; 2, continuing education; 3, license renewal system; 4, tiered licensure system; 5, improvement of foreign license approval.
2. Please check your level of agreement for each choice, and prioritize the options from 1 to 5
3. Please state any other suggestions that you may have in the box below