Journal List > J Korean Med Sci > v.30(11) > 1022770

Jo, Kim, Chang, Shin, and Oh: Development of Quality Management Systems for Clinical Practice Guidelines in Korea

Abstract

This study introduces the Clinical practice guidelines (CPGs) appraisal system by the Korean Academy of Medical Sciences (KAMS). Quality management policies for CPGs vary among different countries, which have their own cultures and health care systems. However, supporting developers in guideline development and appraisals using standardized tools are common practices. KAMS, an organization representing the various medical societies of Korea, has been striving to establish a quality management system for CPGs, and has established a CPGs quality management system that reflects the characteristics of the Korean healthcare environment and the needs of its users. KAMS created a foundation for the development of CPGs, set up an independent appraisal organization, enacted regulations related to the appraisals, and trained appraisers. These efforts could enhance the ability of each individual medical society to develop CPGs, to increase the quality of the CPGs, and to ultimately improve the quality of the information available to decision-makers.

Graphical Abstract

jkms-30-1553-abf001

INTRODUCTION

Clinical practice guidelines (CPGs) are used to improve the quality of care by providing scientific information that can inform decision-makers (1). In terms of several notable characteristics, quality management policies vary among different countries (2), which have their own cultures and health care systems; CPGs management methods also vary accordingly.
In Korea, over 100 CPGs have been developed in the past decade, with more than 70 CPGs currently in development (3). Futhermore, Korean-specific appraisal tools have also been introduced (4). However, the development of these CPGs is disparate, and development competency remains insufficient (56). Unfortunately, there have been no discussions on the governance of CPGs at the early stages; as a result, CPG quality management policies are minimal and differ according to the organizations developing the CPGs.
In the case of the Korean government, the majority of their focus has been on financial support, but this has not been based on a long-term, detailed plan. Furthermore, different departments within the government support different developers. Guidelines have been developed by only a few research groups or academics working individually (7), such that an interdisciplinary approach is lacking. Moreover, support is not provided after development, and appraisals or implementation strategies are not taken into consideration. As a result, low-quality CPGs and significant variations in their quality represent a serious problem (56).
To address this situation, the Korean Academy of Medical Sciences (KAMS), an organization representing medical science in Korea, has been striving to establish quality control systems and is working in collaboration with the government to create policies that ensure the quality of CPGs. CPG development is now a priority; the situation has reached a point in Korea whereby systematic CPG quality management policies can now be established.
To identify future directions in CPG quality management policies in Korea, this study describes the CPG quality management systems used in Western countries, and introduces the appraisal system of the KAMS, an organization that provides the main policies that provide CPG quality control in Korea.

CPGs QUALITY CONTRTOL SYSTEMS IN KOREA AND OTHER COUNTRIES

Countries that have actively introduced CPGs have established unique systems that enable the organization and step-by-step management of the development, distribution, evaluation of CPGs as well as the implementation phases for quality control (28). Furthermore, they manage the whole process in accordance with the cooperation of both public and private organizations; cooperation with the public and private sectors is achieved at a higher administrative level. For such collaborative development of CPGs to address national diseases, building consensuses for various forms of cooperation between countries have been achieved concerning the legal status of CPGs (Table 1).
Among quality control agencies, the relevant public organizations include the National Institute for Health and Care Excellence (NICE) in the UK, the National Health and Medical Research Council (NHMRC) in Australia, and the Agency for Healthcare Research and Quality (AHRQ) in the US. These bodies are responsible for policies on healthcare quality management, which include CPGs (910). The private sector for CPG quality control is represented by the following organizations: the Canadian Medical Association (CMA), the Association of the Scientific Medical Societies in Germany (AWMF), and the German Agency for Quality in Medicine (AZQ). In Canada, the CMA has led CPG quality management activities, including development strategies and the application and implementation of guidelines (11). The AWMF is responsible for the development of CPGs and for the provision of professional training, whereas the AZQ focuses on quality assurance activities such as effective implementation and CPG quality management programs (12). However, public and private cooperation is prevalent in the development of CPGs for high-burden chronic diseases and in quality control in Germany (13). In Korea, KAMS has carried out activities concerned with CPG quality control in Korea. To achieve this, KAMS has established a CPG committee that supports the development and dissemination of CPGs. In particular, KAMS has studied the scientific methodology underlying the development of CPGs, including Korean-specific appraisal tools, scoring guides, etc. Moreover, it has enhanced the capabilities of developers by educating them on the development of CPGs. With respect to the government, the level of cooperation has increased to include CPG topic selection rather than just merely initial financial support.
In the majority of countries, appraisals have commonly been done using standardized tools to improve the quality of the development process. However, CPG accreditation processes vary among countries. Both the US and Canada require checklists to develop CPGs, in addition to periodic updates after guideline registration (141516). Germany also considers each criterion separately during the development and registration of CPGs, and assigns a rating based on the degree of development. In contrast, the UK has a management process involving strict regulatory and certification procedures. To accredit CPGs, Accreditation Advisory Committee meetings are held, with CPGs certified in accordance with regular evaluation procedures. NICE introduces all CPGs that are registered on the National Health Service, but the Accreditation Advisory Committee introduces only those guidelines that have obtained final accreditation (17). Australia also has a CPG accreditation process, which involves eight recommendations with respect to the legal implications of guidelines pertaining to early breast cancer (18). In accordance with the CPG development process suggested by the NHMRC, these recommendations were then included at an institutional level (19).
When it comes to the dissemination of CPGs, almost all countries operate on-line databases for the distribution of CPGs. Clearing houses in the US and Canada verify the requirements for CPGs upon guideline registration, and play a key role in evaluating their quality. In Korea, the Korean Medical Guideline Information center (KOMGI) - a CPG portal - also plays an important role in dissemination and quality assessment (20).
However, strategies and activities concerning the implementation of CPGs are insufficient with respect to the active development and dissemination of CPGs. Countries have attempted to improve their level of CPG use, but establishing effective strategies is difficult because influential factors and health environments vary among countries (21). The proportion of CPGs implemented in Korea reportedly remains at 30%-50% (22).

KOREAN CPG QUALITY CONTROL: THE KAMS SYSTEM

Establishment of a quality management organization

In Korea, KAMS, the main quality management body, has been engaged in efforts to contribute to the development of evidence based medicine (EBM). Since 2006, KAMS has implemented new offices dedicated to CPGs, and has also operated both CPG and Executive committees. The CPG committee, composed of individuals drawn from 26 specialized academy societies, promotes dissemination activities (through networks that exist between societies) and development projects (by cooperating with societies). The Executive Committee facilitates these practices by developing CPG-related systems and methodologies and by promoting direct training pertaining to guideline quality management. These activities have led to the development of management quality policies and a quality appraisal system, which have in turn enabled higher-quality CPGs (Fig. 1).

Establishment of the quality appraisal system

CPG quality appraisal involves the assessment of development processes rather than guideline contents, so that the most-reliable information and recommendations are provided to guideline users (23). In Korea, the demands are higher for the appraisal and quality control of CPGs led by expert groups. Through several studies done on policies aimed at developing quality evaluation tools and on building a quality management system, KAMS developed a quality appraisal model reflecting the characteristics of the Korean health care system, and then collected opinions from other societies through two public hearings. As a result, in April 2013, regulations for CPG appraisal were established in accordance with the principles of independence, transparency, objectiveness and timeliness. Furthermore, procedures and methods related to quality appraisal were organized such that the Executive Committee and a research agency independently evaluate the CPGs (Table 2).

Manpower training for quality appraisal

To appraise CPGs, an Evaluative committee was established consisting of the Executive Committee members, clinical specialists recommended by the various societies, and external experts. Appraisers were able to provide professional-quality evaluations and CPG appraisal following completion of the KAMS education program. To date, 58 appraisers have been trained and participated in these quality appraisal activities.

Quality appraisal process

The quality appraisal of CPGs starts with requests from guideline developers to KAMS. Following registration of a formal request of a developer, the Executive Committee appoints four KAMS appraisers with professional interests relevant to the guideline in question. These appraisers are forwarded the appraisal request and information on the guideline, and evaluate the CPG using the Korean AGREE II Scoring Guide document, which improves the reliability of the AGREE II tool (424). Appraisers evaluate the CPG for 2 weeks, and submit the results of their appraisal, including their opinions on whether the guideline should be used, to the Executive Committee. The Executive Committee then determines whether KAMS recommends use of the CPG, based on the results of the appraisals, and informs the developers of their final decision. If there is no objection from the guideline developers, the decision of the Committee is finalized, and remains in effect for 5 yr. If there is an objection from the developer, the Executive Committee appoints four new appraisers, who re-appraise the CPG, in terms of whether it should be used, before making a final decision. The whole process from the request of a developer to the appraisal by the appointed appraisers and final notification of the appraisal results is conducted using the on-line portal KoMGI (Fig. 2).

CONCLUSION

The goals of CPG quality management are to improve the quality of the development process, to provide fair and reliable evaluation recommendations, and to ensure evidence-based decision-making during patient care and management.
US and Europe share common features in their quality management policies on CPGs with which to appraise the development process by using standardized tools and disseminating qualified CPGs through clearinghouses. Besides, to ensure professionalism and objectivity, and to manage quality on a continuous basis, appraisal by an independent organization of experts is guaranteed (25).
Following the introduction of EBM, the requirement for specialized agencies to support the development of CPGs, and to evaluate developed guidelines, has increased in Korea. KAMS, as a professional body representing the medical community, carries influence regarding the development and management of CPGs; it has established foundations for the assessment of CPGs, including the development of Korean-specific quality appraisal tools. KAMS has also set up an independent appraisal organization (the Executive Committee), established regulations related to appraisals, and improved the evaluation system for CPG quality (which is appropriate to the Korean health care environment). The Executive Committee appraises CPGs and gives accreditation only to those with high quality, which motivates the various societies to manage quality continuously. KAMS has trained staff to conduct appraisals in accordance with the participation of medical academies, to which it assigns appraisals, thereby enhancing the ability of each society to develop CPGs and increasing the quality of CPGs.
KAMS has established a CPG quality management system that reflects the characteristics of the Korean healthcare environment and the needs of its users. In particular, CPG quality appraisals assess their independence and the scientific methodologies used during the development process, and provide users with the most reliable guidelines and recommendations. This could improve the quality of information available to decision-makers and thus ultimately enhance EBM in practice.

Figures and Tables

Fig. 1

Quality management organizations of CPGs by KAMS.

jkms-30-1553-g001
Fig. 2

CPGs appraisal processs by KAMS.

jkms-30-1553-g002
Table 1

Main body and activities of CPGs quality control in Korea and other countries

jkms-30-1553-i001
Process Korea UK (England) USA Australia Canada Germany
Quality control Main body · KAMS · NICE · AHRQ · NHMRC · CMA · AZQ/AWMF
Development Main body · Professionals · Professionals · Professionals · Professionals · Professionals · Professionals
· Central · Central · Central · Central
· Regional · Regional · Regional
Activities · Research & development · Topic selection · Research & development · Research & development · Research & development · Research & development
· Scientific advice · National topic selection
· Research & development
Accreditation or Appraisal Main body · KAMS · NICE (Accreditation advisory committee) · AHRQ · NHMRC's council · CMA · AZQ
Activities · Appraisal · Appraisal & accreditation · NGC Standard · NHMRC Standard · CMA standards · Appraisal
· External opinion & public consultation · Appraisal · Appraisal · Appraisal · Public participation
· Public consultation · Public consultation · Public consultation
Dissemination & Implementation Main Body · KAMS · NICE · AHRQ · NHMRC · CMA · AMWF
Activities · Clearinghouse (KOMGI) · Clearinghouse (NICE) · Clearinghouse (NGC) · Clearinghouse (NHMRC) · Clearinghouse (CMA infobase) · Clearinghouse (AMWF)
· Education

KAMS, Korean Academy of Medical Sciences; NICE, National Institute for Health and Care Excellence; AHRQ, Agency for Healthcare Research and Quality; NHMRC, National Health and Medical Research Council; CMA, Canadian Medical Association; AZQ, German Agency for Quality in Medicine; AWMF, Association of the Scientific Medical Societies in Germany; KoMGI, Korean Medical Guideline Information center; NGC, National Guideline Clearinghouse.

Table 2

Establishment activities for quality amanagement system of CPGs by KAMS

jkms-30-1553-i002
Date Goals Activities
2011.12 Establishment of quality appraisal system Research for quality appraisal model in Korea
2012.6 Development of Korean specific appraisal tools
2012.6-11 Collect opinions from interest Information session for presidents of 26 representative societies
2013.4 Institutionalization Announce the plan for the development of quality appraisal system
Enact policies for appraisal
2013.5-8 Operate quality appraisal Manpower training for quality appraisal
2013.9- Quality appraisal

Notes

Funding This study was supported by a 2013 project grant for health promotion policy development from the Korea Health Promotion Foundation, and Korea Centers for Disease Control and Prevention (2013-84), a research grant from the National Evidence-based Healthcare Collaborating Agency (NC13-006).

DISCLOSURE The authors have no conflicts of interest regarding the material presented here.

AUTHOR CONTRIBUTION Design of the study: Jo HS, Oh MK. Data collection and analysis: Shin ES. Writing manuscript: Jo HS, Oh MK. Revision: Kim DI, Chang SG. Approval of final version of this manuscript: all authors.

References

1. Darling G. The impact of clinical practice guidelines and clinical trials on treatment decisions. Surg Oncol. 2002; 11:255–262.
2. Legido-Quigley H, Panteli D, Brusamento S, Knai C, Saliba V, Turk E, Solé M, Augustin U, Car J, McKee M, et al. Clinical guidelines in the European Union: mapping the regulatory basis, development, quality control, implementation and evaluation across member states. Health Policy. 2012; 107:146–156.
3. Jo HS. Current status of development of clinical practice guidelies in Korea and application for evidence based nursing. Korean Soc Evid Based Nurs. 2014; 2:1–4.
4. Lee YK, Shin ES, Shim JY, Min KJ, Kim JM, Lee SH. Executive Committee for CPGs. Korean Academy of Medical Sciences. Developing a scoring guide for the Appraisal of Guidelines for Research and Evaluation II instrument in Korea: a modified Delphi consensus process. J Korean Med Sci. 2013; 28:190–194.
5. Jo MW, Lee JY, Kim NS, Kim SY, Sheen S, Kim SH, Lee SI. Assessment of the quality of clinical practice guidelines in Korea using the AGREE Instrument. J Korean Med Sci. 2013; 28:357–365.
6. Ahn HS, Kim HJ. Development and implementation of clinical practice guidelines: current status in Korea. J Korean Med Sci. 2012; 27:S55–S60.
7. OECD Health Division. OECD Heath Care Quality Review. Korea, Assessment and Recommendation. Paris: OECD;2012. p. 13–14.
8. AGREE in Europe Collaborative Group. Guideline development in Europe. An international comparison. Int J Technol Assess Health Care. 2000; 16:1039–1049.
9. Kelley E, Moy E, Kosiak B, McNeill D, Zhan C, Stryer D, Clancy C. Prevention health care quality in America: findings from the first National Healthcare Quality and Disparities reports. Prev Chronic Dis. 2004; 1:A03.
10. Kim NS, Kim SY, Park EJ. Promoting the quality of medicine: based on clinical practice guidelines. Seoul, Korea: Korea Institue for Health and Social Affairs;2004.
11. Graham ID, Beardall S, Carter AO, Glennie J, Hébert PC, Tetroe JM, McAlister FA, Visentin S, Anderson GM. What is the quality of drug therapy clinical practice guidelines in Canada? CMAJ. 2001; 165:157–163.
12. Nothacker M, Muche-Borowski C, Kopp IB. Reflections on 20 years of clinical practice guideline programmes in Germany: what is their impact? Z Evid Fortbild Qual Gesundhwes. 2014; 108:550–559.
13. Ollenschläger G, Kopp I, Lelgemann M, Sänger S, Heymans L, Thole H, Trapp H, Lorenz W, Selbmann HK, Encke A. The German program for disease management guidelines. Background, methods, and development process. Med Klin (Munich). 2006; 101:840–845.
14. Canadian Medical Association. Criteria for inclusion of a CPG in the CMA Infobase. accessed on 12 May 2015. Available at https://www.cma.ca/En/Pages/submit-guideline.aspx.
15. National Guideline Clearinghouse. National Guideline Clearinghouse Inclusion Criteria 2014. accessed on 12 May 2015. Available at http://www.guideline.gov/about/inclusion-criteria.aspx.
16. Canadian Medical Association. Handbook on clinical practice guidelines. Ottawa, Canada: Canadian Medical Association;2007.
17. National Institute for Health and Care Excellence. NICE Guidance 2015. accessed on 12 May 2015. Available at https://www.nice.org.uk/guidance/published.
18. National Health Research and Medical Council. Procedures and requirements for meeting the 2011 NHMRC standard for clinical practice guidelines. Canberra, Australia: National Health and Medical Research;2011.
19. Pelly JE, Newby L, Tito F, Redman S, Adrian AM. Clinical practice guidelines before the law: sword or shield? Med J Aust. 1998; 169:330–333.
20. Korea Association of Medical Science. Korea Medical Guideline Information center. Seoul, Korea: accessed on 12 May 2015. Available at http://www.guideline.or.kr/contents/index.php?code=044.
21. Kim YK, Lee SH, Seo JH, Kim JH, Kim SD, Kim GK. A comprehensive model of factors affecting adoption of clinical practice guidelines in Korea. J Korean Med Sci. 2010; 25:1568–1573.
22. Yang J, Han C, Yoon HK, Pae CU, Kim MJ, Park SY, Ahn J. Experiences and barriers to implementation of clinical practice guideline for depression in Korea. BMC Psychiatry. 2013; 13:150.
23. Brouwers MC, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder G, Fervers B, Graham ID, Grimshaw J, Hanna SE, et al. AGREE II: advancing guideline development, reporting and evaluation in health care. CMAJ. 2010; 182:E839–E842.
24. Oh MK, Jo H, Lee YK. Improving the reliability of clinical practice guideline appraisals: effects of the Korean AGREE II scoring guide. J Korean Med Sci. 2014; 29:771–775.
25. Bussières A, Stuber K. The Clinical Practice Guideline Initiative: A joint collaboration designed to improve the quality of care delivered by doctors of chiropractic. J Can Chiropr Assoc. 2013; 57:279–284.
TOOLS
ORCID iDs

Heui-Sug Jo
https://orcid.org/http://orcid.org/0000-0003-0245-3583

Dong Ik Kim
https://orcid.org/http://orcid.org/0000-0001-7527-3829

Sung-Goo Chang
https://orcid.org/http://orcid.org/0000-0003-0733-7266

Ein-Soon Shin
https://orcid.org/http://orcid.org/0000-0002-5086-6086

Moo-Kyung Oh
https://orcid.org/http://orcid.org/0000-0002-2011-5708

Similar articles