Journal List > J Korean Med Sci > v.35(30) > 1146086

Kim, Yoon, Kim, Jeong, Ahn, Park, Kwon, Kim, Park, Kim, Kiem, Choi, The Korean Society of Infectious Diseases, The Korean Society for Antimicrobial Therapy, and Health Insurance Review & Assessment Service: Development of Antibiotic Classification for Measuring Antibiotic Usage in Korean Hospitals Using a Modified Delphi Method

Abstract

In 2019, a project designed to develop a system for measuring and comparing antibiotic usage in hospitals was launched in Korea. As part of this project, we developed a means to classify antibiotic usage in Korean hospitals using a modified Delphi method. In results, the following categories of antibiotic classification were accepted for use in Korean hospitals: 1) broad-spectrum antibacterial agents predominantly used for hospital-onset infections in adults, 2) broad-spectrum antibacterial agents predominantly used for community-acquired infections in adults, 3) antibacterial agents predominantly used for resistant gram-positive infections in adults, 4) narrow-spectrum beta-lactam agents in adults, 5) antibacterial agents predominantly used for extensive antibiotic resistant gram-negative bacteria in adults, and 6) total antibacterial agents.

Graphical Abstract

jkms-35-e241-abf001.jpg

Antimicrobial resistance is one of the greatest threats to public health.1 It diminishes the effectiveness of antimicrobials to infectious diseases, leading to increased mortality, prolonged hospitalization, and increased medical costs.2 Unfortunately, Korea shows higher antimicrobial consumption rates among countries participating in the Organization for Economic Cooperation and Development countries.3 To promote the proper use of antibiotics, several antimicrobial stewardship programs have been implemented by the government over the last decade in Korea.4 Despite these government-led efforts, antibiotic consumption, especially for broad-spectrum antibiotics, have continued to increase.5
Considering the lack of progress in reducing antibiotic consumption, we suspect efforts to improve awareness of antibiotics and to promote voluntary participation in antimicrobial stewardship programs at the individual hospital level may prove more beneficial. Interestingly, providing antibiotic consumption numbers for comparison among individual hospital has been found to be an effective strategy through which to promote antimicrobial stewardship.6 Accordingly, the Centers for Disease Control and Prevention (CDC) operates the National Healthcare Safety Network (NHSN) and seeks to help individual hospitals analyze data on hospital-wide antibiotic use and to compare one's data to national benchmarks.7
In 2019, the Korean CDC initiated a project to develop a system for measuring and comparing antibiotic usage rates in hospitals in Korea. As a part of this project, the Korean Society of Infectious Diseases has begun to work in cooperation with the Korean Society for Antimicrobial Therapy and the Health Insurance Review & Assessment Service (HIRA) to develop a means with which to classify antibiotic usage in Korean hospitals using a modified Delphi method.
To do so, two series of modified Delphi studies were performed from July to August 2019. The first series sought to classify antibiotics used in Korean hospitals; the second was conducted to analyze antibiotic components according to antibiotic classes. Each Delphi study included two rounds of surveys in order to gather opinions and to refine the information related to each.
The questions for the survey in the first round were adopted from the antibiotic classification of the NHSN.8 We excluded antibiotics not available in Korea at the point of the survey. The appropriateness of each question was evaluated by a four-point Likert scale (1 = very inappropriate, 2 = inappropriate, 3 = appropriate, and 4 = very appropriate). In addition to closed-ended questions, the survey participants could freely express their opinions about the items. The questions for the survey in the second round were developed to reflect responses in the first round: some items were modified or added if > 30% of the respondents expressed the same opinion. The mean score for each question and opinions obtained from the first round were presented in the questionnaire as a reference. The evaluation of each question was performed using a four-point Likert scale, as in the first round.
We recruited a total of 12 panel experts, including infectious diseases physicians (10), a professor of preventive medicine (1), and a researcher at the HIRA Service (1). All of them had a Ph.D. as their highest level of education. The questionnaire was sent to these individuals via e-mail and reminders were sent if the survey had not been returned. Each survey was open for 1 week.
To analyze responses provided in the survey, content validity ratios (CVRs) were calculated. We used the formula CVR = (ne − N/2)/(N/2), where ne represents the number of panel experts rating an item as “appropriate” (score of 3 or 4) and N represents the entire number of panelists. The minimum CVR was determined by the number of experts participating in each round and set to 0.56 for the 12 participants.9
The response rates for each round in the first series were 58.3% (7/12) and 75.0% (9/12), respectively. Table 1 shows the results of the surveys. Most of the subjects in the NHSN's antibiotic classification for adults were accepted, except for “antibacterial agents posing the highest risk for Clostridioides difficile infection” (CVR = −1.000) and “agents predominantly used for surgical site infection prophylaxis” was excluded (CVR = 0.333). All subjects for children, however, were rejected. Finally, a total of six classifications were accepted: 1) broad-spectrum antibacterial agents predominantly used for hospital-onset infections in adults (CVR = 1.000), 2) broad-spectrum antibacterial agents predominantly used for community-acquired infections in adults (CVR = 1.000), 3) antibacterial agents predominantly used for resistant gram-positive infections in adults (CVR = 1.000), 4) narrow-spectrum beta-lactam agents in adults (CVR = 1.000), 5) antibacterial agents predominantly used for extensive antibiotic resistant gram-negative bacteria in adults (CVR = 1.000), and 6) total antibacterial agents (CVR = 1.000). Based on the results of the first series, the second series was conducted, with response rates for each round of 58.3% (7/12) and 66.7% (8/12). Table 2 shows the antibiotic components of each classification according to the survey.
This work comprises the first consensus study of an antibiotic classification system in Korea. Although the AWaRe classification of the World Health Organization has been widely adopted, too many antibiotics are included in each class, and the priority of antibiotics to be controlled is somewhat different from that in Korea: for instance, glycopeptide and carbapenem are considered as antibiotics with a higher risk for developing resistance than 4th generation cephalosporins.10 Therefore, we benchmarked the antibiotic classification of the NHSN and modified it in consideration of the importance and applicability to Korean hospitals.
As this was the first attempt to develop a nationwide antibiotic measuring system, antibiotic classifications that might be difficult to measure with the system were excluded. In fact, HIRA data, which are expected to be a resource of the system, do not provide information on the duration of antibiotic use, and therefore, antibiotic consumption could only be calculated with defined daily dose, not with days of therapy.11 For this reason, all items for children were excluded, despite the importance of antimicrobial stewardship programs in children.
Most panel experts agreed that the proper use of “antibacterial agents posing the highest risk for C. difficile infection” and “agents predominantly used for surgical site infection prophylaxis” should be improved; however, they were pessimistic about the applicability of such classification to the antibiotic measurement system. Many expressed that the classification “antibacterial agents posing the highest risk for C. difficile infection” might be unclear, because any antibiotic can predispose an individual to colonization by C. difficile and because there are no domestic data about high-risk antibiotics for C. difficile infection.12 Furthermore, they pointed out the fact that antibiotics used for surgical site infection prophylaxis are being frequently used to treat other infectious diseases and that accurate measurement of agents predominantly used for surgical site infection prophylaxis might not be feasible.
As with other Delphi processes, the study has some limitations. First, the composition of the expert panel was limited to some specialties. Even though infectious diseases specialists are key personnel in antimicrobial stewardship programs in Korean hospitals,13 the participation of other stakeholders should have been encouraged. Second, the surveys were administered online without face to face meetings, and this might have disturbed the communication among the panel. To minimize such limitations, we provided the mean scores for each question and the opinions expressed in the initial rounds of the survey in the following round. Third, antibiotics for children were excluded from classification due to limitations with the data sources.
Notwithstanding, our study not only lays the groundwork for developing an antibiotic measuring system in Korean hospitals, but also could help other researchers in performing studies on antibiotic consumption. To conclude, this study provides a means with which to classify antibiotic usage in Korean hospitals. This classification may guide the development of a system for measuring antibiotic usage in individual Korean hospitals. After additional research, further revisions might be necessary in the future.

Ethics Statement

The study protocol was approved by Institutional Review Board (IRB) of Yonsei University Health System Clinical Trial Center (IRB No. 4-2019-1297).

Notes

Funding: This work was supported by the Research Program funded by the Korea Centers for Disease Control and Prevention (2019-ER5408-00).

Disclosure: The authors have no potential conflicts of interest to disclose.

Author Contributions:

  • Conceptualization: Choi JY.

  • Data curation: Kim B.

  • Formal analysis: Kim B.

  • Investigation: Kim BY, Yoon YK, Kim DS, Jeong SJ, Ahn SV, Park SH, Kwon KT, Kim HB, Park YS, Kim SW, Kiem S, Choi JY.

  • Methodology: Kim BY, Yoon YK, Kim DS, Jeong SJ, Ahn SV, Park SH, Kwon KT, Kim HB, Park YS, Kim SW, Kiem S, Choi JY.

  • Resources: Kim BY, Yoon YK, Kim DS, Jeong SJ, Ahn SV, Park SH, Kwon KT, Kim HB, Park YS, Kim SW, Kiem S, Choi JY.

  • Supervision: Kim BY, Yoon YK, Kim DS, Jeong SJ, Ahn SV, Park SH, Kwon KT, Kim HB, Park YS, Kim SW, Kiem S, Choi JY.

  • Writing - original draft: Kim B.

  • Writing - review & editing: Kim B, Choi JY.

References

1. Spellberg B, Guidos R, Gilbert D, Bradley J, Boucher HW, Scheld WM, et al. The epidemic of antibiotic-resistant infections: a call to action for the medical community from the Infectious Diseases Society of America. Clin Infect Dis. 2008; 46(2):155–164. PMID: 18171244.
crossref
2. Kollef MH. Broad-spectrum antimicrobials and the treatment of serious bacterial infections: getting it right up front. Clin Infect Dis. 2008; 47(Suppl 1):S3–S13. PMID: 18713047.
crossref
3. Choe YJ, Shin JY. Trends in the use of antibiotics among Korean children. Korean J Pediatr. 2019; 62(4):113–118. PMID: 30852884.
crossref
4. Kim BN, Kim HB, Oh MD. Antibiotic control policies in South Korea, 2000–2013. Infect Chemother. 2016; 48(3):151–159. PMID: 27704729.
crossref
5. Park J, Han E, Lee SO, Kim DS. Antibiotic use in South Korea from 2007 to 2014: a health insurance database-generated time series analysis. PLoS One. 2017; 12(5):e0177435. PMID: 28520761.
crossref
6. Linder JA, Meeker D, Fox CR, Friedberg MW, Persell SD, Goldstein NJ, et al. Effects of behavioral interventions on inappropriate antibiotic prescribing in primary care 12 months after stopping interventions. JAMA. 2017; 318(14):1391–1392. PMID: 29049577.
crossref
7. van Santen KL, Edwards JR, Webb AK, Pollack LA, O'Leary E, Neuhauser MM, et al. The standardized antimicrobial administration ratio: a new metric for measuring and comparing antibiotic use. Clin Infect Dis. 2018; 67(2):179–185. PMID: 29409000.
crossref
8. Center for Disease Control and Prevention. Antimicrobial use and resistance (AUR) module. Updated 2020. Accessed April 21, 2020. https://www.cdc.gov/nhsn/PDFs/pscManual/11pscAURcurrent.pdf.
9. Lawshe CH. A quantitative approach to content validity. Pers Psychol. 1975; 28(4):563–575.
crossref
10. World Health Organization. Executive summary: the selection and use of essential medicines 2017. Updated 2017. Accessed April 29, 2020. https://www.who.int/medicines/publications/essentialmedicines/EML_2017_ExecutiveSummary.pdf.
11. Kim B, Myung R, Lee MJ, Kim J, Pai H. Trend of antibiotics usage for acute pyelonephritis in Korea based on national health insurance data 2010–2014. BMC Infect Dis. 2019; 19(1):554. PMID: 31238896.
crossref
12. Kelly CP, Pothoulakis C, LaMont JT. Clostridium difficile colitis. N Engl J Med. 1994; 330(4):257–262. PMID: 8043060.
crossref
13. Kim B, Lee MJ, Moon SM, Park SY, Song KH, Lee H, et al. Current status of antimicrobial stewardship programmes in Korean hospitals: results of a 2018 nationwide survey. J Hosp Infect. 2020; 104(2):172–180. PMID: 31513880.
crossref
Table 1

Antibiotic classification in Korean hospitals according to a modified Delphi method

jkms-35-e241-i001
Classifications CVR Mean ± SD
Broad-spectrum antibacterial agents predominantly used for hospital-onset infections in adultsa 1.000 3.78 ± 0.44
Broad-spectrum antibacterial agents predominantly used for community-acquired infections in adultsa 1.000 3.78 ± 0.44
Antibacterial agents predominantly used for resistant gram-positive infections in adultsa 1.000 3.89 ± 0.33
Narrow-spectrum beta-lactam agents in adultsa 1.000 3.89 ± 0.33
Antibacterial agents posing the highest risk for Clostridioides difficile infection in adults −1.000 1.78 ± 0.44
Antibacterial agents predominantly used for extensive antibiotic resistant gram-negative bacteria in adultsa 1.000 3.89 ± 0.33
Broad-spectrum antibacterial agents predominantly used for hospital-onset infections in children −0.111 2.67 ± 0.87
Broad-spectrum antibacterial agents predominantly used for community-acquired infections in children −0.111 2.67 ± 0.87
Antibacterial agents predominantly used for resistant gram-positive infections in children −0.556 2.22 ± 0.44
Narrow-spectrum beta-lactam agents for children −0.111 2.67 ± 0.87
Macrolides for children −0.556 2.00 ± 1.00
Antibacterial agents posing the highest risk for C. difficile infection in children −0.778 1.78 ± 0.67
Antifungal agents predominantly used for invasive candidiasis in children −0.111 2.56 ± 0.73
Antibacterial agents predominantly used for extensive antibiotic resistant bacteria in children −0.111 2.67 ± 0.87
Agents predominantly used for surgical site infection prophylaxis 0.333 3.11 ± 0.93
Total antibacterial agenta 1.000 4.00 ± 0.00
CVR = content validity ratio, SD = standard deviation.
aAccepted items.
Table 2

Consensual definition of antibiotic components according to the antibiotic classification in Korean hospitals

jkms-35-e241-i002
Antibiotics by classification CVR Mean ± SD
Broad-spectrum antibacterial agents predominantly used for hospital-onset infections in adults
Amikacin (IV) 0.750 3.25 ± 0.71
Tobramycin (IV) 0.750 3.00 ± 0.53
Cefepime 1.000 4.00 ± 0.00
Ceftazidime 1.000 4.00 ± 0.00
Imipenem 1.000 4.00 ± 0.00
Meropenem 1.000 4.00 ± 0.00
Doripenem 1.000 4.00 ± 0.00
Piperacillin/tazobactam 1.000 4.00 ± 0.00
Other 4th generation cephalosporins 1.000 3.75 ± 0.46
Broad-spectrum antibacterial agents predominantly used for community-acquired infections in adults
Cefdinir 1.000 3.75 ± 0.46
Cefixime 0.750 3.75 ± 0.46
Cefotaxime 1.000 4.00 ± 0.00
Cefpodoxime 1.000 3.75 ± 0.46
Ceftriaxone 1.000 4.00 ± 0.00
Ertapenem 1.000 3.88 ± 0.35
Gemifloxacin 1.000 3.75 ± 0.46
Levofloxacin 1.000 3.88 ± 0.35
Moxifloxacin 1.000 3.88 ± 0.35
Ciprofloxacin 1.000 3.88 ± 0.35
Other fluoroquinolones 0.750 3.63 ± 0.74
Other 3rd generation cephalosporins 0.750 3.13 ± 0.64
Antibacterial agents predominantly used for resistant gram-positive infections in adults
Linezolid 1.000 4.00 ± 0.00
Vancomycin (IV) 1.000 4.00 ± 0.00
Teicoplanin 1.000 4.00 ± 0.00
Narrow-spectrum beta-lactam agents in adults
Amoxicillin 1.000 4.00 ± 0.00
Amoxicillin/clavulanate 1.000 3.88 ± 0.35
Ampicillin 1.000 3.88 ± 0.35
Ampicillin/sulbactam 1.000 3.88 ± 0.35
Nafcillin 1.000 3.88 ± 0.35
Cefadroxil 1.000 3.75 ± 0.46
Cefazolin 1.000 3.88 ± 0.35
Cephalexin 1.000 3.75 ± 0.46
Cefotetan 1.000 3.62 ± 0.52
Cefoxitin 1.000 3.62 ± 0.52
Cefaclor 0.750 3.63 ± 0.74
Cefprozil 0.750 3.63 ± 0.74
Other 1st generation cephalosporins 0.750 3.50 ± 0.76
Other 2nd generation cephalosporins 0.500 3.38 ± 0.92
Antibacterial agents predominantly used for extensive antibiotic resistant gram-negative bacteria in adults
Colistin (IV) 1.000 4.00 ± 0.00
Tigecycline 1.000 3.88 ± 0.35
Ceftolozane/tazobactam 1.000 3.75 ± 0.46
CVR = content validity ratio, SD = standard deviation, IV = intravenous.
TOOLS
Similar articles