Journal List > J Korean Med Sci > v.34(Suppl 1) > 1120112

Kim, Song, Kim, Choe, Park, Bang, Kim, Park, Kim, Oh, and Kim: Clinical Prediction Score for Community-Onset Bloodstream Infections Caused by Extended-Spectrum Beta-Lactamase-Producing Escherichia coli and Klebsiella Species

Abstract

Background

This study aimed to identify the predictors and build a prediction score for community-onset bloodstream infections (CO-BSIs) caused by extended-spectrum beta-lactamase (ESBL)-producing Escherichia coli and Klebsiella species.

Methods

All CO-BSIs caused by E. coli and Klebsiella species from 2012 to 2015 were grouped into derivation (BSIs from 2012 to 2014) and validation (BSIs in 2015) cohorts. A prediction score was built using the coefficients of the multivariate logistic regression model from the derivation cohort.

Results

The study included 886 CO-BSIs (594 and 292 in the derivation and validation cohorts, respectively). The independent predictors of CO-BSIs caused by ESBL-producing E. coli and Klebsiella species included: 1) identification of ESBL-producing microorganisms from any clinical culture within one year of admission, 2) beta-lactam or fluoroquinolone treatment within 30 days (with 2 or more courses within 90 days; with 1 course within 90 days), 3) hospitalization within one year, 4) the presence of an indwelling urinary catheter at the time of admission. The area under the curve (AUC) of the clinical prediction score was 0.72 (95% confidence interval [CI], 0.68–0.77). In the validation cohort, the AUC was 0.70 (95% CI, 0.63–0.77).

Conclusions

The results of this study suggest a simple and easy-to-use scoring system to predict CO-BSIs caused by ESBL-producing E. coli and Klebsiella species.

Graphical Abstract

jkms-34-e116-abf001

INTRODUCTION

In selecting antimicrobials, not only the effectiveness but also the possible detrimental effects accompanying antimicrobial treatment should be considered. Timely administration of effective antimicrobials is crucial to clinical outcomes, especially in bloodstream infections (BSIs).12 However, the widespread use of broad-spectrum antimicrobials can lead to unintended consequences such as the emergence of resistance, superinfection by selected pathogenic organisms, and increased hospital costs.34
The spread of resistance and increase in healthcare-associated infections have led to challenges in establishing a treatment strategy for community-onset infections. In the case of gram-negative bacteria, the incidence of infections due to extended-spectrum beta-lactamase (ESBL)-producing Enterobacteriaceae has been increasing in the community,5678 which has made antimicrobial selection more difficult. Specifically, whether to use carbapenems is becoming a major issue.
The widespread use of carbapenems for treatment of community-onset infections should be avoided. There have been concerns about the emergence of carbapenem-resistant Enterobacteriaceae (CRE).910 Furthermore, we do not currently have a highly reliable treatment option for CRE infections.11 The broadness of the antimicrobial spectrum itself could also be a problem. Therefore, guidance is needed to help to determine the necessity of carbapenem use by predicting the presence of infection with ESBL-producing microorganisms.
We aimed to identify the predictors and build a prediction score for community-onset bloodstream infections (CO-BSIs) caused by Escherichia coli and Klebsiella species, which are potential ESBL-producing microorganisms and major pathogens in community-onset gram-negative bacterial infections. The validation process was also performed by applying the score to an independent group of subjects.

METHODS

Study setting

This study was conducted at a university-affiliated referral hospital in a metropolitan area. The number of hospital beds was 900 before April 2013, when it increased to 1,350 beds with the opening of a new building. In this institution, positive blood cultures results are reported to attending physicians and referred to infectious disease specialists through an automated process based on the hospital information system. This automated consultation started in August 2011 and the details of this process are described elsewhere.12

Study subjects

All cases of BSIs identified from January 2012 to December 2015 were reviewed. The BSI was included in the study if 1) the infection was community-onset, 2) the patient was aged ≥ 18 years, and 3) the confirmed pathogen was E. coli or Klebsiella species. If the presence of BSI was established (a blood culture of the BSI was ordered by a physician) within 48 hours of admission, it was considered a CO-BSI. If the BSI occurred in a patient transferred from another hospital, it was not considered a CO-BSI.
The BSI was excluded if it was 1) a polymicrobial or 2) a recurrent BSI occurring in the same patient during the study period. A polymicrobial BSI was defined as the isolation of two or more pathogenic species from the same blood culture set.
Species identification, antimicrobial susceptibility, and ESBL phenotype were tested and evaluated throughout the study period with a VITEK 2 system (bioMérieux, Lyon, France).

Data collection and definitions of variables

To select the candidate predictors of CO-BSIs caused by ESBL-producing E. coli and Klebsiella species (ESBL-BSIs), we referred to previous studies reporting risk factors associated with multi-drug resistance including ESBL.13141516 Prior hospitalization, residency in long-term care facilities, and operation were categorised according to the time sequence. For example, prior hospitalization was divided into three groups: within 90 days, 91 to 180 days, and 181 days to one year of admission. The antimicrobial prescription records within 90 days prior to admission were reviewed. A prescription of beta-lactam or fluoroquinolone for two or more consecutive days was included in the data as a prior course of beta-lactam or fluoroquinolone treatment. The timing and frequency of treatment were also investigated. If the prescription was for the same episode of infection, it was considered a part of a single course rather than an independent course of treatment.
The Charlson comorbidity index (CCI)1718 was calculated as a representative variable of the underlying conditions. The clinical characteristics and outcomes of the BSIs, such as the site of infection, presence of severe sepsis or septic shock, Pitt bacteremia score,19 administration of effective antimicrobials (active in vitro according to susceptibility test findings) within 48 hours from the time of blood cultures, length of stay, and all-cause 30-day mortality were also investigated.

Data management and analysis

Derivation and validation cohorts

The study subjects were divided into derivation and validation cohorts. The derivation cohort contained BSIs identified from 2012 to 2014; the validation cohort contained BSIs from 2015. The derivation cohort was used to identify the predictors and develop a prediction score for ESBL-BSIs, while the validation cohort was used to verify the performance of the prediction score.

Comparing case and control groups

The BSIs of the derivation cohort were classified according to whether the confirmed pathogen was ESBL producing microorganisms (case, ESBL-BSIs) or not (control, non-ESBL-BSIs). To compare the clinical characteristics of the two groups, chi-square or Fisher's exact tests were used for categorical variables. Continuous variables were presented as median values with interquartile range (IQR) and their differences were evaluated using Mann-Whitney median tests.

Identifying the predictors of ESBL-BSIs

To identify the predictors of ESBL-BSIs, a logistic regression analysis was performed. Variables with P < 0.10 in the univariate analysis were used to construct a multivariate regression model. For possible overlapping variables, such as an individual underlying disease and CCI, we constructed separate models. After stepwise backward elimination, variables with P < 0.05 were included in the final model.

Building a prediction score for ESBL-BSIs

The prediction score for ESBL-BSIs was built based on the final multivariate regression model and its regression coefficients.202122 The point for each variable was assigned according to the ratio between the coefficients. The overall risk was expressed as a sum of the points. The discriminative power of the score was evaluated by area under the receiver operating characteristics (ROC) curve (AUC) analysis. The calibration was assessed with the Hosmer-Lemeshow goodness-of-fit test.

Validation

The prediction score was validated by applying the score to the validation cohort. ROC curve analysis was performed, and the AUC was calculated.

Identifying the risk factors for mortality

A log-rank test was performed to compare mortality between ESBL-BSIs and non-ESBL-BSIs. Cox proportional hazards regression was performed to identify the risk factors for mortality. Both derivation and validation cohorts were included in this analysis. To reflect the influence of site of infection, respiratory tract and intraabdominal infection were classified as a high-risk source of infection.2324 Like in the logistic regression, variables with P < 0.10 in the univariate analysis were included in the multivariate model, and separate models were constructed for the possible overlapping variables in order to avoid multicollinearity.

Statistical analysis

All statistical analyses were performed using the Stata version 14 (Stata Corp LP, College Station, TX, USA). All tests were two-tailed and with an alpha level of 0.05.

Ethics statement

This study was approved by the Institutional Review Board (IRB) of Seoul National University Bundang Hospital (IRB No. B-1503/292-102). The study was conducted after obtaining a waiver of informed consent from individual patients. The data were de-identified before analyses.

RESULTS

Microbiology, demographics, and clinical characteristics

According to the enrolment criteria, we included 886 CO-BSIs caused by E. coli and Klebsiella species from 2012 to 2015. Of these, 594 BSIs were included in the derivation cohort (E. coli: n = 419, 70.5%; Klebsiella species: n = 175, 29.5%).
In the derivation cohort, 23.6% were ESBL-BSIs; of all cases, 27.2% of E. coli and 14.9% of Klebsiella species were ESBL-BSIs. The ciprofloxacin resistance rate was 30.8% (38.7% in E. coli, 21.0% in Klebsiella species). The rate was higher in ESBL-BSIs than that in non-ESBL-BSIs (76.4% vs. 16.7%, P < 0.001). There were no BSIs caused by carbapenem-resistant Enterobacteriaceae. The baseline patient demographics and clinical characteristics between ESBL-BSIs and non-ESBL-BSIs are compared in Table 1.
Table 1

Comparison of baseline demographics and clinical characteristics between CO-BSIs caused by ESBL-producing E. and Klebsiella species (ESBL-BSIs) and non-ESBL-BSIs

jkms-34-e116-i001
Variables ESBL-BSI (n = 140) Non-ESBL-BSI (n = 454) P value
Age, yr 70 (59–79) 72 (63–79) 0.198
Age ≥ 70 yr 74 (52.9) 260 (57.3) 0.358
Gender, men 69 (49.3) 223 (49.1) 0.991
Underlying condition
Solid cancer 67 (47.9) 148 (32.6) 0.001
Metastatic cancer 19 (13.6) 29 (6.4) 0.006
Diabetes 33 (23.6) 123 (27.1) 0.408
Cerebrovascular disease 27 (19.3) 65 (14.3) 0.155
Chronic kidney disease 12 (8.6) 50 (11.0) 0.409
Chronic lung disease 12 (8.6) 28 (6.2) 0.321
Advanced liver disease 6 (4.3) 11 (2.4) 0.248
CCI ≥ 3 59 (42.1) 155 (34.1) 0.085
Healthcare-associated condition
Hospitalization < 0.001
≤ 90 day 65 (46.4) 106 (23.4)
> 90 day, ≤ 180 day 16 (11.4) 23 (5.1)
> 180 day, ≤ 1 yr 14 (10.0) 25 (5.5)
Never or not within 1 yr 45 (32.1) 300 (66.1)
Residency in long-term care facility ≤ 1 yr 7 (5.0) 15 (3.3) 0.353
Vascular catheter 9 (6.4) 6 (1.3) 0.001
Urinary catheter 14 (10.0) 21 (4.6) 0.018
IV therapy ≤ 30 day 50 (35.7) 71 (15.6) < 0.001
Regular dialysis 6 (4.3) 7 (1.5) 0.052
Operation 0.455
≤ 90 day 8 (5.7) 25 (5.5)
> 90 day, ≤ 1 yr 11 (7.9) 23 (5.1)
Never or not within 1 yr 121 (86.4) 406 (89.4)
ESBL identification ≤ 1 yra 30 (21.4) 9 (2.0) < 0.001
Beta-lactam or fluoroquinolone treatment
Timing of treatment < 0.001
≤ 30 day 35 (25.0) 17 (3.7)
> 30 day, ≤ 90 day 12 (8.6) 22 (4.9)
Never or not within 90 day 93 (66.4) 415 (91.4)
Number of courses ≤ 90 day < 0.001
1 20 (14.3) 27 (6.0)
≥ 2 27 (19.3) 12 (2.6)
Site of infection 0.099
Urinary tract 60 (42.9) 153 (33.7) 0.048
Hepatobiliary 34 (24.3) 152 (33.5) 0.040
Intraabdominal 41 (29.3) 121 (26.7) 0.541
Respiratory 3 (2.1) 12 (2.6) 0.513
SSTI+BJI 0 (0.0) 11 (2.4) 0.075
Others 2 (1.4) 5 (1.1) 0.670
Severe sepsis or septic shock 26 (18.6) 56 (12.2) 0.061
Pitt bacteremia score ≥ 3 40 (28.6) 107 (23.6) 0.230
ICU admission 18 (12.9) 60 (13.2) 0.913
Effective antimicrobials within 48 hr 67 (47.9) 430 (94.7) < 0.001
Length of stay, day 14.5 (10–23) 11 (8–17) < 0.001
30-day mortality 14 (10.0) 26 (5.7) 0.078
Values are presented as number of patients (%) or median (interquartile range).
CO-BSI = community-onset bloodstream infection, ESBL = extended-spectrum beta-lactamase, BSI = bloodstream infection, CCI = Charlson comorbidity index, IV = intravenous, SSTI = skin and soft tissue infection, BJI = bone and joint infection, ICU = intensive care unit.
aIdentification of ESBL-producing microorganisms from any clinical culture within 1 year.

Predictors of ESBL-BSIs and logistic regression analysis

The independent predictors of ESBL-BSIs in multivariate analysis were as follows (Table 2): identification of ESBL-producing microorganisms from any clinical culture within one year of admission (adjusted odds ratio [aOR], 7.75; 95% confidence interval [CI], 3.15–10.07; P < 0.001), beta-lactam or fluoroquinolone treatment within 30 days with 2 or more courses within 90 days (aOR, 6.82; 95% CI, 2.31–20.16; P < 0.001); with 1 course within 90 days (aOR, 2.89; 95% CI, 1.06–6.32; P = 0.037), hospitalization within one year (aOR, 2.48; 95% CI, 1.55–3.96; P < 0.001), and the presence of an indwelling urinary catheter at the time of admission (aOR, 2.34; 95% CI, 1.04–5.24; P = 0.039). To make a more parsimonious model, hospitalization within one year was included in the final model instead of the divided time periods. Supplementary Table 1 shows results of the regression analysis with the time periods.
Table 2

Results of univariate and multivariate logistic regression analyses for the predictors of CO-BSIs caused by ESBL-producing E. coli and Klebsiella species

jkms-34-e116-i002
Variables Odds ratio 95% confidence interval P value
Univariate
Age ≥ 70 yr 0.84 0.57–1.22 0.358
Gender, men 1.00 0.68–1.46 0.991
Solid cancer 1.90 1.29–2.79 0.001
Metastatic cancer 2.30 1.25–4.25 0.008
Diabetes 0.83 0.53–1.29 0.408
Cerebrovascular disease 1.43 0.87–2.35 0.157
Chronic kidney disease 0.76 0.39–1.47 0.410
Chronic lung disease 1.43 0.71–2.89 0.323
Advanced liver disease 1.80 0.65–4.97 0.254
CCI ≥ 3 1.41 0.95–2.07 0.085
Hospitalization
≤ 90 day 4.09 2.63–6.35 < 0.001
> 90 day, ≤ 180 day 4.64 2.28–9.44 < 0.001
> 180 day, ≤ 1 yr 3.73 1.81–7.71 < 0.001
Residency in long-term care facility ≤ 1 yr 1.54 0.62–3.86 0.356
Vascular catheter 5.13 1.79–14.68 0.002
Urinary catheter 2.29 1.13–4.64 0.021
IV therapy ≤ 30 day 3.00 1.95–4.60 < 0.001
Regular dialysis 2.86 0.94–8.65 0.063
Operation
≤ 90 day 1.07 0.47–2.44 0.865
> 90 day, ≤ 1 yr 1.60 0.76–3.39 0.214
ESBL identification ≤ 1 yra 13.48 6.22–29.29 < 0.001
Beta-lactam or fluoroquinolone treatment
≤ 30 day (with 1 course ≤ 90 day) 4.46 1.94–10.25 < 0.001
≤ 30 day (with ≥ 2 courses ≤ 90 day) 20.53 7.61–55.40 < 0.001
> 30 day, ≤ 90 day (with 1 course ≤ 90 day) 2.38 0.98–5.78 0.055
> 30 day, ≤ 90 day (with ≥ 2 courses ≤ 90 day) 2.55 0.73–8.89 0.142
Multivariate
ESBL identification ≤ 1 yr 7.75 3.15–19.07 < 0.001
Beta-lactam or fluoroquinolone treatment ≤ 30 day
With 2 or more courses ≤ 90 day 6.82 2.31–20.16 < 0.001
With 1 course ≤ 90 day 2.59 1.06–6.32 0.037
Hospitalization ≤ 1 yr 2.48 1.55–3.96 < 0.001
Urinary catheter 2.34 1.04–5.24 0.039
CO-BSI = community-onset bloodstream infection, ESBL= extended-spectrum beta-lactamase, BSI = bloodstream infection, CCI = Charlson comorbidity index, IV = intravenous.
aIdentification of ESBL-producing microorganisms from any clinical culture within 1 year.

Building a prediction score for ESBL-BSIs

The prediction score was built using the regression coefficients of the final multivariate regression model (Table 3). Each regression coefficient was divided by the lowest coefficient in the final model, which was the coefficient of the presence of an indwelling urinary catheter. Two points were assigned for ESBL identification within one year and beta-lactam or fluoroquinolone treatment within 30 days with 2 or more courses within 90 days. One point was assigned for beta-lactam or fluoroquinolone treatment within 30 days with 1 course within 90 days, hospitalization within one year, and the presence of an indwelling urinary catheter, respectively. A total of 190 BSIs had a score of 1 (190/594, 32.0%), 32 (5.4%) had a score of 2, 34 (5.7%) had a score of 3, 17 (2.9%) had a score of 4 or more.
Table 3

Regression coefficients from multivariate logistic regression and clinical prediction score for CO-BSIs caused by ESBL-producing E. coli and Klebsiella species

jkms-34-e116-i003
Variables Coefficient 95% confidence interval Assigned score
ESBL identification ≤ 1 yra 2.047 1.147–2.948 2
Beta-lactam or Fluoroquinolone treatment ≤ 30 day
With 2 or more courses ≤ 90 day 1.920 0.836–3.004 2
With 1 course ≤ 90 day 0.952 0.059–1.844 1
Hospitalization ≤ 1 yr 0.908 0.441–1.376 1
Urinary catheter 0.849 0.042–1.657 1
CO-BSI = community-onset bloodstream infection, ESBL = extended-spectrum beta-lactamase.
aIdentification of ESBL-producing microorganisms from any clinical culture within 1 year.
The AUC of the score was 0.72 (95% CI, 0.68–0.77) (Fig. 1). The P value for the Hosmer-Lemeshow test was 0.60. The sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) for each cutoff are shown in Table 4; The PPV was 66.3% at a cutoff of 2, 76.5% at 3, and 100% at 4 or more; The NPV was 83.4% at a cutoff of 2, 81.4% at 3, and 78.7% at 4.
Fig. 1

ROC curve of the clinical prediction score for community-onset bloodstream infections caused by extended-spectrum beta-lactamase-producing E. coli and Klebsiella species.

ROC = receiver operating characteristics.
jkms-34-e116-g001
Table 4

Receiver operating characteristics cutoff values of the clinical prediction score for CO-BSIs caused by ESBL-producing E. coli and Klebsiella species

jkms-34-e116-i004
Cutoff Sensitivity % (95% CI) Specificity % (95% CI) PPV % (95% CI) NPV % (95% CI)
1 71.4 (63.2–78.7) 61.9 (57.3–66.4) 36.6 (30.9–42.6) 87.5 (83.4–90.9)
2 39.3 (31.1–47.9) 93.8 (91.2–95.9) 66.3 (55.1–76.3) 83.4 (79.8–86.5)
3 27.9 (20.6–36.1) 97.4 (95.4–98.6) 76.5 (62.5–87.2) 81.4 (77.9–84.6)
4 12.1 (7.2–18.7) 100 (99.2–100) 100 (80.5–100) 78.7 (75.1–82.0)
5 9.3 (5.0–15.4) 100 (99.2–100) 100 (75.3–100) 78.1 (74.6–81.4)
CO-BSI = community-onset bloodstream infection, ESBL = extended-spectrum beta-lactamase, CI = confidence interval, PPV = positive predictive value, NPV = negative predictive value.

Predictors of ESBL-BSIs in E. coli subgroup

When the subjects were confined to BSIs caused by E. coli which was the dominant species in the study, the independent predictors of ESBL-BSIs were as follows: identification of ESBL-producing microorganisms within one year (aOR, 7.71; 95% CI, 2.60–22.95; P < 0.001), beta-lactam or fluoroquinolone treatment within 30 days with 2 or more courses within 90 days (aOR, 5.91; 95% CI, 1.50–23.36; P < 0.001); hospitalization within one year (aOR, 2.30; 95% CI, 1.38–3.84; P < 0.001). The AUC was calculated as 0.703. The detailed results are shown in Supplementary Table 2.

Validation

The validation cohort included 292 BSIs (E. coli: n = 200, 68.5%; Klebsiella species: n = 92, 31.5%). The proportion of ESBL-BSIs was 24.3% (28.0% in E. coli, 16.3% in Klebsiella species). The rate of ciprofloxacin resistance was 29.1% (35.5% in E. coli, 15.2% in Klebsiella species). The rate was higher in ESBL-BSIs than that in non-ESBL-BSIs (73.2% vs. 14.9%; P < 0.001). There were no BSIs caused by carbapenem-resistant Enterobacteriaceae.
The same variables as the derivation cohort were investigated (Supplementary Table 3). In the validation cohort, patients with a history of residency in long-term care facilities were more common (6.9% vs. 3.7%; P = 0.038), and the incidence of urinary tract infection was higher (45.6% vs. 35.9%; P = 0.005). Otherwise, there were no significant differences in demographics and clinical characteristics between the two cohorts including the length of stay and all-cause 30-day mortality rate.
The preformed prediction score was applied to the validation cohort. The calculated AUC was 0.70 (95% CI, 0.63–0.77). The sensitivity, specificity, PPV, and NPV for each cutoff were similar to those of the derivation cohort (Supplementary Table 4).

Clinical outcomes of CO-BSIs caused by E. coli and Klebsiella species

Among the 886 BSIs from 2012 to 2015, the median length of stay was significantly longer in ESBL-BSIs than that in non-ESBL-BSIs (15 days [IQR, 10–24] vs. 10 days [IQR, 7–16]; P < 0.001). The log-rank test revealed that there was no significant difference in all-cause 30-day mortality rates between the two groups (8.5% vs. 5.6%; P = 0.131).
Cox proportional hazards regression analysis showed that a high-risk source (adjusted hazard ratio [aHR], 3.79; 95% CI, 2.22–6.47; P < 0.001), Pitt bacteremia score ≥ 3 (aHR, 3.49; 95% CI, 2.07–5.89; P < 0.001), and CCI ≥ 3 (aHR, 2.08; 95% CI, 1.23–3.54; P = 0.007) were independent risk factors of mortality (Supplementary Table 5). ESBL-BSIs (unadjusted HR, 1.52; 95% CI, 0.87–2.67; P = 0.141) and the administration of effective antimicrobials within 48 hours (unadjusted HR, 0.72; 95% CI, 0.38–1.36; P = 0.306) had no significant effect on mortality.

DISCUSSION

This study identified the predictors of CO-BSIs caused by ESBL-producing E. coli and Klebsiella species and suggested a simple prediction score. It also showed the possibility of the extension of the results through validation. The significant advantage of this score is that it consists of easily obtainable clinical parameters, including 1) identification of ESBL-producing microorganisms within one year, 2) beta-lactam or fluoroquinolone treatment within 30 days, 3) hospitalization within one year, 4) presence of an indwelling urinary catheter at the time of admission. The ease of calculation is another advantage of this score.
The previous identification of ESBL-producing microorganisms within one year was the most important predictor of ESBL-BSIs in our study. Several studies have also reported the importance of prior culture positivity.162526 To investigate the previous identification history, we reviewed the medical records and test results for the previous year. However, we could not reflect the time difference between the onset of BSI and the prior identification because there were not enough subjects for this classification. Considering that the fecal carriage of ESBL-producing microorganisms persisted in over one-third of patients after one year of follow-up,2728 more extended time of investigation may be needed regarding this issue.
Prior antimicrobial treatment within 30 days was also a predictor of ESBL-BSIs. Several studies have shown that previous exposure to beta-lactam or fluoroquinolone is associated with infections due to ESBL-producing microorganisms.131415 In our study, both the timing and frequency of antimicrobial treatment were considered when building the multivariate model. The risk of ESBL-BSIs was higher in patients receiving antimicrobial treatment more recently and more frequently, which means overall antimicrobial pressure is important. This increased risk may also have been due to the intensity of medical use rather than the use of antimicrobials. Nevertheless, our finding implies that various factors, such as timing, frequency, dose and/or type of antimicrobials should be considered to evaluate the association between antimicrobial exposure and the risk of infections due to multidrug-resistant microorganisms.
The other predictors of ESBL-BISs included prior hospitalization within one year and the presence of an indwelling urinary catheter. To evaluate the effect of prior hospitalization, the study subjects were classified according to the time difference between the onset of BSI and the prior hospitalization. Unlike our expectation, the difference between the time periods was not significant. Several variables with a period of 30 or 90 days could have influenced these findings, but no significant statistical interaction between the variables was detected. Previous studies have shown that the presence of prosthesis is associated with infections due to ESBL-producing microorganisms.1314 The presence of an indwelling urinary catheter was an independent predictor in our study; however, the fact that the prevalence of urinary tract infection was high should be considered.
In this population, the risk factors for 30-day mortality were 1) high-risk source, high CCI (≥ 3), and 3) high Pitt bacteremia score (≥ 3). ESBL association and the administration of effective antimicrobials had no significant impact on the 30-day mortality. In previous studies, the impact of ESBL association varied especially when adjusted by confounding variables, and it had been suggested that the appropriateness of initial antimicrobials might be the key mediator.29 The association between the initial administration of antimicrobials and mortality was more evident in the subjects with severe sepsis, septic shock, or high-risk source of bacteremia.243031 The lack of association between initial administration of antimicrobials and mortality in the present study is presumably due to the high proportion of low-risk infections such as urinary tract and hepatobiliary infections and the low proportion of bacteremia with severe sepsis or septic shock. Furthermore, the mortality rate was not significantly high in the study subjects. All of the aforementioned features are common in community-onset infections, even though a considerable number of healthcare-associated infections were included in the study. Additionally, the high proportion of elderly patients with comorbidities might have influenced the overall results.
Although AUC analysis showed decent values of AUC in the derivation and validation cohorts, the practical values of its results are limited considering the specificity and sensitivity. Particularly, low specificity was problematic at cutoff 1 (61.9%), while low sensitivity was problematic at cutoffs 2 (39.3%) and 3 (27.9%). Thus, a stratified approach might be needed to promote the appropriate use of antimicrobials using the prediction rules. One of the main purposes of the Cox regression analysis was to establish the basis for the stratified approach in the study population. For example, cutoffs more than 1 may be considered in the presence of high Pitt bacteremia scores, high CCIs, and a high-risk source. In the absence of these risk factors, cutoffs more than 2 might be appropriate. The cutoffs of the prediction score can be set differently depending on the circumstances including the clinical setting of the infection, overall resistance profile in the area, antimicrobial prescription behavior in the hospital, and desired goals.
These results should be applied to other populations cautiously. Firstly, the study subjects were confined to those with E. coli and Klebsiella species infections, although the potential subjects of this study were those affected by community-onset bloodstream infections caused by Enterobacteriaceae. We excluded Enterobacteriaceae other than E. coli and Klebsiella species from the analyses because of the concerns over increasing the heterogeneity and the ambiguity in defining ESBL production or 3rd generation cephalosporin resistance. The number of cases with infections caused by species other than E. coli and Klebsiella species was relatively small, and it was not possible to formulate clear criteria on which species could be included or excluded. When the study subjects were confined to only those with E. coli infections, the impact of the presence of indwelling urinary catheter and recent use of antimicrobials reduced relatively. Since the primary aim of the present study was to make prediction rules which can be used clinically, we concluded that the multivariate model represented the characteristics of the study subjects better when it included both E. coli and Klebsiella species. Thus, E. coli and Klebsiella species, the two dominant pathogens in community-onset gram-negative bacterial infections, were selected as the study subjects.
Secondly, the study was performed at a single institution. The institution is located in a city adjacent to the capital city of the country, and we presumed that it has the dual characteristics of a referral center as well as a community-based hospital. Moreover, there are several long-term care facilities in the same area. Given the universal aging and the increase in healthcare-associated infections, we considered the patients of the institution to be good candidates to evaluate the risks of community-onset infections associated with multidrug-resistant pathogens. Nevertheless, the results are limited and should be interpreted cautiously because the overall study setting cannot represent the general circumstances. The limitation of this study as a single center one may also weaken the strength of the validation, although it was performed on an independent group of subjects. In the validation cohort, residency in long-term care facilities and urinary tract infections were more frequent. It might have been possible that the number of local patients increased first during the expansion of the institution. Conversely, these differences between the two cohorts and the results of validation may imply that the results of the study can be applied to subjects in different conditions.
Finally, as this study was performed retrospectively, the clinical setting at the time point of empirical treatment was not sufficiently reflected. A prospective approach might be needed, especially for the process of validation. Before performing a study, the inclusion criteria for the subjects and the variables to be evaluated should be thoroughly reviewed. Although several studies have been conducted to identify the risks due to the infections by multidrug-resistant pathogens, the details of materials and methods are quite different among the studies. In the current study, some information, including whether the patient was a resident of a long-term care facility, was recorded in preformed text format which had been developed for clinical purposes. We expect that the details of our study design and concepts will provide new perspectives for future studies.
The boundary between community-acquired and healthcare-associated infections has become unclear with the increase in the elderly population and the use of medical care. Antimicrobial resistance circulates bidirectionally between the community and medical facilities, and the selection of appropriate antimicrobials is increasingly more difficult. The results of the present study suggest a simple and easy-to-use scoring system to predict CO-BSIs caused by ESBL-producing E. coli and Klebsiella species. It may be difficult to make a generalized guideline or prediction score reflecting various local factors, but we expect our experience will help build a strategic approach to promote appropriate use of antimicrobials for the treatment of community-onset infections.

ACKNOWLEDGMENTS

We express our gratitude to Ji Young Kwak, Kyounghee Kim, Jung In Park in Seoul National University Bundang Hospital for their assistance in data collection.

Notes

Presentation The results of this study were presented at American Society for Microbiology Microbe 2018, Atlanta, US and the abstract was selected as Outstanding Abstract (Outstanding Abstract Award).

Funding This work was financially supported by Seoul National Bundang Hospital Research Fund (grant No. 02-2014-014).

Disclosure The authors have no potential conflicts of interest to disclose.

Author Contributions

  • Conceptualization: Kim M, Song KH, Kim ES, Kim HB.

  • Data curation: Kim M, Kim CJ, Song KH, Kim ES, Kim HB.

  • Formal analysis: Kim M, Song KH.

  • Funding acquisition: Song KH.

  • Methodology: Kim M, Song KH, Kim ES, Kim HB.

  • Writing - original draft: Kim M, Song KH.

  • Writing - review & editing: Kim M, Song KH, Kim CJ, Choe PG, Park WB, Bang JH, Kim ES, Park SW, Kim NJ, Oh MD, Kim HB.

References

1. Retamar P, Portillo MM, López-Prieto MD, Rodríguez-López F, de Cueto M, García MV, et al. Impact of inadequate empirical therapy on the mortality of patients with bloodstream infections: a propensity score-based analysis. Antimicrob Agents Chemother. 2012; 56(1):472–478.
crossref pmid pmc
2. Paul M, Andreassen S, Tacconelli E, Nielsen AD, Almanasreh N, Frank U, et al. Improving empirical antibiotic treatment using TREAT, a computerized decision support system: cluster randomized trial. J Antimicrob Chemother. 2006; 58(6):1238–1245.
crossref pmid
3. Fridkin SK, Steward CD, Edwards JR, Pryor ER, McGowan JE Jr, Archibald LK, et al. Surveillance of antimicrobial use and antimicrobial resistance in United States hospitals: project ICARE phase 2. Project Intensive Care Antimicrobial Resistance Epidemiology (ICARE) hospitals. Clin Infect Dis. 1999; 29(2):245–252.
pmid
4. Shlaes DM, Gerding DN, John JF Jr, Craig WA, Bornstein DL, Duncan RA, et al. Society for Healthcare Epidemiology of America and Infectious Diseases Society of America Joint Committee on the Prevention of Antimicrobial Resistance: guidelines for the prevention of antimicrobial resistance in hospitals. Clin Infect Dis. 1997; 25(3):584–599.
crossref pmid
5. McDanel J, Schweizer M, Crabb V, Nelson R, Samore M, Khader K, et al. Incidence of extended-spectrum β-lactamase (ESBL)-producing Escherichia coli and Klebsiella infections in the United States: a systematic literature review. Infect Control Hosp Epidemiol. 2017; 38(10):1209–1215.
pmid
6. Chang YT, Coombs G, Ling T, Balaji V, Rodrigues C, Mikamo H, et al. Epidemiology and trends in the antibiotic susceptibilities of Gram-negative bacilli isolated from patients with intra-abdominal infections in the Asia-Pacific region, 2010–2013. Int J Antimicrob Agents. 2017; 49(6):734–739.
crossref pmid
7. Thaden JT, Fowler VG, Sexton DJ, Anderson DJ. Increasing incidence of extended-spectrum β-lactamase-producing Escherichia coli in community hospitals throughout the southeastern United States. Infect Control Hosp Epidemiol. 2016; 37(1):49–54.
pmid
8. Kim YA, Kim JJ, Kim H, Lee K. Community-onset extended-spectrum-β-lactamase-producing Escherichia coli sequence type 131 at two Korean community hospitals: the spread of multidrug-resistant E. coli to the community via healthcare facilities. Int J Infect Dis. 2017; 54:39–42.
pmid
9. Logan LK, Weinstein RA. The epidemiology of carbapenem-resistant Enterobacteriaceae: the impact and evolution of a global menace. J Infect Dis. 2017; 215:suppl_1. S28–S36.
10. Muggeo A, Guillard T, Barbe C, Thierry A, Bajolet O, Vernet-Garnier V, et al. Factors associated with carriage of carbapenem-non-susceptible Enterobacteriaceaein North-Eastern France and outcomes of infected patients. J Antimicrob Chemother. 2017; 72(5):1496–1501.
pmid
11. Morrill HJ, Pogue JM, Kaye KS, LaPlante KL. Treatment options for carbapenem-resistant Enterobacteriaceae infections. Open Forum Infect Dis. 2015; 2(2):ofv050.
crossref
12. Kim M, Song KH, Kim CJ, Song M, Choe PG, Park WB, et al. Electronic alerts with automated consultations promote appropriate antimicrobial prescriptions. PLoS One. 2016; 11(8):e0160551.
crossref
13. Hendrik TC, Voor In 't Holt AF, Vos MC. Clinical and molecular epidemiology of extended-spectrum beta-lactamase-producing Klebsiella spp.: a systematic review and meta-analyses. PLoS One. 2015; 10(10):e0140754.
14. Lim CJ, Cheng AC, Kong DC, Peleg AY. Community-onset bloodstream infection with multidrug-resistant organisms: a matched case-control study. BMC Infect Dis. 2014; 14(1):126.
crossref pmid pmc
15. Falcone M, Russo A, Giannella M, Cangemi R, Scarpellini MG, Bertazzoni G, et al. Individualizing risk of multidrug-resistant pathogens in community-onset pneumonia. PLoS One. 2015; 10(4):e0119528.
crossref
16. Augustine MR, Testerman TL, Justo JA, Bookstaver PB, Kohn J, Albrecht H, et al. Clinical risk score for prediction of extended-spectrum β-lactamase-producing Enterobacteriaceae in bloodstream isolates. Infect Control Hosp Epidemiol. 2017; 38(3):266–272.
pmid
17. Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987; 40(5):373–383.
crossref pmid
18. Sundararajan V, Henderson T, Perry C, Muggivan A, Quan H, Ghali WA. New ICD-10 version of the Charlson comorbidity index predicted in-hospital mortality. J Clin Epidemiol. 2004; 57(12):1288–1294.
crossref pmid
19. Paterson DL, Ko WC, Von Gottberg A, Mohapatra S, Casellas JM, Goossens H, et al. International prospective study of Klebsiella pneumoniae bacteremia: implications of extended-spectrum beta-lactamase production in nosocomial infections. Ann Intern Med. 2004; 140(1):26–32.
pmid
20. Tu JV, Naylor CD. Clinical prediction rules. J Clin Epidemiol. 1997; 50(6):743–744.
crossref pmid
21. Harrell F. Regression coefficients and scoring rules. J Clin Epidemiol. 1996; 49(7):819.
crossref
22. Moons KG, Harrell FE, Steyerberg EW. Should scoring rules be based on odds ratios or regression coefficients? J Clin Epidemiol. 2002; 55(10):1054–1055.
crossref pmid
23. Blot S, Vandewoude K, De Bacquer D, Colardyn F. Nosocomial bacteremia caused by antibiotic-resistant gram-negative bacteria in critically ill patients: clinical outcome and length of hospitalization. Clin Infect Dis. 2002; 34(12):1600–1606.
crossref pmid
24. Kang CI, Kim SH, Park WB, Lee KD, Kim HB, Kim EC, et al. Bloodstream infections caused by antibiotic-resistant gram-negative bacilli: risk factors for mortality and impact of inappropriate initial antimicrobial therapy on outcome. Antimicrob Agents Chemother. 2005; 49(2):760–766.
crossref pmid pmc
25. Van Aken S, Lund N, Ahl J, Odenholt I, Tham J. Risk factors, outcome and impact of empirical antimicrobial treatment in extended-spectrum β-lactamase-producing Escherichia coli bacteraemia. Scand J Infect Dis. 2014; 46(11):753–762.
pmid
26. Denis B, Lafaurie M, Donay JL, Fontaine JP, Oksenhendler E, Raffoux E, et al. Prevalence, risk factors, and impact on clinical outcome of extended-spectrum beta-lactamase-producing Escherichia coli bacteraemia: a five-year study. Int J Infect Dis. 2015; 39:1–6.
27. Titelman E, Hasan CM, Iversen A, Nauclér P, Kais M, Kalin M, et al. Faecal carriage of extended-spectrum β-lactamase-producing Enterobacteriaceae is common 12 months after infection and is related to strain factors. Clin Microbiol Infect. 2014; 20(8):O508–O515.
28. Bar-Yoseph H, Hussein K, Braun E, Paul M. Natural history and decolonization strategies for ESBL/carbapenem-resistant Enterobacteriaceae carriage: systematic review and meta-analysis. J Antimicrob Chemother. 2016; 71(10):2729–2739.
29. Rottier WC, Ammerlaan HS, Bonten MJ. Effects of confounders and intermediates on the association of bacteraemia caused by extended-spectrum β-lactamase-producing Enterobacteriaceae and patient outcome: a meta-analysis. J Antimicrob Chemother. 2012; 67(6):1311–1320.
pmid
30. Yokota PK, Marra AR, Martino MD, Victor ES, Durão MS, Edmond MB, et al. Impact of appropriate antimicrobial therapy for patients with severe sepsis and septic shock--a quality improvement study. PLoS One. 2014; 9(11):e104475.
31. Paul M, Shani V, Muchtar E, Kariv G, Robenshtok E, Leibovici L. Systematic review and meta-analysis of the efficacy of appropriate empiric antibiotic therapy for sepsis. Antimicrob Agents Chemother. 2010; 54(11):4851–4863.
crossref pmid pmc

SUPPLEMENTARY MATERIALS

Supplementary Table 1

Results of multivariate logistic regression analysis with divided time periods of hospitalization for the predictors of CO-BSIs caused by ESBL-producing E. coli and Klebsiella species

Supplementary Table 2

Results of multivariate logistic regression analysis for the predictors of CO-BSIs caused by ESBL-producing E. coli

Supplementary Table 3

Comparison of baseline demographics and clinical characteristic between the derivation and validation cohorts

Supplementary Table 4

Receiver operating characteristics cutoff values of the clinical prediction score for CO-BSIs caused by ESBL-producing E. coli and Klebsiella species

Supplementary Table 5

Results of Cox proportional hazards regression for the risk factors of mortality in patients with CO-BSIs caused by E. coli and Klebsiella species
TOOLS
ORCID iDs

Moonsuk Kim
https://orcid.org/0000-0001-8640-939X

Kyoung-Ho Song
https://orcid.org/0000-0002-4517-3840

Chung-Jong Kim
https://orcid.org/0000-0002-9987-6533

Pyoeng Gyun Choe
https://orcid.org/0000-0001-6794-7918

Wan Beom Park
https://orcid.org/0000-0003-0022-9625

Ji Hwan Bang
https://orcid.org/0000-0002-7628-1182

Eu Suk Kim
https://orcid.org/0000-0001-7132-0157

Sang-Won Park
https://orcid.org/0000-0002-0550-1897

Nam Joong Kim
https://orcid.org/0000-0001-6793-9467

Myoung-don Oh
https://orcid.org/0000-0002-2344-7695

Hong Bin Kim
https://orcid.org/0000-0001-6262-372X

Similar articles