<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.0 20120330//EN" "JATS-journalpublishing1.dtd">
<article article-type="research-article" dtd-version="1.0" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">ACC</journal-id>
<journal-title-group>
<journal-title>Acute and Critical Care</journal-title><abbrev-journal-title>Acute Crit Care</abbrev-journal-title></journal-title-group>
<issn pub-type="ppub">2586-6052</issn>
<issn pub-type="epub">2586-6060</issn>
<publisher>
<publisher-name>Korean Society of Critical Care Medicine</publisher-name></publisher></journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.4266/acc.2019.00780</article-id>
<article-id pub-id-type="publisher-id">acc-2019-00780</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Original Article</subject>
<subj-group subj-group-type="heading">
<subject>Trauma</subject></subj-group></subj-group></article-categories>
<title-group>
<article-title>Inclusion of lactate level measured upon emergency room arrival in trauma outcome prediction models improves mortality prediction: a retrospective, single-center study</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<contrib-id contrib-id-type="orcid">http://orcid.org/0000-0002-4630-3301</contrib-id>
<name><surname>Moon</surname><given-names>Jonghwan</given-names></name>
<xref ref-type="aff" rid="af1-acc-2019-00780"><sup>1</sup></xref>
</contrib>
<contrib contrib-type="author">
<contrib-id contrib-id-type="orcid">http://orcid.org/0000-0002-5922-4186</contrib-id>
<name><surname>Hwang</surname><given-names>Kyungjin</given-names></name>
<xref ref-type="aff" rid="af1-acc-2019-00780"><sup>1</sup></xref>
</contrib>
<contrib contrib-type="author">
<contrib-id contrib-id-type="orcid">http://orcid.org/0000-0003-1635-8376</contrib-id>
<name><surname>Yoon</surname><given-names>Dukyong</given-names></name>
<xref ref-type="aff" rid="af2-acc-2019-00780"><sup>2</sup></xref>
</contrib>
<contrib contrib-type="author">
<contrib-id contrib-id-type="orcid">http://orcid.org/0000-0001-7895-0362</contrib-id>
<name><surname>Jung</surname><given-names>Kyoungwon</given-names></name>
<xref ref-type="corresp" rid="c1-acc-2019-00780"/>
<xref ref-type="aff" rid="af1-acc-2019-00780"><sup>1</sup></xref>
</contrib>
<aff id="af1-acc-2019-00780">
<label>1</label>Division of Trauma Surgery, Department of Surgery, Ajou University School of Medicine and Graduate School of Medicine, Suwon, <country>Korea</country></aff>
<aff id="af2-acc-2019-00780">
<label>2</label>Department of Biomedical Informatics, Ajou University School of Medicine and Department of Biomedical Sciences, Ajou University Graduate School of Medicine, Suwon, <country>Korea</country></aff>
</contrib-group>
<author-notes>
<corresp id="c1-acc-2019-00780">Corresponding author Kyoungwon Jung Division of Trauma Surgery, Department of Surgery, Ajou University School of Medicine and Graduate School of Medicine, 206 World cup-ro, Yeongtong-gu, Suwon 16499, Korea Tel: +82-31-219-7764 Fax: +82-31-219-7781 E-mail: <email>jake98@daum.net</email></corresp>
</author-notes>
<pub-date pub-type="ppub">
<month>5</month>
<year>2020</year></pub-date>
<pub-date pub-type="epub">
<day>31</day>
<month>5</month>
<year>2020</year></pub-date>
<volume>35</volume>
<issue>2</issue>
<fpage>102</fpage>
<lpage>109</lpage>
<history>
<date date-type="received">
<day>9</day>
<month>12</month>
<year>2019</year></date>
<date date-type="rev-recd">
<day>3</day>
<month>05</month>
<year>2020</year></date>
<date date-type="accepted">
<day>19</day>
<month>05</month>
<year>2020</year></date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2020 The Korean Society of Critical Care Medicine</copyright-statement>
<copyright-year>2020</copyright-year>
<license>
<license-p>This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (<ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/licenses/by-nc/4.0/">http://creativecommons.org/licenses/by-nc/4.0/</ext-link>) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p></license></permissions>
<abstract>
<sec><title>Background</title>
<p>This study aimed to develop a model for predicting trauma outcomes by adding arterial lactate levels measured upon emergency room (ER) arrival to existing trauma injury severity scoring systems.</p></sec>
<sec><title>Methods</title>
<p>We examined blunt trauma cases that were admitted to our hospital during 2010&#x02013; 2014. Eligibility criteria were cases with an Injury Severity Score of &#x02265;9, complete Trauma and Injury Severity Score (TRISS) variable data, and lactate levels that were assessed upon ER arrival. Survivor and non-survivor groups were compared and lactate-based prediction models were generated using logistic regression. We compared the predictive performances of traditional prediction models (Revised Trauma Score [RTS] and TRISS) and lactate-based models using the area under the curve (AUC) of receiver operating characteristic curves.</p></sec>
<sec><title>Results</title>
<p>We included 829 patients, and the in-hospital mortality rate among these patients was 21.6%. The model that used lactate levels and age provided a significantly better AUC value than the RTS model. The model with lactate added to the TRISS variables provided the highest Youden J statistic, with 86.0% sensitivity and 70.8% specificity at a cutoff value of 0.15, as well as the highest predictive value, with a significantly higher AUC than the TRISS.</p></sec>
<sec><title>Conclusions</title>
<p>These findings indicate that lactate testing upon ER arrival may help supplement or replace traditional physiological parameters to predict mortality outcomes among Korean trauma patients. Adding lactate levels also appears to improve the predictive abilities of existing trauma outcome prediction models.</p></sec>
</abstract>
<kwd-group>
<kwd>lactate</kwd>
<kwd>mortality</kwd>
<kwd>prognosis</kwd>
<kwd>wounds and injuries</kwd>
</kwd-group>
</article-meta></front>
<body>
<sec sec-type="intro">
<title>INTRODUCTION</title>
<p>It is often difficult to determine the severity of multiple blunt trauma based on a patient&#x02019;s appearance, and under-triage of trauma during the initial resuscitation process can lead to death. Thus, models have been developed to identify the severity of injuries &#x0005b;<xref ref-type="bibr" rid="b1-acc-2019-00780">1</xref>-<xref ref-type="bibr" rid="b10-acc-2019-00780">10</xref>&#x0005d;, including trauma outcome prediction models that use statistical methods (i.e., logistic regression), to quantify diverse and complex traumas and estimate the likelihood of mortality. These models facilitate better communication among medical staff and improve treatment prioritization.</p>
<p>The Revised Trauma Score (RTS) combines clinical and observational physiologic data into a single score. The RTS incorporates the Glasgow Coma Scale (GCS), systolic blood pressure (SBP), and respiratory rate (RR). The RTS is strongly correlated with mortality and remains important in injury scoring through its contribution to the Trauma and Injury Severity Score (TRISS) model. The TRISS is a weighted combination of patient age, Injury Severity Score (ISS), and RTS variables that predicts a patient&#x02019;s probability of survival (Ps). Using the TRISS methodology, the Ps of any one patient can be estimated using the following formula:</p>
<p>Ps&#x0003d;1/(1&#x0002b;e<sup>&#x02013;b</sup>)</p>
<p>where b&#x0003d;b<sub>0</sub>&#x0002b;b<sub>1</sub>(RTS)&#x0002b;b<sub>2</sub>(ISS)&#x0002b;b<sub>3</sub>(age).</p>
<p>Here, b<sub>0&#x02013;3</sub> are coefficients derived from Walker-Duncan regression analysis applied to data from thousands of patients analyzed in the Major Trauma Outcome Study &#x0005b;<xref ref-type="bibr" rid="b10-acc-2019-00780">10</xref>&#x0005d;.</p>
<p>The TRISS considers the trauma&#x02019;s anatomical location, as well as the patient&#x02019;s age and physiological parameters, which makes it a useful system for predicting trauma outcomes &#x0005b;<xref ref-type="bibr" rid="b10-acc-2019-00780">10</xref>-<xref ref-type="bibr" rid="b12-acc-2019-00780">12</xref>&#x0005d;. However, the TRISS requires both accurate Abbreviated Injury Scale (AIS) coding and reliable information regarding initial SBP, RR, and GCS to calculate the RTS. Furthermore, previous studies have revealed that data are missing for approximately 20% of the variables, which highlights the difficulty in obtaining reliable information regarding these values &#x0005b;<xref ref-type="bibr" rid="b11-acc-2019-00780">11</xref>,<xref ref-type="bibr" rid="b13-acc-2019-00780">13</xref>,<xref ref-type="bibr" rid="b14-acc-2019-00780">14</xref>&#x0005d;. This problem is magnified in Korea, where the trauma management system is relatively new, and patients are often transferred to a hospital without appropriate triage during initial resuscitation. Therefore, it is extremely difficult to obtain accurate physiological values, and AIS coding is only available at certain hospitals with trained staff. Moreover, the lack of post-mortem examination, which is related to cultural preferences, also interferes with accurate AIS coding. Thus, it has been difficult to use established tools to predict outcomes in Korean trauma cases.</p>
<p>Recent studies have indicated that lactate can be a useful marker for predicting trauma outcomes. We hypothesized that lactate levels, which reflect organ perfusion, could help determine the degree of anatomical trauma and/or the patient&#x02019;s physiological parameters using a single examination. Therefore, our goal was to develop a model for predicting trauma outcomes by assessing the relationship between arterial lactate level upon emergency room (ER) arrival and outcomes in cases of multiple blunt trauma.</p>
</sec>
<sec sec-type="materials|methods">
<title>MATERIALS AND METHODS</title>
<sec>
<title>Research Ethics</title>
<p>This study&#x02019;s retrospective protocol was approved by the Institutional Review Board of Ajou University Hospital (IRB No. AJIRB-MED-MDB-17-359). Informed consent was waived by the board because of the observational nature of the study.</p>
</sec>
<sec>
<title>Setting and Patient Data</title>
<p>We examined data from trauma cases that were treated at our center between 2010 and 2014. Among the in-patient trauma cases, we targeted cases where the mechanism of injury was blunt force. We excluded patients who were dead on arrival or missing lactate data at the time of ER arrival. As the main outcome of interest was in-hospital mortality, this study was designed to compare our new lactate-based scoring system and a representative trauma mortality prediction model, the TRISS. Therefore, only cases with an ISS of &#x02265;9 and complete TRISS variable data were considered eligible for inclusion (<xref rid="f1-acc-2019-00780" ref-type="fig">Figure 1</xref>).</p>
</sec>
<sec>
<title>Variables for the Prediction Models</title>
<p>Lactate levels were assessed using arterial blood upon ER arrival, and the interval between ER arrival and blood sampling was calculated. Patients were divided into four groups based on their lactate levels: &#x02264;2.5, 2.6&#x02013;5.0, 5.1&#x02013;7.5, and &#x02265;7.6 mmol/L. According to the TRISS method, we also dichotomized patients based on an age of 55 years. RTS was calculated based on SBP, RR, and the GCS at ER arrival, which were categorized based on the RTS variables&#x02019; breakpoints. AIS coding was performed by a well-trained trauma nurse, and we carefully evaluated and confirmed the results.</p>
</sec>
<sec>
<title>Statistical Analysis</title>
<p>Survivor and non-survivor groups were compared using the Mann-Whitney U-test (non-normally distributed continuous variables), the chi-square test (categorical variables), or the chi-square test for trend (categorical variables with three or more groups). Lactate-based prediction models were generated using logistic regression analysis, with mortality as the dependent variable and lactate level, RTS, ISS, and age as the independent variables. Subsequently, we designed several new prediction models: the LA model, based on lactate-only, the LAG model based on lactate level and age, the LAGISS model that used lactate instead of the RTS (i.e., lactate and ISS), the LAGRTS model that used lactate and the RTS, and the LATRISS model that used lactate in addition to the traditional TRISS variables. The predictive value of each model was evaluated by calculating the area under the curve (AUC) of the receiver operating characteristic curve and the Hosmer-Lemeshow test. Sensitivity, specificity, the Youden J value, and optimal cutoff value for outcome prediction were also obtained for each model. Predictive performances of the traditional prediction models (RTS and TRISS) and the lactate-based models were also compared. All analyses were performed using MedCalc software ver. 17.9.2 (MedCalc Software, Mariakerke, Belgium), and differences were considered statistically significant at P-values of &#x0003c;0.05.</p>
</sec>
</sec>
<sec sec-type="results">
<title>RESULTS</title>
<p>The present study included 829 patients (630 men) with a median age of 47 years. Approximately 55% of the patients (456 patients) were transferred to our center from a different hospital, and the in-hospital mortality rate was 21.6% (179/829). Significant differences in age, ISS, SBP, RR, GCS, RTS, and initial lactate levels were observed when we compared patients who survived with those who died. These differences remained significant after coding according to the RTS variable breakpoints (<xref rid="t1-acc-2019-00780" ref-type="table">Table 1</xref>). Lactate levels were assessed at a median interval of 12 minutes (interquartile range, 8&#x02013;21 minutes) after ER arrival. Surviving patients had a median lactate level of 2.4 mmol/L while patients who died had a median lactate level of 5.5 mmol/L (P&#x0003c;0.001). Higher lactate levels were positively correlated with mortality (P&#x0003c;0.001) (<xref rid="f2-acc-2019-00780" ref-type="fig">Figure 2</xref>).</p>
<p>All age-based logistic regression models had AUC values of &#x02265;0.8, and the Hosmer-Lemeshow test results revealed that all models had P-values of &#x02265;0.05 (<xref rid="t2-acc-2019-00780" ref-type="table">Table 2</xref>). The AUC of the traditional RTS was 0.735, while that of the LA model was slightly higher, albeit not significantly so (0.776, P&#x0003d;0.151). The LAG model based on lactate levels and age had a significantly better AUC value than the traditional RTS (0.803, P&#x0003d;0.015) (<xref rid="t3-acc-2019-00780" ref-type="table">Table 3</xref>, <xref rid="f3-acc-2019-00780" ref-type="fig">Figure 3A</xref>). However, this value was not significantly better than the value for the traditional TRISS (0.801, P&#x0003d;0.952) (<xref rid="t3-acc-2019-00780" ref-type="table">Table 3</xref>, <xref rid="f3-acc-2019-00780" ref-type="fig">Figure 3B</xref>).</p>
<p>Regression analysis indicated that the model that incorporated age, ISS, and lactate level (LAGISS model) had a better predictive value than the TRISS model (0.836 vs. 0.801, P&#x0003d;0.059). In contrast, the LAGRTS model provided a significantly improved predictive value compared to the TRISS model (0.849 vs. 0.801, P&#x0003d;0.003). The LATRISS model provided the highest Youden J value (0.568), with 86.0% sensitivity and 70.8% specificity at the cutoff point of 0.15 (<xref rid="t2-acc-2019-00780" ref-type="table">Table 2</xref>). The LATRISS model also provided the highest predictive value, and this value was remarkably higher than that of the traditional TRISS method (difference, 0.057; P&#x0003c;0.001) (<xref rid="t3-acc-2019-00780" ref-type="table">Table 3</xref>, <xref rid="f3-acc-2019-00780" ref-type="fig">Figure 3B</xref>).</p>
</sec>
<sec sec-type="discussion">
<title>DISCUSSION</title>
<p>Since trauma management systems were established in the United States in the 1970s, several different systems have been suggested for scoring injury severity. However, only a few are widely used, such as the TRISS, which includes the ISS as an anatomical component, the RTS as a physiological component, and age as a comorbidity component. TRISS is useful for both blunt and penetrating trauma and can be used to predict the Ps in trauma cases &#x0005b;<xref ref-type="bibr" rid="b10-acc-2019-00780">10</xref>,<xref ref-type="bibr" rid="b15-acc-2019-00780">15</xref>&#x0005d;. However, its calculation requires accurate information regarding several variables (age, SBP, RR, GCS, and ISS), and missing or inaccurate data can lead to incorrect scores. Previous large-scale studies of the TRISS have revealed high proportions of missing data (11.3%&#x02013;23.3%) &#x0005b;<xref ref-type="bibr" rid="b11-acc-2019-00780">11</xref>,<xref ref-type="bibr" rid="b13-acc-2019-00780">13</xref>,<xref ref-type="bibr" rid="b14-acc-2019-00780">14</xref>&#x0005d;. In Korea, the immature trauma system is an additional problem, as there is no training or legal requirements for paramedics to assess initial physiological parameters, such as the GCS or SBP of injured patients, and most hospitals do not even perform ISS measurements. Thus, the accuracy of pre-hospital vital signs or GCS values is limited and/or these measurements are frequently omitted &#x0005b;<xref ref-type="bibr" rid="b16-acc-2019-00780">16</xref>-<xref ref-type="bibr" rid="b18-acc-2019-00780">18</xref>&#x0005d;. In addition, because pre-hospital triage for injured patients has not been well-established in Korea, &#x0003e;50% of patients who should have been admitted directly to a trauma center were actually transferred to our facility from another hospital &#x0005b;<xref ref-type="bibr" rid="b16-acc-2019-00780">16</xref>,<xref ref-type="bibr" rid="b17-acc-2019-00780">17</xref>&#x0005d;. These issues make it extremely difficult to obtain accurate initial physiological data. In addition, ISS coding is only performed in 17 Korean trauma centers that were established after 2012, as time and resources are needed to train individuals to perform accurate coding &#x0005b;<xref ref-type="bibr" rid="b18-acc-2019-00780">18</xref>&#x0005d;. Furthermore, the frequency of post-mortem examinations is much lower for Korean trauma cases than those in other countries &#x0005b;<xref ref-type="bibr" rid="b19-acc-2019-00780">19</xref>,<xref ref-type="bibr" rid="b20-acc-2019-00780">20</xref>&#x0005d;, which further complicates AIS coding for patients who have died before or at their ER arrival. Therefore, TRISS measurements are difficult and have limited reliability in Korea, which is why we examined the utility of lactate levels for predicting trauma outcomes.</p>
<p>At our center, lactate level is assessed using arterial blood, and severe trauma cases (expected ISS score of &#x02265;9) undergo lactate testing upon ER arrival. The main drawbacks of this examination are its economic cost, invasive nature, and the time required for testing. However, it is a single test that can accurately reflect the patient&#x02019;s overall condition, regardless of the trauma&#x02019;s anatomical site or the assessment timepoint. In Korea, with its immature trauma system, even severe trauma patients are often transferred to another hospital without receiving appropriate definitive care at the first hospital. Thus, before being transferred, patients may receive massive intravenous fluid infusion, blood transfusion, or hemodynamic drugs, which can lead to discrepancies between their original vital signs and the vital signs that are measured at the trauma center or terminal hospital. These discrepancies can introduce error into the assigned TRISS value, which limits its predictive value. In contrast, almost all patients with severe trauma undergo blood sampling and lactate testing, which may be useful as a supplement or replacement for TRISS in predicting trauma outcomes. This possibility is supported by previous studies that have reported that lactate levels are associated with survival outcomes in trauma cases &#x0005b;<xref ref-type="bibr" rid="b21-acc-2019-00780">21</xref>-<xref ref-type="bibr" rid="b26-acc-2019-00780">26</xref>&#x0005d;.</p>
<p>The present study examined data from a 5-year period at our center, and analyses of this data revealed a strong correlation between the initial lactate levels of patients with severe blunt trauma (ISS of &#x02265;9) and in-hospital mortality. Lactate testing was performed at a median interval of 12 minutes after ER arrival, and arterial blood was used for all cases. Patients who died had average lactate levels that were 3.1 mmol/L higher than those of patients who survived, and this difference was statistically significant. Thus, we coded patients into four groups according to lactate levels based on previous studies &#x0005b;<xref ref-type="bibr" rid="b25-acc-2019-00780">25</xref>-<xref ref-type="bibr" rid="b28-acc-2019-00780">28</xref>&#x0005d; and observed a positive correlation between initial lactate levels and mortality rate. Moreover, we performed logistic regression to create lactate-based prediction models for trauma mortality. Logistic regression revealed that the lactate-based model provided a higher AUC value than the RTS-based model, although this difference was not significant. However, the model that used lactate levels and dichotomized age (55 years, the same age used for the TRISS calculation), provided a significantly higher AUC value than the RTS-based model. Therefore, initial lactate levels may be equally useful, or possibly superior, to traditional physiological parameters (e.g., SBP, RR, or GCS).</p>
<p>Previous reports have claimed that the standard for SBP should be adjusted to 110 mm Hg, rather than the 90 mm Hg that is used in the RTS &#x0005b;<xref ref-type="bibr" rid="b29-acc-2019-00780">29</xref>,<xref ref-type="bibr" rid="b30-acc-2019-00780">30</xref>&#x0005d;. Similarly, the present study revealed that the median SBP was 110 mm Hg in the non-survivor group, which may have contributed to the limited predictive value of the RTS. In addition, more precise measurement of the RR is needed, and its range should be modified, although our limited sample size prevented us from performing these additional analyses. Furthermore, we believe that classification of traditional vital signs (such as SBP) should eventually be reconsidered. Therefore, despite the invasive nature of lactate testing (relative to assessing blood pressure, pulse rate, or GCS), its utility in predicting trauma outcomes when incorporated in trauma scoring models potentially justifies its use.</p>
<p>Predictive values were similar when we compared the traditional TRISS model and a model that used lactate levels plus age. Thus, appropriate combination of lactate levels and traditional variables in a model will likely lead to better prediction of outcomes than the traditional TRISS model. We originally hypothesized that replacing the RTS with lactate levels in the TRISS model would improve the predictive value of the model; however, our analyses revealed that the improvement was only marginally significant (P&#x0003d;0.059). Nevertheless, combining the RTS and lactate levels without the ISS (an anatomical parameter) had superior predictive value to that of the TRISS model (P&#x0003d;0.003). Moreover, logistic regression using all of the variables (age, lactate, the ISS, and the RTS) provided the highest AUC value (0.859), which indicates that combining lactate levels with TRISS variables may be useful for developing a model with superior ability to predict trauma outcomes.</p>
<p>The present study had several limitations. First, patients were included only if they had experienced blunt trauma, undergone lactate testing at ER arrival, had complete physiological data, and had an ISS of &#x02265;9. Thus, our results are subject to selection bias, although this approach was necessary to compare the results to the traditional scoring system, as lactate levels are only tested at our center for patients with an ISS of &#x02265;9. Second, we did not consider whether patients had been transferred from another center, and all data regarding vital signs and GCS were obtained upon the patients&#x02019; arrival at our ER. Thus, patients with no accurate GCS or RR (e.g., due to sedation or intubation before arrival) were excluded from the study. Third, we did not categorize cases based on the time of lactate testing or the reason for any delayed testing. Although most patients underwent testing relatively quickly (median interval of 12 minutes), approximately 5% of the patients underwent testing at &#x02265;1 hour after their arrival. Lastly, the present study is a single-center retrospective study in a country without a well-established trauma management system, and the findings may not be generalizable to other regions.</p>
<p>Our findings indicate that lactate testing upon ER arrival may help supplement traditional physiological parameters to predict trauma mortality in Korea. Furthermore, adding lactate levels improves the predictive ability of established trauma outcome prediction models, such as the RTS and TRISS. Nevertheless, these findings require validation using additional data from a large-scale, multi-center study.</p>
</sec>
</body>
<back>
<fn-group>
<fn fn-type="conflict"><p><bold>CONFLICT OF INTEREST</bold> No potential conflict of interest relevant to this article was reported.</p></fn>
<fn fn-type="participating-researchers"><p><bold>AUTHOR CONTRIBUTIONS</bold></p>
<p>Conceptualization: JM, KJ. Data curation &amp; Formal analysis: all authors. Methodology: all authors. Project administration &amp; Visualization: JM, KJ. Writing–original draft: JM, KJ, KH. Writing–review &amp; editing: all authors.</p></fn>
</fn-group>
<ack><p>The authors thank our trauma registrar (Juryang Kim) and the hospital’s Department of Electronic Medical Records for data collection and maintenance.</p></ack>
<ref-list>
<title>REFERENCES</title>
<ref id="b1-acc-2019-00780">
<label>1</label>
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name><surname>Cook</surname><given-names>A</given-names></name>
<name><surname>Weddle</surname><given-names>J</given-names></name>
<name><surname>Baker</surname><given-names>S</given-names></name>
<name><surname>Hosmer</surname><given-names>D</given-names></name>
<name><surname>Glance</surname><given-names>L</given-names></name>
<name><surname>Friedman</surname><given-names>L</given-names></name>
<etal/>
</person-group>
<article-title>A comparison of the Injury Severity Score and the Trauma Mortality Prediction Model</article-title>
<source>J Trauma Acute Care Surg</source>
<year>2014</year>
<volume>76</volume>
<fpage>47</fpage>
<lpage>52</lpage>
</element-citation></ref>
<ref id="b2-acc-2019-00780">
<label>2</label>
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name><surname>Cassidy</surname><given-names>LD</given-names></name>
<name><surname>Cook</surname><given-names>A</given-names></name>
<name><surname>Ertl</surname><given-names>A</given-names></name>
<name><surname>Gourlay</surname><given-names>D</given-names></name>
<name><surname>Osler</surname><given-names>T</given-names></name>
</person-group>
<article-title>Is the Trauma Mortality Prediction Model (TMPM-ICD-9) a valid predictor of mortality in pediatric trauma patients?</article-title>
<source>J Pediatr Surg</source>
<year>2014</year>
<volume>49</volume>
<fpage>189</fpage>
<lpage>92</lpage>
</element-citation></ref>
<ref id="b3-acc-2019-00780">
<label>3</label>
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name><surname>Vivien</surname><given-names>B</given-names></name>
<name><surname>Yeguiayan</surname><given-names>JM</given-names></name>
<name><surname>Le Manach</surname><given-names>Y</given-names></name>
<name><surname>Bonithon-Kopp</surname><given-names>C</given-names></name>
<name><surname>Mirek</surname><given-names>S</given-names></name>
<name><surname>Garrigue</surname><given-names>D</given-names></name>
<etal/>
</person-group>
<article-title>The motor component does not convey all the mortality prediction capacity of the Glasgow Coma Scale in trauma patients</article-title>
<source>Am J Emerg Med</source>
<year>2012</year>
<volume>30</volume>
<fpage>1032</fpage>
<lpage>41</lpage>
</element-citation></ref>
<ref id="b4-acc-2019-00780">
<label>4</label>
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name><surname>Haider</surname><given-names>AH</given-names></name>
<name><surname>Villegas</surname><given-names>CV</given-names></name>
<name><surname>Saleem</surname><given-names>T</given-names></name>
<name><surname>Efron</surname><given-names>DT</given-names></name>
<name><surname>Stevens</surname><given-names>KA</given-names></name>
<name><surname>Oyetunji</surname><given-names>TA</given-names></name>
<etal/>
</person-group>
<article-title>Should the IDC-9 Trauma Mortality Prediction Model become the new paradigm for benchmarking trauma outcomes?</article-title>
<source>J Trauma Acute Care Surg</source>
<year>2012</year>
<volume>72</volume>
<fpage>1695</fpage>
<lpage>701</lpage>
</element-citation></ref>
<ref id="b5-acc-2019-00780">
<label>5</label>
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name><surname>Moore</surname><given-names>L</given-names></name>
<name><surname>Lavoie</surname><given-names>A</given-names></name>
<name><surname>Turgeon</surname><given-names>AF</given-names></name>
<name><surname>Abdous</surname><given-names>B</given-names></name>
<name><surname>Le Sage</surname><given-names>N</given-names></name>
<name><surname>Emond</surname><given-names>M</given-names></name>
<etal/>
</person-group>
<article-title>Improving trauma mortality prediction modeling for blunt trauma</article-title>
<source>J Trauma</source>
<year>2010</year>
<volume>68</volume>
<fpage>698</fpage>
<lpage>705</lpage>
</element-citation></ref>
<ref id="b6-acc-2019-00780">
<label>6</label>
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name><surname>Huber-Wagner</surname><given-names>S</given-names></name>
<name><surname>Stegmaier</surname><given-names>J</given-names></name>
<name><surname>Mathonia</surname><given-names>P</given-names></name>
<name><surname>Paffrath</surname><given-names>T</given-names></name>
<name><surname>Euler</surname><given-names>E</given-names></name>
<name><surname>Mutschler</surname><given-names>W</given-names></name>
<etal/>
</person-group>
<article-title>The sequential trauma score: a new instrument for the sequential mortality prediction in major trauma</article-title>
<source>Eur J Med Res</source>
<year>2010</year>
<volume>15</volume>
<fpage>185</fpage>
<lpage>95</lpage>
</element-citation></ref>
<ref id="b7-acc-2019-00780">
<label>7</label>
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name><surname>Glance</surname><given-names>LG</given-names></name>
<name><surname>Osler</surname><given-names>TM</given-names></name>
<name><surname>Mukamel</surname><given-names>DB</given-names></name>
<name><surname>Meredith</surname><given-names>W</given-names></name>
<name><surname>Wagner</surname><given-names>J</given-names></name>
<name><surname>Dick</surname><given-names>AW</given-names></name>
</person-group>
<article-title>TMPM-ICD9: a trauma mortality prediction model based on ICD-9-CM codes</article-title>
<source>Ann Surg</source>
<year>2009</year>
<volume>249</volume>
<fpage>1032</fpage>
<lpage>9</lpage>
</element-citation></ref>
<ref id="b8-acc-2019-00780">
<label>8</label>
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name><surname>Osler</surname><given-names>T</given-names></name>
<name><surname>Glance</surname><given-names>L</given-names></name>
<name><surname>Buzas</surname><given-names>JS</given-names></name>
<name><surname>Mukamel</surname><given-names>D</given-names></name>
<name><surname>Wagner</surname><given-names>J</given-names></name>
<name><surname>Dick</surname><given-names>A</given-names></name>
</person-group>
<article-title>A trauma mortality prediction model based on the anatomic injury scale</article-title>
<source>Ann Surg</source>
<year>2008</year>
<volume>247</volume>
<fpage>1041</fpage>
<lpage>8</lpage>
</element-citation></ref>
<ref id="b9-acc-2019-00780">
<label>9</label>
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name><surname>Marcin</surname><given-names>JP</given-names></name>
<name><surname>Pollack</surname><given-names>MM</given-names></name>
</person-group>
<article-title>Triage scoring systems, severity of illness measures, and mortality prediction models in pediatric trauma</article-title>
<source>Crit Care Med</source>
<year>2002</year>
<volume>30</volume>
<issue>11 Suppl</issue>
<fpage>S457</fpage>
<lpage>67</lpage>
</element-citation></ref>
<ref id="b10-acc-2019-00780">
<label>10</label>
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name><surname>Boyd</surname><given-names>CR</given-names></name>
<name><surname>Tolson</surname><given-names>MA</given-names></name>
<name><surname>Copes</surname><given-names>WS</given-names></name>
</person-group>
<article-title>Evaluating trauma care: the TRISS method: trauma score and the injury severity score</article-title>
<source>J Trauma</source>
<year>1987</year>
<volume>27</volume>
<fpage>370</fpage>
<lpage>8</lpage>
</element-citation></ref>
<ref id="b11-acc-2019-00780">
<label>11</label>
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name><surname>Schluter</surname><given-names>PJ</given-names></name>
<name><surname>Nathens</surname><given-names>A</given-names></name>
<name><surname>Neal</surname><given-names>ML</given-names></name>
<name><surname>Goble</surname><given-names>S</given-names></name>
<name><surname>Cameron</surname><given-names>CM</given-names></name>
<name><surname>Davey</surname><given-names>TM</given-names></name>
<etal/>
</person-group>
<article-title>Trauma and Injury Severity Score (TRISS) coefficients 2009 revision</article-title>
<source>J Trauma</source>
<year>2010</year>
<volume>68</volume>
<fpage>761</fpage>
<lpage>70</lpage>
</element-citation></ref>
<ref id="b12-acc-2019-00780">
<label>12</label>
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name><surname>de Munter</surname><given-names>L</given-names></name>
<name><surname>Polinder</surname><given-names>S</given-names></name>
<name><surname>Lansink</surname><given-names>KW</given-names></name>
<name><surname>Cnossen</surname><given-names>MC</given-names></name>
<name><surname>Steyerberg</surname><given-names>EW</given-names></name>
<name><surname>de Jongh</surname><given-names>MA</given-names></name>
</person-group>
<article-title>Mortality prediction models in the general trauma population: a systematic review</article-title>
<source>Injury</source>
<year>2017</year>
<volume>48</volume>
<fpage>221</fpage>
<lpage>9</lpage>
</element-citation></ref>
<ref id="b13-acc-2019-00780">
<label>13</label>
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name><surname>Schluter</surname><given-names>PJ</given-names></name>
</person-group>
<article-title>Trauma and Injury Severity Score (TRISS): is it time for variable re-categorisations and re-characterisations?</article-title>
<source>Injury</source>
<year>2011</year>
<volume>42</volume>
<fpage>83</fpage>
<lpage>9</lpage>
</element-citation></ref>
<ref id="b14-acc-2019-00780">
<label>14</label>
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name><surname>Champion</surname><given-names>HR</given-names></name>
<name><surname>Copes</surname><given-names>WS</given-names></name>
<name><surname>Sacco</surname><given-names>WJ</given-names></name>
<name><surname>Lawnick</surname><given-names>MM</given-names></name>
<name><surname>Keast</surname><given-names>SL</given-names></name>
<name><surname>Bain</surname><given-names>LW</given-names><suffix>Jr</suffix></name>
<etal/>
</person-group>
<article-title>The Major Trauma Outcome Study: establishing national norms for trauma care</article-title>
<source>J Trauma</source>
<year>1990</year>
<volume>30</volume>
<fpage>1356</fpage>
<lpage>65</lpage>
</element-citation></ref>
<ref id="b15-acc-2019-00780">
<label>15</label>
<element-citation publication-type="book">
<person-group person-group-type="author">
<name><surname>Becher</surname><given-names>RD</given-names></name>
<name><surname>Meredith</surname><given-names>JW</given-names></name>
<name><surname>Kilgo</surname><given-names>PD</given-names></name>
</person-group>
<chapter-title>Injury severity scoring and outcomes research</chapter-title>
<person-group person-group-type="editor">
<name><surname>Mattox</surname><given-names>KL</given-names></name>
<name><surname>Moore</surname><given-names>EE</given-names></name>
<name><surname>Feliciano</surname><given-names>DV</given-names></name>
</person-group>
<source>Trauma</source>
<edition>7th ed</edition>
<publisher-loc>New York</publisher-loc>
<publisher-name>McGraw-Hill</publisher-name>
<year>2013</year>
<fpage>77</fpage>
<lpage>90</lpage>
</element-citation></ref>
<ref id="b16-acc-2019-00780">
<label>16</label>
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name><surname>Jung</surname><given-names>K</given-names></name>
<name><surname>Huh</surname><given-names>Y</given-names></name>
<name><surname>Lee</surname><given-names>JC</given-names></name>
<name><surname>Kim</surname><given-names>Y</given-names></name>
<name><surname>Moon</surname><given-names>J</given-names></name>
<name><surname>Youn</surname><given-names>SH</given-names></name>
<etal/>
</person-group>
<article-title>The applicability of trauma and injury severity score for a blunt trauma population in Korea and a proposal of new models using score predictors</article-title>
<source>Yonsei Med J</source>
<year>2016</year>
<volume>57</volume>
<fpage>728</fpage>
<lpage>34</lpage>
</element-citation></ref>
<ref id="b17-acc-2019-00780">
<label>17</label>
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name><surname>Jung</surname><given-names>K</given-names></name>
<name><surname>Lee</surname><given-names>JC</given-names></name>
<name><surname>Park</surname><given-names>RW</given-names></name>
<name><surname>Yoon</surname><given-names>D</given-names></name>
<name><surname>Jung</surname><given-names>S</given-names></name>
<name><surname>Kim</surname><given-names>Y</given-names></name>
<etal/>
</person-group>
<article-title>The best prediction model for trauma outcomes of the current Korean population: a comparative study of three injury severity scoring systems</article-title>
<source>Korean J Crit Care Med</source>
<year>2016</year>
<volume>31</volume>
<fpage>221</fpage>
<lpage>8</lpage>
</element-citation></ref>
<ref id="b18-acc-2019-00780">
<label>18</label>
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name><surname>Jung</surname><given-names>K</given-names></name>
<name><surname>Lee</surname><given-names>JC</given-names></name>
<name><surname>Kim</surname><given-names>J</given-names></name>
</person-group>
<article-title>Injury severity scoring system for trauma patients and trauma outcomes research in Korea</article-title>
<source>J Acute Care Surg</source>
<year>2016</year>
<volume>6</volume>
<fpage>11</fpage>
<lpage>7</lpage>
</element-citation></ref>
<ref id="b19-acc-2019-00780">
<label>19</label>
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name><surname>Park</surname><given-names>JH</given-names></name>
<name><surname>Na</surname><given-names>JY</given-names></name>
<name><surname>Lee</surname><given-names>BW</given-names></name>
<name><surname>Chung</surname><given-names>NE</given-names></name>
<name><surname>Choi</surname><given-names>YS</given-names></name>
</person-group>
<article-title>A statistical analysis on forensic autopsies performed in Korea in 2015</article-title>
<source>Korean J Leg Med</source>
<year>2016</year>
<volume>40</volume>
<fpage>104</fpage>
<lpage>18</lpage>
</element-citation></ref>
<ref id="b20-acc-2019-00780">
<label>20</label>
<element-citation publication-type="web">
<person-group person-group-type="author">
<collab>Statistics Korea</collab>
</person-group>
<article-title>Korean statistical information service [Internet]</article-title>
<publisher-loc>Daejeon</publisher-loc>
<publisher-name>Statistics Korea</publisher-name>
<year>2018</year>
<comment>[cited 2020 May 20]. Available from: <ext-link xlink:href="http://kosis.kr/publication/publicationThema.do" ext-link-type="uri">http://kosis.kr/publication/publicationThema.do</ext-link></comment>
</element-citation></ref>
<ref id="b21-acc-2019-00780">
<label>21</label>
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name><surname>Baxter</surname><given-names>J</given-names></name>
<name><surname>Cranfield</surname><given-names>KR</given-names></name>
<name><surname>Clark</surname><given-names>G</given-names></name>
<name><surname>Harris</surname><given-names>T</given-names></name>
<name><surname>Bloom</surname><given-names>B</given-names></name>
<name><surname>Gray</surname><given-names>AJ</given-names></name>
</person-group>
<article-title>Do lactate levels in the emergency department predict outcome in adult trauma patients? A systematic review</article-title>
<source>J Trauma Acute Care Surg</source>
<year>2016</year>
<volume>81</volume>
<fpage>555</fpage>
<lpage>66</lpage>
</element-citation></ref>
<ref id="b22-acc-2019-00780">
<label>22</label>
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name><surname>Lewis</surname><given-names>CT</given-names></name>
<name><surname>Naumann</surname><given-names>DN</given-names></name>
<name><surname>Crombie</surname><given-names>N</given-names></name>
<name><surname>Midwinter</surname><given-names>MJ</given-names></name>
</person-group>
<article-title>Prehospital point-of-care lactate following trauma: a systematic review</article-title>
<source>J Trauma Acute Care Surg</source>
<year>2016</year>
<volume>81</volume>
<fpage>748</fpage>
<lpage>55</lpage>
</element-citation></ref>
<ref id="b23-acc-2019-00780">
<label>23</label>
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name><surname>Parsikia</surname><given-names>A</given-names></name>
<name><surname>Bones</surname><given-names>K</given-names></name>
<name><surname>Kaplan</surname><given-names>M</given-names></name>
<name><surname>Strain</surname><given-names>J</given-names></name>
<name><surname>Leung</surname><given-names>PS</given-names></name>
<name><surname>Ortiz</surname><given-names>J</given-names></name>
<etal/>
</person-group>
<article-title>The predictive value of initial serum lactate in trauma patients</article-title>
<source>Shock</source>
<year>2014</year>
<volume>42</volume>
<fpage>199</fpage>
<lpage>204</lpage>
</element-citation></ref>
<ref id="b24-acc-2019-00780">
<label>24</label>
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name><surname>Ouellet</surname><given-names>JF</given-names></name>
<name><surname>Roberts</surname><given-names>DJ</given-names></name>
<name><surname>Tiruta</surname><given-names>C</given-names></name>
<name><surname>Kirkpatrick</surname><given-names>AW</given-names></name>
<name><surname>Mercado</surname><given-names>M</given-names></name>
<name><surname>Trottier</surname><given-names>V</given-names></name>
<etal/>
</person-group>
<article-title>Admission base deficit and lactate levels in Canadian patients with blunt trauma: are they useful markers of mortality?</article-title>
<source>J Trauma Acute Care Surg</source>
<year>2012</year>
<volume>72</volume>
<fpage>1532</fpage>
<lpage>5</lpage>
</element-citation></ref>
<ref id="b25-acc-2019-00780">
<label>25</label>
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name><surname>Vandromme</surname><given-names>MJ</given-names></name>
<name><surname>Griffin</surname><given-names>RL</given-names></name>
<name><surname>Weinberg</surname><given-names>JA</given-names></name>
<name><surname>Rue LW</surname><given-names>3rd</given-names></name>
<name><surname>Kerby</surname><given-names>JD</given-names></name>
</person-group>
<article-title>Lactate is a better predictor than systolic blood pressure for determining blood requirement and mortality: could prehospital measures improve trauma triage?</article-title>
<source>J Am Coll Surg</source>
<year>2010</year>
<volume>210</volume>
<fpage>861</fpage>
<lpage>9</lpage>
</element-citation></ref>
<ref id="b26-acc-2019-00780">
<label>26</label>
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name><surname>Callaway</surname><given-names>DW</given-names></name>
<name><surname>Shapiro</surname><given-names>NI</given-names></name>
<name><surname>Donnino</surname><given-names>MW</given-names></name>
<name><surname>Baker</surname><given-names>C</given-names></name>
<name><surname>Rosen</surname><given-names>CL</given-names></name>
</person-group>
<article-title>Serum lactate and base deficit as predictors of mortality in normotensive elderly blunt trauma patients</article-title>
<source>J Trauma</source>
<year>2009</year>
<volume>66</volume>
<fpage>1040</fpage>
<lpage>4</lpage>
</element-citation></ref>
<ref id="b27-acc-2019-00780">
<label>27</label>
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name><surname>Mizushima</surname><given-names>Y</given-names></name>
<name><surname>Ueno</surname><given-names>M</given-names></name>
<name><surname>Watanabe</surname><given-names>H</given-names></name>
<name><surname>Ishikawa</surname><given-names>K</given-names></name>
<name><surname>Matsuoka</surname><given-names>T</given-names></name>
</person-group>
<article-title>Discrepancy between heart rate and makers of hypoperfusion is a predictor of mortality in trauma patients</article-title>
<source>J Trauma</source>
<year>2011</year>
<volume>71</volume>
<fpage>789</fpage>
<lpage>92</lpage>
</element-citation></ref>
<ref id="b28-acc-2019-00780">
<label>28</label>
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name><surname>Neville</surname><given-names>AL</given-names></name>
<name><surname>Nemtsev</surname><given-names>D</given-names></name>
<name><surname>Manasrah</surname><given-names>R</given-names></name>
<name><surname>Bricker</surname><given-names>SD</given-names></name>
<name><surname>Putnam</surname><given-names>BA</given-names></name>
</person-group>
<article-title>Mortality risk stratification in elderly trauma patients based on initial arterial lactate and base deficit levels</article-title>
<source>Am Surg</source>
<year>2011</year>
<volume>77</volume>
<fpage>1337</fpage>
<lpage>41</lpage>
</element-citation></ref>
<ref id="b29-acc-2019-00780">
<label>29</label>
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name><surname>Hasler</surname><given-names>RM</given-names></name>
<name><surname>Nuesch</surname><given-names>E</given-names></name>
<name><surname>J&#x000fc;ni</surname><given-names>P</given-names></name>
<name><surname>Bouamra</surname><given-names>O</given-names></name>
<name><surname>Exadaktylos</surname><given-names>AK</given-names></name>
<name><surname>Lecky</surname><given-names>F</given-names></name>
</person-group>
<article-title>Systolic blood pressure below 110 mm Hg is associated with increased mortality in blunt major trauma patients: multicentre cohort study</article-title>
<source>Resuscitation</source>
<year>2011</year>
<volume>82</volume>
<fpage>1202</fpage>
<lpage>7</lpage>
</element-citation></ref>
<ref id="b30-acc-2019-00780">
<label>30</label>
<element-citation publication-type="journal">
<person-group person-group-type="author">
<name><surname>Hasler</surname><given-names>RM</given-names></name>
<name><surname>N&#x000fc;esch</surname><given-names>E</given-names></name>
<name><surname>J&#x000fc;ni</surname><given-names>P</given-names></name>
<name><surname>Bouamra</surname><given-names>O</given-names></name>
<name><surname>Exadaktylos</surname><given-names>AK</given-names></name>
<name><surname>Lecky</surname><given-names>F</given-names></name>
</person-group>
<article-title>Systolic blood pressure below 110 mmHg is associated with increased mortality in penetrating major trauma patients: Multicentre cohort study</article-title>
<source>Resuscitation</source>
<year>2012</year>
<volume>83</volume>
<fpage>476</fpage>
<lpage>81</lpage>
</element-citation></ref>
</ref-list>
<sec sec-type="display-objects">
<title>Figures and Tables</title>
<fig id="f1-acc-2019-00780" position="float">
<label>Figure 1.</label><caption><p>Study population. ER: emergency room; ISS: Injury Severity Score; TRISS: Trauma and Injury Severity Score.</p></caption>
<graphic xlink:href="acc-2019-00780f1.tif"/>
</fig>
<fig id="f2-acc-2019-00780" position="float">
<label>Figure 2.</label><caption><p>Trauma outcomes in relation to initial lactate levels. Patients that died and those that survived had significantly different lactate levels (P&lt;0.001).</p></caption>
<graphic xlink:href="acc-2019-00780f2.tif"/>
</fig>
<fig id="f3-acc-2019-00780" position="float">
<label>Figure 3.</label><caption><p>(A) Comparison of the areas under the receiver operator characteristic curves for mortality between the Revised Trauma Score (RTS) and other models using lactate (LA). (B) Comparison of the areas under the receiver operator characteristic curves for mortality between the Trauma and Injury Severity Score (TRISS) and other models using TRISS predictor variables plus lactate. LAG: lactate plus age; ISS: Injury Severity Score; LAGISS: LAG plus ISS; LAGRTS: LAG plus RTS; LATRISS: LA plus TRISS.</p></caption>
<graphic xlink:href="acc-2019-00780f3.tif"/>
</fig>
<table-wrap id="t1-acc-2019-00780" position="float">
<label>Table 1.</label>
<caption><p>Comparison of TRISS predictor variables and initial lactate values for the study population</p></caption>
<table rules="groups" frame="hsides">
<thead><tr>
<th align="left" valign="middle">Variable</th>
<th align="center" valign="middle">All patients (N=829)</th>
<th align="center" valign="middle">Survivor (n=650)</th>
<th align="center" valign="middle">Non-survivor (n=179)</th>
<th align="center" valign="middle">P-value</th>
</tr></thead>
<tbody>
<tr>
<td valign="top" align="left">Age (yr)</td>
<td valign="top" align="center">47 (31&#x02013;58)</td>
<td valign="top" align="center">45 (30&#x02013;56)</td>
<td valign="top" align="center">52 (36&#x02013;65)</td>
<td valign="top" align="center">&lt;0.001</td>
</tr>
<tr>
<td valign="top" align="left">&#x02003;0&#x02013;55</td>
<td valign="top" align="center">565 (68.2)</td>
<td valign="top" align="center">465 (71.5)</td>
<td valign="top" align="center">100 (55.9)</td>
<td valign="top" align="center">&lt;0.001</td>
</tr>
<tr>
<td valign="top" align="left">&#x02003;&gt;55</td>
<td valign="top" align="center">264 (31.8)</td>
<td valign="top" align="center">185 (28.5)</td>
<td valign="top" align="center">79 (44.1)</td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">ISS</td>
<td valign="top" align="center">25 (16&#x02013;29)</td>
<td valign="top" align="center">22 (16&#x02013;27)</td>
<td valign="top" align="center">29 (25&#x02013;34.75)</td>
<td valign="top" align="center">&lt;0.001</td>
</tr>
<tr>
<td valign="top" align="left">SBP at arrival (mm Hg)</td>
<td valign="top" align="center">120 (110&#x02013;139)</td>
<td valign="top" align="center">120 (101&#x02013;139)</td>
<td valign="top" align="center">110 (80&#x02013;140)</td>
<td valign="top" align="center">0.010</td>
</tr>
<tr>
<td valign="top" align="left">&#x02003;0</td>
<td valign="top" align="center">7 (0.8)</td>
<td valign="top" align="center">1 (0.2)</td>
<td valign="top" align="center">6 (3.4)</td>
<td valign="top" align="center">&lt;0.001</td>
</tr>
<tr>
<td valign="top" align="left">&#x02003;1&#x02013;49</td>
<td valign="top" align="center">3 (0.4)</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">3 (1.7)</td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">&#x02003;50&#x02013;75</td>
<td valign="top" align="center">58 (7.0)</td>
<td valign="top" align="center">31 (4.8)</td>
<td valign="top" align="center">27 (15.1)</td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">&#x02003;76&#x02013;89</td>
<td valign="top" align="center">67 (8.1)</td>
<td valign="top" align="center">49 (7.5)</td>
<td valign="top" align="center">18 (10.1)</td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">&#x02003;&gt;89</td>
<td valign="top" align="center">694 (83.7)</td>
<td valign="top" align="center">569 (87.5)</td>
<td valign="top" align="center">125 (69.8)</td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">RR at arrival (/min)</td>
<td valign="top" align="center">18 (16&#x02013;23)</td>
<td valign="top" align="center">18 (15&#x02013;22)</td>
<td valign="top" align="center">23 (16&#x02013;25)</td>
<td valign="top" align="center">0.013</td>
</tr>
<tr>
<td valign="top" align="left">&#x02003;0</td>
<td valign="top" align="center">7 (0.8)</td>
<td valign="top" align="center">1 (0.2)</td>
<td valign="top" align="center">6 (3.4)</td>
<td valign="top" align="center">&lt;0.001</td>
</tr>
<tr>
<td valign="top" align="left">&#x02003;1&#x02013;5</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">&#x02003;6&#x02013;9</td>
<td valign="top" align="center">2 (0.2)</td>
<td valign="top" align="center">1 (0.2)</td>
<td valign="top" align="center">1 (0.6)</td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">&#x02003;&gt;29</td>
<td valign="top" align="center">66 (8.0)</td>
<td valign="top" align="center">48 (7.4)</td>
<td valign="top" align="center">18 (10.1)</td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">&#x02003;10&#x02013;29</td>
<td valign="top" align="center">754 (91.0)</td>
<td valign="top" align="center">600 (92.3)</td>
<td valign="top" align="center">154 (86.0)</td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">GCS at arrival</td>
<td valign="top" align="center">15 (7.75&#x02013;15)</td>
<td valign="top" align="center">15 (11&#x02013;15)</td>
<td valign="top" align="center">6 (3&#x02013;12)</td>
<td valign="top" align="center">&lt;0.001</td>
</tr>
<tr>
<td valign="top" align="left">&#x02003;3</td>
<td valign="top" align="center">67 (8.1)</td>
<td valign="top" align="center">21 (3.2)</td>
<td valign="top" align="center">46 (25.7)</td>
<td valign="top" align="center">&lt;0.001</td>
</tr>
<tr>
<td valign="top" align="left">&#x02003;4&#x02013;5</td>
<td valign="top" align="center">62 (7.5)</td>
<td valign="top" align="center">30 (4.6)</td>
<td valign="top" align="center">32 (17.9)</td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">&#x02003;6&#x02013;8</td>
<td valign="top" align="center">101 (12.2)</td>
<td valign="top" align="center">67 (10.3)</td>
<td valign="top" align="center">34 (19.0)</td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">&#x02003;9&#x02013;12</td>
<td valign="top" align="center">106 (12.8)</td>
<td valign="top" align="center">83 (12.8)</td>
<td valign="top" align="center">23 (12.8)</td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">&#x02003;13&#x02013;15</td>
<td valign="top" align="center">493 (59.5)</td>
<td valign="top" align="center">449 (69.1)</td>
<td valign="top" align="center">44 (24.6)</td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">RTS at arrival</td>
<td valign="top" align="center">7.84 (5.97-7.84)</td>
<td valign="top" align="center">7.84 (6.82-7.84)</td>
<td valign="top" align="center">5.97 (4.23-7.7)</td>
<td valign="top" align="center">&lt;0.001</td>
</tr>
<tr>
<td valign="top" align="left">Initial lactate at ER (mmol/L)</td>
<td valign="top" align="center">2.8 (1.5&#x02013;4.6)</td>
<td valign="top" align="center">2.4 (1.3&#x02013;3.8)</td>
<td valign="top" align="center">5.5 (3.3&#x02013;7.8)</td>
<td valign="top" align="center">&lt;0.001</td>
</tr>
<tr>
<td valign="top" align="left">&#x02003;&#x02264;2.5</td>
<td valign="top" align="center">383 (46.2)</td>
<td valign="top" align="center">355 (54.6)</td>
<td valign="top" align="center">28 (15.6)</td>
<td valign="top" align="center">&lt;0.001</td>
</tr>
<tr>
<td valign="top" align="left">&#x02003;2.6&#x02013;5.0</td>
<td valign="top" align="center">264 (31.8)</td>
<td valign="top" align="center">211 (32.5)</td>
<td valign="top" align="center">53 (29.6)</td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">&#x02003;5.1&#x02013;7.5</td>
<td valign="top" align="center">120 (14.5)</td>
<td valign="top" align="center">70 (10.8)</td>
<td valign="top" align="center">50 (27.9)</td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">&#x02003;&#x02265;7.6</td>
<td valign="top" align="center">62 (7.5)</td>
<td valign="top" align="center">14 (2.2)</td>
<td valign="top" align="center">48 (26.8)</td>
<td valign="top" align="center"></td>
</tr>
</tbody></table>
<table-wrap-foot>
<fn><p>Values are presented as median (interquartile range) or number (%).</p>
<p>TRISS: Trauma and Injury Severity Score; ISS: Injury Severity Score; SBP: systolic blood pressure; RR: respiratory rate; GCS: Glasgow Coma Scale; RTS: Revised Trauma Score; ER: emergency room.</p></fn>
</table-wrap-foot>
</table-wrap>
<table-wrap id="t2-acc-2019-00780" position="float">
<label>Table 2.</label>
<caption><p>Prediction model performance for mortality</p></caption>
<table rules="groups" frame="hsides">
<thead><tr>
<th align="left" valign="middle">Prediction model and variable used in the models</th>
<th align="center" valign="middle">Discrimination AUC (95% CI<sup><xref rid="tfn1-acc-2019-00780" ref-type="table-fn">a</xref></sup>)</th>
<th align="center" valign="middle">Calibration H-L P-value</th>
<th align="center" valign="middle">Sensitivity (%)</th>
<th align="center" valign="middle">Specificity (%)</th>
<th align="center" valign="middle">Youden Index J</th>
<th align="center" valign="middle">Cutoff value</th>
</tr></thead>
<tbody>
<tr>
<td valign="top" align="left">RTS (SBP, RR, GCS)</td>
<td valign="top" align="center">0.735 (0.704&#x02013;0.765)</td>
<td valign="top" align="center">1.000</td>
<td valign="top" align="center">63.1</td>
<td valign="top" align="center">76.9</td>
<td valign="top" align="center">0.401</td>
<td valign="top" align="center">0.216</td>
</tr>
<tr>
<td valign="top" align="left">LA (lactate)</td>
<td valign="top" align="center">0.776 (0.746&#x02013;0.804)</td>
<td valign="top" align="center">1.000</td>
<td valign="top" align="center">54.8</td>
<td valign="top" align="center">87.1</td>
<td valign="top" align="center">0.418</td>
<td valign="top" align="center">0.199</td>
</tr>
<tr>
<td valign="top" align="left">LAG (lactate, age)</td>
<td valign="top" align="center">0.803 (0.774&#x02013;0.829)</td>
<td valign="top" align="center">1.000</td>
<td valign="top" align="center">67.6</td>
<td valign="top" align="center">80.0</td>
<td valign="top" align="center">0.476</td>
<td valign="top" align="center">0.149</td>
</tr>
<tr>
<td valign="top" align="left">TRISS (age, ISS, RTS)</td>
<td valign="top" align="center">0.801 (0.772&#x02013;0.828)</td>
<td valign="top" align="center">0.397</td>
<td valign="top" align="center">77.1</td>
<td valign="top" align="center">70.5</td>
<td valign="top" align="center">0.476</td>
<td valign="top" align="center">0.192</td>
</tr>
<tr>
<td valign="top" align="left">LAGISS (age, ISS, lactate)</td>
<td valign="top" align="center">0.836 (0.809&#x02013;0.861)</td>
<td valign="top" align="center">0.251</td>
<td valign="top" align="center">78.8</td>
<td valign="top" align="center">74.2</td>
<td valign="top" align="center">0.529</td>
<td valign="top" align="center">0.183</td>
</tr>
<tr>
<td valign="top" align="left">LAGRTS (age, RTS, lactate)</td>
<td valign="top" align="center">0.849 (0.823&#x02013;0.873)</td>
<td valign="top" align="center">0.183</td>
<td valign="top" align="center">83.2</td>
<td valign="top" align="center">71.9</td>
<td valign="top" align="center">0.551</td>
<td valign="top" align="center">0.170</td>
</tr>
<tr>
<td valign="top" align="left">LATRISS (age, ISS, RTS, lactate)</td>
<td valign="top" align="center">0.859 (0.833&#x02013;0.882)</td>
<td valign="top" align="center">0.603</td>
<td valign="top" align="center">86.0</td>
<td valign="top" align="center">70.8</td>
<td valign="top" align="center">0.568</td>
<td valign="top" align="center">0.150</td>
</tr>
</tbody></table>
<table-wrap-foot>
<fn><p>AUC: area under the receiver operator characteristic curve; CI: confidence interval; H-L: Hosmer and Lemeshow test; RTS: Revised Trauma Score; SBP: systolic blood pressure; RR: respiratory rate; GCS: Glasgow Coma Scale; LA: lactate; LAG: lactate plus age; TRISS: Trauma and Injury Severity Score; ISS: Injury Severity Score; LAGISS: LAG plus ISS; LAGRTS: LAG plus RTS; LATRISS: LA plus TRISS.</p></fn>
<fn id="tfn1-acc-2019-00780"><label>a</label><p>Binomial exact.</p></fn>
</table-wrap-foot>
</table-wrap>
<table-wrap id="t3-acc-2019-00780" position="float">
<label>Table 3.</label>
<caption><p>Pairwise comparisons of ROC curves for the prediction models.</p></caption>
<table rules="groups" frame="hsides">
<thead><tr>
<th align="left" valign="middle">Model</th>
<th align="center" valign="middle">Difference between the areas</th>
<th align="center" valign="middle">95% CI</th>
<th align="center" valign="middle">P-value</th>
</tr></thead>
<tbody>
<tr>
<td valign="top" align="left">RTS vs. LA</td>
<td valign="top" align="center">0.041</td>
<td valign="top" align="center">&#x02013;0.015 to 0.069</td>
<td valign="top" align="center">0.151</td>
</tr>
<tr>
<td valign="top" align="left">RTS vs. LAG</td>
<td valign="top" align="center">0.067</td>
<td valign="top" align="center">0.013 to 0.121</td>
<td valign="top" align="center">0.015<sup><xref rid="tfn2-acc-2019-00780" ref-type="table-fn">a</xref></sup></td>
</tr>
<tr>
<td valign="top" align="left">TRISS vs. LAG</td>
<td valign="top" align="center">0.001</td>
<td valign="top" align="center">&#x02013;0.044 to 0.047</td>
<td valign="top" align="center">0.952</td>
</tr>
<tr>
<td valign="top" align="left">TRISS vs. LAGISS</td>
<td valign="top" align="center">0.035</td>
<td valign="top" align="center">&#x02013;0.001 to 0.071</td>
<td valign="top" align="center">0.059</td>
</tr>
<tr>
<td valign="top" align="left">TRISS vs. LAGRTS</td>
<td valign="top" align="center">0.048</td>
<td valign="top" align="center">0.016 to 0.080</td>
<td valign="top" align="center">0.003<sup><xref rid="tfn2-acc-2019-00780" ref-type="table-fn">a</xref></sup></td>
</tr>
<tr>
<td valign="top" align="left">TRISS vs. LATRISS</td>
<td valign="top" align="center">0.057</td>
<td valign="top" align="center">0.030 to 0.085</td>
<td valign="top" align="center">&lt;0.001<sup><xref rid="tfn2-acc-2019-00780" ref-type="table-fn">a</xref></sup></td>
</tr>
<tr>
<td valign="top" align="left">LAGISS vs. LAGRTS</td>
<td valign="top" align="center">0.013</td>
<td valign="top" align="center">&#x02013;0.005 to 0.031</td>
<td valign="top" align="center">0.152</td>
</tr>
<tr>
<td valign="top" align="left">LAGISS vs. LATRISS</td>
<td valign="top" align="center">0.022</td>
<td valign="top" align="center">0.008 to 0.037</td>
<td valign="top" align="center">0.002<sup><xref rid="tfn2-acc-2019-00780" ref-type="table-fn">a</xref></sup></td>
</tr>
<tr>
<td valign="top" align="left">LAGRTS vs. LATRISS</td>
<td valign="top" align="center">0.009</td>
<td valign="top" align="center">0.001 to 0.018</td>
<td valign="top" align="center">0.027<sup><xref rid="tfn2-acc-2019-00780" ref-type="table-fn">a</xref></sup></td>
</tr>
</tbody></table>
<table-wrap-foot>
<fn><p>ROC: receiver operating characteristic; CI: confidence interval; RTS: Revised Trauma Score; LA: lactate; LAG: lactate plus age; TRISS: Trauma and Injury Severity Score; ISS: Injury Severity Score; LAGISS: LAG plus ISS; LAGRTS: LAG plus RTS; LATRISS: LA plus TRISS.</p></fn>
<fn id="tfn2-acc-2019-00780"><label>a</label><p>Statistically significant.</p></fn>
</table-wrap-foot>
</table-wrap>
</sec>
</back></article>