<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<?xml-stylesheet type="text/xsl" href="ViewNLM-v2.3.xsl"?>
<article xml:lang="EN" article-type="research-article">

<front>
<journal-meta>
<journal-id journal-id-type="nlm-ta">J Gynecol Oncol</journal-id>
<journal-id journal-id-type="publisher-id">JGO</journal-id>
<journal-title>Journal of Gynecologic Oncology</journal-title>
<issn pub-type="ppub">2005-0380</issn>
<issn pub-type="epub">2005-0399</issn>
<publisher>
<publisher-name>Korean Society of Gynecologic Oncology and Colposcopy</publisher-name>
</publisher>
</journal-meta>

<article-meta>
<article-id pub-id-type="doi">10.3802/jgo.2012.23.4.251</article-id>
<article-categories>
<subj-group>
<subject>Original Article</subject>
</subj-group>
</article-categories>
<title-group>
<article-title>How low is low enough? Evaluation of various risk-assessment models for lymph node metastasis in endometrial cancer: a Korean multicenter study</article-title>
</title-group>

<contrib-group>

<contrib contrib-type="author" corresp="yes">
<contrib-id contrib-id-type="orcid">http://orcid.org/0000-0002-8428-9555</contrib-id>
<name>
<surname>Kang</surname>
<given-names>Sokbom</given-names>
</name>
<xref ref-type="aff" rid="A1">1</xref>
</contrib>

<contrib contrib-type="author">
<name>
<surname>Lee</surname>
<given-names>Jong-Min</given-names>
</name>
<xref ref-type="aff" rid="A2">2</xref>
</contrib>

<contrib contrib-type="author">
<contrib-id contrib-id-type="orcid">http://orcid.org/0000-0003-3101-6403</contrib-id>
<name>
<surname>Lee</surname>
<given-names>Jae-Kwan</given-names>
</name>
<xref ref-type="aff" rid="A3">3</xref>
</contrib>

<contrib contrib-type="author">
<contrib-id contrib-id-type="orcid">http://orcid.org/0000-0003-1835-9436</contrib-id>
<name>
<surname>Kim</surname>
<given-names>Jae Weon</given-names>
</name>
<xref ref-type="aff" rid="A4">4</xref>
</contrib>

<contrib contrib-type="author">
<name>
<surname>Cho</surname>
<given-names>Chi-Heum</given-names>
</name>
<xref ref-type="aff" rid="A5">5</xref>
</contrib>

<contrib contrib-type="author">
<name>
<surname>Kim</surname>
<given-names>Seok-Mo</given-names>
</name>
<xref ref-type="aff" rid="A6">6</xref>
</contrib>

<contrib contrib-type="author">
<name>
<surname>Park</surname>
<given-names>Sang-Yoon</given-names>
</name>
<xref ref-type="aff" rid="A1">1</xref>
</contrib>

<contrib contrib-type="author">
<name>
<surname>Park</surname>
<given-names>Chan-Yong</given-names>
</name>
<xref ref-type="aff" rid="A7">7</xref>
</contrib>

<contrib contrib-type="author">
<name>
<surname>Kim</surname>
<given-names>Ki-Tae</given-names>
</name>
<xref ref-type="aff" rid="A8">8</xref>
</contrib>

</contrib-group>

<aff id="A1"><label>1</label>Center for Uterine Cancer, National Cancer Center, Goyang, Korea.</aff>
<aff id="A2"><label>2</label>Department of Obstetrics and Gynecology, Kyung Hee University School of Medicine, Seoul, Korea.</aff>
<aff id="A3"><label>3</label>Department of Obstetrics and Gynecology, Korea University College of Medicine, Seoul, Korea.</aff>
<aff id="A4"><label>4</label>Department of Obstetrics and Gynecology, Seoul National University College of Medicine, Seoul, Korea.</aff>
<aff id="A5"><label>5</label>Department of Obstetrics and Gynecology, Dongsan Medical Center, Keimyung University, Daegu, Korea.</aff>
<aff id="A6"><label>6</label>Department of Obstetrics and Gynecology, Chonnam National University Medical School, Gwangju, Korea.</aff>
<aff id="A7"><label>7</label>Department of Obstetrics and Gynecology, Gachon University Hospital, Incheon, Korea.</aff>
<aff id="A8"><label>8</label>Department of Obstetrics and Gynecology, Inje University Busan Paik Hospital, Busan, Korea.</aff>

<author-notes>
<corresp>Correspondence to Sokbom Kang. Center for Uterine Cancer, National Cancer Center, 323 Ilsan-ro, Ilsandong-gu, Goyang 410-769, Korea. Tel: 82-31-920-2382, Fax: 82-31-920-1238, <email>sokbom@gmail.com</email></corresp>
</author-notes>

<pub-date pub-type="ppub">
<month>10</month>
<year>2012</year>
</pub-date>
<pub-date pub-type="epub">
<day>19</day>
<month>09</month>
<year>2012</year>
</pub-date>
<volume>23</volume>
<issue>4</issue>
<fpage>251</fpage>
<lpage>256</lpage>
<history>
<date date-type="received">
<day>07</day>
<month>05</month>
<year>2012</year>
</date>
<date date-type="accepted">
<day>28</day>
<month>05</month>
<year>2012</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x00A9; 2012. Asian Society of Gynecologic Oncology, Korean Society of Gynecologic Oncology</copyright-statement>
<copyright-year>2012</copyright-year>
<license license-type="open-access" xlink:href="http://creativecommons.org/licenses/by-nc/3.0">
<p>This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (<ext-link ext-link-type="uri" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="http://creativecommons.org/licenses/by-nc/3.0/">http://creativecommons.org/licenses/by-nc/3.0/</ext-link>) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.</p>
</license>
</permissions>

<abstract>
<sec>
<title>Objective</title>
<p>The aim of this study was to identify a standard for the evaluation of future models for prediction of lymph node metastasis in endometrial cancer through estimation of performance of well-known surgicopathological models.</p>
</sec>
<sec>
<title>Methods</title>
<p>Using the medical records of 947 patients with endometrial cancer who underwent surgical management with lymphadenectomy, we retrospectively assessed the predictive performances of nodal metastasis of currently available models.</p>
</sec>
<sec>
<title>Results</title>
<p>We evaluated three models included: 1) a model modified from the Gynecologic Oncology Group (GOG) pilot study; 2) one from the GOG-33 data; and 3) one from Mayo Clinic data. The three models showed similar negative predictive values ranging from 97.1&#x0025; to 97.4&#x0025;. Using Bayes' theorem, this can be translated into 2&#x0025; of negative post-test probability when 10&#x0025; of prevalence of lymph node metastasis was assumed. In addition, although the negative predictive value was similar among these models, the proportion that was classified as low-risk was significantly different between the studies (56.4&#x0025;, 44.8&#x0025;, and 30.5&#x0025;, respectively; p&#x003C;0.001).</p>
</sec>
<sec>
<title>Conclusion</title>
<p>The current study suggests that a false negativity of 2&#x0025; or less should be a goal for determining clinical usefulness of preoperative or intraoperative prediction models for low-risk of nodal metastasis.</p>
</sec>
</abstract>

<kwd-group>
<kwd>Endometrial cancer</kwd>
<kwd>Low-risk group</kwd>
<kwd>Lymph node dissection</kwd>
<kwd>Lymphadenectomy</kwd>
<kwd>Prediction</kwd>
<kwd>Sensitivity and specificity</kwd>
</kwd-group>

</article-meta>
</front>

<body>

<sec sec-type="intro">
<title>INTRODUCTION</title>
  <p>Despite recently published randomized trials suggesting no survival benefit for routine lymphadenectomy in endometrial cancer [<xref ref-type="bibr" rid="B1">1</xref>,<xref ref-type="bibr" rid="B2">2</xref>], full pelvic and paraaortic lymphadenectomy is still recommended by many gynecologic oncologic societies and guideline committees [<xref ref-type="bibr" rid="B3">3</xref>-<xref ref-type="bibr" rid="B5">5</xref>]. However, although there is ongoing controversy concerning the benefit of routine lymphadenectomy [<xref ref-type="bibr" rid="B6">6</xref>-<xref ref-type="bibr" rid="B8">8</xref>], the general consensus is that there is a certain subset of patients in which the omission of routine lymphadenectomy may be justified [<xref ref-type="bibr" rid="B9">9</xref>-<xref ref-type="bibr" rid="B11">11</xref>].</p>
  
  <p>For several decades, researchers have proposed several models to predict patients at low-risk for nodal metastasis [<xref ref-type="bibr" rid="B12">12</xref>-<xref ref-type="bibr" rid="B15">15</xref>]. Most of these prediction models were designed using surgicopathological parameters, such as depth of myometrial invasion or pathological grade [<xref ref-type="bibr" rid="B13">13</xref>,<xref ref-type="bibr" rid="B14">14</xref>,<xref ref-type="bibr" rid="B16">16</xref>,<xref ref-type="bibr" rid="B17">17</xref>]. Therefore, it has been frequently challenged whether we can apply frozen section results in these models due to the inaccuracy of frozen section examination [<xref ref-type="bibr" rid="B18">18</xref>,<xref ref-type="bibr" rid="B19">19</xref>], and many have claimed that routine lymphadenectomy is unavoidable [<xref ref-type="bibr" rid="B20">20</xref>].</p>
  
  <p>Although many researchers have suggested several methods to identify the low-risk group of nodal metastasis before lymphadenectomy [<xref ref-type="bibr" rid="B21">21</xref>-<xref ref-type="bibr" rid="B25">25</xref>], many gynecologic oncologists are still skeptical about these results [<xref ref-type="bibr" rid="B26">26</xref>]. Moreover, there has been no consensus about the desirable performance of a prediction method. The American Society of Breast Surgeons recommended a false-negative rate of 5&#x0025; or less in order to abandon axillary dissection [<xref ref-type="bibr" rid="B27">27</xref>]. Then, how should an acceptable false-negative rate of lymph node metastasis be determined in endometrial cancer?</p>
  
  <p>To answer these questions, we began a multi-institutional, retrospective study. If we are able to estimate the innate false-negative rate of the final pathology-based models, we may also use that as a tool for determining clinical usefulness of pre- or intra-operative prediction models which are in development.</p>
</sec>

<sec sec-type="methods">
<title>MATERIALS AND METHODS</title>
<sec>
<title>1. Patient selection</title>
  <p>Using data from eight independent institutions, we retrospectively reviewed the medical records and pathological findings of patients surgically treated for endometrial cancer between 2000 and 2006. A total of 1,298 patients were identified after approval from the institutional review board. A part of the dataset has been used in previous reports; eligibility for the study and treatment strategy have been described previously [<xref ref-type="bibr" rid="B28">28</xref>]. Briefly, patients with histologically confirmed endometrial cancer who underwent surgical management, including hysterectomy, were enrolled in the study. At all institutions, patients were consecutively enrolled and defined using the selection criteria. Exclusion criteria were as follows: histologic diagnosis of sarcoma including carcinosarcoma, double primary tumor, or other metastatic cancer. Our study was designed and analyzed as recommended by the Standards for Reporting Diagnostic Accuracy Steering Group [<xref ref-type="bibr" rid="B29">29</xref>].</p>
  
  <p>As an index test, three models predicting low-risk groups based on pathologic data were used. These included the following: 1) criteria modified from the GOG pilot study suggested by Boronow et al. [<xref ref-type="bibr" rid="B12">12</xref>,<xref ref-type="bibr" rid="B13">13</xref>] (Model A) ; 2) criteria modified from the GOG-33 data suggested by Creasman et al. [<xref ref-type="bibr" rid="B14">14</xref>] (Model B) ; and 3) the Mayo clinic criteria suggested by Mariani et al. [<xref ref-type="bibr" rid="B15">15</xref>,<xref ref-type="bibr" rid="B21">21</xref>] (Model C) . Detailed descriptions of these models are summarized in <xref ref-type="table" rid="T1">Table 1</xref>.</p>
  
  <p>The reference standard was defined as the final pathologic diagnosis of the harvested lymph nodes. Central pathologic review was not performed, as pathologists from each participating center assessed lymph node status. No restriction of harvested lymph nodes was applied if one or more lymph nodes were harvested. Instead, we categorized optimal and suboptimal lymphadenectomy based on the number of harvested lymph nodes. Optimal lymphadenectomy was arbitrarily defined as more than ten harvested nodes and four or more harvested paraaortic nodes [<xref ref-type="bibr" rid="B30">30</xref>,<xref ref-type="bibr" rid="B31">31</xref>].</p>
</sec>

<sec>
<title>2. Statistical analysis</title>
  <p>All statistical analyses were performed using STATA ver. 11.0 (STATA, College Station, TX, USA). To estimate continuous variables, Student's t-test and the Wilcoxon rank-sum test were used. For categorical variables, chi-square and Fisher exact tests were used. All p-values presented are two-sided, and associations are considered significant if the p-value is &#x003C;0.05.</p>
  
  <p>To assess the performance of models predicting low-risk groups for lymph node metastasis, we selected the negative likelihood ratio (LR) as a primary endpoint [<xref ref-type="bibr" rid="B32">32</xref>,<xref ref-type="bibr" rid="B33">33</xref>]. We concluded that the negative predictive value was not an adequate endpoint, as negative predictive value is vulnerable to the prevalence of events. Using Bayes' theorem, the negative post-test probability (PTP) was derived from the negative LR based on the assumed pre-test probability of lymph node metastasis as 10&#x0025;. PTP was calculated as: post-test odds/(post-test odds+1), where post-test odds is calculated as: prevalence/(1-prevalence)&#x00D7;sensitivity/(1-specificity).</p>
</sec>
</sec>

<sec sec-type="results">
<title>RESULTS</title>
  <p>The records of 1,298 patients who received surgical management for uterine cancer were reviewed (<xref ref-type="fig" rid="F1">Fig. 1</xref>). Of the 1,298 patients, 58 patients were excluded because of a diagnosis of non-epithelial cancer including carcinosarcoma, double primary tumor, or other metastatic cancer. Furthermore, 293 patients who did not undergo lymph node dissection were excluded. The characteristics of the remaining 947 patients are summarized in <xref ref-type="table" rid="T2">Table 2</xref>. As expected, the distribution of stage, tumor grade, myometrial invasion, lymphovascular space invasion (LVSI), and extra-uterine involvement were significantly different between the lymphadenectomy versus non-lymphadenectomy groups, representing the tendency to avoid lymphadenectomy in cases with fewer risk factors.</p>
  
  <p>The negative predictive values (NPVs) and negative LRs were not statistically different among the three models (<xref ref-type="table" rid="T3">Table 3</xref>). However, the proportion of patients classified as low-risk group was significantly different among the models. Model A, which included LVSI information, identified the largest number of patients as a low-risk group (56.4&#x0025;) without hampering the negative predictive value. Model C identified the smallest low-risk group (30.5&#x0025;), although its predictive performance was similar to that of other models. In addition, using Bayes' theorem, the negative PTP could be calculated at the 10&#x0025; of assumed prevalence of lymph node metastasis (<xref ref-type="table" rid="T3">Table 3</xref>). All models indicated that false negative rate might be 2&#x0025; when the prevalence of lymph node metastasis was 10&#x0025;.</p>
</sec>

<sec sec-type="discussion">
<title>DISCUSSION</title>
  <p>In the current study, we compared the predictive performance of various prediction models to identify a low-risk group in a large cohort of patients with endometrial cancer. Several clinical implications suggested by our data are as follows.</p>
  
  <p>First, our study revealed that three models based on surgical pathology showed similar negative predictive powers. Our data suggest that the low-risk group can be identified with a false negativity rate of 2&#x0025; by final pathologic data (<xref ref-type="table" rid="T3">Table 3</xref>), regardless of the choice of prediction model. Second, although the false negativity of these models was similar, the model from the Gynecologic Oncology Group (GOG) pilot study [<xref ref-type="bibr" rid="B12">12</xref>,<xref ref-type="bibr" rid="B13">13</xref>], which included LVSI as a predictor, was able to identify the largest number of patients (56&#x0025;) as a low-risk group. The proportions of patients in the low-risk group identified using those two models (A and C) were significantly different.</p>

  <p>In summary, even with final pathologic data, the currently available prediction identifying the low-risk group of lymph node metastasis in endometrial cancer has a false negative rate about 2&#x0025; at 10&#x0025; of the assumed prevalence. Therefore, future pre-/intra-operative prediction models may be regarded as clinically useful if the model shows a false negative rate less than 2&#x0025;, when the prevalence of nodal metastasis was assumed as 10&#x0025;.</p>
</sec>

</body>

<back>

<ack>
<title>ACKNOWLEDGMENTS</title>
  <p>This study was funded by National Cancer Center, Korea (grant no. 1210200).</p>
</ack>

<fn-group>

<fn fn-type="presented-at">
  <p>Presented at the 2012 Annual Meeting of Society of Gynecologic Oncology.</p>
</fn>

<fn fn-type="conflict">
  <p>No potential conflict of interests relevant to this article was reported.</p>
</fn>

</fn-group>

    <ref-list>
  <ref id="B1">
    <label>1</label>
    <nlm-citation citation-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Benedetti Panici</surname>
          <given-names>P</given-names>
        </name>
        <name>
          <surname>Basile</surname>
          <given-names>S</given-names>
        </name>
        <name>
          <surname>Maneschi</surname>
          <given-names>F</given-names>
        </name>
        <name>
          <surname>Alberto Lissoni</surname>
          <given-names>A</given-names>
        </name>
        <name>
          <surname>Signorelli</surname>
          <given-names>M</given-names>
        </name>
        <name>
          <surname>Scambia</surname>
          <given-names>G</given-names>
        </name>
        <etal/>
      </person-group>
      <article-title>Systematic pelvic lymphadenectomy vs. no lymphadenectomy in early-stage endometrial carcinoma: randomized clinical trial</article-title>
      <source>J Natl Cancer Inst</source>
      <year>2008</year>
      <volume>100</volume>
      <fpage>1707</fpage>
      <lpage>1716</lpage>
    </nlm-citation>
  </ref>

  <ref id="B2">
    <label>2</label>
    <nlm-citation citation-type="journal">
      <collab>ASTEC study group</collab>
      <person-group person-group-type="author">
        <name>
          <surname>Kitchener</surname>
          <given-names>H</given-names>
        </name>
        <name>
          <surname>Swart</surname>
          <given-names>AM</given-names>
        </name>
        <name>
          <surname>Qian</surname>
          <given-names>Q</given-names>
        </name>
        <name>
          <surname>Amos</surname>
          <given-names>C</given-names>
        </name>
        <name>
          <surname>Parmar</surname>
          <given-names>MK</given-names>
        </name>
      </person-group>
      <article-title>Efficacy of systematic pelvic lymphadenectomy in endometrial cancer (MRC ASTEC trial): a randomised study</article-title>
      <source>Lancet</source>
      <year>2009</year>
      <volume>373</volume>
      <fpage>125</fpage>
      <lpage>136</lpage>
    </nlm-citation>
  </ref>

  <ref id="B3">
    <label>3</label>
    <nlm-citation citation-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Creasman</surname>
          <given-names>WT</given-names>
        </name>
        <name>
          <surname>Odicino</surname>
          <given-names>F</given-names>
        </name>
        <name>
          <surname>Maisonneuve</surname>
          <given-names>P</given-names>
        </name>
        <name>
          <surname>Quinn</surname>
          <given-names>MA</given-names>
        </name>
        <name>
          <surname>Beller</surname>
          <given-names>U</given-names>
        </name>
        <name>
          <surname>Benedet</surname>
          <given-names>JL</given-names>
        </name>
        <etal/>
      </person-group>
      <article-title>Carcinoma of the corpus uteri: FIGO 26th Annual Report on the Results of Treatment in Gynecological Cancer</article-title>
      <source>Int J Gynaecol Obstet</source>
      <year>2006</year>
      <volume>95</volume>
      <supplement>Suppl 1</supplement>
      <fpage>S105</fpage>
      <lpage>S143</lpage>
    </nlm-citation>
  </ref>

  <ref id="B4">
    <label>4</label>
    <nlm-citation citation-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Greer</surname>
          <given-names>BE</given-names>
        </name>
        <name>
          <surname>Koh</surname>
          <given-names>WJ</given-names>
        </name>
        <name>
          <surname>Abu-Rustum</surname>
          <given-names>N</given-names>
        </name>
        <name>
          <surname>Bookman</surname>
          <given-names>MA</given-names>
        </name>
        <name>
          <surname>Bristow</surname>
          <given-names>RE</given-names>
        </name>
        <name>
          <surname>Campos</surname>
          <given-names>SM</given-names>
        </name>
        <etal/>
      </person-group>
      <article-title>Uterine neoplasms: clinical practice guidelines in oncology</article-title>
      <source>J Natl Compr Canc Netw</source>
      <year>2009</year>
      <volume>7</volume>
      <fpage>498</fpage>
      <lpage>531</lpage>
    </nlm-citation>
  </ref>

  <ref id="B5">
    <label>5</label>
    <nlm-citation citation-type="journal">
      <collab>American College of Obstetricians and Gynecologists</collab>
      <article-title>ACOG practice bulletin, clinical management guidelines for obstetrician-gynecologists, number 65, August 2005: management of endometrial cancer</article-title>
      <source>Obstet Gynecol</source>
      <year>2005</year>
      <volume>106</volume>
      <fpage>413</fpage>
      <lpage>425</lpage>
    </nlm-citation>
  </ref>

  <ref id="B6">
    <label>6</label>
    <nlm-citation citation-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Kitchener</surname>
          <given-names>HC</given-names>
        </name>
      </person-group>
      <article-title>To stage or not to stage? That is the question: (with apologies to Shakespeare)</article-title>
      <source>Int J Gynecol Cancer</source>
      <year>2010</year>
      <volume>20</volume>
      <fpage>S55</fpage>
      <lpage>S56</lpage>
    </nlm-citation>
  </ref>

  <ref id="B7">
    <label>7</label>
    <nlm-citation citation-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Walsh</surname>
          <given-names>CS</given-names>
        </name>
        <name>
          <surname>Karlan</surname>
          <given-names>BY</given-names>
        </name>
      </person-group>
      <article-title>Lymphadenectomy's role in early endometrial cancer: prognostic or therapeutic?</article-title>
      <source>J Natl Cancer Inst</source>
      <year>2008</year>
      <volume>100</volume>
      <fpage>1660</fpage>
      <lpage>1661</lpage>
    </nlm-citation>
  </ref>

  <ref id="B8">
    <label>8</label>
    <nlm-citation citation-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Uccella</surname>
          <given-names>S</given-names>
        </name>
        <name>
          <surname>Podratz</surname>
          <given-names>KC</given-names>
        </name>
        <name>
          <surname>Aletti</surname>
          <given-names>GD</given-names>
        </name>
        <name>
          <surname>Mariani</surname>
          <given-names>A</given-names>
        </name>
      </person-group>
      <article-title>Re: Systematic pelvic lymphadenectomy vs no lymphadenectomy in early-stage endometrial carcinoma: randomized clinical trial</article-title>
      <source>J Natl Cancer Inst</source>
      <year>2009</year>
      <volume>101</volume>
      <fpage>897</fpage>
      <lpage>898</lpage>
    </nlm-citation>
  </ref>

  <ref id="B9">
    <label>9</label>
    <nlm-citation citation-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Chan</surname>
          <given-names>JK</given-names>
        </name>
        <name>
          <surname>Wu</surname>
          <given-names>H</given-names>
        </name>
        <name>
          <surname>Cheung</surname>
          <given-names>MK</given-names>
        </name>
        <name>
          <surname>Shin</surname>
          <given-names>JY</given-names>
        </name>
        <name>
          <surname>Osann</surname>
          <given-names>K</given-names>
        </name>
        <name>
          <surname>Kapp</surname>
          <given-names>DS</given-names>
        </name>
      </person-group>
      <article-title>The outcomes of 27,063 women with unstaged endometrioid uterine cancer</article-title>
      <source>Gynecol Oncol</source>
      <year>2007</year>
      <volume>106</volume>
      <fpage>282</fpage>
      <lpage>288</lpage>
    </nlm-citation>
  </ref>

  <ref id="B10">
    <label>10</label>
    <nlm-citation citation-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Trimble</surname>
          <given-names>EL</given-names>
        </name>
        <name>
          <surname>Kosary</surname>
          <given-names>C</given-names>
        </name>
        <name>
          <surname>Park</surname>
          <given-names>RC</given-names>
        </name>
      </person-group>
      <article-title>Lymph node sampling and survival in endometrial cancer</article-title>
      <source>Gynecol Oncol</source>
      <year>1998</year>
      <volume>71</volume>
      <fpage>340</fpage>
      <lpage>343</lpage>
    </nlm-citation>
  </ref>

  <ref id="B11">
    <label>11</label>
    <nlm-citation citation-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Lee</surname>
          <given-names>TS</given-names>
        </name>
        <name>
          <surname>Kim</surname>
          <given-names>JW</given-names>
        </name>
        <name>
          <surname>Kim</surname>
          <given-names>SH</given-names>
        </name>
        <name>
          <surname>Seong</surname>
          <given-names>SJ</given-names>
        </name>
        <name>
          <surname>Song</surname>
          <given-names>ES</given-names>
        </name>
        <name>
          <surname>Kim</surname>
          <given-names>JH</given-names>
        </name>
        <etal/>
      </person-group>
      <article-title>Surgical practice patterns in endometrial cancer: results of the Korean Gynecologic Oncology Group survey</article-title>
      <source>J Gynecol Oncol</source>
      <year>2009</year>
      <volume>20</volume>
      <fpage>107</fpage>
      <lpage>112</lpage>
    </nlm-citation>
  </ref>

  <ref id="B12">
    <label>12</label>
    <nlm-citation citation-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Boronow</surname>
          <given-names>RC</given-names>
        </name>
      </person-group>
      <article-title>Surgical staging of endometrial cancer: evolution, evaluation, and responsible challenge: a personal perspective</article-title>
      <source>Gynecol Oncol</source>
      <year>1997</year>
      <volume>66</volume>
      <fpage>179</fpage>
      <lpage>189</lpage>
    </nlm-citation>
  </ref>

  <ref id="B13">
    <label>13</label>
    <nlm-citation citation-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Boronow</surname>
          <given-names>RC</given-names>
        </name>
        <name>
          <surname>Morrow</surname>
          <given-names>CP</given-names>
        </name>
        <name>
          <surname>Creasman</surname>
          <given-names>WT</given-names>
        </name>
        <name>
          <surname>Disaia</surname>
          <given-names>PJ</given-names>
        </name>
        <name>
          <surname>Silverberg</surname>
          <given-names>SG</given-names>
        </name>
        <name>
          <surname>Miller</surname>
          <given-names>A</given-names>
        </name>
        <etal/>
      </person-group>
      <article-title>Surgical staging in endometrial cancer: clinical-pathologic findings of a prospective study</article-title>
      <source>Obstet Gynecol</source>
      <year>1984</year>
      <volume>63</volume>
      <fpage>825</fpage>
      <lpage>832</lpage>
    </nlm-citation>
  </ref>

  <ref id="B14">
    <label>14</label>
    <nlm-citation citation-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Creasman</surname>
          <given-names>WT</given-names>
        </name>
        <name>
          <surname>Morrow</surname>
          <given-names>CP</given-names>
        </name>
        <name>
          <surname>Bundy</surname>
          <given-names>BN</given-names>
        </name>
        <name>
          <surname>Homesley</surname>
          <given-names>HD</given-names>
        </name>
        <name>
          <surname>Graham</surname>
          <given-names>JE</given-names>
        </name>
        <name>
          <surname>Heller</surname>
          <given-names>PB</given-names>
        </name>
      </person-group>
      <article-title>Surgical pathologic spread patterns of endometrial cancer: a Gynecologic Oncology Group Study</article-title>
      <source>Cancer</source>
      <year>1987</year>
      <volume>60</volume>
      <fpage>2035</fpage>
      <lpage>2041</lpage>
    </nlm-citation>
  </ref>

  <ref id="B15">
    <label>15</label>
    <nlm-citation citation-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Mariani</surname>
          <given-names>A</given-names>
        </name>
        <name>
          <surname>Webb</surname>
          <given-names>MJ</given-names>
        </name>
        <name>
          <surname>Keeney</surname>
          <given-names>GL</given-names>
        </name>
        <name>
          <surname>Haddock</surname>
          <given-names>MG</given-names>
        </name>
        <name>
          <surname>Calori</surname>
          <given-names>G</given-names>
        </name>
        <name>
          <surname>Podratz</surname>
          <given-names>KC</given-names>
        </name>
      </person-group>
      <article-title>Low-risk corpus cancer: is lymphadenectomy or radiotherapy necessary?</article-title>
      <source>Am J Obstet Gynecol</source>
      <year>2000</year>
      <volume>182</volume>
      <fpage>1506</fpage>
      <lpage>1519</lpage>
    </nlm-citation>
  </ref>

  <ref id="B16">
    <label>16</label>
    <nlm-citation citation-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Schink</surname>
          <given-names>JC</given-names>
        </name>
        <name>
          <surname>Lurain</surname>
          <given-names>JR</given-names>
        </name>
        <name>
          <surname>Wallemark</surname>
          <given-names>CB</given-names>
        </name>
        <name>
          <surname>Chmiel</surname>
          <given-names>JS</given-names>
        </name>
      </person-group>
      <article-title>Tumor size in endometrial cancer: a prognostic factor for lymph node metastasis</article-title>
      <source>Obstet Gynecol</source>
      <year>1987</year>
      <volume>70</volume>
      <fpage>216</fpage>
      <lpage>219</lpage>
    </nlm-citation>
  </ref>

  <ref id="B17">
    <label>17</label>
    <nlm-citation citation-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Morrow</surname>
          <given-names>CP</given-names>
        </name>
        <name>
          <surname>Bundy</surname>
          <given-names>BN</given-names>
        </name>
        <name>
          <surname>Kurman</surname>
          <given-names>RJ</given-names>
        </name>
        <name>
          <surname>Creasman</surname>
          <given-names>WT</given-names>
        </name>
        <name>
          <surname>Heller</surname>
          <given-names>P</given-names>
        </name>
        <name>
          <surname>Homesley</surname>
          <given-names>HD</given-names>
        </name>
        <etal/>
      </person-group>
      <article-title>Relationship between surgical-pathological risk factors and outcome in clinical stage I and II carcinoma of the endometrium: a Gynecologic Oncology Group study</article-title>
      <source>Gynecol Oncol</source>
      <year>1991</year>
      <volume>40</volume>
      <fpage>55</fpage>
      <lpage>65</lpage>
    </nlm-citation>
  </ref>

  <ref id="B18">
    <label>18</label>
    <nlm-citation citation-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Case</surname>
          <given-names>AS</given-names>
        </name>
        <name>
          <surname>Rocconi</surname>
          <given-names>RP</given-names>
        </name>
        <name>
          <surname>Straughn</surname>
          <given-names>JM</given-names>
          <suffix>Jr</suffix>
        </name>
        <name>
          <surname>Conner</surname>
          <given-names>M</given-names>
        </name>
        <name>
          <surname>Novak</surname>
          <given-names>L</given-names>
        </name>
        <name>
          <surname>Wang</surname>
          <given-names>W</given-names>
        </name>
        <etal/>
      </person-group>
      <article-title>A prospective blinded evaluation of the accuracy of frozen section for the surgical management of endometrial cancer</article-title>
      <source>Obstet Gynecol</source>
      <year>2006</year>
      <volume>108</volume>
      <fpage>1375</fpage>
      <lpage>1379</lpage>
    </nlm-citation>
  </ref>

  <ref id="B19">
    <label>19</label>
    <nlm-citation citation-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Neubauer</surname>
          <given-names>NL</given-names>
        </name>
        <name>
          <surname>Havrilesky</surname>
          <given-names>LJ</given-names>
        </name>
        <name>
          <surname>Calingaert</surname>
          <given-names>B</given-names>
        </name>
        <name>
          <surname>Bulusu</surname>
          <given-names>A</given-names>
        </name>
        <name>
          <surname>Bernardini</surname>
          <given-names>MQ</given-names>
        </name>
        <name>
          <surname>Fleming</surname>
          <given-names>ND</given-names>
        </name>
        <etal/>
      </person-group>
      <article-title>The role of lymphadenectomy in the management of preoperative grade 1 endometrial carcinoma</article-title>
      <source>Gynecol Oncol</source>
      <year>2009</year>
      <volume>112</volume>
      <fpage>511</fpage>
      <lpage>516</lpage>
    </nlm-citation>
  </ref>

  <ref id="B20">
    <label>20</label>
    <nlm-citation citation-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Chan</surname>
          <given-names>JK</given-names>
        </name>
        <name>
          <surname>Kapp</surname>
          <given-names>DS</given-names>
        </name>
      </person-group>
      <article-title>Role of complete lymphadenectomy in endometrioid uterine cancer</article-title>
      <source>Lancet Oncol</source>
      <year>2007</year>
      <volume>8</volume>
      <fpage>831</fpage>
      <lpage>841</lpage>
    </nlm-citation>
  </ref>

  <ref id="B21">
    <label>21</label>
    <nlm-citation citation-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Mariani</surname>
          <given-names>A</given-names>
        </name>
        <name>
          <surname>Dowdy</surname>
          <given-names>SC</given-names>
        </name>
        <name>
          <surname>Cliby</surname>
          <given-names>WA</given-names>
        </name>
        <name>
          <surname>Gostout</surname>
          <given-names>BS</given-names>
        </name>
        <name>
          <surname>Jones</surname>
          <given-names>MB</given-names>
        </name>
        <name>
          <surname>Wilson</surname>
          <given-names>TO</given-names>
        </name>
        <etal/>
      </person-group>
      <article-title>Prospective assessment of lymphatic dissemination in endometrial cancer: a paradigm shift in surgical staging</article-title>
      <source>Gynecol Oncol</source>
      <year>2008</year>
      <volume>109</volume>
      <fpage>11</fpage>
      <lpage>18</lpage>
    </nlm-citation>
  </ref>

  <ref id="B22">
    <label>22</label>
    <nlm-citation citation-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Todo</surname>
          <given-names>Y</given-names>
        </name>
        <name>
          <surname>Okamoto</surname>
          <given-names>K</given-names>
        </name>
        <name>
          <surname>Hayashi</surname>
          <given-names>M</given-names>
        </name>
        <name>
          <surname>Minobe</surname>
          <given-names>S</given-names>
        </name>
        <name>
          <surname>Nomura</surname>
          <given-names>E</given-names>
        </name>
        <name>
          <surname>Hareyama</surname>
          <given-names>H</given-names>
        </name>
        <etal/>
      </person-group>
      <article-title>A validation study of a scoring system to estimate the risk of lymph node metastasis for patients with endometrial cancer for tailoring the indication of lymphadenectomy</article-title>
      <source>Gynecol Oncol</source>
      <year>2007</year>
      <volume>104</volume>
      <fpage>623</fpage>
      <lpage>628</lpage>
    </nlm-citation>
  </ref>

  <ref id="B23">
    <label>23</label>
    <nlm-citation citation-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Ballester</surname>
          <given-names>M</given-names>
        </name>
        <name>
          <surname>Dubernard</surname>
          <given-names>G</given-names>
        </name>
        <name>
          <surname>Lecuru</surname>
          <given-names>F</given-names>
        </name>
        <name>
          <surname>Heitz</surname>
          <given-names>D</given-names>
        </name>
        <name>
          <surname>Mathevet</surname>
          <given-names>P</given-names>
        </name>
        <name>
          <surname>Marret</surname>
          <given-names>H</given-names>
        </name>
        <etal/>
      </person-group>
      <article-title>Detection rate and diagnostic accuracy of sentinel-node biopsy in early stage endometrial cancer: a prospective multicentre study (SENTI-ENDO)</article-title>
      <source>Lancet Oncol</source>
      <year>2011</year>
      <volume>12</volume>
      <fpage>469</fpage>
      <lpage>476</lpage>
    </nlm-citation>
  </ref>

  <ref id="B24">
    <label>24</label>
    <nlm-citation citation-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Suh</surname>
          <given-names>DH</given-names>
        </name>
        <name>
          <surname>Kim</surname>
          <given-names>K</given-names>
        </name>
        <name>
          <surname>Kim</surname>
          <given-names>JW</given-names>
        </name>
      </person-group>
      <article-title>Major clinical research advances in gynecologic cancer in 2011</article-title>
      <source>J Gynecol Oncol</source>
      <year>2012</year>
      <volume>23</volume>
      <fpage>53</fpage>
      <lpage>64</lpage>
    </nlm-citation>
  </ref>

  <ref id="B25">
    <label>25</label>
    <nlm-citation citation-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Kang</surname>
          <given-names>S</given-names>
        </name>
        <name>
          <surname>Kang</surname>
          <given-names>WD</given-names>
        </name>
        <name>
          <surname>Chung</surname>
          <given-names>HH</given-names>
        </name>
        <name>
          <surname>Jeong</surname>
          <given-names>DH</given-names>
        </name>
        <name>
          <surname>Seo</surname>
          <given-names>SS</given-names>
        </name>
        <name>
          <surname>Lee</surname>
          <given-names>JM</given-names>
        </name>
        <etal/>
      </person-group>
      <article-title>Preoperative identification of a low-risk group for lymph node metastasis in endometrial cancer: a Korean gynecologic oncology group study</article-title>
      <source>J Clin Oncol</source>
      <year>2012</year>
      <volume>30</volume>
      <fpage>1329</fpage>
      <lpage>1334</lpage>
    </nlm-citation>
  </ref>

  <ref id="B26">
    <label>26</label>
    <nlm-citation citation-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Soliman</surname>
          <given-names>PT</given-names>
        </name>
        <name>
          <surname>Frumovitz</surname>
          <given-names>M</given-names>
        </name>
        <name>
          <surname>Spannuth</surname>
          <given-names>W</given-names>
        </name>
        <name>
          <surname>Greer</surname>
          <given-names>MJ</given-names>
        </name>
        <name>
          <surname>Sharma</surname>
          <given-names>S</given-names>
        </name>
        <name>
          <surname>Schmeler</surname>
          <given-names>KM</given-names>
        </name>
        <etal/>
      </person-group>
      <article-title>Lymphadenectomy during endometrial cancer staging: practice patterns among gynecologic oncologists</article-title>
      <source>Gynecol Oncol</source>
      <year>2010</year>
      <volume>119</volume>
      <fpage>291</fpage>
      <lpage>294</lpage>
    </nlm-citation>
  </ref>

  <ref id="B27">
    <label>27</label>
    <nlm-citation citation-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Lyman</surname>
          <given-names>GH</given-names>
        </name>
        <name>
          <surname>Giuliano</surname>
          <given-names>AE</given-names>
        </name>
        <name>
          <surname>Somerfield</surname>
          <given-names>MR</given-names>
        </name>
        <name>
          <surname>Benson</surname>
          <given-names>AB</given-names>
          <suffix>3rd</suffix>
        </name>
        <name>
          <surname>Bodurka</surname>
          <given-names>DC</given-names>
        </name>
        <name>
          <surname>Burstein</surname>
          <given-names>HJ</given-names>
        </name>
        <etal/>
      </person-group>
      <article-title>American Society of Clinical Oncology guideline recommendations for sentinel lymph node biopsy in early-stage breast cancer</article-title>
      <source>J Clin Oncol</source>
      <year>2005</year>
      <volume>23</volume>
      <fpage>7703</fpage>
      <lpage>7720</lpage>
    </nlm-citation>
  </ref>

  <ref id="B28">
    <label>28</label>
    <nlm-citation citation-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Lee</surname>
          <given-names>KB</given-names>
        </name>
        <name>
          <surname>Ki</surname>
          <given-names>KD</given-names>
        </name>
        <name>
          <surname>Lee</surname>
          <given-names>JM</given-names>
        </name>
        <name>
          <surname>Lee</surname>
          <given-names>JK</given-names>
        </name>
        <name>
          <surname>Kim</surname>
          <given-names>JW</given-names>
        </name>
        <name>
          <surname>Cho</surname>
          <given-names>CH</given-names>
        </name>
        <etal/>
      </person-group>
      <article-title>The risk of lymph node metastasis based on myometrial invasion and tumor grade in endometrioid uterine cancers: a multicenter, retrospective Korean study</article-title>
      <source>Ann Surg Oncol</source>
      <year>2009</year>
      <volume>16</volume>
      <fpage>2882</fpage>
      <lpage>2887</lpage>
    </nlm-citation>
  </ref>

  <ref id="B29">
    <label>29</label>
    <nlm-citation citation-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Bossuyt</surname>
          <given-names>PM</given-names>
        </name>
        <name>
          <surname>Reitsma</surname>
          <given-names>JB</given-names>
        </name>
        <name>
          <surname>Bruns</surname>
          <given-names>DE</given-names>
        </name>
        <name>
          <surname>Gatsonis</surname>
          <given-names>CA</given-names>
        </name>
        <name>
          <surname>Glasziou</surname>
          <given-names>PP</given-names>
        </name>
        <name>
          <surname>Irwig</surname>
          <given-names>LM</given-names>
        </name>
        <etal/>
      </person-group>
      <article-title>Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative: Standards for Reporting of Diagnostic Accuracy</article-title>
      <source>Clin Chem</source>
      <year>2003</year>
      <volume>49</volume>
      <fpage>1</fpage>
      <lpage>6</lpage>
    </nlm-citation>
  </ref>

  <ref id="B30">
    <label>30</label>
    <nlm-citation citation-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Chan</surname>
          <given-names>JK</given-names>
        </name>
        <name>
          <surname>Kapp</surname>
          <given-names>DS</given-names>
        </name>
        <name>
          <surname>Cheung</surname>
          <given-names>MK</given-names>
        </name>
        <name>
          <surname>Osann</surname>
          <given-names>K</given-names>
        </name>
        <name>
          <surname>Shin</surname>
          <given-names>JY</given-names>
        </name>
        <name>
          <surname>Cohn</surname>
          <given-names>D</given-names>
        </name>
        <etal/>
      </person-group>
      <article-title>The impact of the absolute number and ratio of positive lymph nodes on survival of endometrioid uterine cancer patients</article-title>
      <source>Br J Cancer</source>
      <year>2007</year>
      <volume>97</volume>
      <fpage>605</fpage>
      <lpage>611</lpage>
    </nlm-citation>
  </ref>

  <ref id="B31">
    <label>31</label>
    <nlm-citation citation-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Chi</surname>
          <given-names>DS</given-names>
        </name>
        <name>
          <surname>Barakat</surname>
          <given-names>RR</given-names>
        </name>
        <name>
          <surname>Palayekar</surname>
          <given-names>MJ</given-names>
        </name>
        <name>
          <surname>Levine</surname>
          <given-names>DA</given-names>
        </name>
        <name>
          <surname>Sonoda</surname>
          <given-names>Y</given-names>
        </name>
        <name>
          <surname>Alektiar</surname>
          <given-names>K</given-names>
        </name>
        <etal/>
      </person-group>
      <article-title>The incidence of pelvic lymph node metastasis by FIGO staging for patients with adequately surgically staged endometrial adenocarcinoma of endometrioid histology</article-title>
      <source>Int J Gynecol Cancer</source>
      <year>2008</year>
      <volume>18</volume>
      <fpage>269</fpage>
      <lpage>273</lpage>
    </nlm-citation>
  </ref>

  <ref id="B32">
    <label>32</label>
    <nlm-citation citation-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Jaeschke</surname>
          <given-names>R</given-names>
        </name>
        <name>
          <surname>Guyatt</surname>
          <given-names>GH</given-names>
        </name>
        <name>
          <surname>Sackett</surname>
          <given-names>DL</given-names>
        </name>
      </person-group>
      <collab>The Evidence-Based Medicine Working Group</collab>
      <article-title>Users' guides to the medical literature. III. How to use an article about a diagnostic test. B. What are the results and will they help me in caring for my patients?</article-title>
      <source>JAMA</source>
      <year>1994</year>
      <volume>271</volume>
      <fpage>703</fpage>
      <lpage>707</lpage>
    </nlm-citation>
  </ref>

  <ref id="B33">
    <label>33</label>
    <nlm-citation citation-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Jaeschke</surname>
          <given-names>R</given-names>
        </name>
        <name>
          <surname>Guyatt</surname>
          <given-names>G</given-names>
        </name>
        <name>
          <surname>Sackett</surname>
          <given-names>DL</given-names>
        </name>
      </person-group>
      <collab>Evidence-Based Medicine Working Group</collab>
      <article-title>Users' guides to the medical literature. III. How to use an article about a diagnostic test. A. Are the results of the study valid?</article-title>
      <source>JAMA</source>
      <year>1994</year>
      <volume>271</volume>
      <fpage>389</fpage>
      <lpage>391</lpage>
    </nlm-citation>
  </ref>
    </ref-list>

</back>

<floats-wrap>

<fig position="float" id="F1">
<label>Fig. 1</label>
<caption>
  <p>Flowchart of patient selection process.</p>
</caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="jgo-23-251-g001" alt-version="no"></graphic>
</fig>

<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption>
  <p>Description of three surgicopathological prediction models for the low-risk group of lymph node metastasis in endometrial cancer</p>
</caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="jgo-23-251-i001" alt-version="no"></graphic>
</table-wrap>

<table-wrap position="float" id="T2">
<label>Table 2</label>
<caption>
  <p>Characteristics of the 1,240 patients included in the analysis</p>
</caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="jgo-23-251-i002" alt-version="no"></graphic>
<table-wrap-foot>
<fn>
  <p>Values are presented as number (&#x0025;) or median (range).</p>
  <p>NA, not available.</p>
</fn>
</table-wrap-foot>
</table-wrap>

<table-wrap position="float" id="T3">
<label>Table 3</label>
<caption>
  <p>Comparison of model performance in predicting a low-risk group of nodal metastasis</p>
</caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="jgo-23-251-i003" alt-version="no"></graphic>
<table-wrap-foot>
<fn>
  <p>Values are presented as percentage (95&#x0025; confidence interval).</p>
  <p><sup>&#x002A;</sup>Comparison with model B and C yielded p&#x003C;0.001 for both comparisons (chi-square test).</p>
</fn>
</table-wrap-foot>
</table-wrap>

</floats-wrap>

</article>