<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.1 20151215//EN" "JATS-journalpublishing1.dtd">
<article xml:lang="EN" article-type="research-article">

<front>
<journal-meta>
<journal-id journal-id-type="nlm-ta">Ann Surg Treat Res</journal-id>
<journal-id journal-id-type="publisher-id">ASTR</journal-id>
<journal-title-group>
<journal-title>Annals of Surgical Treatment and Research</journal-title>
</journal-title-group>
<issn pub-type="ppub">2288-6575</issn>
<issn pub-type="epub">2288-6796</issn>
<publisher>
<publisher-name>The Korean Surgical Society</publisher-name>
</publisher>
</journal-meta>

<article-meta>
<article-id pub-id-type="doi">10.4174/astr.2019.96.4.169</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Original Article</subject>
</subj-group>
</article-categories>
<title-group>
<article-title>Nomogram for accurate prediction of breast and axillary pathologic response after neoadjuvant chemotherapy in node positive patients with breast cancer</article-title>
</title-group>

<contrib-group>

<contrib contrib-type="author">
<name>
<surname>Choi</surname>
<given-names>Hee Jun</given-names>
</name>
<xref ref-type="aff" rid="A1">1</xref>
</contrib>

<contrib contrib-type="author">
<name>
<surname>Ryu</surname>
<given-names>Jai Min</given-names>
</name>
<xref ref-type="aff" rid="A2">2</xref>
</contrib>

<contrib contrib-type="author">
<name>
<surname>Kim</surname>
<given-names>Isaac</given-names>
</name>
<xref ref-type="aff" rid="A2">2</xref>
</contrib>

<contrib contrib-type="author">
<name>
<surname>Nam</surname>
<given-names>Seok Jin</given-names>
</name>
<xref ref-type="aff" rid="A2">2</xref>
</contrib>

<contrib contrib-type="author">
<name>
<surname>Kim</surname>
<given-names>Seok Won</given-names>
</name>
<xref ref-type="aff" rid="A2">2</xref>
</contrib>

<contrib contrib-type="author">
<name>
<surname>Yu</surname>
<given-names>Jonghan</given-names>
</name>
<xref ref-type="aff" rid="A2">2</xref>
</contrib>

<contrib contrib-type="author">
<name>
<surname>Lee</surname>
<given-names>Jeong Eon</given-names>
</name>
<xref ref-type="aff" rid="A2">2</xref>
</contrib>

<contrib contrib-type="author" corresp="yes">
<contrib-id contrib-id-type="orcid" authenticated="true">https://orcid.org/0000-0003-1630-1783</contrib-id>
<name>
<surname>Lee</surname>
<given-names>Se Kyung</given-names>
</name>
<xref ref-type="aff" rid="A2">2</xref>
</contrib>

</contrib-group>

<aff id="A1"><label>1</label>Department of Surgery, Samsung Changwon Hospital, Sungkyunkwan University School of Medicine, Changwon, <country>Korea</country>.</aff>
<aff id="A2"><label>2</label>Division of Breast Surgery, Department of Surgery, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, <country>Korea</country>.</aff>

<author-notes>
<corresp>Corresponding Author: Se Kyung Lee. Division of Breast and Endocrine Surgery, Department of Surgery, Samsung Medical Center, Sungkyunkwan University School of Medicine, 81 Irwon-ro, Gangnam-gu, Seoul 06351, Korea. Tel: +82-2-3410-0051, Fax: +82-2-3410-6982, <email>sekyung.lee@samsung.com</email></corresp>
</author-notes>

<pub-date pub-type="ppub">
<month>04</month>
<year>2019</year>
</pub-date>
<pub-date pub-type="epub">
<day>28</day>
<month>03</month>
<year>2019</year>
</pub-date>
<volume>96</volume>
<issue>4</issue>
<fpage>169</fpage>
<lpage>176</lpage>

<history>
<date date-type="received">
<day>14</day>
<month>08</month>
<year>2018</year>
</date>
<date date-type="rev-recd">
<day>19</day>
<month>11</month>
<year>2018</year>
</date>
<date date-type="accepted">
<day>11</day>
<month>12</month>
<year>2018</year>
</date>
</history>

<permissions>
<copyright-statement>Copyright &#x00A9; 2019, the Korean Surgical Society</copyright-statement>
<copyright-year>2019</copyright-year>
<copyright-holder>The Korean Surgical Society</copyright-holder>
<license license-type="open-access" xlink:href="http://creativecommons.org/licenses/by-nc/4.0/">
<license-p>Annals of Surgical Treatment and Research is an Open Access Journal. All articles are distributed under the terms of the Creative Commons Attribution Non-Commercial License (<ext-link ext-link-type="uri" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="http://creativecommons.org/licenses/by-nc/4.0/">http://creativecommons.org/licenses/by-nc/4.0/</ext-link>) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
</license>
</permissions>

<abstract>
<sec>
<title>Purpose</title>
<p>Many patients with cytology proven node-positive breast cancer receive a neoadjuvant chemotherapy (NAC) treatment. We developed a nomogram to predict the breast and axillary pathologic complete responses (pCR) in patients with a cytologically proven axillary node positive breast cancer with NAC.</p>
</sec>
<sec>
<title>Methods</title>
<p>We selected 995 patients who were diagnosed with an invasive breast cancer and axillary lymph nodes metastasis, and who were treated with NAC followed by a curative surgery at the Samsung Medical Center between January 2007 and December 2014. The baseline patient and tumor characteristics, chemotherapy regimen, and tumor and nodal responses were thoroughly analyzed and reviewed. A nomogram was developed using a binary logistic regression model with a cross validation.</p>
</sec>
<sec>
<title>Results</title>
<p>Axillary pCR was achieved in 47.3% and breast pCR was achieved in 24.3% of the patients after NAC. In this case, the both pCR was associated with an initial clinical tumor stage, negative progesterone receptor status, positive human epidermal growth factor receptor 2 status, and clinical radiologic nodal responses. A nomogram was developed based on the clinical and statistically significant predictors. It had good discrimination performance (area under the curve [AUC], 0.868; 95% confidence interval, 0.84&#x2013;0.89) and calibration fit as noted in that case. The cross validation had an average AUC 0.853 (0.837&#x2013;0.869).</p>
</sec>
<sec>
<title>Conclusion</title>
<p>Our nomogram might help to predict breast and axillary pCRs after NAC in patients with an initially node-positive breast cancer. Minimal surgery might be acceptable in patients for whom the nomogram indicates a high probability of achieving pCRs.</p>
</sec>
</abstract>

<kwd-group>
<kwd>Complete response</kwd>
<kwd>Neoadjuvant treatment</kwd>
<kwd>Nomograms</kwd>
</kwd-group>

</article-meta>
</front>

<body>

<sec sec-type="intro">
<title>INTRODUCTION</title>
  <p>The use of neoadjuvant chemotherapy (NAC) is increasingly used for patients with operable breast cancer to allow for the use of more minimal surgery [<xref ref-type="bibr" rid="B1">1</xref><xref ref-type="bibr" rid="B2">2</xref>]. To avoid axillary lymph node dissection (ALND) or mastectomy, it is preferable to have a sentinel lymph node (SLN) surgical procedure or breast conserving surgery (BCS), which results in fewer instances of problems and lower morbidity [<xref ref-type="bibr" rid="B1">1</xref><xref ref-type="bibr" rid="B3">3</xref><xref ref-type="bibr" rid="B4">4</xref><xref ref-type="bibr" rid="B5">5</xref>].</p>
  <p>It should be noted that although about 30% patients had no residual disease in the axilla after NAC, ALND has been recommended for most patients with a biopsy proven node-positive breast cancer regardless of their response to NAC treatment [<xref ref-type="bibr" rid="B6">6</xref><xref ref-type="bibr" rid="B7">7</xref>]. In this case, some evidence has suggested that the nodal stage after NAC reflects the prognosis more accurately than the initial axillary status [<xref ref-type="bibr" rid="B8">8</xref>]. Therefore, the ALND may not be needed for patients with a complete response (CR). These patients are able to avoid postoperative morbidities such as lymphedema, arm pain, and reduced arm movement [<xref ref-type="bibr" rid="B9">9</xref><xref ref-type="bibr" rid="B10">10</xref>].</p>
  <p>If we can predict which patients will develop axillary pathologic complete response (pCR), we can prevent ALND and if we can predict the breast pCR, we can prevent mastectomy. Additionally, both axillary and breast pCRs after a course of NAC are associated with improved oncologic survival [<xref ref-type="bibr" rid="B11">11</xref>]. Therefore we investigated the factors that predicted both pCRs and established a nomogram calculating the probability of both pCRs in patients who received NAC.</p>
</sec>

<sec sec-type="methods">
<title>METHODS</title>
  <p>This study is a registered medical record review based on a prospectively collected database. We selected 995 patients who were diagnosed with an invasive breast cancer and axillary lymph nodes metastasis by ultrasound of axilla, and who were treated with NAC followed by curative surgery at Samsung Medical Center between the timeframe of January 2006 and December 2015. Patients were eligible if they met the following criteria: (1) diagnosed with an enlarged axillary lymph node (LN) by the use of a breast ultrasonography and by fine needle aspiration cytology upon an initial examination, (2) completed all cycles of the planned-dosage NAC, and (3) who had undergone a radical excision of a primary tumor and SLNB or ALND. Likewise, patients with bilateral breast cancer, previous ipsilateral axillary surgery, inflammatory breast cancer, or distant metastasis were excluded from the study.</p>
  <p>Most patients (95.1%) received anthracycline- and/or taxane-based regimens. These regimens included anthracycline plus cyclophosphamide, followed by anthracycline-based, taxane-based, or trastuzumab regimens. The adjuvant radiotherapy was performed with tangential fields in all patients following by a BCS.</p>
  <p>For the most part, the clinical response to treatment was evaluated by a breast magnetic resonance imaging (MRI) or a breast ultrasonography. In case of discordance between ultrasonography and MRI, we used the results of the MRI. Clinical CR of the breast was defined as a disappearance of all of the tumor deposits on a MRI or breast ultrasonography. We used RECIST (response evaluation criteria in solid tumor) criteria for clinical response evaluation. The quantification of response by using the categories of CR, partial response (PR), stable disease, and progressive disease (PD) served as a gross estimate of the chemosensitivity. And clinical nodal response was divided the categories to breast MRI or breast sonography into disappeared, decreased or no changed/increased.</p>
  <p>A sentinel node biopsy was performed with technetium-99m sulfur colloid diluted in normal saline solution and/or vital blue dye (0.8% indigo carmine). The site and timing of the agent administration were at the physician's discretion: the radiolabeled colloid was injected 2 to 6 hours before the scheduled surgery, and/or 5 mL of 0.8% indigo carmine was injected periareolarly, and the breast was massaged for 5 minutes. For the sulfur-colloid injection, a handheld gamma detection probe was used to scan the axilla transcutaneously, and was used to identify the most radioactive area. All radioactive and/or blue LNs and palpable LNs were excised and submitted as SLNs.</p>
  <p>We measured, froze, and serially sectioned the excised SLNs transversely into 16 or 24 slices. After pathological evaluation of the sections, we fixed the remaining tissue in 10% formalin, embedded it in paraffin blocks, and finally prepared the hematoxylin and eosin (H&#x0026;E)-stained sections. We designated metastatic foci of 0.2 mm to 2 mm as micrometastases, and metastatic clusters smaller than 0.2 mm were considered isolated tumor cells, whether detected by the H&#x0026;E or by the use of immunohistochemistry. All of the patients underwent a breast and axillary surgery within 6 weeks of completing the NAC. The type of breast surgery was selected according to the preferences of the surgeon and the patient.</p>
  <p>We built a nomogram based on a binary logistic regression model with the significant and predefined predictors. The model was then used to predict the probabilities of the individual patients achieving both axillary and breast pCRs to NAC. The performance of the model was quantified with respect to significant factors related to discrimination and calibration. The intolerant abilities of the model were assessed by measuring the area under the receiver-operating characteristics curve. In this case, the calibration is the agreement between the frequencies of the observed outcomes, and the probabilities predicted by the model. The calibration plot was evaluated using the Hosmer-Lemeshow goodness-of-fit test and visualized by accompanying plots. A nomogram was developed using a binary logistic regression model with a cross validation model. The cross validation has a 5-fold cross-validation model with a random split analysis in a cohort of patients. The differences were assumed to be significant when the P-value was less than 0.05. This study was approved by the Institutional Review Board of Samsung Medical Center, Seoul, Korea (approval number: 2017-09-051). Informed consent was waived because of the low risk posed by this investigation.</p>
</sec>

<sec sec-type="results">
<title>RESULTS</title>
  <p>In this study, the median age at the time of surgery was 45.8 years in age. The demographic, clinicopathological, and treatment characteristics of the patients included in this study are listed in <xref ref-type="table" rid="T1">Table 1</xref>. The axillary pCR was achieved in 47.3% (n = 472) of the patients who underwent axillary surgery after NAC. The breast pCR was achieved in 24.3% (n = 242) of the patients who underwent breast surgery. Generally speaking, both breast and axillary pCRs were achieved in 20.5% (n = 204) of the patients who underwent surgery. The patients with both pCRs tended to be estrogen receptor (ER) negative, progesterone receptor (PR) negative, human epidermal growth factor receptor 2 (HER2) positive, with high Ki-67, good tumor response, good nodal response and early clinical tumor stage as compared with the patients with a non-pCR.</p>
  <p>The both pCRs were associated with an initial clinical tumor stage, negative ER status, negative PR status, positive HER2 status, high Ki-67 (Ki-67 &#x003E; 20) and clinical radiologic nodal responses in a univariate analysis. The multivariate logistic regression analysis showed that the both pCRs were associated with initial clinical tumor stage, negative PR status, positive HER2 status, and clinical radiologic nodal responses (<xref ref-type="table" rid="T2">Table 2</xref>).</p>
  <p>We made a nomogram based on the clinically and statistically significant variables noted in this study. The significant variables that can be assessed in preoperative evaluations in the multivariate analysis were the noted years of a clinical tumor stage (cT1, cT2, cT3, or cT4), PR status (negative or positive), HER2 status (negative or positive), and the clinical radiologic nodal stage (disappeared, decreased or no changed/increased) (<xref ref-type="table" rid="T3">Table 3</xref>). In this case, <xref ref-type="fig" rid="F1">Fig. 1</xref> illustrates the nomogram to calculate the probability of achieving both pCR. The total nomogram score is calculated by summing up the scores for each of the variables. In that instance, the total score can then be used to assign a probability of achieving both pCRs to individual patients using the scale.</p>
  <p>A nomogram was developed based on the clinical and statistically significant predictors. It had good discrimination performance (AUC, 0.868; 95% CI, 0.845&#x2013;0.891) and calibration fit. The calibration plot showed a good and satisfactory agreement between the predicted and observed probabilities according to an administered Hosmer-Lemeshow test (<xref ref-type="fig" rid="F2">Fig. 2</xref>). We had 5-fold cross-validation model with a random split analysis in a cohort of patients and Cross validation who had an average of AUC 0.853 (0.837&#x2013;0.869) (<xref ref-type="fig" rid="F3">Fig. 3</xref>).</p>
</sec>

<sec sec-type="discussion">
<title>DISCUSSION</title>
  <p>Predicting pCR after NAC in patients with breast cancer and cytologically proven nodal metastasis is important for understanding and improving the patient outcomes as well as for identifying patients in whom ALND and mastectomy might be omitted as a treatment option. We performed a registered medical record review based on a prospectively collected database and made a prediction model based on the clinicopathologic characteristics of a tumor to estimate the probability of achieving breast and axillary pCR. We used a 5-fold cross-validation model in a cohort of patients. We assigned the largest value of the Youden index as the cutoff and the nomogram score was 97 points. In this cutoff, sensitivity was 91.2%, specificity was 67.2%, positive predictive value was 41.9%, negative predictive value was 96.7% and accuracy was 72.2%. The generated data demonstrated that the incidence of a low clinical T stage, negative PR, positive HER2 and clinical radiologic node response were all significant independent predictors of ypT0/ypN0 on an adjusted analysis.</p>
  <p>No association in breast and axillary pCRs was found with a clinical tumor response in our study. This may indicate that it is the degree of the initial tumor size, which predicts a known biological response in the axilla and the breast. In our study, a stable disease and a PD seemed to be a meaningless designation for comparison, because there was no case of pCR, but it was difficult to find the meaning in the analysis. Moreover, the cases of CR and PR were more than 50% in the incidence of a non-pCR. Interestingly to note, among 471 axilla pCR patients, 202 patients (42.9%) have breast and axilla pCRs. However, among the 242 breast pCR patients, 202 patients (84.2%) have breast and axilla pCRs. In line with this reasoning, only 40 patients (15.8%) indicative of breast pCR have nonaxilla pCR.</p>
  <p>During our study period, it is noted that the trastuzumab was not added to the NAC as a standard treatment in patients with HER2 positive tumors. For the most part, the neoadjuvant trastuzumab therapy was approved in late 2013 in Korea, making it a relatively new treatment option for patients requiring this treatment. Therefore, only 10.0% of the patients in our study received trastuzumab with their NAC. In addition, the patients of the HER2 positive breast cancer had 29.5% (95 of 322) both pCR but these of HER2 negative breast cancer had 16.3% (110 of 673) both pCR. The American College of Surgeons Oncology Group Z1071 trial, which reflects current chemotherapy approaches including the use of trastuzumab for patients with HER2 positive tumors, showed differential nodal responses based on the tumor biology. The overall nodal pCR was 41.1%, but this varied from 21.1% in patients with Hormone receptor (HR) positive/HER2 negative tumors, to 49.4% in patients with a triple-negative breast cancer to 64.7% in patients with HER2 positive disease (P &#x003C; 0.0001) [<xref ref-type="bibr" rid="B12">12</xref>]. Given these points, it was shown that recently a meta-analysis showed that improvement in event-free survival for pCR vs non-pCR was substantial: (HR, 0.37). This association was greater for patients with a hormone receptor-negative disease (HR, 0.29) than for those patients who had a hormone receptor-positive disease (HR, 0.52) [<xref ref-type="bibr" rid="B13">13</xref>]. Although the biologic tumor subtype was associated with pCR, we did not subsequently incorporate the biologic tumor subtype into the nomogram. Because the definition of biologic subtype varies somewhat among studies, we chose to include the receptor status (ER, PR, and HER2) of biologic subtype from the nomogram for simplicity purposes. It is important to point out that our study corroborated these findings, with a noted positive HER2 status that was strongly predictive of a tumor and axillary response.</p>
  <p>Many studies have evaluated nomograms for predicting the axillary response to NAC in node positive patients with breast cancer [<xref ref-type="bibr" rid="B14">14</xref><xref ref-type="bibr" rid="B15">15</xref><xref ref-type="bibr" rid="B16">16</xref><xref ref-type="bibr" rid="B17">17</xref>]. A recent study showed that patients with high nuclear grade (odds ratio [OR], 13.4), HER2-positive (OR, 4.7), ER- negative (OR, 3.5), or PR-negative (OR, 4.3) tumors were more likely to achieve axillary pCR [<xref ref-type="bibr" rid="B14">14</xref>]. A study of 403 patients with biopsy-confirmed axillary metastases who received NAC, showed that patients who achieved a axillary pCR had received a better 5-year overall survival (93 %) and diseasefree survival (87%) than those who had acquired the residual axillary disease (72%, 60%) [<xref ref-type="bibr" rid="B7">7</xref>]. The axillary pCR is affected by offering a better oncological outcome of the patients. However a recent study demonstrated that the pCR defined as no residual invasive cancer in the breast and axillary nodes with presence or absence of in situ cancer (ypT0/is ypN0 or ypT0 ypN0), served to provide a better association with improved outcomes as compared to eradication of an invasive tumor from the breast alone (ypT0/is) [<xref ref-type="bibr" rid="B18">18</xref>]. Therefore, the evaluation of both breast and axilla pCRs is more important than the evaluation of only the axilla pCR.</p>
  <p>Although this study was performed in a single comprehensive cancer institution located in Korea and the number of patients was relatively small, this study did not investigate clinically suspected node-positive patients, but instead investigated node-positive patients whose diagnoses were confirmed by cytology. Therefore the results from the small number of participating patients are still meaningful, and allow us to confidently draw important results. Additionally this study was not a prospective randomized clinical trial, and for that reason, the distribution of patients might be uneven and can be presumed to have had some effect on the results of the regional control. Our study did not includ the regimens commonly used for neoadjuvant, therapy of docetaxel, carboplatin, trastuzumab, and pertuzumab in HER2 positive breast cancer, since it included patients who would have been in a follow-up of patients monitored up until 2014. Also, we had 238 patients with sentinel lymph node biopsy (SLNB) try and 85 patients with SLN negative. Analyses of several prospective trials show that the accuracy of SLNB can be improved using a dual-tracer technique and the retrieval of 2 or more SLNs, with an ensured removal of the node initially confirmed to contain metastases [<xref ref-type="bibr" rid="B3">3</xref>]. Several studies currently are working on ways to ensure removal of the clipped nodes, while using techniques such as a targeted axillary dissection [<xref ref-type="bibr" rid="B4">4</xref><xref ref-type="bibr" rid="B19">19</xref><xref ref-type="bibr" rid="B20">20</xref>]. We did not perform a targeted axillary dissection in our study. If these better techniques were used, then a more accurate axillary evaluation would be possible in future studies.</p>
  <p>In conclusion, the breast and axilla pCRs are associated significantly with a low clinical T stage, negative PR, positive HER2 and a clinical radiologic node response. Our nomogram might help predict breast and axilla pCRs after NAC in patients with initially node-positive breast cancer. Patients with a high probability of achieving both breast and axillary pCRs might be candidates for less invasive surgery.</p>
</sec>

</body>

<back>

<fn-group>
<fn fn-type="conflict">
<label>CONFLICTS OF INTEREST</label>
  <p>No potential conflict of interest relevant to this article was reported.</p>
</fn>

</fn-group>

<ref-list>

  <ref id="B1">
    <label>1</label>
    <element-citation publication-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Fisher</surname>
          <given-names>B</given-names>
        </name>
        <name>
          <surname>Brown</surname>
          <given-names>A</given-names>
        </name>
        <name>
          <surname>Mamounas</surname>
          <given-names>E</given-names>
        </name>
        <name>
          <surname>Wieand</surname>
          <given-names>S</given-names>
        </name>
        <name>
          <surname>Robidoux</surname>
          <given-names>A</given-names>
        </name>
        <name>
          <surname>Margolese</surname>
          <given-names>RG</given-names>
        </name>
        <etal/>
      </person-group>
      <article-title>Effect of preoperative chemotherapy on local-regional disease in women with operable breast cancer: findings from National Surgical Adjuvant Breast and Bowel Project B-18</article-title>
      <source>J Clin Oncol</source>
      <year>1997</year>
      <volume>15</volume>
      <fpage>2483</fpage>
      <lpage>2493</lpage>
    </element-citation>
  </ref>

  <ref id="B2">
    <label>2</label>
    <element-citation publication-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Bear</surname>
          <given-names>HD</given-names>
        </name>
        <name>
          <surname>Anderson</surname>
          <given-names>S</given-names>
        </name>
        <name>
          <surname>Smith</surname>
          <given-names>RE</given-names>
        </name>
        <name>
          <surname>Geyer</surname>
          <given-names>CE</given-names>
          <suffix>Jr</suffix>
        </name>
        <name>
          <surname>Mamounas</surname>
          <given-names>EP</given-names>
        </name>
        <name>
          <surname>Fisher</surname>
          <given-names>B</given-names>
        </name>
        <etal/>
      </person-group>
      <article-title>Sequential preoperative or postoperative docetaxel added to preoperative doxorubicin plus cyclophosphamide for operable breast cancer: National Surgical Adjuvant Breast and Bowel Project Protocol B-27</article-title>
      <source>J Clin Oncol</source>
      <year>2006</year>
      <volume>24</volume>
      <fpage>2019</fpage>
      <lpage>2027</lpage>
    </element-citation>
  </ref>

  <ref id="B3">
    <label>3</label>
    <element-citation publication-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Boughey</surname>
          <given-names>JC</given-names>
        </name>
        <name>
          <surname>Suman</surname>
          <given-names>VJ</given-names>
        </name>
        <name>
          <surname>Mittendorf</surname>
          <given-names>EA</given-names>
        </name>
        <name>
          <surname>Ahrendt</surname>
          <given-names>GM</given-names>
        </name>
        <name>
          <surname>Wilke</surname>
          <given-names>LG</given-names>
        </name>
        <name>
          <surname>Taback</surname>
          <given-names>B</given-names>
        </name>
        <etal/>
      </person-group>
      <article-title>Sentinel lymph node surgery after neoadjuvant chemotherapy in patients with node-positive breast cancer: the ACOSOG Z1071 (Alliance) clinical trial</article-title>
      <source>JAMA</source>
      <year>2013</year>
      <volume>310</volume>
      <fpage>1455</fpage>
      <lpage>1461</lpage>
    </element-citation>
  </ref>

  <ref id="B4">
    <label>4</label>
    <element-citation publication-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Mittendorf</surname>
          <given-names>EA</given-names>
        </name>
        <name>
          <surname>Caudle</surname>
          <given-names>AS</given-names>
        </name>
        <name>
          <surname>Yang</surname>
          <given-names>W</given-names>
        </name>
        <name>
          <surname>Krishnamurthy</surname>
          <given-names>S</given-names>
        </name>
        <name>
          <surname>Shaitelman</surname>
          <given-names>S</given-names>
        </name>
        <name>
          <surname>Chavez-MacGregor</surname>
          <given-names>M</given-names>
        </name>
        <etal/>
      </person-group>
      <article-title>Implementation of the american college of surgeons oncology group z1071 trial data in clinical practice: is there a way forward for sentinel lymph node dissection in clinically node-positive breast cancer patients treated with neoadjuvant chemotherapy?</article-title>
      <source>Ann Surg Oncol</source>
      <year>2014</year>
      <volume>21</volume>
      <fpage>2468</fpage>
      <lpage>2473</lpage>
    </element-citation>
  </ref>

  <ref id="B5">
    <label>5</label>
    <element-citation publication-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Kim</surname>
          <given-names>KS</given-names>
        </name>
        <name>
          <surname>Kim</surname>
          <given-names>Z</given-names>
        </name>
        <name>
          <surname>Shim</surname>
          <given-names>EJ</given-names>
        </name>
        <name>
          <surname>Kim</surname>
          <given-names>NH</given-names>
        </name>
        <name>
          <surname>Jung</surname>
          <given-names>SY</given-names>
        </name>
        <name>
          <surname>Kim</surname>
          <given-names>J</given-names>
        </name>
        <etal/>
      </person-group>
      <article-title>The reality in the follow-up of breast cancer survivors: survey of Korean Breast Cancer Society</article-title>
      <source>Ann Surg Treat Res</source>
      <year>2015</year>
      <volume>88</volume>
      <fpage>133</fpage>
      <lpage>139</lpage>
    </element-citation>
  </ref>

  <ref id="B6">
    <label>6</label>
    <element-citation publication-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Shen</surname>
          <given-names>J</given-names>
        </name>
        <name>
          <surname>Gilcrease</surname>
          <given-names>MZ</given-names>
        </name>
        <name>
          <surname>Babiera</surname>
          <given-names>GV</given-names>
        </name>
        <name>
          <surname>Ross</surname>
          <given-names>MI</given-names>
        </name>
        <name>
          <surname>Meric-Bernstam</surname>
          <given-names>F</given-names>
        </name>
        <name>
          <surname>Feig</surname>
          <given-names>BW</given-names>
        </name>
        <etal/>
      </person-group>
      <article-title>Feasibility and accuracy of sentinel lymph node biopsy after preoperative chemotherapy in breast cancer patients with documented axillary metastases</article-title>
      <source>Cancer</source>
      <year>2007</year>
      <volume>109</volume>
      <fpage>1255</fpage>
      <lpage>1263</lpage>
    </element-citation>
  </ref>

  <ref id="B7">
    <label>7</label>
    <element-citation publication-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Hennessy</surname>
          <given-names>BT</given-names>
        </name>
        <name>
          <surname>Hortobagyi</surname>
          <given-names>GN</given-names>
        </name>
        <name>
          <surname>Rouzier</surname>
          <given-names>R</given-names>
        </name>
        <name>
          <surname>Kuerer</surname>
          <given-names>H</given-names>
        </name>
        <name>
          <surname>Sneige</surname>
          <given-names>N</given-names>
        </name>
        <name>
          <surname>Buzdar</surname>
          <given-names>AU</given-names>
        </name>
        <etal/>
      </person-group>
      <article-title>Outcome after pathologic complete eradication of cytologically proven breast cancer axillary node metastases following primary chemotherapy</article-title>
      <source>J Clin Oncol</source>
      <year>2005</year>
      <volume>23</volume>
      <fpage>9304</fpage>
      <lpage>9311</lpage>
    </element-citation>
  </ref>

  <ref id="B8">
    <label>8</label>
    <element-citation publication-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Rouzier</surname>
          <given-names>R</given-names>
        </name>
        <name>
          <surname>Extra</surname>
          <given-names>JM</given-names>
        </name>
        <name>
          <surname>Klijanienko</surname>
          <given-names>J</given-names>
        </name>
        <name>
          <surname>Falcou</surname>
          <given-names>MC</given-names>
        </name>
        <name>
          <surname>Asselain</surname>
          <given-names>B</given-names>
        </name>
        <name>
          <surname>Vincent-Salomon</surname>
          <given-names>A</given-names>
        </name>
        <etal/>
      </person-group>
      <article-title>Incidence and prognostic significance of complete axillary downstaging after primary chemotherapy in breast cancer patients with T1 to T3 tumors and cytologically proven axillary metastatic lymph nodes</article-title>
      <source>J Clin Oncol</source>
      <year>2002</year>
      <volume>20</volume>
      <fpage>1304</fpage>
      <lpage>1310</lpage>
    </element-citation>
  </ref>

  <ref id="B9">
    <label>9</label>
    <element-citation publication-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Mansel</surname>
          <given-names>RE</given-names>
        </name>
        <name>
          <surname>Fallowfield</surname>
          <given-names>L</given-names>
        </name>
        <name>
          <surname>Kissin</surname>
          <given-names>M</given-names>
        </name>
        <name>
          <surname>Goyal</surname>
          <given-names>A</given-names>
        </name>
        <name>
          <surname>Newcombe</surname>
          <given-names>RG</given-names>
        </name>
        <name>
          <surname>Dixon</surname>
          <given-names>JM</given-names>
        </name>
        <etal/>
      </person-group>
      <article-title>Randomized multicenter trial of sentinel node biopsy versus standard axillary treatment in operable breast cancer: the ALMANAC Trial</article-title>
      <source>J Natl Cancer Inst</source>
      <year>2006</year>
      <volume>98</volume>
      <fpage>599</fpage>
      <lpage>609</lpage>
    </element-citation>
  </ref>

  <ref id="B10">
    <label>10</label>
    <element-citation publication-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Lucci</surname>
          <given-names>A</given-names>
        </name>
        <name>
          <surname>McCall</surname>
          <given-names>LM</given-names>
        </name>
        <name>
          <surname>Beitsch</surname>
          <given-names>PD</given-names>
        </name>
        <name>
          <surname>Whitworth</surname>
          <given-names>PW</given-names>
        </name>
        <name>
          <surname>Reintgen</surname>
          <given-names>DS</given-names>
        </name>
        <name>
          <surname>Blumencranz</surname>
          <given-names>PW</given-names>
        </name>
        <etal/>
      </person-group>
      <article-title>Surgical complications associated with sentinel lymph node dissection (SLND) plus axillary lymph node dissection compared with SLND alone in the American College of Surgeons Oncology Group Trial Z0011</article-title>
      <source>J Clin Oncol</source>
      <year>2007</year>
      <volume>25</volume>
      <fpage>3657</fpage>
      <lpage>3663</lpage>
    </element-citation>
  </ref>

  <ref id="B11">
    <label>11</label>
    <element-citation publication-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Green</surname>
          <given-names>MC</given-names>
        </name>
        <name>
          <surname>Buzdar</surname>
          <given-names>AU</given-names>
        </name>
        <name>
          <surname>Smith</surname>
          <given-names>T</given-names>
        </name>
        <name>
          <surname>Ibrahim</surname>
          <given-names>NK</given-names>
        </name>
        <name>
          <surname>Valero</surname>
          <given-names>V</given-names>
        </name>
        <name>
          <surname>Rosales</surname>
          <given-names>MF</given-names>
        </name>
        <etal/>
      </person-group>
      <article-title>Weekly paclitaxel improves pathologic complete remission in operable breast cancer when compared with paclitaxel once every 3 weeks</article-title>
      <source>J Clin Oncol</source>
      <year>2005</year>
      <volume>23</volume>
      <fpage>5983</fpage>
      <lpage>5992</lpage>
    </element-citation>
  </ref>

  <ref id="B12">
    <label>12</label>
    <element-citation publication-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Boughey</surname>
          <given-names>JC</given-names>
        </name>
        <name>
          <surname>McCall</surname>
          <given-names>LM</given-names>
        </name>
        <name>
          <surname>Ballman</surname>
          <given-names>KV</given-names>
        </name>
        <name>
          <surname>Mittendorf</surname>
          <given-names>EA</given-names>
        </name>
        <name>
          <surname>Ahrendt</surname>
          <given-names>GM</given-names>
        </name>
        <name>
          <surname>Wilke</surname>
          <given-names>LG</given-names>
        </name>
        <etal/>
      </person-group>
      <article-title>Tumor biology correlates with rates of breast-conserving surgery and pathologic complete response after neoadjuvant chemotherapy for breast cancer: findings from the ACOSOG Z1071 (Alliance) Prospective Multicenter Clinical Trial</article-title>
      <source>Ann Surg</source>
      <year>2014</year>
      <volume>260</volume>
      <fpage>608</fpage>
      <lpage>614</lpage>
    </element-citation>
  </ref>

  <ref id="B13">
    <label>13</label>
    <element-citation publication-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Broglio</surname>
          <given-names>KR</given-names>
        </name>
        <name>
          <surname>Quintana</surname>
          <given-names>M</given-names>
        </name>
        <name>
          <surname>Foster</surname>
          <given-names>M</given-names>
        </name>
        <name>
          <surname>Olinger</surname>
          <given-names>M</given-names>
        </name>
        <name>
          <surname>McGlothlin</surname>
          <given-names>A</given-names>
        </name>
        <name>
          <surname>Berry</surname>
          <given-names>SM</given-names>
        </name>
        <etal/>
      </person-group>
      <article-title>Association of pathologic complete response to neoadjuvant therapy in HER2-positive breast cancer with long-term outcomes: a meta-analysis</article-title>
      <source>JAMA Oncol</source>
      <year>2016</year>
      <volume>2</volume>
      <fpage>751</fpage>
      <lpage>760</lpage>
    </element-citation>
  </ref>

  <ref id="B14">
    <label>14</label>
    <element-citation publication-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Vila</surname>
          <given-names>J</given-names>
        </name>
        <name>
          <surname>Mittendorf</surname>
          <given-names>EA</given-names>
        </name>
        <name>
          <surname>Farante</surname>
          <given-names>G</given-names>
        </name>
        <name>
          <surname>Bassett</surname>
          <given-names>RL</given-names>
        </name>
        <name>
          <surname>Veronesi</surname>
          <given-names>P</given-names>
        </name>
        <name>
          <surname>Galimberti</surname>
          <given-names>V</given-names>
        </name>
        <etal/>
      </person-group>
      <article-title>Nomograms for predicting axillary response to neoadjuvant chemotherapy in clinically node-positive patients with breast cancer</article-title>
      <source>Ann Surg Oncol</source>
      <year>2016</year>
      <volume>23</volume>
      <fpage>3501</fpage>
      <lpage>3509</lpage>
    </element-citation>
  </ref>

  <ref id="B15">
    <label>15</label>
    <element-citation publication-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Kantor</surname>
          <given-names>O</given-names>
        </name>
        <name>
          <surname>Sipsy</surname>
          <given-names>LM</given-names>
        </name>
        <name>
          <surname>Yao</surname>
          <given-names>K</given-names>
        </name>
        <name>
          <surname>James</surname>
          <given-names>TA</given-names>
        </name>
      </person-group>
      <article-title>A predictive model for axillary node pathologic complete response after neoadjuvant chemotherapy for breast cancer</article-title>
      <source>Ann Surg Oncol</source>
      <year>2018</year>
      <volume>25</volume>
      <fpage>1304</fpage>
      <lpage>1311</lpage>
    </element-citation>
  </ref>

  <ref id="B16">
    <label>16</label>
    <element-citation publication-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Kim</surname>
          <given-names>JY</given-names>
        </name>
        <name>
          <surname>Park</surname>
          <given-names>HS</given-names>
        </name>
        <name>
          <surname>Kim</surname>
          <given-names>S</given-names>
        </name>
        <name>
          <surname>Ryu</surname>
          <given-names>J</given-names>
        </name>
        <name>
          <surname>Park</surname>
          <given-names>S</given-names>
        </name>
        <name>
          <surname>Kim</surname>
          <given-names>SI</given-names>
        </name>
      </person-group>
      <article-title>Prognostic nomogram for prediction of axillary pathologic complete response after neoadjuvant chemotherapy in cytologically proven node-positive breast cancer</article-title>
      <source>Medicine (Baltimore)</source>
      <year>2015</year>
      <volume>94</volume>
      <elocation-id>e1720</elocation-id>
    </element-citation>
  </ref>

  <ref id="B17">
    <label>17</label>
    <element-citation publication-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Schipper</surname>
          <given-names>RJ</given-names>
        </name>
        <name>
          <surname>Moossdorff</surname>
          <given-names>M</given-names>
        </name>
        <name>
          <surname>Nelemans</surname>
          <given-names>PJ</given-names>
        </name>
        <name>
          <surname>Nieuwenhuijzen</surname>
          <given-names>GA</given-names>
        </name>
        <name>
          <surname>de Vries</surname>
          <given-names>B</given-names>
        </name>
        <name>
          <surname>Strobbe</surname>
          <given-names>LJ</given-names>
        </name>
        <etal/>
      </person-group>
      <article-title>A model to predict pathologic complete response of axillary lymph nodes to neoadjuvant chemo(immuno) therapy in patients with clinically node-positive breast cancer</article-title>
      <source>Clin Breast Cancer</source>
      <year>2014</year>
      <volume>14</volume>
      <fpage>315</fpage>
      <lpage>322</lpage>
    </element-citation>
  </ref>

  <ref id="B18">
    <label>18</label>
    <element-citation publication-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Cortazar</surname>
          <given-names>P</given-names>
        </name>
        <name>
          <surname>Geyer</surname>
          <given-names>CE</given-names>
          <suffix>Jr</suffix>
        </name>
      </person-group>
      <article-title>Pathological complete response in neoadjuvant treatment of breast cancer</article-title>
      <source>Ann Surg Oncol</source>
      <year>2015</year>
      <volume>22</volume>
      <fpage>1441</fpage>
      <lpage>1446</lpage>
    </element-citation>
  </ref>

  <ref id="B19">
    <label>19</label>
    <element-citation publication-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Donker</surname>
          <given-names>M</given-names>
        </name>
        <name>
          <surname>Straver</surname>
          <given-names>ME</given-names>
        </name>
        <name>
          <surname>Wesseling</surname>
          <given-names>J</given-names>
        </name>
        <name>
          <surname>Loo</surname>
          <given-names>CE</given-names>
        </name>
        <name>
          <surname>Schot</surname>
          <given-names>M</given-names>
        </name>
        <name>
          <surname>Drukker</surname>
          <given-names>CA</given-names>
        </name>
        <etal/>
      </person-group>
      <article-title>Marking axillary lymph nodes with radioactive iodine seeds for axillary staging after neoadjuvant systemic treatment in breast cancer patients: the MARI procedure</article-title>
      <source>Ann Surg</source>
      <year>2015</year>
      <volume>261</volume>
      <fpage>378</fpage>
      <lpage>382</lpage>
    </element-citation>
  </ref>

  <ref id="B20">
    <label>20</label>
    <element-citation publication-type="journal">
      <person-group person-group-type="author">
        <name>
          <surname>Caudle</surname>
          <given-names>AS</given-names>
        </name>
        <name>
          <surname>Yang</surname>
          <given-names>WT</given-names>
        </name>
        <name>
          <surname>Krishnamurthy</surname>
          <given-names>S</given-names>
        </name>
        <name>
          <surname>Mittendorf</surname>
          <given-names>EA</given-names>
        </name>
        <name>
          <surname>Black</surname>
          <given-names>DM</given-names>
        </name>
        <name>
          <surname>Gilcrease</surname>
          <given-names>MZ</given-names>
        </name>
        <etal/>
      </person-group>
      <article-title>Improved axillary evaluation following neoadjuvant therapy for patients with node-positive breast cancer using selective evaluation of clipped nodes: implementation of targeted axillary dissection</article-title>
      <source>J Clin Oncol</source>
      <year>2016</year>
      <volume>34</volume>
      <fpage>1072</fpage>
      <lpage>1078</lpage>
    </element-citation>
  </ref>

</ref-list>

</back>

<floats-group>

<fig position="float" id="F1">
<label>Fig. 1</label>
<caption>
  <title>Nomogram for the prediction of the probability of the pathologic complete response. PR, progesterone receptor; HER2, human epidermal growth factor receptor 2.</title>
</caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="astr-96-169-g001"></graphic>
</fig>

<fig position="float" id="F2">
<label>Fig. 2</label>
<caption>
  <title>The receiver-operating characteristics (ROC) curve and the calibration plot of the nomogram in the training set. (A) ROC curve with area under the curve = 0.868 (95% confidence interval, 0.845&#x2013;0.891). (B) Calibration plot of the nomogram.</title>
</caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="astr-96-169-g002"></graphic>
</fig>

<fig position="float" id="F3">
<label>Fig. 3</label>
<caption>
  <title>The receiver-operating characteristics (ROC) curve of the nomogram in the cross-validation set. (A) ROC curve with area under the curve = 0.853 (95% confidence interval, 0.837&#x2013;0.869). (B) Calibration plot of the nomogram.</title>
</caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="astr-96-169-g003"></graphic>
</fig>

<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption>
  <title>Baseline patient and tumor characteristic of 995 patients treated with neoadjuvant chemotherapy</title>
</caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="astr-96-169-i001"></graphic>
<table-wrap-foot>
<fn>
  <p>Values are presented as number (%).</p>
  <p>pCR, pathologic complete response; HER2, human epidermal growth factor receptor 2; NAC, neoadjuvant chemotherapy.</p>
</fn>
</table-wrap-foot>
</table-wrap>

<table-wrap position="float" id="T2">
<label>Table 2</label>
<caption>
  <title>Univariate and multivariate analysis for both pathologic complete response</title>
</caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="astr-96-169-i002"></graphic>
<table-wrap-foot>
<fn>
  <p>OR, odds ratio; CI, confidence interval; HER2, human epidermal growth factor receptor 2.</p>
</fn>
</table-wrap-foot>
</table-wrap>

<table-wrap position="float" id="T3">
<label>Table 3</label>
<caption>
  <title>Model development of risk point</title>
</caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="astr-96-169-i003"></graphic>
<table-wrap-foot>
<fn>
  <p>PR, progesterone receptor; HER2, human epidermal growth factor receptor 2.</p>
</fn>
</table-wrap-foot>
</table-wrap>

</floats-group>

</article>