Annals of Surgical Oncology Sign the Guestbook
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS

Originally published as Ann Surg Oncol Early Release 10.1245/ASO.2003.03.015 on November 10, 2003

Annals of Surgical Oncology 10:1140-1151 (2003)
© 2003 Society of Surgical Oncology
This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Van Zee, K. J.
Right arrow Articles by Kattan, M. W.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Van Zee, K. J.
Right arrow Articles by Kattan, M. W.
Related Collections
Right arrow Sentinel lymph node

ORIGINAL ARTICLES

A Nomogram for Predicting the Likelihood of Additional Nodal Metastases in Breast Cancer Patients With a Positive Sentinel Node Biopsy

Kimberly J. Van Zee, MS, MD, Donna-Marie E. Manasseh, MD, Jose L. B. Bevilacqua, MD, Susan K. Boolbol, MD, Jane V. Fey, MPH, Lee K. Tan, MD, Patrick I. Borgen, MD, Hiram S. Cody, III, MD and Michael W. Kattan, PhD

From the Departments of Surgery (KJVZ, DMEM, JLBB, SKB, JVF, PIB, HSC), Pathology (LKT), and Urology, Epidemiology and Biostatistics (MWK), Memorial Sloan-Kettering Cancer Center, New York, New York.

Correspondence: Address correspondence and reprint requests to: Kimberly J. Van Zee, MS, MD, FACS, 1275 York Ave., MRI-1026, New York, NY 10021; Fax: 212-794–5812; E-mail: vanzeek{at}mskcc.org


    ABSTRACT
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
Background: The standard of care for breast cancer patients with sentinel lymph node (SLN) metastases includes complete axillary lymph node dissection (ALND). However, many question the need for complete ALND in every patient with detectable SLN metastases, particularly those perceived to have a low risk of non-SLN metastases. Accurate estimates of the likelihood of additional disease in the axilla could assist greatly in decision-making regarding further treatment.

Methods: Pathological features of the primary tumor and SLN metastases of 702 patients who underwent complete ALND were assessed with multivariable logistic regression to predict the presence of additional disease in the non-SLNs of these patients. A nomogram was created using pathological size, tumor type and nuclear grade, lymphovascular invasion, multifocality, and estrogen-receptor status of the primary tumor; method of detection of SLN metastases; number of positive SLNs; and number of negative SLNs. The model was subsequently applied prospectively to 373 patients.

Results: The nomogram for the retrospective population was accurate and discriminating, with an area under the receiver operating characteristic (ROC) curve of 0.76. When applied to the prospective group, the model accurately predicted likelihood of non-SLN disease (ROC, 0.77).

Conclusions: We have developed a user-friendly nomogram that uses information commonly available to the surgeon to easily and accurately calculate the likelihood of having additional, non-SLN metastases for an individual patient.

Key Words: Axillary metastases • Breast cancer • Nomogram • Prediction • Sentinel node


    INTRODUCTION
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
The sentinel lymph node (SLN) biopsy procedure has been validated by numerous studies1–6 and found to be accurate for assessing regional lymph node involvement. For those whose SLN biopsy specimen is histopathologically negative, the risk of "missed" axillary disease is extremely low.7,8 Therefore, SLN biopsy alone, without complete axillary lymph node dissection (ALND), has been adopted at many institutions as an accurate method of staging the axilla while avoiding much of the morbidity associated with a complete ALND. Although the standard of care for breast cancer patients with SLN metastases remains performance of complete ALND, many question the need for complete ALND in every patient with detectable SLN metastases, particularly those in whom the perceived risk of additional disease is low.9,10

Proponents of performance of completion ALND after a positive SLN biopsy argue that further axillary clearance is critical to management. The total number of involved nodes is important prognostic information, as an increasing number of positive nodes portends worse survival.11–13 This is reflected in the new American Joint Committee on Cancer (AJCC) sixth edition staging system, wherein the number of positive nodes defines N1, N2, and N3 disease and ultimately the stage to which the patient is assigned.14 In addition, proponents of the performance of complete ALND after positive SLN biopsy argue that the additional information can benefit patients by guiding decisions about adjuvant chemotherapy. For the approximately one-half of patients in whom there is residual nodal disease, it is also argued that complete ALND can influence survival via local-regional control of the axilla,15–17 thereby eliminating a potential site of recurrent disease and, ultimately, a source for distant disease. A meta-analysis of randomized trials revealed a 5.4% survival benefit associated with ALND for clinically node-negative patients.18

Opponents of complete ALND performed after positive SLN biopsy argue that the therapeutic benefit of complete ALND is minimal.19 Furthermore, approximately 50% of patients with positive SLNs are found to have no other nodal metastases.1–6,20–24 Therefore, many patients are undergoing unnecessary ALND, with no additional therapeutic benefit or further staging information provided. It is also argued that because patients with SLN metastases will generally receive systemic therapy, regardless of the presence of any additional nodal metastases, any residual disease does not influence choice of therapy and may itself be eradicated by the systemic therapy. In addition, radiation therapy after breast-conserving surgery may contribute to control of any additional nodal disease. It is this debate that physicians and their patients are faced with in the office setting when a positive SLN is discovered on final pathology.

Several groups have identified histopathological variables of the primary tumor and its metastasis that can influence risk of additional disease in the non-SLNs9,10,21–29 (Table 1). Size of the primary tumor and size of the SLN metastasis are the two variables most commonly analyzed. Previous investigation at our institution found that size of the primary tumor and of the SLN metastasis are significantly predictive of likelihood of additional, non-SLN metastases.26 Most other studies that examined at least one of these two variables showed a statistically significant correlation with risk of additional, non-SLN disease,9,10,21–25,27–29 yet most have not been able to identify a subset that has no risk of additional disease in the non-SLNs.10,22–24,27,28,30 Those studies that have identified favorable subsets with an apparently negligible risk of additional nodal disease have all involved very small subsets (i.e., 5–24 patients).9,21,26,30–32


View this table:
[in this window]
[in a new window]
 
TABLE 1. Studies reporting predictors of non-SLN metastases in patients with a positive SLN biopsy; values listed are P values reported in study
 
Furthermore, it is difficult to estimate the risk of additional, non-SLN metastases for an individual patient by using the literature. First, the estimates of risk for any given characteristic vary considerably among studies. Tables 2 through 5GoGoGo show reported incidences by primary tumor size, presence of lymphovascular invasion (LVI) in the primary tumor size of SLN metastasis, and presence of immunohistochemically (IHC-) detected SLN metastases. This variation in reported incidences may be attributable to relatively small sample sizes or the result of differences among the study populations in terms of other variables influencing risk. Second, it is difficult to apply risk estimates to several patient characteristics simultaneously because of the generally univariate method of reporting in the literature.


View this table:
[in this window]
[in a new window]
 
TABLE 2. Studies reporting incidence of non-SLN metastases in axillae with positive SLN(s), by primary tumor size
 

View this table:
[in this window]
[in a new window]
 
TABLE 3. Studies reporting incidence of non-SLN metastases in axillae with positive SLN(s), by presence of LVI in primary tumor
 

View this table:
[in this window]
[in a new window]
 
TABLE 4. Studies reporting incidence of non-SLN metastases in axillae with positive SLN(s), by size of SLN metastasis
 

View this table:
[in this window]
[in a new window]
 
TABLE 5. Studies reporting incidence of non-SLN metastases in patients with IHC-detected SLN metastases
 
In an attempt to achieve a more precise prediction for the individual patient than is readily available by using these published estimates of risk, we used a multivariable logistic-regression analysis of a large data set to model the association between selected variables and the likelihood of metastases in non-SLNs in patients with a positive SLN biopsy. We examined pathological size of the primary tumor, the method of detection of the SLN metastasis, and several other variables that are readily available and theoretically related to risk of additional nodal disease. We used 702 cases from our large prospective sentinel lymph node database to develop the model, and we developed a user-friendly nomogram to predict the likelihood of finding additional positive nodes at completion ALND. We then tested our model by prospectively applying it in an additional study group comprising 373 patients.

The goal of our study was to develop a tool that would allow greater individualization of a patient’s risk estimate by simultaneously taking into account several pertinent characteristics specific to the patient. With a more precise and individualized estimate, both physician and patient would be better able to weigh the pros and cons of further axillary dissection.


    MATERIALS AND METHODS
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
Between September 12, 1996, and September 20, 2002, 4790 consecutive cases of SLN biopsy at Memorial Sloan-Kettering Cancer Center (MSKCC) were entered prospectively into the MSKCC Breast Cancer Sentinel Lymph Node Database. Our study population involved the subset of 1075 cases that fulfilled the following criteria: primary invasive breast carcinoma with clinically negative axilla and no prior systemic treatment; successful SLN biopsy in which metastatic disease was identified; and completion ALND with at least 10 nodes examined. A total of 140 cases were excluded because a completion ALND was not performed. The overall study population comprised the patients meeting the selection criteria, who were then divided into two groups: a retrospective group who had undergone SLN biopsy between September 12, 1996, and April 24, 2001, and a prospective group undergoing SLN biopsy between April 25, 2001, and September 20, 2002. This project was reviewed and approved by the MSKCC Institutional Review Board.

Our technique for SLN biopsy includes the use of both blue dye and radioisotope, as previously outlined in earlier studies at our institution.33

SLN Histopathological Evaluation
Whenever possible, the SLN was bisected and sectioned at 2–3-mm intervals. The nodal tissue was quick-frozen in liquid nitrogen, and a single 5-µm-thick section stained with hematoxylin and eosin (H&E) was examined intraoperatively (frozen-section analysis). If the section was positive, a complete ALND was done immediately. After the frozen-section analysis, the remaining frozen tissue was fixed in formalin and embedded in paraffin. Another 5-µm-thick H&E-stained section was evaluated as a frozen-section control (routine histopathology). If this section showed evidence of metastatic disease, no further pathological workup of the SLN was performed. If the routine H&E section remained negative, enhanced pathological analysis was performed in the following fashion: two pairs of H&E- and cytokeratin IHC–stained sections with a distance of 50 µm between the pairs were prepared from the paraffin block. At one level, the cytokeratin antibody CAM 5.2 (Becton Dickinson Immunocytometry Systems, San Jose, CA) was used, whereas the cytokeratin cocktail AE1:AE3 (Ventana Medical Systems, Tucson, AZ) was applied for the other level. Patients with SLN metastases not detected by frozen-section analysis generally underwent completion ALND at a later date. For all additional nodes identified by completion ALND, routine H&E analysis was done on a single section of each node.

Data Analysis
Clinical data collected for each case from the database included age; pathological size of the invasive carcinoma, defined in centimeters; tumor type (ductal or lobular carcinoma); nuclear grade (I: slight or no variation in size and shape of nucleus; II: moderate variation in size and shape; III: marked variation in size and shape); presence of lymphovascular invasion (presence of one or more tumor cells in a lymphatic or vascular structure); multifocality of primary tumor (foci of carcinoma separate from primary tumor); estrogen-receptor (ER) status (negative, <10% of cells staining positive); method of detection of SLN metastases (frozen-section analysis [frozen], routine histopathology [routine], H&E stains of serial sections [serial HE], IHC); number of positive SLNs; and number of negative SLNs. Because lobular carcinomas generally are not assigned a nuclear grade, the tumor type and nuclear grade were combined into the following four categories: ductal carcinoma, nuclear grade I; ductal carcinoma, nuclear grade II; ductal carcinoma, nuclear grade III; and lobular carcinoma. To allow use of our model by groups that do not routinely perform frozen-section analysis, a second model was developed with only three levels for the method of detection variable: routine histopathology (routine), serial sectioning (serial HE), and immunohistochemistry (IHC). In this model, a node in which metastatic disease was detected by either frozen-section analysis or routine histopathology was categorized as routine. Data on additional variables such as progesterone-receptor status, histologic grade, and AJCC T stage were also collected; however, because these variables are highly correlated with ER status, nuclear grade, and pathological size, respectively, they were not considered to be of substantial benefit to the model. HER-2/neu amplification data were also collected but were not included because they were incomplete and variable, owing to evolving methods of assessment during the years of the study.

A nomogram was developed based on the patients in the retrospective group and then was validated with the patients in the prospective group. In the retrospective population (n = 702), multivariable logistic regression was used to analyze the association of each variable with the likelihood of non-SLN metastases, and a nomogram was created with all variables. This model was used in the prospective group (n = 373) to predict each individual patient’s probability of having positive non-SLNs. The discrimination of the model was measured by using the area under the receiver operating characteristic (ROC) curve. The calibration of the model was assessed graphically. Women were grouped into deciles based on their nomogram predictions. For each decile, the mean nomogram-predicted probability was compared with the proportion of women who actually had positive non-SLNs (actual probability). All analyses were performed with S-Plus Software Version 2000 Professional Edition with the Design Library (Mathsoft, Data Analysis Products Division, Seattle, WA).34


    RESULTS
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
Descriptive characteristics of the study population are listed in Table 6. Table 7 shows the incidence of additional, non-SLN metastases for retrospective, prospective, and total patient populations by primary and SLN pathological characteristics. On multivariable logistic-regression analysis, pathological size, lymphovascular invasion, method of detection, number of positive SLNs, and number of negative SLNs were each associated with the likelihood of additional, non-SLN metastases (P < .05 for each). Multifocality was of borderline significance, and neither tumor type and nuclear grade nor ER status had a statistically significant association with the likelihood of non-SLN metastases (Tables 8 and 9Go). Age was not included in the final nomograms because its effect was too small to be seen on the nomograms.


View this table:
[in this window]
[in a new window]
 
TABLE 6. Descriptive characteristics of the retrospective (9/12/1996–4/24/2001) and prospective (4/25/2001–9/20/2002) patient populations
 

View this table:
[in this window]
[in a new window]
 
TABLE 7. Incidence of additional, non-SLN metastases for retrospective and prospective patient populations, by primary and SLN pathologic characteristics
 

View this table:
[in this window]
[in a new window]
 
TABLE 8. Results of multivariable logistic-regression analysis testing the relationship between primary tumor and SLN characteristics and the incidence of additional, non-SLN metastases
 

View this table:
[in this window]
[in a new window]
 
TABLE 9. Results of multivariable logistic-regression analysis testing the relationship between primary tumor and SLN characteristics and the incidence of non-SLN metastasesa
 
A nomogram based on this model and developed in the retrospective population (n = 702) appears in Figure 1. The overall predictive accuracy of a model incorporating the eight variables, as measured by the bootstrap corrected ROC curve, was 0.76. To address the calibration accuracy of the nomogram (i.e., the absolute error of its prediction), we conducted additional bootstrapping and plotted the probabilities predicted by the nomogram against the corresponding observed proportions in the prospective population (n = 373) (Fig. 2). The area under the ROC curve for the model applied to the prospective population is 0.77. For those users who do not routinely perform frozen-section analysis on the SLN, a separate analysis without frozen-section information was performed and illustrated in the nomogram in Figure 3. The ROC of this version of the nomogram is 0.75 in the retrospective population and 0.78 in the prospective population; the corresponding calibration curve is depicted in Figure 4.



View larger version (18K):
[in this window]
[in a new window]
 
FIG. 1. Nomogram to predict likelihood of additional, non-sentinel lymph node (non-SLN) metastases in a patient with a positive SLN. NUCGRADE, tumor type and nuclear grade (ductal, nuclear grade I; ductal, nuclear grade II; ductal, nuclear grade III; lobular); LVI, lymphovascular invasion; MULTIFOCAL, multifocality of primary tumor; ER, estrogen-receptor status; NUMNEGSLN, number of negative SLNs; NUMSLNPOS, number of positive SLNs; PATHSIZE, pathological size, defined in centimeters; and METHDETECT, method of detection of SLN metastases (frozen, routine H&E, serial HE, IHC). The first row (POINTS) is the point assignment for each variable. Rows 2–9 represent the variables included in the model. For an individual patient, each variable is assigned a point value (uppermost scale, POINTS) based on the histopathological characteristics. A vertical line is made between the appropriate variable value and the POINTS line. The assigned points for all eight variables are summed, and the total is found in row 10 (TOTAL POINTS). Once the total is located, a vertical line is made between TOTAL POINTS and the final row, Row 11 (Predicted Probability of +non-SLN).

 


View larger version (15K):
[in this window]
[in a new window]
 
FIG. 2. Calibration plot for nomogram with frozen section information. The nomogram developed with use of the retrospective group of patients (n = 702) was applied to the prospective group (n = 373). A histogram of the calculated probabilities for the prospective population is shown along the horizontal axis. These 373 patients are grouped in deciles of their predicted probabilities, and the actual incidence of additional, non-SLN metastases was calculated for each decile. The vertical axis represents the actual, observed incidence (Actual Probability), and the horizontal axis represents the probability calculated by the nomogram (Predicted Probability). For each decile of the prospective group, a triangle is plotted to show actual probability. If the model were perfect, all triangles would lie on the dotted line, with a slope of 1.

 


View larger version (19K):
[in this window]
[in a new window]
 
FIG. 3. Nomogram without frozen-section information, for use when frozen-section analysis is not done at the time of sentinel lymph node (SLN) biopsy. See Figure 1 legend for instructions on nomogram use. Routine, routine H&E.

 


View larger version (15K):
[in this window]
[in a new window]
 
FIG. 4. Calibration plot for nomogram without frozen section data. The nomogram developed with use of the retrospective group of patients (n = 702) was applied to the prospective group (n = 373). A histogram of the calculated probabilities for the prospective population is shown along the horizontal axis. These 373 patients are grouped in deciles of their predicted probabilities, and the actual incidence of additional, non-SLN metastases was calculated for each decile. The vertical axis represents the actual, observed incidence (Actual Probability), and the horizontal axis represents the probability calculated by the nomogram (Predicted Probability). For each decile of the prospective group, a triangle is plotted to show actual probability. If the model were perfect, all triangles would lie on the dotted line, with a slope of 1.

 
Using the Nomogram
Each version of the nomogram consists of 11 rows. The first row (POINTS) is the point assignment for each variable. Rows 2 through 9 represent the variables included in the model. For an individual patient, each variable is assigned a point value (uppermost scale [POINTS]) based on the histopathological characteristics. To determine the point assignment, a vertical line is made between the appropriate variable value and the POINTS line. For example, a pathological size of 1 cm (PATHSIZE, 2) confers about 10 points.

The assigned points for all eight variables are summed, and the total is found in row 10 (TOTAL POINTS). Once the total is located in row 10 (TOTAL POINTS), a vertical line is made between it and the corresponding value in the final row, row 11 (Predicted Probability of +non-SLN). The version of the nomogram in Figure 1 is for use when information on frozen-section analysis is available; that in Figure 3 is for those cases where frozen-section information is not available.

In addition to the graphic nomograms, to facilitate ease of use in the clinical setting, we have made a personal digital assistant (PDA)-compatible application for use with hand-held Palm-type devices (Palm, Milpitas, CA). We will make these applications available at our Web site, www.mskcc.org/nomograms.


    DISCUSSION
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
With the adoption of SLN biopsy, a new clinical conundrum has become commonplace: should a completion ALND be done for a patient with a positive SLN biopsy? This question is particularly difficult with regard to patients with micrometastatic disease, disease which was undetectable in the era prior to SLN biopsy. Other investigators have attempted to address this question and have identified risk factors for the presence of additional, non-SLN disease, but all such attempts are limited by the practical difficulty of simultaneously including several variables in the risk estimate. Here, simultaneously using several variables in a large population, we have developed nomograms to predict the likelihood of additional nodal metastases after a positive SLN biopsy. We have prospectively tested them, demonstrating that they perform well in the prospective population.

Our nomograms utilize readily available clinical information and allow quick calculation. This approach may allow identification of extremely low-risk individuals for whom the risks associated with completion ALND are judged to outweigh the benefits. Conversely, our nomogram may allow identification of women at sufficient risk of additional nodal disease that they and their surgeon elect to proceed with completion ALND even though clinical "guesstimates" would suggest that they are at low risk.

The nomograms provide risk estimates that will have to be judged on an individual basis. A woman with a 1.8-cm, ER-positive, high-nuclear-grade ductal carcinoma with no LVI who has a single IHC-positive SLN might be considered to be at low risk. Our nomogram suggests that she has a 12% risk of having non-SLN metastases. Should she undergo completion ALND? Given this scenario, some will judge that a 12% risk of additional, non-SLN metastases justifies further ALND; others will not. The nomogram itself makes no actual treatment recommendations.

There are several limitations to our model. The nodes retrieved at completion ALND were examined by routine pathological analysis only. Other investigators25,35 have shown that if non-SLNs are examined with serial sectioning and IHC, a higher proportion of patients with additional, non-SLN disease at completion ALND are identified. Evaluation by enhanced pathological analysis would clearly alter our model.

Furthermore, the clinical relevance of resecting additional nodal disease (even that detected by routine analysis) remains unknown. Although some argue that surgical removal of subclinical nodal disease is associated with a small but nonzero survival benefit, others argue that current adjuvant systemic therapy and radiation therapy would likely treat the majority of patients adequately. This study does not address this issue but provides accurate and individualized estimates of the likelihood of finding additional disease at completion ALND. The American College of Surgeons Oncology Group Protocol Z0011 (ACOSOG Z0011), currently under way and randomizing women with a positive SLN to undergo ALND or no ALND, is designed to address this question directly.

In addition, the prognostic significance of micrometastatic nodal disease is a subject of debate. In his 1997 review of the published literature, Dowlatshahi36 concluded that all but one of the large (N >=147) and long-term (>=6-year) studies demonstrated a statistically significant decrement in survival associated with micrometastatic disease. At MSKCC, Tan et al.37 recently re-examined all axillary nodes from 373 patients treated in the 1970s who were deemed to be node-negative by routine histopathological analysis. Nodes were examined by serial sectioning and IHC, and the presence of any detectable micrometastatic disease was associated with worse disease-free and overall survival.

Another limitation of our data is the absence of size determination for the nodal metastases. The AJCC Cancer Staging Manual, 6th edition, now includes size of metastasis as an important determination of stage (and, therefore, of prognosis). However, we have had difficulty assigning a size to many cases because of the difference in pattern of distribution of malignant cells within the node. For example, some nodes may have scattered single cells or multiple small clusters of cells. How should these be measured? Ideally, an accurate estimate of volume could be assigned to each SLN metastasis. However, this is extremely time-consuming and somewhat impractical.

Nevertheless, it is clear that IHC is more sensitive than H&E in detecting micrometastases, that routine H&E analysis is more sensitive than frozen-section analysis, and that there is a correlation between method of detection and volume of disease. Others10,24 have demonstrated quantitatively that method of detection is correlated with measured size of the SLN metastasis. Therefore, in order to have a consistent, practical, and reproducible methodology of estimation, the method of detection of the nodal metastasis was used. This provides a general estimate of the amount of nodal disease and allows categorizing into four distinct groups.

Another potential weakness in our data is that some of our patients, especially those with a perceived low risk of additional, non-SLN metastases, did not undergo a completion ALND and therefore were not included in our model. However, as demonstrated in the histograms (Figs. 2 and 4Go), the patients in the prospective population are distributed quite evenly across the range of predicted risk. Furthermore, as demonstrated on the calibration curves, the models do predict well in the prospective population, even for those in the lowest decile of predicted risk.

Some might express surprise at the effect of ER status in the nomogram. Intuitively, one might expect ER positivity to be associated with lower risk of additional, non-SLN metastases. In our model, the effect of ER status is of only borderline statistical significance (P = .08), but it was included to improve the overall predictive ability of the model. Furthermore, although the finding is counterintuitive, others have reported similar findings. Nationwide data from the American College of Surgeons38 also indicated that cases negative for ER had a lower risk of lymph node metastases, after adjustment for all other factors.

Last, our models are imperfect. For the first model, the area under the ROC curve was 0.77 for the prospective population. This means that if we randomly select two women, of whom one has at least one positive non-SLN and the other has negative non-SLNs, there is a 77% chance that the nomogram will predict a higher probability for the positive woman. This is a scale that ranges from 0.5, which would be achieved by tossing a coin, to 1.0, which would require perfect ability to tell the positive woman from the negative one.

Nevertheless, these models represent a significant improvement over estimates based on one or two variables in smaller populations. We have used our large, prospective database to develop the models and have proven their validity by testing them prospectively on a subsequent population. The calibration errors of our models are small (see Figs. 2 and 4Go), generally <10% across the spectrum of predictors. Other investigators have shown that removing statistically insignificant predictors actually worsens the predictive ability of the model.39 Here, we have incorporated all statistically significant variables, as well as other clinically available and relevant variables, to provide improved prediction capability. Nomograms provide improved predictive ability in comparison with the crude counting of risk factors, and in addition, nomograms usually outperform clinical judgment, according to numerous studies conducted in other areas of medicine.40

With the important clinical question of whether to perform a completion ALND in a patient with a positive SLN biopsy arising more and more frequently, our nomograms provide an easy-to-use tool with which to simultaneously incorporate several important variables into the estimate of risk of additional, non-SLN metastases. Further validation and follow-up studies such as ACOSOG Z0011 will ultimately provide additional guidance to the clinician and patient. These nomograms provide a risk estimate that can help in weighing the pros and cons of completion ALND for an individual patient with SLN metastases.


    ACKNOWLEDGMENTS
 
The acknowledgments are available online in the full-text version at www.annalssurgicaloncology.org. They are not available in the PDF version.

The authors acknowledge Drs. Mary Gemignani, Alexandra Heerdt, Leslie Montgomery, Jeanne Petrek, Elisa Port, Virgilio Sacchini, and Lisa Sclafani for contributing patients to the sentinel node database and acknowledge Alexandra MacDonald for her expert editorial assistance.


    FOOTNOTES
 
Drs. Manasseh and Bevilacqua contributed equally to the work.

Dr. Bevilacqua is currently affiliated with Hospital Sírio Libanes, Instituto Brasileiro de Controle do Câncer, and Disciplina de Cirurgia Geral, Departamento de Cirurgia, Faculdade de Medicina da Univerdidade de Sao Paulo. São Paulo, Brazil; Dr. Boolbol is currently affiliated with Beth Israel Medical Center, New York, New York.

An accurate and easy-to-use nomogram was developed to predict the likelihood of non-sentinel node metastases in breast cancer patients with sentinel node metastases. The model was created with use of 702 cases and then prospectively validated in 373 cases.

Received for publication March 6, 2003. Accepted for publication August 19, 2003.


    REFERENCES
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 

  1. Giuliano AE, Jones RC, Brennan M, Statman R. Sentinel lymphadenectomy in breast cancer. J Clin Oncol 1997; 15: 2345–50.[Abstract/Free Full Text]
  2. Albertini JJ, Lyman GH, Cox C, et al. Lymphatic mapping and sentinel node biopsy in the patient with breast cancer. JAMA 1996; 276: 1818–22.[Abstract]
  3. Veronesi U, Paganelli G, Galimberti V, et al. Sentinel node biopsy to avoid axillary dissection in breast cancer with clinically negative lymph-nodes. Lancet 1997; 349: 1864–7.[CrossRef][Medline]
  4. O’Hea BJ, Hill AD, El-Shirbiny AM, et al. Sentinel lymph node biopsy in breast cancer: initial experience at Memorial Sloan-Kettering Cancer Center. J Am Coll Surg 1998; 186: 423–7.[CrossRef][Medline]
  5. Krag D, Weaver D, Ashikaga T, et al. The sentinel node in breast cancer: a multicenter validation study. N Engl J Med 1998; 339: 941–6.[Abstract/Free Full Text]
  6. Veronesi U, Paganelli G, Viale G, et al. Sentinel lymph node biopsy and axillary dissection in breast cancer: results in a large series. J Natl Cancer Inst 1999; 91: 368–73.[Abstract/Free Full Text]
  7. Giuliano AE, Haigh PI, Brennan MB, et al. Prospective observational study of sentinel lymphadenectomy without further axillary dissection in patients with sentinel node-negative breast cancer. J Clin Oncol 2000; 18: 2553–9.[Abstract/Free Full Text]
  8. Turner RR, Ollila DW, Krasne DL, Giuliano AE. Histopathologic validation of the sentinel lymph node hypothesis for breast carcinoma. Ann Surg 1997; 226: 271–8.[CrossRef][Medline]
  9. Chu KU, Turner RR, Hansen NM, Brennan MB, Bilchik A, Giuliano AE. Do all patients with sentinel node metastasis from breast carcinoma need complete axillary node dissection? Ann Surg 1999; 229: 536–41.[CrossRef][Medline]
  10. Kamath VJ, Giuliano R, Dauway EL, et al. Characteristics of the sentinel lymph node in breast cancer predict further involvement of higher-echelon nodes in the axilla. Arch Surg 2001; 136: 688–92.[Abstract/Free Full Text]
  11. Cabanes PA, Salmon RJ, Vilcoq JR, et al. Value of axillary dissection in addition to lumpectomy and radiotherapy in early breast cancer. Lancet 1992; 339: 1245–8.[CrossRef][Medline]
  12. Moore MP, Kinne DW. Axillary lymphadenectomy: a diagnostic and therapeutic procedure. J Surg Oncol 1997; 66: 2–6.[CrossRef][Medline]
  13. Carter CL, Allen C, Henson DE. Relation of tumor size, lymph node status and survival in 24,740 breast cancer cases. Cancer 1989; 63: 181–7.[CrossRef][Medline]
  14. American Joint Committee on Cancer. Breast. AJCC Cancer Staging Manual. 6th ed. New York: Springer, 2002: 221–40.
  15. Sosa JA, Diener-West M, Gusev Y, et al. Association between extent of axillary lymph node dissection and survival in patients with stage I breast cancer. Ann Surg Oncol 1998; 5: 140–9.[Abstract]
  16. Hayward J, Caleffi M. The significance of local control in the primary treatment of breast cancer. Arch Surg 1987; 122: 1244–7.[Abstract]
  17. Osteen RT, Harris JR. Patients with early breast cancer benefit from effective axillary treatment. Breast Cancer Res Treat 1985; 5: 17–21.[CrossRef][Medline]
  18. Orr RK. The impact of prophylactic axillary node dissection on breast cancer survival: a Bayesian meta-analysis. Ann Surg Oncol 1999; 6: 109–16.[Abstract]
  19. Cady B. Case against axillary lymphadenectomy for most patients with infiltrating breast cancer. J Surg Oncol 1997; 66: 7–10.[CrossRef][Medline]
  20. Giuliano AE, Kirgan DM, Guenther JM, Morton DL. Lymphatic mapping and sentinel lymphadenectomy for breast cancer. Ann Surg 1994; 220: 391–401.[Medline]
  21. Reynolds C, Rosemarie M, Donohue JH, et al. Sentinel lymph node biopsy with metastasis: can axillary dissection be avoided in some patients with breast cancer? J Clin Oncol 1999; 17: 1720–6.[Abstract/Free Full Text]
  22. Teng S, Dupont E, McCann C, et al. Do cytokeratin-positive-only sentinel lymph nodes warrant complete axillary lymph node dissection in patients with invasive breast cancer? Am Surg 2000; 66: 574–8.[Medline]
  23. Abdessalam SF, Zervos EE, Prasad M, et al. Predictors of positive axillary lymph nodes after sentinel lymph node biopsy in breast cancer. Am J Surg 2001; 182: 316–20.[CrossRef][Medline]
  24. Rahusen FD, Torrenga H, van Diest PJ, et al. Predictive factors for metastatic involvement of nonsentinel nodes in patients with breast cancer. Arch Surg 2001; 136: 1059–63.[Abstract/Free Full Text]
  25. Turner RR, Chu KU, Qi K, et al. Pathologic features associated with nonsentinel lymph node metastases in patients with metastatic breast carcinoma in a sentinel lymph node. Cancer 2000; 89: 574–81.[CrossRef][Medline]
  26. Weiser MR, Montgomery LL, Tan LK, et al. Lymphovascular invasion enhances the prediction of non-sentinel node metastases in breast cancer patients with positive sentinel nodes. Ann Surg Oncol 2001; 8: 145–9.[Abstract/Free Full Text]
  27. Wong SL, Edwards MJ, Chao C, et al. Predicting the status of the nonsentinel axillary nodes. Arch Surg 2001; 136: 563–8.[Abstract/Free Full Text]
  28. Viale G, Maiorano E, Mazzarol G, et al. Histologic detection and clinical implications of micrometastases in axillary sentinel lymph nodes for patients with breast carcinoma. Cancer 2001; 92: 1378–84.[CrossRef][Medline]
  29. Sachdev U, Murphy K, Derzie A, Jaffer S, Bleiweiss IJ, Brower S. Predictors of nonsentinel lymph node metastasis in breast cancer patients. Am J Surg 2002; 183: 213–7.[CrossRef][Medline]
  30. Mignotte H, Treilleux I, Faure C, Nessah K, Bremond A. Axillary lymph-node dissection for positive sentinel nodes in breast cancer patients. Eur J Surg Oncol 2002; 28: 623–6.[CrossRef][Medline]
  31. Jakub JW, Diaz NM, Ebert MD, et al. Completion axillary lymph node dissection minimizes the likelihood of false negatives for patients with invasive breast carcinoma and cytokeratin positive only sentinel lymph nodes. Am J Surg 2002; 184: 302–6.[CrossRef][Medline]
  32. Czerniecki BJ, Scheff AM, Callans LS, et al. Immunohistochemistry with pancytokeratins improves the sensitivity of sentinel lymph node biopsy in patients with breast carcinoma. Cancer 1999; 85: 1098–103.[CrossRef][Medline]
  33. Cody HS III. Clinical aspects of sentinel node biopsy. Breast Cancer Res 2001; 3: 104–8.[CrossRef][Medline]
  34. Harrell FE Jr. Regression Modeling Strategies With Applications to Linear Models, Logistic Regression, and Survival Analysis. Springer Series in Statistics. New York: Springer-Verlag, 2001: 568.
  35. Chu KU, Turner RR, Hansen NM, Brennan MB, Giuliano AE. Sentinel node metastasis in patients with breast carcinoma accurately predicts immunohistochemically detectable nonsentinel node metastasis. Ann Surg Oncol 1999; 6: 756–61.[Abstract]
  36. Dowlatshahi K, Fan M, Snider HC, Habib FA. Lymph node micrometastases from breast carcinoma: reviewing the dilemma. Cancer 1997; 80: 1188–97.[CrossRef][Medline]
  37. Tan LK, Giri D, Panageas K, et al. Occult/micrometastases in axillary lymph nodes of breast cancer patients are significant: a retrospective study with long-term follow-up [abstract]. Proc Am Soc Clin Oncol 2002; 21: 37a.
  38. Gann PH, Colilla SA, Gapstur SM, Winchester DJ, Winchester DP. Factors associated with axillary lymph node metastasis from breast carcinoma: descriptive and predictive analyses. Cancer 1999; 86: 1511–9.[CrossRef][Medline]
  39. Harrell FE Jr, Lee KL, Mark DB. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med 1996; 15: 361–87.[CrossRef][Medline]
  40. Ross PL, Gerigk C, Gonen M, et al. Comparisons of nomogram and urologists’ predictions in prostate cancer. Semin Urol Oncol 2002; 20: 82–8.[CrossRef][Medline]



This article has been cited by other articles:


Home page
Ann. Surg. Oncol.Home page
E. Poirier, L. Sideris, P. Dube, P. Drolet, and S. H. Meterissian
Analysis of Clinical Applicability of the Breast Cancer Nomogram for Positive Sentinel Lymph Node: The Canadian Experience
Ann. Surg. Oncol., September 1, 2008; 15(9): 2562 - 2567.
[Abstract] [Full Text] [PDF]


Home page
Ann. Surg. Oncol.Home page
J. Cho, W. Han, J. W. Lee, E. Ko, S. Y. Kang, S.-Y. Jung, E.-K. Kim, W. K. Moon, N. Cho, I.-A. Park, et al.
A Scoring System to Predict Nonsentinel Lymph Node Status in Breast Cancer Patients with Metastatic Sentinel Lymph Nodes: A Comparison with Other Scoring Systems
Ann. Surg. Oncol., August 1, 2008; 15(8): 2278 - 2286.
[Abstract] [Full Text] [PDF]


Home page
JCOHome page
H. D. Bear
Completion Axillary Lymph Node Dissection for Breast Cancer: Immediate Versus Delayed Versus None
J. Clin. Oncol., July 20, 2008; 26(21): 3483 - 3484.
[Full Text] [PDF]


Home page
JCOHome page
J. A. Olson Jr, L. M. McCall, P. Beitsch, P. W. Whitworth, D. S. Reintgen, P. W. Blumencranz, A. M. Leitch, S. Saha, K. K. Hunt, and A. E. Giuliano
Impact of Immediate Versus Delayed Axillary Node Dissection on Surgical Outcomes in Breast Cancer Patients With Positive Sentinel Nodes: Results From American College of Surgeons Oncology Group Trials Z0010 and Z0011
J. Clin. Oncol., July 20, 2008; 26(21): 3530 - 3535.
[Abstract] [Full Text] [PDF]


Home page
Ann. Surg. Oncol.Home page
K. A. Vanderveen, R. Ramsamooj, and R. J. Bold
A Prospective, Blinded Trial of Touch Prep Analysis versus Frozen Section for Intraoperative Evaluation of Sentinel Lymph Nodes in Breast Cancer
Ann. Surg. Oncol., July 1, 2008; 15(7): 2006 - 2011.
[Abstract] [Full Text] [PDF]


Home page
StrokeHome page
I. R. Konig, A. Ziegler, E. Bluhmki, W. Hacke, P. M.W. Bath, R. L. Sacco, H. C. Diener, C. Weimar, and on behalf of the Virtual International Stroke Tria
Predicting Long-Term Outcome After Acute Ischemic Stroke: A Simple Index Works in Patients From Controlled Clinical Trials
Stroke, June 1, 2008; 39(6): 1821 - 1826.
[Abstract] [Full Text] [PDF]


Home page
Ann. Surg. Oncol.Home page
S. Samphao, J. M. Eremin, M. El-Sheemy, and O. Eremin
Management of the Axilla in Women With Breast Cancer: Current Clinical Practice and a New Selective Targeted Approach
Ann. Surg. Oncol., May 1, 2008; 15(5): 1282 - 1296.
[Abstract] [Full Text] [PDF]


Home page
Ann. Surg. Oncol.Home page
C. H. M. van Deurzen, C. A. Seldenrijk, R. Koelemij, R. van Hillegersberg, M. G. G. Hobbelink, and P. J. van Diest
The Microanatomic Location of Metastatic Breast Cancer in Sentinel Lymph Nodes Predicts Nonsentinel Lymph Node Involvement
Ann. Surg. Oncol., May 1, 2008; 15(5): 1309 - 1315.
[Abstract] [Full Text] [PDF]


Home page
JCOHome page
S. J. Wang, C. D. Fuller, J.-S. Kim, D. F. Sittig, C. R. Thomas Jr, and P. M. Ravdin
Prediction Model for Estimating the Survival Benefit of Adjuvant Radiotherapy for Gallbladder Cancer
J. Clin. Oncol., May 1, 2008; 26(13): 2112 - 2117.
[Abstract] [Full Text] [PDF]


Home page
JCOHome page
L. K. Tan, D. Giri, A. J. Hummer, K. S. Panageas, E. Brogi, L. Norton, C. Hudis, P. I. Borgen, and H. S. Cody III
Occult Axillary Node Metastases in Breast Cancer Are Prognostically Significant: Results in 368 Node-Negative Patients With 20-Year Follow-Up
J. Clin. Oncol., April 10, 2008; 26(11): 1803 - 1809.
[Abstract] [Full Text] [PDF]


Home page
Ann. Surg. Oncol.Home page
E. Barranger, O. Morel, and C. Coutant
Axilla Scoring Systems Predicting Risk of Non-sentinel-node Metastasis in Breast Cancer Patients with a Positive Sentinel Node
Ann. Surg. Oncol., April 1, 2008; 15(4): 1261 - 1262.
[Full Text] [PDF]


Home page
Ann. Surg. Oncol.Home page
C. Dauphine
In Reply
Ann. Surg. Oncol., April 1, 2008; 15(4): 1263 - 1264.
[Full Text] [PDF]


Home page
Ann. Surg. Oncol.Home page
A. M. Fink, H. Lass, H. Hartleb, W. Jurecka, H. Salzer, and A. Steiner
S-Classification of Sentinel Lymph Node Predicts Axillary Nonsentinel Lymph Node Status in Patients with Breast Cancer
Ann. Surg. Oncol., March 1, 2008; 15(3): 848 - 853.
[Abstract] [Full Text] [PDF]


Home page
Br Med BullHome page
S. K. Somasundaram, D. W. Chicken, and M. R. S. Keshtgar
Detection of the sentinel lymph node in breast cancer
Br. Med. Bull., January 3, 2008; (2008) ldm032v1.
[Abstract] [Full Text] [PDF]


Home page
Clin. Cancer Res.Home page
G. G. Van den Eynden, M. K. Vandenberghe, P.-J. H. van Dam, C. G. Colpaert, P. van Dam, L. Y. Dirix, P. B. Vermeulen, and E. A. Van Marck
Increased Sentinel Lymph Node Lymphangiogenesis is Associated with Nonsentinel Axillary Lymph Node Involvement in Breast Cancer Patients with a Positive Sentinel Node
Clin. Cancer Res., September 15, 2007; 13(18): 5391 - 5397.
[Abstract] [Full Text] [PDF]


Home page
JCOHome page
J. L. B. Bevilacqua, M. W. Kattan, J. V. Fey, H. S. Cody III, P. I. Borgen, and K. J. Van Zee
Doctor, What Are My Chances of Having a Positive Sentinel Node? A Validated Nomogram for Risk Estimation
J. Clin. Oncol., August 20, 2007; 25(24): 3670 - 3679.
[Abstract] [Full Text] [PDF]


Home page
Ann. Surg. Oncol.Home page
K. J. Van Zee and M. W. Kattan
Validating a Predictive Model for Presence of Additional Disease in the Non Sentinel Lymph Nodes of a Woman with Sentinel Node Positive Breast Cancer
Ann. Surg. Oncol., August 1, 2007; 14(8): 2177 - 2178.
[Full Text] [PDF]


Home page
Ann. Surg. Oncol.Home page
S. Alran, Y. De Rycke, V. Fourchotte, H. Charitansky, F. Laki, M. C. Falcou, M. Benamor, P. Freneaux, R. J. Salmon, for the Institut Curie Breast Cancer Study Group, et al.
Validation and Limitations of Use of a Breast Cancer Nomogram Predicting the Likelihood of Non Sentinel Node Involvement After Positive Sentinel Node Biopsy
Ann. Surg. Oncol., August 1, 2007; 14(8): 2195 - 2201.
[Abstract] [Full Text] [PDF]


Home page
Ann. Surg. Oncol.Home page
L. A. Lambert, G. D. Ayers, and F. Meric-Bernstam
Validation of a Breast Cancer Nomogram for Predicting Nonsentinel Lymph Node Metastases after a Positive Sentinel Node Biopsy
Ann. Surg. Oncol., August 1, 2007; 14(8): 2422 - 2423.
[Full Text] [PDF]


Home page
Ann. Surg. Oncol.Home page
C. E. Dauphine, J. S. Haukoos, M. P. Vargas, N. M. Isaac, I. Khalkhali, and H. I. Vargas
Evaluation of Three Scoring Systems Predicting Non Sentinel Node Metastasis in Breast Cancer Patients with a Positive Sentinel Node Biopsy
Ann. Surg. Oncol., March 1, 2007; 14(3): 1014 - 1019.