A systematic review of tests for lymph node status in primary endometrial cancer
BMC Women's Health volume 8, Article number: 8 (2008)
The lymph node status of a patient is a key determinate in staging, prognosis and adjuvant treatment of endometrial cancer. Despite this, the potential additional morbidity associated with lymphadenectomy makes its role controversial. This study systematically reviews the accuracy literature on sentinel node biopsy; ultra sound scanning, magnetic resonance imaging (MRI) and computer tomography (CT) for determining lymph node status in endometrial cancer.
Relevant articles were identified form MEDLINE (1966–2006), EMBASE (1980–2006), MEDION, the Cochrane library, hand searching of reference lists from primary articles and reviews, conference abstracts and contact with experts in the field. The review included 18 relevant primary studies (693 women). Data was extracted for study characteristics and quality. Bivariate random-effect model meta-analysis was used to estimate diagnostic accuracy of the various index tests.
MRI (pooled positive LR 26.7, 95% CI 10.6 – 67.6 and negative LR 0.29 95% CI 0.17 – 0.49) and successful sentinel node biopsy (pooled positive LR 18.9 95% CI 6.7 – 53.2 and negative LR 0.22, 95% CI 0.1 – 0.48) were the most accurate tests. CT was not as accurate a test (pooled positive LR 3.8, 95% CI 2.0 – 7.3 and negative LR of 0.62, 95% CI 0.45 – 0.86. There was only one study that reported the use of ultrasound scanning.
MRI and sentinel node biopsy have shown similar diagnostic accuracy in confirming lymph node status among women with primary endometrial cancer than CT scanning, although the comparisons made are indirect and hence subject to bias. MRI should be used in preference, in light of the ASTEC trial, because of its non invasive nature.
Endometrial cancer is a cancer of the developed world. In Europe it is the most common gynaecological cancer and the fourth most common female cancer after breast, lung and colon cancer . Despite the frequency of this disease the treatment of this cancer, especially in its early stage remains controversial. In 1988 FIGO changed the staging of endometrial cancer to include pelvic and paraaortic lymphadenectomy in acceptance that the lymph node status is one of the most important prognostic factors for a patient . This led to large variations in practice throughout the UK and Europe. A Study of Gynaecological Oncologists in Western Europe revealed only 24.4% performed lymphadenectomy and that despite it's inclusion as part of FIGO staging most reserved it for specific pathological conditions .
Advocates for lymphadenectomy demonstrate that it allows precise determination of prognosis, accurate tailoring of adjuvant therapy, and may potentially provide a small survival advantage . Others argue that routine lymphadenectomy is associated with an increased operative time averaging an extra 30 minutes, an increased risk of intraoperative complications and that lymphadenectomy is not necessary in women with good prognostic factors that are at low risk of lymph node involvement. Women with stage 1a-1c disease have less than 0–15% chance of lymph node metastasis.
In light of the controversy surrounding the benefits and risks of lymphadenectomy in patients with endometrial cancer there is increasing interest in minimal and non invasive techniques to determine their lymph node status. Potentially the introduction of a reliable technique could direct the most appropriate patient treatment without the unnecessary risk of lymphadenectomy. As in other cancers studies have investigated the use of imaging techniques and sentinel node biopsy, but the accuracy of these modalities has not been adequately assessed. We systematically reviewed the evidence for the accuracy of minimally invasive and non invasive tests to determine the lymph node status in women with primary endometrial cancer.
Our search attempted to capture all the studies that reported the diagnostic accuracy of sentinel node biopsy, positron emission tomography (PET), magnetic resonance imaging (MRI), computer tomography (CT) and ultrasound scanning for the detection of lymphatic spread in primary endometrial cancer. Bibliographic databases MEDLINE (1966–2006), EMBASE, Cochrane Library (issue II, 2006) and MEDION (1980–2006) were searched without language restrictions. The search strategy used relevant medical subheadings (MeSH), text words and word variants for endometrial cancer and combined these with the terms for the index tests and lymphadenopathy (see Additional file 1). Hand searches of reference lists from primary articles and other reviews were carried out to identify manuscripts missed by electronic searching. Experts in the field were contacted for unpublished studies and conference abstracts were reviewed.
Study selection and data extraction
The selection of studies involved a two-stage process and two reviewers (TJS, CHM). The electronic searches were examined and complete manuscripts of potentially relevant citations retrieved for a final decision on inclusion based on pre-defined selection criteria. Studies were selected if they reported accuracy of the index tests, compared to histological examination of the lymph nodes (reference standard) in women with a primary presentation of endometrial cancer of any histological type or stage and allowed data extraction to create two by two tables. No language restrictions were applied. In cases of duplicate publications the most recent manuscript was selected. Final inclusion or exclusion was decided after examining the complete manuscripts. All were examined in duplicate by the two reviewers with any discrepancies resolved by a third reviewer (KSK).
A piloted data extraction form was used to collect information on study characteristics, quality and accuracy results from each of the selected manuscripts. The study characteristics extracted were the stage of disease, the index test and reference standard methodology and the setting and date of the study. Accuracy data from the studies were reordered in two by two tables. For the purpose of analysis when a manuscript reported the accuracy of more than one index test, the tests were reported on separately. Non diagnostic test results and a failure to perform the test, such as an inability to detect the sentinel node or inadequate histology were excluded from the two by two tables, but their occurrence was recorded, along with the results from the reference standard in each case, if provided.
Assessment of Study Quality
All of the manuscripts meeting the selection criteria were assessed for their methodological quality, defined as the confidence that the study design, conduct and analysis minimised biases in the estimation of test accuracy. Existing, well developed tools were used to generate items for our assessment of methodological quality [7–9], this process was again carried out in duplicate. For the population, consecutive or random recruitment of eligible women in to the study was considered ideal. Convenience sampling, such as arbitrary recruitment or non-consecutive recruitment was deemed inadequate. Prospective recruitment of patients was considered to be associated with potentially a lesser degree of bias than retrospective recruitment. The description of the population was considered ideal if the study clarified the stage of disease and the body mass index of a patient, which can affect the accuracy of techniques. We recorded the stage of disease in accordance with FIGO classification. The reporting of the index test was considered ideal if the study documented the test in sufficient detail to allow replication by other researchers. It was considered important for the time interval between the index test and the reference standard to be described and an interval of four or less weeks was considered suitable . For the reference standard itself, a description of method of histological verification was important and it was considered preferable for the readers of the reference standard to be blind to the index test results. Information on the number of women recruited into the study and those on whom outcome data were known was sought from the manuscripts to examine partial and differential verification. Verification was considered ideal if all women originally enrolled into the study, without legitimate exclusions were included in the data analysis. We examined if withdraws from the study were explained and if uninterpretable results were reported.
The main strengths and weaknesses in respect of each of the above items for all studies included in the systematic review were tabulated. We did not attempt to collapse our assessment of quality into a score, as suggested methods have little validity and may have a tendency to obscure the strengths and weaknesses of a study rather than clarify them.
From the two by two tables, sensitivity (true positive rate) and specificity (true negative rate), along with their exact confidence intervals were computed. These estimates were plotted in a ROC space to evaluate the degree of correlation between these indices. When two by two tables contained zero cells we applied a standard correction of adding 0.5 to all four cells of that table .
We anticipated that in common with other diagnostic reviews [10, 12, 13] there would be heterogeneity of results amongst involved studies. We examined heterogeneity visually using forest plots of sensitivity, specificity and LRs and statistically using Cochran Q . The small number of studies did not allow for detailed exploration of reasons for heterogeneity using meta regression techniques. However studies were instead divided into index test type, which in previous reviews has represented a major source of heterogeneity  and difference in accuracy were tested for statistical significance.
We used bivariate random-effect meta-analysis  to obtain summary estimates of sensitivity and specificity and other derived measures such as positive and negative likelihood ratios (LRs). LRs allow estimation of the probability of lymphatic spread with a specific test result [17–19]. The bivariate model assumes that logit transformations of sensitivity and specificity are negatively correlated and follow a bivariate normal distribution. This analysis also incorporates the different precision by which sensitivity and specificity have been measured in each study. The model produces random effect estimations for the mean logit sensitivity and specificity with corresponding 95% confidence intervals, it produces also an estimation for the amount of between-study variation for sensitivity and specificity separately, and finally an estimation of the covariance between sensitivity and specificity. Confidence regions in logit-ROC space can be constructed using these estimates. The ellipse in logit-ROC space can be back-transformed to conventional scale, and plotted in ROC space giving a confidence region for the summary operating point.
Meta-DiSc version 1.4  was used for initial analyses and forest plots and the PROC MIXED procedure in SAS version 8.2 for Windows (SAS Institute) was used to fit bivariate models.
A total of 18 manuscripts including 693 women with primary endometrial cancer were included in the review [20–37] (Figure 1). There were 19 two by two tables evaluating one of four index tests, there were no studies identified that reported the accuracy of PET. A proportion of the population (106/693, 15%) were included more than once in 2/19 two by two tables. Table 1 and Figure 2 summaries the salient features and quality of each of the studies. It is evident that there was a wide variation and numerous deficiencies in the methodological quality of the included studies.
Figure 3 show Forrest plots with sensitivities and specificities of individual studies according to index test. Table 2 shows pooled sensitivities and specificities for the various index tests estimated by the bivariate analysis from which we derived other measures such as positive and negative likelihood ratios. Figure 4 shows the summary operating estimates for the various index tests with corresponding confidence ellipses. For each of the index tests variation in sensitivity was much greater than specificity. MRI was the most accurate index test while successful sentinel node had similar results (Table 2). P-values of tests for comparison between the three main diagnostic modalities are shown in Table 2. CT was much less accurate in detection of lymphatic spread (Table 2). There was only one study that reported the accuracy of ultrasound scanning the results of which were positive LR 50.3 and a negative LR 0.67, the presence of only one study makes it difficult to draw a conclusion concerning this technique, other than to note the sensitivity of the test (33%) was poor. The failure rate to detect the sentinel node ranged from 6.6% (1/16 patients) to 100%.
Our review showed that MRI and successful sentinel node biopsy (sentinel node biopsy has a variable failure rate) were the most accurate tests for predicting the lymph node status of women with primary endometrial cancer. Other tests were poor in accuracy. These results must be interpreted with caution as the quality of studies available for review was variable, with many of poor methodological quality that may result in the introduction of bias. This review show an urgent need for the further high quality primary studies that include the use of PET scanning as an alternative test which may be beneficial.
This review provides a robust summary of the available evidence to date and an example of the methodology required to perform a review of diagnostic test accuracy. We performed an extensive search for studies and used well developed methods for quality assessment. The deficiencies in quality made explicit by our review should help improve further research in this area . It is imperative that the new STARD and QUADAS guidelines are followed in the undertaking of such studies so that our inference in the future can be based on high quality review, reducing heterogeneity and the risk of bias. Another criticism of our approach might be that in light of the unexplained heterogeneity in the results, meta analysis should perhaps have been avoided. We also accept that we are combing results of tests over a wide time scale, where the accuracy of the technique may have improved. Also that the comparison of tests is an indirect one and hence subject to bias, especially as there is a wide variation in the spectrum of diseases that the different tests are used in.
Our study shows that based on the currently available evidence MRI is the most accurate tool to determine the lymph node status of patients. It has the advantage of also guiding the surgeon as to the depth of myometrial invasion and potential treatment required. Reviews of test accuracy for lymphatic spread in other gynaecological cancers have shown sentinel node biopsy to be the most accurate test, as have studies in other cancers . However this did not appear to be the case for endometrial cancer as MRI was marginally more accurate, although this was not a statistically significant increase in accuracy over sentinel node biopsy. There was a large variation in the ability to detect the sentinel node. Although this usually occurred in a small percentage of patients in the studies, one study was unable to detect the node in any of its patients . This may have been due the different technique used and the reliance on only blue dye to detect the node (Table I).
The debate regarding the necessity of lymphadenectomy in these patients led to the Medical Research Council funded ASTEC (a study in the treatment of endometrial cancer) trial. One of the study's primary aims is to assess the benefit, or otherwise of pelvic lymphadenectomy in patients where disease is thought to be confined to the corpus. Recruitment for this trial had now closed and the preliminary results were presented at European Society of Gynaecological Oncology in 2005. They suggested that there was no benefit for survival or prevention of recurrence in performing lymphadenectomy for early stage endometrial cancer. If this is confirmed in the final publication of the trial then it adds further importance to the use of a non invasive assessment of lymph node status which would allow a decision to be made on the requirement of adjuvant surgery, which in light of this trial will be the only potential benefit of lymphadenectomy.
Independent of the results of ASTEC there are still benefits in accurately being able to use a non or minimally invasive technique to predict the lymph node status of patients with primary endometrial cancer. This systematic review of the available evidence suggests that MRI is the most accurate method to do this, however one should be cautious in interpreting the results in view of the number and heterogeneity of the studies available and the large confidence intervals of results. Further high quality studies are required to look at the real potential both of this and other imaging modalities such as PET.
Amant F, Moeman P, Neven P, Timmerman D, Limbergen E, Vergot I: Endometrial cancer. Lancet. 2005, 366: 491-505. 10.1016/S0140-6736(05)67063-8.
Chee JJ, Ho TH, Tay EH, Low JJH, Yam KL: Endometrioid Adenocarcinoma of the Uterus: Surgico-Pathological Correlations and Role of Pelvic Lymphadenectomy. Annals of the Academy of Medicine, Singapore. 2003, 32 (5): 670-5.
Maggino T, Romagnolo C, Zola P, Sartori E, Landoni F, Gadducci A: An analysis of approaches to the treatment of endometrial cancer in Western Europe: A CTF study. European Journal of Cancer. 1995, 31 (12): 1993-7. 10.1016/0959-8049(95)00316-9.
Fanning J, Firestein S: Prospective evaluation of the morbidity of complete lymphadenectomy in endometrial cancer. International Journal of Gynecological Cancer. 1998, 8 (4): 270-3. 10.1046/j.1525-1438.1998.09833.x.
Khan KS, Dinnes J, Kleijnen J: Systematic reviews to evaluate diagnostic tests. European Journal of Obstet Gynecol Reprod biol. 2001, 95: 6-11. 10.1016/S0301-2115(00)00463-2.
Deeks J: Systematic reviews of evaluations of diagnostic and screening tests. Systematic Reviews Health Care: Meta-Analysis in Context. Edited by: Egger M, Smith G, Altman D. 2001, London: BMJ Books
Selman TJ, Khan KS, Mann CH: An evidence-based approach to test accuracy studies in gynaecologic oncology: the 'STARD' checklist. Gynecologic Oncology. 2005, 96 (3): 575-8. 10.1016/j.ygyno.2004.09.053.
Lijmer J, Mol B, Heisterkamp S, Bonsel G, Prins M: Emperical evidence of design-related bias in studies of diagnostic tests. JAMA. 1999, 282: 1061-6. 10.1001/jama.282.11.1061.
Whiting P, Rutjes A, Reitsma J, Kleijnen J: The development of QUADAS : a tool for the quality assessment of studies of diagnostic accuracy included ijn systematic reviews. BMC Med Res Methodology. 2003, 3 (1): 41.
Clark TJ, Mann CH, Shah N, Khan KS, Song F, Gupta JK: Evaluation of outpatient hysteroscopy and ultrasonography in the diagnosis of endometrial disease. Obstet Gynecol. 2002, 99: 1001-7. 10.1016/S0029-7844(02)01976-2.
Sankey S, Weistfiels L, Fine M, Kapoor W: An assessment of the use of the continuity correction for sparse data in meta anlysis. Commun Stat Simulation Computation. 1996, 25: 1031-56. 10.1080/03610919608813357.
Scheidler J, Hricak H, Yu KK, Subak L, Segal MR: Radiological evaluation of lymph node metastases in patients with cervical cancer. A meta-analysis. JAMA. 1997, 278 (13): 1096-101. 10.1001/jama.278.13.1096.
Selman TJ, Luesley DM, Acheson N, Khan KS, Mann CH: A systematic review of the accuracy of diagnostic tests for inguinal lymph node status in vulvar cancer. Gynecologic Oncology. 2005, 99 (1): 206-14. 10.1016/j.ygyno.2005.05.029.
Zamora J, Abraira V, Muriel A, Khan KS, Coomarasamy A: Meta-DiSc: a software for meta-analysis of test accuracy data. BMC Medical Research Methodology. 2006, 6: 31-10.1186/1471-2288-6-31.
Selman TJ, Luesley DM, Acheson N, Khan KS, Mann CH: A systematic review of the accuracy of diagnostic tests for inguinal lymph node status in vulvar cancer. Gynecologic Oncology. 2005, 99 (1): 206-14. 10.1016/j.ygyno.2005.05.029.
Reitsma JB, Glas AS, Rutjes AW, Scholten RJ, Bossuyt PM, Zwinderman AH: Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. J Clin Epidemiol. 2005, 58 (10): 982-90. 10.1016/j.jclinepi.2005.02.022.
Deeks J, Morris J: Evaluation diagnostic tests. Baillieres Clinical Obstetrics & Gynaecology. 1996, 10: 613-30. 10.1016/S0950-3552(96)80008-3.
Jaeschke R, Guyatt G, Sackett D: Users' guide to the medical literature, III: how to use an article about a diagnostic test, B. JAMA. 1994, 271: 703-7. 10.1001/jama.271.9.703.
Greenhalgh T: How to read a paper. Papers that report diagnostic or screening tests. BMJ. 1997, 3 (15): 540-543.
Burke TW, Levenback C, Tornos C, Morris M, Wharton JT, Gershenson DM: Intraabdominal lymphatic mapping to direct selective pelvic and paraaortic lymphadenectomy in women with high-risk endometrial cancer: results of a pilot study. Gynecologic Oncology. 1996, 62 (2): 169-73. 10.1006/gyno.1996.0211.
Echt ML, Finan MA, Hoffman MS, Kline RC, Roberts WS, Fiorica JV: Detection of sentinel lymph nodes with lymphazurin in cervical, uterine, and vulvar malignancies. Southern Medical Journal. 1999, 92 (2): 204-8. 10.1097/00007611-199902000-00008.
Holub Z, Kliment L, Lukac J, Voracek J: Laparoscopically-assisted intraoperative lymphatic mapping in endometrial cancer: preliminary results. European Journal of Gynaecological Oncology. 2001, 22 (2): 118-21.
Niikura H, Okamura C, Utsunomiya H, Yoshinaga K, Akahira J, Ito K, Yaegashi N: Sentinel lymph node detection in patients with endometrial cancer. Gynecologic Oncology. 2004, 92 (2): 669-74. 10.1016/j.ygyno.2003.10.039.
Pelosi E, Arena V, Baudino B, Bello M, Giusti M, Gargiulo T, Palladin D, Bisi G: Pre-operative lymphatic mapping and intra-operative sentinel lymph node detection in early stage endometrial cancer. Nuclear Medicine Communications. 2003, 24 (9): 971-5. 10.1097/00006231-200309000-00005.
Raspagliesi F, Ditto A, Kusamura S, Fontanelli R, Vecchione F, Maccauro M, Solima E: Hysteroscopic injection of tracers in sentinel node detection of endometrial cancer: a feasibility study. American Journal of Obstetrics & Gynecology. 2004, 191 (2): 435-9. 10.1016/j.ajog.2004.03.008.
Fersis N, Gruber I, Relakis K, Friedrich M, Becker S, Wallwiener D: Sentinel node identification and intraoperative lymphatic mapping. First results of a pilot study in patients with endometrial cancer. European Journal of Gynaecological Oncology. 2004, 25 (3): 339-42.
Holub Z, Jabor A, Lukac J, Kliment L: Laparoscopic detection of sentinel lymph nodes using blue dye in women with cervical and endometrial cancer. Medical Science Monitor. 2004, 10: CR587-CR591.
Lelievre L, Camatte S, Frere-Belda MA, Kerrou K, Froissart M, Taurelle R, vilde F, Lecuru F: Sentinel lymph node biopsy in cervix and corpus uteri cancers. International Journal of Gynecological Cancer. 2004, 14 (2): 271-8. 10.1111/j.1048-891X.2004.014210.x.
Balfe DM, Van DJ, Lee JK, Weyman PJ, McClennan BL: Computed tomography in malignant endometrial neoplasms. Journal of Computer Assisted Tomography. 1983, 7 (4): 677-81. 10.1097/00004728-198308000-00018.
Varpula MJ, Klemi PJ: Staging of uterine endometrial carcinoma with ultra-low field (0.02 T) MRI: A comparative study with CT. Journal of Computer Assisted Tomography. 1993, 17 (4): 641-7. 10.1097/00004728-199307000-00023.
La Fianza A, Di Maggio EM, Preda L, Coscia D, Tateo S, Campani R: Clinical usefulness of CT in the treatment of stage I endometrial carcinoma. Radiologia Medica. 1997, 93 (5): 567-71.
Zerbe MJ, Bristow R, Grumbine FC, Montz FJ: Inability of preoperative computed tomography scans to accurately predict the extent of myometrial invasion and extracorporal spread in endometrial cancer. Gynecologic Oncology. 2000, 78 (1): 67-70. 10.1006/gyno.2000.5820.
Sawicki W, Spiewankiewicz B, Stelmachow J, Cendrowski K: The value of ultrasonography in preoperative assessment of selected prognostic factors in endometrial cancer. European Journal of Gynaecological Oncology. 2003, 24 (3–4): 293-8.
Taieb S, Ceugnart L, Leblanc E, Chevalier A, Cabaret V, Querleu D: MR imaging of endometrial carcinoma: role and limits. Bulletin du Cancer. 2002, 89 (11): 963-8.
Manfredi R, Mirk P, Maresca G, Margariti PA, Testa A, Zannoni GF, Giodano D, Scambia G, Marano P: Local-regional staging of endometrial carcinoma: role of MR imaging in surgical planning. Radiology. 2004, 231 (2): 372-8. 10.1148/radiol.2312021184.
Connor JP, Andrews JI, Anderson B, Buller RE: Computed tomography in endometrial carcinoma. Obstetrics & Gynecology. 2000, 95 (5): 692-6. 10.1016/S0029-7844(99)00626-2.
Hricak H, Hamm B, Semelka RC, Cann CE, Nauert T, Secaf E, Stem JK, Wof KJ: Carcinoma of the uterus: use of gadopentetate dimeglumine in MR imaging. Radiology. 1991, 181 (1): 95-106.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6874/8/8/prepub
MRC RCOG clinical training fellowship held by Miss Tara Selman financed cost incurred in obtaining original manuscripts.
The authors declare that they have no competing interests.
TS participated in the development of the research design and the search strategy essential for systematic review, in the data analysis and interpretation of the data, in writing the first draft and the critical reading there after and approved the final version. CM participated in the development of the research question, in the data extraction and interpretation and the critical reading of the manuscript and approved the final version. JZ participated in the development of the research strategy, in writing a computer program used in the research, in the data analysis and interpretation, in providing essential statistical and methodological advice and in the critically reading of the manuscript and approved the final version. KK participated in the development of the research design and the search strategy essential for systematic review, in the data analysis and interpretation of the data, in surmounting problems that arouse, in providing essential methodological and statistical advice and in the critical reading of the manuscript and approved the final version.
Electronic supplementary material
Additional file 1: Search strategy. The data provided shows the search strategy used in the systematic review of tests for lymph node status in primary endometrial cancer. (DOC 40 KB)
Authors’ original submitted files for images
About this article
Cite this article
Selman, T.J., Mann, C.H., Zamora, J. et al. A systematic review of tests for lymph node status in primary endometrial cancer. BMC Women's Health 8, 8 (2008). https://doi.org/10.1186/1472-6874-8-8