Journal List > J Korean Soc Menopause > v.19(1) > 1052099

Park, Hwang, Park, Lee, Lee, Kim, Kim, Jung, Yun, and Song: Discrimination between Benign and Malignant Pelvic Masses Using the Risk of Malignancy Index 1

Abstract

Objectives

To assess the ability of risk of malignancy index (RMI) 1 to discriminate between benign and malignant pelvic masses.

Methods

Between January 2007 and December 2010, 547 women with pelvic masses were evaluated. Their medical records are reviewed here retrospectively. The sensitivity, specificity and positive and negative predictive values of the cancer antigen (CA) 125 level, ultrasound findings and menopausal status in the prediction of malignant pelvic masses were calculated and compared individually or combined using the RMI 1.

Results

The receiver operating characteristic (ROC) curves of CA 125, the ultrasound score and the RMI 1 were all found to be relevant predictors of malignancy. ROC analysis of the RMI 1, CA 125 serum levels, ultrasound score and menopausal status showed areas under the curves of 0.795, 0.782, 0.784 and 0.594, respectively. The RMI 1 was found to be statistically significantly correlated with menopausal status (P = 0.001), while not statistically significantly correlated with CA 125 (P = 0.628) or the ultrasound score (P = 0.541). The RMI 1 at a cut-off of 150 - with a sensitivity of 77.9%, specificity of 81.1%, positive predictive value of 51.7% and negative predictive value of 93.4% - showed the highest performance in determining the malignant tendency of pelvic masses.

Conclusion

Accepting a RMI 1 cut-off value of 150 results in statistically more significant diagnostic criteria than menopausal status for the discrimination of benign and malignant pelvic masses.

The accurate diagnosis of a pelvic mass is a challenge to a gynecologist before the pelvic cavity is explored by laparotomy or laparoscopy, because of pelvic masses' bizarre and atypical behavior. Pelvic masses are one of the most common clinical presentations. These masses represent a number of benign and malignant conditions. Treatment can be optimally planned if it is known beforehand whether an ovarian neoplasm is benign or malignant. The prognosis for women with ovarian cancer may be greatly influenced by appropriate first-line therapy.1~6
Used alone, the diagnostic accuracy of demographic, sonographic and biochemical variables is poor for clinical use. Jacobs et al.7 developed the risk of malignancy index (RMI) for referral of relevant patients to gynecologic oncology centers. The RMI 1 was the first diagnostic model in the assessment of patients with pelvic masses. The RMI was adjusted by Tingulstad et al.8 in 1996 (RMI 2) and again in 1999 (RMI 3).9 The three versions of the RMI have been validated retrospectively and prospectively in different clinical studies7~19 where a cut-off value of 200 showed the best discrimination between benign and malignant pelvic masses, with high sensitivity and specificity levels (sensitivity 51-90%, specificity 51-97%). Recently RMI 4 was introduced by Yamamoto et al.20 Four RMIs had some different characteristics. RMI 1 was the first version as developed by Jacobs et al.7 and gave an ultrasound score (U) of 0 when none of the ultrasound features were present, resulting in an RMI 1 of 0 regardless of the cancer antigen (CA) 125 level. But, RMI 2-4 had not ultrasound score of 0. Yamamoto et al.20 have published their study in which RMI 4 was created, that includes tumor size as an additional parameter.
The main advantage of four RMIs is that it is a simple scoring system that can be applied directly into clinical practice without the introduction of expensive or complicated methods (such as computed tomography scan, magnetic resonance imaging, and whole-body positron emission tomography). The RMIs can be applied in less specialized centers. The RMI 1 was the first diagnostic model that combined demographic, sonographic and biochemical data in the assessment of patients with pelvic masses.
The purpose of the present study was to assess ability of the RMI 1 to discriminate between benign and malignant pelvic masses.

Materials and Methods

This is a retrospective study. The clinical data were obtained from consecutive 547 women with pelvic masses scheduled for laparotomy or laparoscopy at the Department of Obstetrics and Gynecology of a single institution between January 2007 and December 2010. Preoperative serum CA 125 levels, ultrasound findings, and menopausal status were noted. In all cases, ultrasound was performed transvaginally with a 6.0 MHz transducer (Acuvix XQ, Medison, Korea); an abdominal scan was also conducted when indicated.
As proposed by Jacobs et al.7 in 1990, the RMI 1 is defined as the multiplied value of the ultrasound score (U), menopausal status (M) and serum CA 125 level: RMI 1 = U × M × CA 125.
Multilocularity, solid areas, bilaterality, ascites and intraabdominal metastases score one point each. A total of 2 or more points gives U = 3, 1 point gives U = 1, 0 points gives U = 0. Postmenopausal status is defined as more than 1 year of amenorrhea, or age 50 years or older among women who had prior hysterectomies, and scores M = 3; premenopausal status scores M = 1. Serum CA 125 (U/mL) is entered directly into the equation. The ultrasounds were performed by gynecologic oncologists, general gynecologists, or residents.
The histopathologic diagnosis was regarded as a definitive outcome. When a gynecological cancer was found, it was staged according to the International Federation of Gynecology and Obstetrics (FIGO) classification.21
The sensitivity was defined as the percentage of patients with malignant disease having a positive test result. The specificity was defined as the percentage of patients with benign disease having a negative test result. The positive predictive value was defined as the percentage of patients with a positive test result having malignant disease and the negative predictive value was defined as the percentage of patients with a negative test result having benign disease.
Statistical analyses were performed using the Statistical Packages for the Social Sciences Version 14.0.1 (SPSS Inc., Chicago, IL, USA). The χ2-test was used to test differences in distribution of menopausal status, and the ultrasound score. The Mann-Whitney U-test was applied in the cases where the assumptions of the 2-sample t-test do not hold (when testing differences in distribution of CA 125 among women with benign and malignant pelvic masses). A receiver operating characteristic (ROC) curve was created to show the relation between sensitivity and specificity of the CA 125, menopausal status, the ultrasound score, and the RMI 1 in the discrimination between benign and malignant pelvic masses.

Results

A total of 547 patients were included in the study. A number of 434 patients (79.3%) were diagnosed with benign conditions, whereas 113 patients (20.7%) had malignant disease (Table 1). The malignancies included serous cystadenocarcinoma (n = 35), mucinous cystadenocarcinoma (n = 13), endometrioid adenocarcinoma (n = 6), clear cell carcinoma (n = 6), transitional cell carcinoma (n = 7), granulosa cell tumor (n = 6), Yolk sac tumor (n = 2), dysgerminoma (n = 2), immature teratoma (n = 1), Sertoli-Leidig cell tumor (n = 1), malignant mixed mullerian tumor (n = 2), mullerian adenosarcoma (n = 1), Krukenberg's tumor (n = 2), and borderline malignancy (n = 29). The benign gynecological conditions included mature cystic teratoma (n = 184), mucinous cystadenoma (n = 85), serous cystadenoma (n = 93), endometriosis (n = 27), fibroma (n = 12), fibrothecoma (n = 5), tubo-ovarian abscess (n = 5), paratubal cyst (n = 6), functional follicle (n = 6), struma ovarii (n = 3), actinomycosis (n = 2), Brenner tumor (n = 2), sclerosing stromal tumor (n = 1), and leiomyoma (n = 1).
The distribution of benign and malignant cases by menopausal status, the ultrasound score, and CA 125 is described in Table 2. In univariate analysis, a significant linear trend for malignancy was found by postmenopausal state, increasing ultrasound score, and increasing CA 125, respectively. The mean serum level of CA 125 was significantly higher among women with malignancies when compared with women with benign lesions (507 U/mL vs 35 U/mL). The sensitivity, specificity, and positive and negative predictive values of different levels of serum CA 125, the ultrasound score, and menopausal status are reported in Table 3. The best performance was obtained for a serum CA 125 level of 40 U/mL. At a serum level of CA 125 40 U/mL, the sensitivity of detecting malignancy was 73.4% and the specificity was 83.1%, positive and negative predictive values were 53.2% and 92.3%, respectively. The sensitivity, specificity, and positive and negative predictive values of the ultrasound score of 2 were 94.7, 62.2, 39.5, and 97.8%, respectively. When individual parameters were compared, CA 125 performed better than the ultrasound score and menopausal status, even though the ultrasound score of 2 had more sensitivity than CA 125, but with considerable loss of specificity.
The performance of RMI 1 at different cut-off values is shown in Table 3. The overall best performance in the index was obtained at a cut-off level of 150. RMI 1 at a cut-off of 150 with a sensitivity of 77.9%, specificity of 81.1%, and positive predictive value of 51.7% and negative predictive value of 93.4% had the highest performance in determining malignant tendency of a pelvic mass.
The diagnostic performance of the ultrasound score, CA 125, and menopausal status with the RMI 1 were shown in ROC curves (Fig. 1). ROC analysis of the RMI 1, CA 125 serum levels, the ultrasound score, and menopausal status showed that the values of area under the curve had values of 0.795, 0.782, 0.784, and 0.594, respectively. The RMI 1 had the largest area under the ROC curve when compared with CA 125, the ultrasound score, and menopausal status. The ROC curve evaluation of CA 125, the ultrasound score, and the RMI 1 were all found to be relevant predictors of malignancy. The RMI 1 was found to be statistically significant to the menopausal status (P = 0.001), while were not statistically significant to CA 125 (P = 0.628) and the ultrasound score (P = 0.541).

Discussion

This study was designed to identify the ability of the RMI to correctly identify benign and malignant pelvic masses. The RMI was originally developed by Jacobs et al.7 and subsequently the same group reproduced the results in a new group of patients, establishing the superiority of RMI 1 over the individual parameter.10
The most useful individual criteria in discriminating benign gynecologic lesions from malignant ovarian tumors in the present study were serum CA 125 40 U/mL with a sensitivity of 73.4% and specificity of 83.1%, and an ultrasound score of 2 with a sensitivity of 94.7% and specificity of 62.2%. These results are similar to those of a previous study by Jacobs et al.7 in 1990, which calculated a sensitivity and specificity of 71% and 75% for CA 125 and sensitivity and specificity of 71% and 83% for an ultrasound score of 2. In the present study menopausal status performed less well than the RMI 1, while CA 125 and the ultrasound score had similar performances. The RMI 1 was a useful preoperative method in the classification of women with pelvic masses into low and high risk for malignancy. The high sensitivity, specificity, positive predictive value and negative predictive value of 82.1%, 78.1%, 40.6% and 96.0%, respectively found in the present study at a cut-off of 150 is similar to other studies that found that the RMI was a better diagnostic marker in diagnosing ovarian cancer.10,17
The previous studies indicate that a RMI 1 of 200 gives the most optimal cut-off, while some authors have suggested a different cut-off value.7,11 Using an RMI 1 cut-off of 150, Torres et al.15 showed a sensitivity and specificity of 79%, and Ulusoy et al.19 showed a sensitivity, specificity, positive and negative predictive value of 76.4%, 77.9%, 65.9% and 85.5%, respectively, with a 79.4% correct diagnosis rate. This study showed that a RMI 1 of 150 yields the optimal cut-off value. There are probable reasons to describe the different cut-off values: First, the malignancy prevalence is different. It is well known that, for any test, the positive predictive value will be lower and the negative predictive value higher when used in populations where the disease is uncommon. In our study population, 20.7% of the patients were diagnosed with malignancies while Manjunath et al.13 reported 61.2% of malignant disease. Second, the lower cut-off value, obtained in our study may be associated with the higher number of malignant cases in the premenopausal group - 56.6% in our study versus 19%7 and 20%.8 Third, the diagnostic accuracy of a serum CA 125 assay is expected to be lower in premenopausal patients. CA 125 levels fluctuate during the menstrual cycle, being the highest during menstruation. Also, diseases such as endometriosis and pelvic inflammatory disease are more frequent in premenopause. These diseases are known to cause elevated CA 125 values.22
Borderline malignancies tend to have lower RMI 1-values compared to invasive malignancies and are therefore less detectable. This can be explained by the different features they exhibit, and therefore they have low scores both on ultrasound and CA 125 levels.23 One must keep in mind that the primary goal for developing the RMI 1 is the referral of patients with malignant diseases to gynecologic oncologists. Considering the biological nature and behavior of borderline ovarian tumors, in these patients, one can discuss the relevance of primary surgical treatment and staging at the subspecialized department. Further research is needed to evaluate methods able to identify these patients better than in the present and similar studies. A detailed evaluation of the present material is necessary and specifically needed to eventually improve preoperative scoring. Recently Alanbay et al.24 reported that compared to ultrasound, menopausal status, CA 125, CA 19-9, the RMI 4 was fond to be the best predictive method for differentiation of borderline ovary tumor from benign adnexal masses.
Vaginal ultrasound and new scoring system represent the good diagnostic tool for the detection malignant ovary masses. Parameters of new scoring system were wall thickness, number of septum, volume of mass, irregularity, vascularity and echogenicity. The new scoring system had sensitivity 73.9%, specificity 97.7% and negative and positive predictive values of 96.6% and 80.9% respectively. Sensitivity of new scoring system was similar to previous ones but specificity of that is higher. New scoring system shows better to differentiate benign from malignant ovarian mass than four other scoring systems.25
We have chosen to use the first version RMI 1 as developed by Jacobs et al.7 Some limitation for this include Jacobs et al. allocating an ultrasound score of 0 when none of the ultrasound features were present, resulting in an RMI 1 of 0 regardless of the CA 125 level. In our study, no patient had malignant tumor in ultrasound score of 0.
The major finding of this study, accepting the RMI 1 cut-off value as 150, is statistically significant diagnostic criteria than menopausal status that discriminate between benign and malignant pelvic masses.

Figures and Tables

Fig. 1
Receiver operating characteristic (ROC) curves of individual predictors showing the relationship between sensitivity and specificity of menopause score, ultrasound score, serum cancer antigen (CA) 125 level and the risk of malignancy index (RMI) 1 in the discrimination between benign and malignant pelvic masses.
jksm-19-18-g001
Table 1
The distribution of histopathologic diagnosis
jksm-19-18-i001
Table 2
The distribution of benign and malignant cases by menopausal status, ultrasound score and serum cancer antigen 125
jksm-19-18-i002

CA 125: cancer antigen 125

Table 3
Sensitivity, specificity, positive (PPV) and negative (NPV) predictive values of serum cancer antigen 125, ultrasound score, menopausal status and different cut-off levels of the risk of malignancy index (RMI) 1
jksm-19-18-i003

PPV: positive, NPV: negative, CA 125: cancer antigen 125, RMI: risk of malignancy index

References

1. Young RC, Decker DG, Wharton JT, Piver MS, Sindelar WF, Edwards BK, et al. Staging laparotomy in early ovarian cancer. JAMA. 1983. 250:3072–3076.
2. Gillis CR, Hole DJ, Still RM, Davis J, Kaye SB. Medical audit, cancer registration, and survival in ovarian cancer. Lancet. 1991. 337:611–612.
3. Engelen MJ, Kos HE, Willemse PH, Aalders JG, de Vries EG, Schaapveld M, et al. Surgery by consultant gynecologic oncologists improves survival in patients with ovarian carcinoma. Cancer. 2006. 106:589–598.
4. Earle CC, Schrag D, Neville BA, Yabroff KR, Topor M, Fahey A, et al. Effect of surgeon specialty on processes of care and outcomes for ovarian cancer patients. J Natl Cancer Inst. 2006. 98:172–180.
5. Kumpulainen S, Kuoppala T, Leminen A, Penttinen J, Puistola U, Pukkala E, et al. Surgical treatment of ovarian cancer in different hospital categories--a prospective nation-wide study in Finland. Eur J Cancer. 2006. 42:388–395.
6. Goff BA, Matthews BJ, Wynn M, Muntz HG, Lishner DM, Baldwin LM. Ovarian cancer: patterns of surgical care across the United States. Gynecol Oncol. 2006. 103:383–390.
7. Jacobs I, Oram D, Fairbanks J, Turner J, Frost C, Grudzinskas JG. A risk of malignancy index incorporating CA 125, ultrasound and menopausal status for the accurate preoperative diagnosis of ovarian cancer. Br J Obstet Gynaecol. 1990. 97:922–929.
8. Tingulstad S, Hagen B, Skjeldestad FE, Onsrud M, Kiserud T, Halvorsen T, et al. Evaluation of a risk of malignancy index based on serum CA125, ultrasound findings and menopausal status in the pre-operative diagnosis of pelvic masses. Br J Obstet Gynaecol. 1996. 103:826–831.
9. Tingulstad S, Hagen B, Skjeldestad FE, Halvorsen T, Nustad K, Onsrud M. The risk-of-malignancy index to evaluate potential ovarian cancers in local hospitals. Obstet Gynecol. 1999. 93:448–452.
10. Davies AP, Jacobs I, Woolas R, Fish A, Oram D. The adnexal mass: benign or malignant? Evaluation of a risk of malignancy index. Br J Obstet Gynaecol. 1993. 100:927–931.
11. Morgante G, la Marca A, Ditto A, De Leo V. Comparison of two malignancy risk indices based on serum CA125, ultrasound score and menopausal status in the diagnosis of ovarian masses. Br J Obstet Gynaecol. 1999. 106:524–527.
12. Aslam N, Tailor A, Lawton F, Carr J, Savvas M, Jurkovic D. Prospective evaluation of three different models for the pre-operative diagnosis of ovarian cancer. BJOG. 2000. 107:1347–1353.
13. Manjunath AP, Pratapkumar , Sujatha K, Vani R. Comparison of three risk of malignancy indices in evaluation of pelvic masses. Gynecol Oncol. 2001. 81:225–229.
14. Mol BW, Boll D, De Kanter M, Heintz AP, Sijmons EA, Oei SG, et al. Distinguishing the benign and malignant adnexal mass: an external validation of prognostic models. Gynecol Oncol. 2001. 80:162–167.
15. Torres JC, Derchain SF, Faundes A, Gontijo RC, Martinez EZ, Andrade LA. Risk-of-malignancy index in preoperative evaluation of clinically restricted ovarian cancer. Sao Paulo Med J. 2002. 120:72–76.
16. Andersen ES, Knudsen A, Rix P, Johansen B. Risk of malignancy index in the preoperative evaluation of patients with adnexal masses. Gynecol Oncol. 2003. 90:109–112.
17. Obeidat BR, Amarin ZO, Latimer JA, Crawford RA. Risk of malignancy index in the preoperative evaluation of pelvic masses. Int J Gynaecol Obstet. 2004. 85:255–258.
18. Bailey J, Tailor A, Naik R, Lopes A, Godfrey K, Hatem HM, et al. Risk of malignancy index for referral of ovarian cancer cases to a tertiary center: does it identify the correct cases? Int J Gynecol Cancer. 2006. 16:Suppl 1. 30–34.
19. Ulusoy S, Akbayir O, Numanoglu C, Ulusoy N, Odabas E, Gulkilik A. The risk of malignancy index in discrimination of adnexal masses. Int J Gynaecol Obstet. 2007. 96:186–191.
20. Yamamoto Y, Yamada R, Oguri H, Maeda N, Fukaya T. Comparison of four malignancy risk indices in the preoperative evaluation of patients with pelvic masses. Eur J Obstet Gynecol Reprod Biol. 2009. 144:163–167.
21. FIGO Cancer Committee. Staging announcement. Gynecol Oncol. 1986. 25:383–385.
22. Strigini FA, Gadducci A, Del Bravo B, Ferdeghini M, Genazzani AR. Differential diagnosis of adnexal masses with transvaginal sonography, color flow imaging, and serum CA 125 assay in pre- and postmenopausal women. Gynecol Oncol. 1996. 61:68–72.
23. Yazbek J, Aslam N, Tailor A, Hillaby K, Raju KS, Jurkovic D. A comparative study of the risk of malignancy index and the ovarian crescent sign for the diagnosis of invasive ovarian cancer. Ultrasound Obstet Gynecol. 2006. 28:320–324.
24. Alanbay I, Akturk E, Coksuer H, Ercan M, Karaşahin E, Dede M, et al. Comparison of risk of malignancy index (RMI), CA125, CA 19-9, ultrasound score, and menopausal status in borderline ovarian tumor. Gynecol Endocrinol. 2012. 28:478–482.
25. Cho IS, Nam KH, Lee HH, Kim JS, Kim TH, Cho HJ, et al. A new scoring system for differentiation between benign and malignant ovarian masses. Korean J Obstet Gynecol. 2006. 49:1681–1689.
TOOLS
Similar articles