Journal List > Cancer Res Treat > v.54(1) > 1154851

TOOLS
Kang, Kim, Lim, Yoon, Kim, Kang, Nam, Shim, Lee, Bok, Lee, Shin, Ahn, Oh, and Cho: Validation of the Korean Version of the Patient-Reported Outcomes Measurement Information System 29 Profile V2.1 among Cancer Survivors
Original Article
General

Cancer Res Treat 2022;54(1):10-19.

Published online: 9 April 2021

DOI: https://doi.org/10.4143/crt.2020.1200

Validation of the Korean Version of the Patient-Reported Outcomes Measurement Information System 29 Profile V2.1 among Cancer Survivors

Danbee Kang1, 2, Youngha Kim2, Jihyun Lim2, Junghee Yoon3, Sooyeon Kim1, 2, Eunjee Kang2, 4, Heesu Nam1, 2, Sungkeun Shim2, 3, Mangyeong Lee2, 3, Haesook Bok5, 6, Sang-Won Lee6, Soo-Yong Shin3, 7, Jin Seok Ahn8, Dongryul Oh9, Juhee Cho1, 2, 3, 4

1Department of Clinical Research Design & Evaluation, SAIHST, Sungkyunkwan University, Seoul, Korea

2Center for Clinical Epidemiology, Samsung Medical Center, Seoul, Korea

3Department of Digital Health, SAIHST, Sungkyunkwan University, Seoul, Korea

4Department of Medical Device Management and Research, SAIHST, Sungkyunkwan University, Seoul, Korea

5Clinical Research Institute, Samsung Medical Center, Seoul, Korea

6School of Pharmacy, Sungkyunkwan University, Suwon, Korea

7Center for Research Resource Standardization, Seoul, Korea

8Division of Hematology/Oncology, Department of Medicine, Sungkyunkwan University School of Medicine, Seoul, Korea

9Department of Radiation Oncology, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Korea

Correspondence: Juhee Cho, Department of Clinical Research Design and Evaluation, SAIHST, Sungkyunkwan University, 81 Irwon-ro, Gangnam-gu, Seoul 06351, Korea, Tel: 82-2-3410-1448, Fax: 82-2-3410-6639, E-mail: jcho@skku.edu

* Danbee Kang and Youngha Kim contributed equally to this work.

Received 16 November 2020       Accepted 8 April 2021

Copyright © 2022 by the Korean Cancer Association

This is an Open-Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0/) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Purpose

The purpose of the study was to validate the Korean version of Patient-Reported Outcomes Measurement Information System 29 Profile v2.1 (K-PROMIS-29 V2.1) among cancer survivors.

Materials and Methods

Participants were recruited from outpatient clinics of the Comprehensive Cancer Center at the Samsung Medical Center in Seoul, South Korea, from September to October 2018. Participants completed a survey questionnaire that included the K-PROMIS-29 V2.1 and the European Organisation for Research and Treatment of Cancer Quality of Life Core Questionnaire (EORTC QLQ-C30). Principal component analysis and confirmatory factor analysis (CFA) and Pearson’s correlations were used to evaluate the reliability and validity of the K-PROMIS-29 V2.1.

Results

The mean age of the study participants was 54.4 years, the mean time since diagnosis was 1.2 (±2.4) years, and 349 (87.3%) completed the entire questionnaire. The Cronbach’s alpha coefficients of the seven domains in the K-PROMIS-29 V2.1 ranged from 0.81 to 0.96, indicating satisfactory internal consistency. In the CFA, the goodness-of-fit indices for the K-PROMIS-29 V2.1 were high (comparative fit index, 0.91 and standardized root-mean-squared residual, 0.06). High to moderate correlations were found between comparable subscales of the K-PROMIS-29 V2.1 and subscales of the EORTC QLQ-C30 (r=0.52–0.73).

Conclusion

The K-PROMIS-29 V2.1 is a reliable and valid measure for assessing the health-related quality of life domains in a cancer population, thus supporting their use in studies and oncology trials.

Keywords: Quality of life, Cancer, Validation, PROMIS-29

Introduction

Measurement of patient-reported outcome (PRO) enables a holistic assessment of treatment benefit, and the use of PRO measures is emphasized in many treatment guidelines [1]. Moreover, both the U.S. Food and Drug Administration (FDA) and the European Medicines Agency (EMA) encourage the assessment of PROs in anticancer drug development [2]. In cancer patients, the European Organisation for Research and Treatment of Cancer Quality of Life Core Questionnaire (EORTC QLQ-C30) [3], and the Functional Assessment of Cancer Therapy-General (FACT-G) [4] are most widely used to measure health-related quality of life (HRQoL). However, the purpose of cancer-specific measurements is to identify cancer treatment-related symptoms and functions that could make it difficult to compare with other diseases [5]. Therefore, a generic measurement score for PROs could also be needed to evaluate cancer’s relative burden compared with other diseases [6]. In addition, since long-term survival rates for many types of cancer have substantially improved over the past decades [7], there is also a need to measure HRQoL in patients’ different settings beyond cancer treatment itself. Therefore, comprehensive generic measures may add more predictive value for HRQoL of cancer patients than cancer-specific measures, which focus more on symptoms [8].
Generic measurements, such as the 36-item short-form health survey (SF-36) [9], and the EuroQoL-5D (EQ-5D) [10], were frequently used to assess the HRQoL of cancer patients [11]. Both measurements had reported limitations in measuring the HRQoL of patients with cancer. SF-36 does not include important symptoms for patients with cancer, such as fatigue, pain, anxiety, depression, and sleep [9], and it has been reported that the EQ-5D does not capture all aspects of health state that matter to patients, specifically in cancer [12]. Inevitably, unmeasured health-related aspects perceived to impact an individual’s quality of life (QoL) significantly generate inaccuracies in HRQoL measurements [12]. In the face of these challenges and limitations, the Patient-Reported Outcomes Measurement Information System 29 Profile v2.1 (PROMIS-29 V2.1), a multi-item measure for assessing generic profile HRQoL developed by the National Institutes of Health (NIH), has been suggested [13]. While cancer patients were included in the validation of PROMIS measures [13–15], studies were limited to specific cancer patients. Moreover, there is no psychometric evaluation of the PROMIS-29 V2.1 among cancer survivors.

Materials and Methods

1. Study participants and procedure

This was a cross-sectional study. Study participants were recruited from outpatient clinics of the Comprehensive Cancer Center at the Samsung Medical Center in Seoul, South Korea, from September to October 2018. Patients were eligible if they were aged 18 or older, diagnosed with cancer, receiving cancer treatment or completing active cancer treatment within 6 months, and able to speak and read Korean. We excluded patients who had any physical or psychiatric conditions that would interfere with completing the questionnaire. Trained researchers explained the purpose and procedures of the study to the participants.

2. Measurement

We used the Korean version of the PROMIS-29 Profile v2.1 (K-PROMIS-29 V2.1) obtained from the PROMIS Health Organization (https://www.promishealth.org). The PROMIS-29 V2.1 consists of 29 items across seven domains: physical function (four items), anxiety (four items), depression (four items), fatigue (four items), sleep disturbance (four items), ability to participate in social roles and activities (four items), pain interference (four items), and pain intensity (one item). We used a five-point Likert scale (range, 1 to 5) to measure the severity or frequency of the symptoms. The single pain intensity item is measured separately, and the response scale ranges from 0 (no pain) to 10 (worst pain imaginable). Items to evaluate the physical function and ability to participate in social roles and activities domains do not specify a time frame. For the other five domains, items pertain to the past seven days. Domain scores were obtained by summing the item scores for each domain. The PROMIS-29 V2.1 scale is scored using a T-score metric via the Assessment Center. The T-score rescales the raw score into a standardized T-score with a mean of 50 and a standard deviation (SD) of 10. When we calculated the T-score, we included all participants, even those with missing values, using the Assessment Center algorithm.
To examine convergent and discriminant validity, we used the EORTC QLQ-C30, a 30-item cancer-specific questionnaire. The EORTC QLQ-C30 includes five functional domains—physical (five items), role (two items), cognitive (two items), emotional (four items), and social (two items); one global health status scale (two items); three symptom scales—fatigue (three items), pain (two items), and nausea and vomiting (two items); and six single items—dyspnea, appetite loss, sleep disturbance, constipation, diarrhea, and financial difficulty that assess symptoms commonly reported by patients with cancer [3]. Participants rated each item on a Likert scale ranging from 1 (not at all) to 4 (very much), excluding the global health status items, which were rated from 1 (very poor) to 7 (excellent). Items to evaluate all domains pertain to the previous week, except for the physical function domain. Items to evaluate physical function do not specify a timeframe. We used the scoring procedures outlined in the manual to score the EORTC QLQ-C30 items [16] and linearly transformed the data to yield scores from 0 to 100; a higher score represented a better level of functioning. The EORTC QLQ-C30 has been validated, translated to Korean [17], and widely used to measure the QoL of cancer survivors in Korea.
We also asked study participants about their socio-demographic characteristics, including marital status, education level, monthly family income, and employment status. Clinical characteristics were obtained from electronic medical records.

3. Statistical analysis

The analysis was conducted using the raw score. To assess the reliability of the K-PROMIS-29 V2.1, we calculated the internal consistency of each domain using Cronbach’s α and the item-rest correlation for each item. It is generally accepted that an α of 0.6–0.7 indicates an acceptable level, and 0.8 or greater indicates a very good level of reliability [18].
To confirm the construct validity, we performed a principal component analysis (PCA) to determine the underlying structure of the K-PROMIS-29 V2.1. After extracting factors that had an eigenvalue > 1 using scree plot, we performed a principle axis factor procedure with a varimax rotation to extract latent constructs to simplify the loadings of items by removing the middle ground and more specifically identifying the factor upon which data load. Furthermore, we carried out a confirmatory factor analysis (CFA) using the maximum likelihood to test whether our factor structure fits the data. Several goodness-of-fit indices were used to evaluate the model fit, including the goodness-of-fit index, comparative fit index (CFI), standardized root-mean-squared residual (SRMR), non-normed fit index (NNFI), and Akaike’s information criterion (AIC). A CFI > 0.9, SRMR < 0.08, and NNFI ≥ 0.95 indicate a good fit to the data [19].
To examine convergent and discriminant validity, first hypotheses on the direction and magnitude were formulated [20] and summed item scores for each domain of the K-PROMIS-29 V2.1 (physical function, anxiety, depression, fatigue, sleep disturbance, ability to participate in social roles and activities, pain interference, and pain intensity) and linearly transformed domain score of EORTC QLQ-C30 (global health status, physical, role, cognitive, emotional, social, fatigue, pain, nausea, vomiting, dyspnea, appetite loss, sleep disturbance, constipation, diarrhea, and financial difficulty) were calculated. Then, we calculated Pearson’s correlation coefficients between the K-PROMIS-29 V2.1 and EORTC QLQ-C30. Moderate (0.5 < |r| < 0.7) or large correlations (|r| ≥ 0.7) were considered to indicate construct validity [21]. We completed a pairwise deletion in the analysis.
All significance tests were two-tailed, and p < 0.05 was considered significant. All data analyses were performed using STATA ver. 15 (StataCorp LLC, College Station, TX).

Results

1. Study participants

A total of 400 patients were enrolled in the study, and 349 (87.3%) completed the study questionnaire. Among the 51 patients who were excluded from the study due to missing responses, eight (15.7%), nine (17.6%), and 34 (66.7%) did not answer 1, 2, and more than three items, respectively. Of these missing responses, the item on sleep quality was not answered the most (9.8%).
Of the 349 patients, 170 (48.7%) were female and had a mean age (SD) of 54.4 (10.2) years. Among the participants, 11.3% had completed less than a middle school education (Table 1). The types of cancer that participants had included breast cancer (n=73, 20.9%), lung cancer (n=59, 16.9%), colorectal cancer (n=55, 15.8%), head and neck or esophageal (n=41, 11.8%), gastric cancer (n=17, 4.9%), and others. In the T-scores, the study sample reported higher depression (mean±SD, 51.0±8.5), anxiety (51.5±9.1), and sleep disturbance (52.1±7.7) scores compared to the general population (Table 2) [13].

2. Construct validity

The Cronbach’s alpha coefficients of the seven domains in the K-PROMIS-29 V2.1 ranged from 0.81 to 0.96, indicating satisfactory internal consistency. Pain interference had the highest Cronbach’s α (0.96). Item-rest correlations, when any one of the items was removed, varied from 0.56 to 0.94. While all the items had generally acceptable levels of item-rest correlation (≥ 0.60), the item “In the past 7 days, my sleep was refreshing” had a relatively low correlation (r=0.56) with other items in the sleep disturbance domain (Table 2).
In the PCA, the factor loadings for the varimax rotated factors were obtained (Table 3, S1 Fig.). The variance explained by the seven-factor solution was 79.8%. The percentage of variance explained of F5, F1, F3, F7, F6, F4, and F2 were 9.3%, 18.2%, 11.8%, 6.3%, 6.8%, 11.6%, and 15.8% (Table 3), respectively. While other domains confirmed our hypothesis regarding the original constructs of the K-PROMIS-29 V2.1, “depression and anxiety” were combined as one domain, and sleep disturbance items were separated by “sleep quality” and “sleep was refreshing,” among others (S2 Table).
In the CFA, the goodness-of-fit indices for the K-PROMIS-29 V2.1 (Fig. 1) were high (CFI, 0.91; SRMR, 0.06; NNFI, 0.90 and AIC, 20114.171). However, “problem with my sleep” and “difficulty falling asleep” in the sleep domain had relatively large errors. Regarding the correlation between the domains in the K-PROMIS-29 V2.1, depression had a high correlation with anxiety (r=0.80).

3. Convergent validity

In the convergent and discriminant validity of the K-PROMIS-29 V2.1, pain interference and physical function in the K-PROMIS-29 V2.1 and pain and physical functioning in the EORTC QLQ-C30 observed a large correlation (r=0.73 and r=0.71, respectively). In addition, the correlations between ability to participate in social role activities in the K-PROMIS-29 V2.1 and role functioning (r=0.65) and social functioning (r=0.52) in the EORTC QLQ-C30 were moderate. Regarding anxiety (r=−0.66) and depression (r=−0.55) in the K-PROMIS-29 V2.1, there were moderate correlations observed with emotional functioning in the EORTC QLQ-C30. Fatigue (r=0.66) and sleep disturbance (r=0.64) in the K-PROMIS-29 V2.1 were also moderately correlated with fatigue and insomnia in the EORTC QLQ-C30, respectively (Table 4).

Discussion

In this study, the Korean version of the PROMIS-29 V2.1 was found to be a reliable and valid measure of HRQoL among cancer patients. The goodness-of-fit indices of the K-PROMIS-29 V2.1 were also high. Moderate or higher correlations also demonstrated the convergent validity of the K-PROMIS-29 V2.1 with relevant EORTC QLQ-C30 questionnaires.
In total, 88% of participants completed all the questions without any missing items, which is a higher completion rate than those of other studies. Considering that over 15.2% and 11.3% of the study participants were older than 65 years and less than middle school graduates, the K-PROMIS-29 V2.1 seems to be a feasible instrument to evaluate HRQoL regardless of age and literacy level. In our study, the most commonly unanswered question by study participants was “My sleep was refreshing.” In previous studies conducted in Dutch [22], responders also felt that it was difficult to understand it. The researcher who conducted the previous study suggested alternatives items, such as “My sleep gave me new energy” which could improve understanding [22]. Our study participants might have difficulties in understanding the sentence because the word “refreshing” is not commonly used to describe sleep quality.
The results indicate that the internal consistency and reliability of the measure are high. All subdomains showed an acceptable Cronbach’s alpha level, which is considered acceptable for internal consistency [23]. Interestingly, in our study, items for anxiety and depression were loaded to one factor in PCA, and there was also a strong correlation between depression and anxiety in the CFA. This might be because these are the two most common symptoms experienced by cancer survivors. In a previous study, anxiety and depressive disorder was commonly cited at a 25%–40% overlap [24]. In other words, because many cancer patients experience depression and anxiety simultaneously, items loaded to one factor reflect a high level of negative affect, which might be common to both depression and anxiety [25]. Given the large correlations among the two constructs, further study is needed to investigate hierarchical and multidimensional models of depression and anxiety that will allow us to “borrow” information between these constructs and create an even more efficient computer adaptive tests for their assessment.
Although other domains and items had strong to moderate correlations with each other, items asking about sleep quality had relatively low item-rest correlations with the other two items of the sleep disturbance domain: “In the past 7 days, I had a problem with my sleep” and “In the past 7 days, I had difficulty falling asleep,” and they also had large errors in the CFA. In fact, they were loaded to a different factor in the PCA. In a previous study, sleep initiation and sleep continuity appeared as separate constructs, and people perceived feeling refreshed in the morning and good sleep continuity as good sleep [26].
The convergent validity of the K-PROMIS-29 V2.1 was demonstrated by its varying degrees of correlation with the EORTC QLQ-C30. The K-PROMIS-29 V2.1 domain correlated with the comparable EORTC QLQ-C30 subdomain. Moreover, symptoms that have been reported frequently in cancer patients, such as anxiety, depression, fatigue, and sleep disturbance, might be more sensitive to the K-PROMIS-29 V2.1 than the EORTC QLQ-C30, as the K-PROMIS-29 V2.1 includes multiple items to assess those conditions [13]. For example, while the EORTC QLQ-C30 uses one item (Did you feel depressed?) to assess depression, the K-PROMIS-29 V2.1 evaluates depression symptoms using multiple items, including “worthless, helpless, depressed, or hopeless.” Similarly, sleep quality is also assessed by a single item with the EORTC QLQ-C30, and it might not capture the construct, have fewer points of discrimination, and lack a measure of internal consistency reliability compared to the sleep domain of the K-PROMIS-29 V2.1, which includes multiple items.
This study has several limitations. First, we recruited only individuals visiting the outpatient clinic at one institution in Korea. These findings may not be generalizable to patients in other settings. However, this study included patients with multiple types of cancer, and it could cover many areas of cancer. In addition, we included patients with very low educational attainment, suggesting that the K-PROMIS-29 V2.1 has acceptable measurement properties for use in diverse patients with cancer. Second, we did not conduct a test-retest. Therefore, additional research is needed to evaluate reliability. However, since many studies have already proven the reliability of the PROMIS-29, we expected the results to be similar to those in previous studies. Finally, we did not include other general measurements, such as the SF-36 or EQ-5D. However, previous studies have already confirmed that the PROMIS-29 is highly correlated with the SF-36 and EQ-5D [27,28]. In addition, the PROMIS-29 produced more sensitivity to function changes than the SF-36 [29], and had a higher correlation with self-reported health, more sensitive, and required fewer respondents than the EQ-5D [27].
In conclusion, this study adds to the evidence base supporting the reliability and validity of K-PROMIS-29 V2.1 in assessing QoL among Korean speakers being treated for cancer. The PROMIS-29 is quickly becoming a standard PRO research and practice measure and is recommended for initial outcome assessment [30]. In addition, PROMIS integrates item response theory and computer adaptive testing to create individualized questionnaires [13]. Therefore, this study provides psychometric evidence for the reliability and construct validity of the K-PROMIS-29 V2.1 measures in a cancer population, supporting their use in studies and oncology trials.

Electronic Supplementary Material

Supplementary materials are available at Cancer Research and Treatment website (https://www.e-crt.org).
crt-2020-1200_S1_Fig.pdf
crt-2020-1200_S2_Table.pdf

Notes

Ethical Statement

After providing informed consent, participants were asked to complete the paper questionnaire. This study was approved by the Institutional Review Board (IRB) of the Samsung Medical Center (IRB number: SMC-2017-03-103-012).

Author Contributions

Conceived and designed the analysis: Kang D, Kim Y, Lim J, Yoon J, Kim S, Kang E, Nam H, Shim S, Lee M, Bok H, Lee SW, Shin SY, Ahn JS, Oh D, Cho J.

Collected the data: Kim Y, Yoon J, Shim S, Lee M, Oh D, Cho J.

Contributed data or analysis tools: Kang D, Kim Y, Lim J, Bok H, Ahn JS, Oh D, Cho J.

Performed the analysis: Kang D, Kim Y, Lim J, Cho J.

Wrote the paper: Kang D, Kim Y, Lim J, Yoon J, Kim S, Kang E, Nam H, Shim S, Lee M, Bok H, Lee SW, Shin SY, Ahn JS, Oh D, Cho J.

Conflicts of Interest

Conflict of interest relevant to this article was not reported.

Acknowledgments

This research was supported by a grant (18182MFDS407) from the Ministry of Food and Drug Safety in 2018 and the Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (2020R1I1A20-74210).

References

1. Kim JY, Lee KE, Kim K, Lee MA, Yoon WS, Han DS, et al. Choosing wisely: the Korean perspective and launch of the ‘right decision in cancer care’ initiative. Cancer Res Treat. 2020; 52:655–60.
crossref
2. European Medicines Agency. Appendix 2 to the guideline on the evaluation of anticancer medicinal products in man: the use of patient–reported outcome (PRO) measures in oncology studies. Amsterdam: European Medicines Agency;2016.
3. Aaronson NK, Ahmedzai S, Bergman B, Bullinger M, Cull A, Duez NJ, et al. The European Organization for Research and Treatment of Cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology. J Natl Cancer Inst. 1993; 85:365–76.
crossref
4. Cella DF, Tulsky DS, Gray G, Sarafian B, Linn E, Bonomi A, et al. The Functional Assessment of Cancer Therapy scale: development and validation of the general measure. J Clin Oncol. 1993; 11:570–9.
crossref
5. Sprangers MA, Cull A, Bjordal K, Groenvold M, Aaronson NK. The European Organization for Research and Treatment of Cancer: approach to quality of life assessment: guidelines for developing questionnaire modules. EORTC Study Group on Quality of Life. Qual Life Res. 1993; 2:287–95.
6. Jensen RE, Potosky AL, Moinpour CM, Lobo T, Cella D, Hahn EA, et al. United States population-based estimates of patient-reported outcomes measurement information system symptom and functional status reference values for individuals with cancer. J Clin Oncol. 2017; 35:1913–20.
crossref
7. Brenner H. Long-term survival rates of cancer patients achieved by the end of the 20th century: a period analysis. Lancet. 2002; 360:1131–5.
crossref
8. Grande GE, Farquhar MC, Barclay SI, Todd CJ. Quality of life measures (EORTC QLQ-C30 and SF-36) as predictors of survival in palliative colorectal and lung cancer patients. Palliat Support Care. 2009; 7:289–97.
crossref
9. Ware JE Jr, Sherbourne CD. The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care. 1992; 30:473–83.
10. Brooks R. EuroQol: the current state of play. Health Policy. 1996; 37:53–72.
crossref
11. Wells GA, Russell AS, Haraoui B, Bissonnette R, Ware CF. Validity of quality of life measurement tools: from generic to disease-specific. J Rheumatol Suppl. 2011; 88:2–6.
12. Efthymiadou O, Mossman J, Kanavos P. Health related quality of life aspects not captured by EQ-5D-5L: results from an international survey of patients. Health Policy. 2019; 123:159–65.
crossref
13. Cella D, Riley W, Stone A, Rothrock N, Reeve B, Yount S, et al. The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005–2008. J Clin Epidemiol. 2010; 63:1179–94.
crossref
14. Jensen RE, Potosky AL, Reeve BB, Hahn E, Cella D, Fries J, et al. Validation of the PROMIS physical function measures in a diverse US population-based cohort of cancer patients. Qual Life Res. 2015; 24:2333–44.
crossref
15. Quach CW, Langer MM, Chen RC, Thissen D, Usinger DS, Emerson MA, et al. Reliability and validity of PROMIS measures administered by telephone interview in a longitudinal localized prostate cancer study. Qual Life Res. 2016; 25:2811–23.
crossref
16. Fayers PM, Aaronson NK, Bjordal K, Groenvold M, Curran D, Bottomley A. The EORTC QLQ-C30 scoring manual. 3rd ed. Brussels: European Organization for Research and Treatment of Cancer;2001.
17. Yun YH, Park YS, Lee ES, Bang SM, Heo DS, Park SY, et al. Validation of the Korean version of the EORTC QLQ-C30. Qual Life Res. 2004; 13:863–8.
crossref
18. Ursachi G, Horodnic IA, Zait A. How reliable are measurement scales? External factors with indirect influence on reliability estimators. Procedia Econ Financ. 2015; 20:679–86.
crossref
19. Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Modeling. 1999; 6:1–55.
crossref
20. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010; 19:539–49.
crossref
21. Hinkle DE, Wiersma W, Jurs SG. Applied statistics for the behavioral sciences. Boston, MA: Houghton Mifflin;2003.
22. van Kooten JA, Terwee CB, Kaspers GJ, van Litsenburg RR. Content validity of the patient-reported outcomes measurement information system sleep disturbance and sleep related impairment item banks in adolescents. Health Qual Life Outcomes. 2016; 14:92.
crossref
23. Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007; 60:34–42.
crossref
24. Dobson KS. The relationship between anxiety and depression. Clin Psychol Rev. 1985; 5:307–24.
crossref
25. Krueger RF, Finger MS. Using item response theory to understand comorbidity among anxiety and unipolar mood disorders. Psychol Assess. 2001; 13:140–51.
crossref
26. Libman E, Fichten C, Creti L, Conrod K, Tran DL, Grad R, et al. Refreshing sleep and sleep continuity determine perceived sleep quality. Sleep Disord. 2016; 2016:7170610.
crossref
27. Hartman JD, Craig BM. Comparing and transforming PROMIS utility values to the EQ-5D. Qual Life Res. 2018; 27:725–33.
crossref
28. Morrisroe K, Stevens W, Huq M, Sahhar J, Ngian GS, Zochling J, et al. Validity of the workers productivity and activity impairment questionnaire: specific health problem (WPAI: SHP) in patients with systemic sclerosis. Clin Exp Rheumatol. 2017; 35(Suppl 106):130–7.
29. Hinchcliff ME, Beaumont JL, Carns MA, Podlusky S, Thavarajah K, Varga J, et al. Longitudinal evaluation of PROMIS-29 and FACIT-dyspnea short forms in systemic sclerosis. J Rheumatol. 2015; 42:64–72.
crossref
30. Forrest CB, Bevans KB, Tucker C, Riley AW, Ravens-Sieberer U, Gardner W, et al. Commentary: the patient-reported outcome measurement information system (PROMIS(R)) for children and youth: application to pediatric psychology. J Pediatr Psychol. 2012; 37:614–21.
crossref

Fig. 1
Confirmatory factor analysis of the items in the Korean version of the Patient-Reported Outcomes Measurement Information System 29 Profile v2.1.
crt-2020-1200f1.gif
Table 1
Characteristics of study population
Characteristic No. (%) (n=349)
Female sex 170 (48.7)
Age (yr) 54.4±10.2
 Age ≥ 65 53 (15.2)
Marital status
 Single 23 (6.7)
 Married 299 (86.7)
 Divorced/Widowed 23 (6.7)
Education
 ≤ Middle school 39 (11.3)
 High school 142 (41.2)
  College and higher 164 (47.5)
Monthly family income
 < $2,000 71 (20.7)
 $2,000–$3,990 103 (30.0)
 ≥ $4,000 169 (49.3)
Current worker 129 (37.4)
Smoking status
 Never smoked 171 (50.4)
 Past smoker 163 (48.1)
 Current smoker 5 (1.5)
Drinking status
 Never drank 81 (23.8)
 Past drinker 244 (71.8)
 Current drinker 15 (4.4)
Time since diagnosis (yr) 1.2 (2.4)
Type of cancer
 Breast cancer 73 (20.9)
 Gastric cancer 17 (4.9)
 Lung cancer 59 (16.9)
 Head and neck/Esophageal 41 (11.8)
 Lymphoma/Myeloma 25 (7.2)
 Colorectal cancer 55 (15.8)
 Other 79 (22.6)

Values are presented as number (%) or mean±SD. In this data set, education level (n=4), current worker (n=4), marital status (n=4), walking support (n=6), smoking status (n=10), drinking status (n=9), and monthly family income (n=6) had missing data. For all other variables, the values were available for all participants.

Table 2
Percentage of variance explained by each domain (item numbers represent the order in the instrument)
Mean±SD Cronbach’s α Item-rest correlation
Raw score T-score
Physical function 18.1±2.8 49.6±7.5 0.87
 Are you able to do chores such as vacuuming or yard work? 0.73
 Are you able to go up and down stairs at a normal pace? 0.70
 Are you able to go for a walk of at least 15 minutes? 0.71
 Are you able to run errands and shop? 0.75
Anxiety 7.1±3.3 51.5±9.1 0.91
 In the past 7 days, I felt fearful 0.77
 In the past 7 days, I found it hard to focus on anything other than my anxiety 0.77
 In the past 7 days, my worries overwhelmed me 0.84
 In the past 7 days, I felt uneasy 0.80
Depression 6.9±3.3 51.0±8.5 0.90
 In the past 7 days, I felt worthless 0.81
 In the past 7 days, I felt helpless 0.83
 In the past 7 days, I felt depressed 0.75
 In the past 7 days, I felt hopeless 0.74
Fatigue 7.6±3.7 45.7±9.9 0.94
 During the past 7 days, I feel fatigued 0.80
 During the past 7 days, I have trouble starting things because I am tired 0.82
 In the past 7 days, how run-down did you feel on average? 0.89
 In the past 7 days, how fatigued were you on average? 0.89
Sleep disturbance 10.9±3.4 52.1±7.7 0.81
 In the past 7 days, my sleep quality was… 0.64
 In the past 7 days, my sleep was refreshing 0.56
 In the past 7 days, I had a problem with my sleep 0.66
 In the past 7 days, I had difficulty falling asleep 0.63
Ability to participate in social roles and activities 14.7±4.7 50.6±10.5 0.93
 I have trouble doing all of my regular leisure activities with others 0.83
 I have trouble doing all of the family activities that I want to do 0.87
 I have trouble doing all of my usual work (include work at home) 0.83
 I have trouble doing all of the activities with friends that I want to do 0.85
Pain interference 7.7±4.3 51.8±9.3 0.96
 In the past 7 days, how much did pain interfere with your day to day activities? 0.89
 In the past 7 days, how much did pain interfere with work around the home? 0.94
 In the past 7 days, how much did pain interfere with your ability to participate in social activities? 0.86
 In the past 7 days, how much did pain interfere with your household chores? 0.90
Pain intensity 2.7±2.4
 In the past 7 days, how would you rate your pain on average?

SD, standard deviation.

Table 3
Exploratory factor analysis of the K-PROMIS-29 items
Original domain and items Factor loading Percentage of variance explained
F1 F2 F3 F4 F5 F6 F7
F5
 Physical function 9.3
  Are you able to do chores such as vacuuming or yard work? 0.20 0.30 0.28 0.21 0.68a) 0.08 0.04
  Are you able to go up and down stairs at a normal pace? 0.09 0.21 0.26 0.29 0.69a) 0.13 0.03
  Are you able to go for a walk of at least 15 minutes? 0.13 0.20 0.16 0.13 0.81a) −0.02 0.07
  Are you able to run errands and shop? 0.19 0.25 0.21 0.17 0.77a) 0.04 −0.02
F1 18.2
 Anxiety
  In the past 7 days, I felt fearful 0.75a) 0.06 0.11 0.14 0.14 0.15 0.08
  In the past 7 days, I found it hard to focus on anything other than my anxiety 0.75a) 0.14 0.14 0.14 0.17 0.15 0.06
  In the past 7 days, my worries overwhelmed me 0.84a) 0.05 0.11 0.09 0.08 0.16 0.08
  In the past 7 days, I felt uneasy 0.81a) 0.15 0.15 0.17 0.11 0.14 0.05
 Depression
  In the past 7 days, I felt worthless 0.73a) 0.20 0.23 0.16 0.04 −0.09 0.11
  In the past 7 days, I felt helpless 0.69a) 0.19 0.31 0.21 0.13 −0.09 0.16
  In the past 7 days, I felt depressed 0.78a) 0.08 0.28 0.18 0.09 0.00 0.07
  In the past 7 days, I felt hopeless 0.71a) 0.12 0.32 0.15 0.09 −0.02 0.07
F3
 Fatigue 11.8
  During the past 7 days, I feel fatigued 0.30 0.18 0.75a) 0.19 0.23 0.04 0.10
  During the past 7 days, I had trouble starting things because I was tired 0.22 0.23 0.74a) 0.27 0.28 0.05 0.09
  In the past 7 days, how run-down did you feel on average? 0.27 0.23 0.81a) 0.26 0.14 0.07 0.12
  In the past 7 days, how fatigued were you on average? 0.28 0.23 0.81a) 0.22 0.17 0.13 0.12
F7 6.3
 Sleep disturbance
  In the past 7 days, my sleep quality was… 0.11 0.13 0.12 0.06 0.03 0.25 0.87a)
  In the past 7 days, my sleep was refreshing 0.13 0.10 0.12 0.12 0.04 0.13 0.91a)
F6 6.8
 In the past 7 days, I had a problem with my sleep 0.09 0.15 0.06 0.05 0.05 0.91a) 0.19
 In the past 7 days, I had difficulty falling asleep 0.10 0.14 0.08 0.09 0.04 0.92a) 0.15
F4
 Ability to participate in social roles and activities 11.6
  I have trouble doing all of my regular leisure activities with others 0.16 0.19 0.16 0.86a) 0.12 0.08 0.14
  I have trouble doing all of the family activities that I want to do 0.23 0.33 0.26 0.77a) 0.16 0.07 0.08
  I have trouble doing all of my usual work (include work at home) 0.19 0.33 0.31 0.71a) 0.23 0.08 0.05
  I have trouble doing all of the activities with friends that I want to do 0.21 0.24 0.20 0.83a) 0.15 0.03 0.03
F2
 Pain interference 15.8
  In the past 7 days, how much did pain interfere with your day to day activities? 0.08 0.87a) 0.20 0.19 0.14 0.11 0.09
  In the past 7 days, how much did pain interfere with work around the home? 0.10 0.89a) 0.18 0.20 0.17 0.10 0.08
  In the past 7 days, how much did pain interfere with your ability to participate in social activities? 0.14 0.83a) 0.12 0.32 0.12 0.03 0.07
  In the past 7 days, how much did pain interfere with your household chores? 0.14 0.85a) 0.12 0.23 0.22 0.13 0.01
 Pain intensity
  In the past 7 days, how would you rate your pain on average? 0.13 0.80a) 0.17 0.02 0.08 0.11 0.14

a) The factors that affect the question the most (and therefore have the highest factor loadings) are marked.

Table 4
Pearson’s correlation coefficients comparing the K-PROMIS-29 V2.1 with EORTC QLQ-C30 (n=349)
EORTC QLQ C-30 K-PROMIS-29 V2.1
Physical function Anxiety Depression Ability to participate in social roles and activities Fatigue Pain interference Sleep disturbance
Overall
 Overall QoL/Health status 0.37* −0.44* −0.44* 0.52* −0.49* −0.43* −0.27*
Function
 Physical 0.71*a) −0.39* −0.41* 0.61* −0.61* −0.56* −0.27*
 Emotional 0.33* −0.66*a) −0.55*a) 0.35* −0.51* −0.37* −0.31*
 Role 0.57* −0.41* −0.45* 0.65*a) −0.59* −0.53* −0.22*
 Social 0.32* −0.43* −0.39* 0.52*a) −0.44* −0.40* −0.25*
 Cognitive 0.34* −0.38* −0.33* 0.32* −0.44* −0.30* −0.31*
Symptoms
 Fatigue −0.54* 0.37* 0.38* −0.55* 0.66*a) 0.53* 0.35*
 Nausea/Vomiting −0.28* 0.17* 0.20* −0.31* 0.35* 0.30* 0.13*
 Pain −0.49* 0.32* 0.34* −0.44* 0.51* 0.73*a) 0.33*
 Dyspnea −0.47* 0.32* 0.32* −0.40* 0.51* 0.40* 0.20*
 Insomnia −0.35* 0.30* 0.25* −0.32* 0.37* 0.31* 0.64*a)
 Appetite loss −0.39* 0.26* 0.28* −0.42* 0.44* 0.40* 0.29*
 Constipation −0.24* 0.10 0.15* −0.20* 0.26* 0.26* 0.21*
 Diarrhea −0.06 0.08 0.11* −0.08 0.11* 0.14* 0.11
 Financial −0.23* 0.33* 0.34* −0.29* 0.35* 0.28* 0.28*

EORTC QLQ-C30, European Organisation for the Research and Treatment of Cancer Quality of Life Questionnaire Core 30; K-PROMIS-29 V2.1, Korean version of Patient-Reported Outcomes Measurement Information System 29 Profile v2.1; QoL, quality of life.

* Pearson’s correlation coefficient, all p < 0.05.

a) Domains expected to be highly correlated.

TOOLS
Similar articles