Article Text
Abstract
Objectives To assess (A) determinants of patient's global assessment of disease activity (PTGL) and patient's assessment of general health (GH) scores of rheumatoid arthritis (RA) patients; (B) whether they are equivalent as individual variables; and (C) whether they may be used interchangeably in calculating common RA activity assessment composite indices.
Methods Data of 7023 patients from 30 countries in the Quantitative Standard Monitoring of Patients with RA (QUEST-RA) was analysed. PTGL and GH determinants were assessed by mixed-effects analyses of covariance models. PTGL and GH equivalence was determined by Bland-Altman 95% limits of agreement (BALOA) and Lin's coefficient of concordance (LCC). Concordance between PTGL and GH based Disease Activity Score 28 (DAS28), Clinical Disease Activity Index (CDAI) and Routine Assessment of Patient Index Data 3 (RAPID3) indices were calculated using LCC, and the level of agreement in classifying RA activity in four states (remission, low, moderate, high) using κ statistics.
Results Significant differences in relative and absolute contribution of RA and non-RA related variables in PTGL and GH ratings were noted. LCC of 0.64 and BALOA of −4.41 to 4.54 showed that PTGL and GH are not equivalent. There was excellent concordance (LCC 0.95–0.99) for PTGL and GH based DAS28, CDAI and RAPID3 indices, and >80% absolute agreement (κ statistics 0.75–0.84) in RA activity state classification for all three indices.
Conclusions PTGL and GH ratings differ in their determinants. Although they are individually not equivalent, they may be used interchangeably for calculating composite indices for RA activity assessment.
Statistics from Altmetric.com
Disease activity is an important concept in the evaluation of patients with rheumatoid arthritis (RA) in clinical care and research. Objective RA activity assessment, to guide treatment decisions, is recommended to achieve remission or at least low disease activity state.1 ,2 Since there is no single ‘gold standard’ variable that reflects RA activity in a valid and reliable fashion, composite indices, derived from multiple individual variables, have been developed for RA activity assessment.3
A patient self-report ‘global measure’ is part of the American College of Rheumatology (ACR) core data set and a component of multiple composite indices used for RA activity assessment and treatment response. The patient's global assessment is one of the outcome measures commonly included in these indices because it is reliable, sensitive to change, feasible (one item), and directly reflects the patient's overall perspective.4 ,5 This ‘global measure’ has been defined either as patient's global assessment of disease activity (PTGL), which directs the patient to respond specifically to the effects of RA, or the patient's assessment of general health/global health (GH), which asks more generically about health. GH was originally a component of the Disease Activity Score (DAS)6 and the subsequent modification of DAS287; while PTGL was originally a component of Simplified Disease Activity Index (SDAI),8 Clinical Disease Activity Index (CDAI),9 Routine Assessment of Patient Index Data 3 (RAPID3)10 and Patient Activity Scale (PAS and PASII).11
PTGL and GH have been customarily considered equivalent, and used interchangeably to calculate indices that they were not originally the component of.12,–,14 In fact, the variable ‘patient’s global assessment' has been used without specifying whether it refers to PTGL or GH; or the term for one ‘global measure’ is used even though the assessment has been made for the other.5 ,15,–,18
There is no study that has assessed whether PTGL and GH scores have similar determinants, and whether they are equivalent as an individual variable for RA activity assessment. Two recent studies showed minimal influence on DAS28 scores calculated by using either PTGL or GH as the ‘patient global measure’.19 ,20 However, these studies were conducted in a single centre or a single country. Moreover, no data on the impact of using PTGL and GH interchangeably for other commonly used composite indices for RA activity assessment exist. The objectives of our study were to assess whether (A) determinants of PTGL and GH scores are similar; (B) they are equivalent as individual variables for RA activity assessment; and (C) they can be used interchangeably to calculate common composite indices used for RA activity assessment.
Methods
Study population
The Quantitative Standard Monitoring of Patients with RA (QUEST-RA) study was initiated in 2005 to promote quantitative RA activity assessment, and to develop an international database of RA patients who received usual care from rheumatologists in ≥3 clinics in several countries. One hundred consecutive non-selected patients were recruited from each participating clinic.21 Each study participant was assessed by the standard protocol to evaluate RA that consisted of a four-page patient self-report questionnaire and a three-page clinician assessment.22
Study variables
PTGL was assessed by the question, ‘In terms of joint tenderness (ie, joint pain associated with light touch) and joint swelling (ie, joint enlargement due to inflammation), how active would you say your rheumatic condition is TODAY?’ on a 0–10 cm visual analogue scale (VAS) with ‘not active at all’ and ‘extremely active’ as anchors. This question is a component of RA Disease Activity Index (RADAI), and was originally denoted as ‘arthritis now’.23 In a validation study of RADAI, in 484 RA patients, the authors reported ‘arthritis now’ to be equivalent to PTGL.24 GH was assessed by the question, ‘Considering all the ways in which illness and health conditions may affect you at this time, please make a mark below to show how you are doing’ on a 0–10 cm VAS with ‘very well’ and ‘very poorly’ as anchors.
Pain and fatigue were assessed by 0–10 cm VAS; physical function by the health assessment questionnaire (HAQ),25 and morning stiffness (MS) duration by patient self-report questionnaire. Psychological distress was assessed by the psychological HAQ (psych HAQ) questionnaire which asks about the ability to deal with the usual stresses of daily life, feelings of anxiety and depression and a good night's sleep. The responses are calculated in the HAQ format, and scored from 0—3.26 Physicians assessed 28 joints for tenderness (tender joint count on 28-tender joint count evaluation – TJC) and swelling (swollen joint count – SJC). Erythrocyte sedimentation rate (ESR) was measured in the local laboratory. Physicians completed information on comorbidities. Comorbidity burden was quantified by a composite comorbidity index (modified by excluding depression; range: 0–8) that comprised of 10 comorbid conditions, including pulmonary disorders, myocardial infarction, other cardiovascular disorders, stroke, diabetes mellitus, hypertension, fracture, gastrointestinal ulcer, other gastrointestinal disorders and cancer.27 ,28 Physicians noted the presence or absence of three other painful comorbidities (osteoarthritis, fibromyalgia and chronic back pain). Body mass index (BMI) was calculated using the standard formula.
Composite RA activity indices
DAS28, CDAI and RAPID3 indices were selected as being representative of composite RA activity indices that are calculated from different types of individual components such as acute phase reactant (DAS28), joint counts (DAS28 and CDAI), and solely patient reported outcomes (RAPID3). The composite indices score were calculated using originally described formulas, and then recalculated using the alternative ‘patient global measure’ (table 1). The RA activity states were classified as remission, low, moderate or high disease activity using the accepted cut off values (table 1).
Statistical analysis
Mixed-effects analyses of covariance models were used to model PTGL and GH measures as functions of demographic and medical characteristics using the MIXED procedure in Statistical Analysis System (SAS).29 Demographic variables included age, gender, race (white, non-white) and education >12 years (yes, no); while medical characteristics included RA duration, patient's pain score, patient's fatigue score, HAQ, psych HAQ, TJC, SJC, ESR, MS duration (0, 1–60 and >60 min), comorbidity index score (0, 1–2, >2), BMI, fibromyalgia (yes, no), osteoarthritis (yes, no) and chronic back pain (yes, no). The reporting institution was included in the models as a random effect variable to adjust for correlations among subjects from the same institution. Partial R-square plots were constructed to understand the relative importance of individual variables to the PTGL and GH scores.
Lin's concordance coefficient (LCC) was used to quantify the level of concordance between PTGL and GH scores. LCC takes into account the correlation and the precision of agreement between two continuous variables, and represents how well a new set of observations reproduce an original set.30 LCC values are interpreted as: 0–0.20 poor; 0.21–0.40 fair; 0.41–0.60 moderate; 0.61–0.80 substantial; and 0.81–1.00 almost perfect. The Bland-Altman plot was made by plotting the average of PTGL and GH versus the difference between PTGL and GH scores. Bland-Altman 95th percentile limits of agreement (BALOA) were calculated to define the range within which 95% of differences between PTGL and GH values fell.31
LCC was used to evaluate the level of concordance between PTGL and GH based DAS28, CDAI and RAPID3 scores. κ statistics were used to assess the extent of agreement in RA activity states (remission, low, moderate and high) and were calculated using PTGL and GH. κ values classified agreement as: 0–0.20 very poor; 0.21–0.40 poor; 0.41–0.60 moderate; 0.61–0.80 good; and 0.81–1.0 excellent.32
Missing data
While most variables were over 90% complete (except psych HAQ with 80.2% completeness), overall, 43% subjects had at least one missing value. Multiple imputations of the missing data were performed using the MICE library33 as implemented in R V. 2.14. The imputation process was repeated five times, producing five ‘complete’ data sets. These data sets were analysed as described above, resulting in five sets of results. These results were combined using the MIANALYZE procedure in SAS (see online supplementary material for details). All analyses were performed in SAS V. 9.3 (SAS Institute, Cary, North Carolina, USA)29 or in R V. 2.14 (R Foundation for Statistical Computing, Vienna, Austria).34
Results
Study population
The QUEST-RA database contained 7568 patients who were recruited from 83 sites in 30 countries at the time of the study analysis. Five hundred and forty-five (7.2%) patients were excluded from the analysis (465 patients had missing information for both PTGL and GH, and 80 patients had missing information on ≥5 study variables). Hence, the study results are based on data from 7023 (92.8%) patients (4004 (57%) with complete data, and 3019 (43%) with imputation of ≥1 missing variable information). The majority of the patients were women (79.8%), Caucasian (72.1%), and mean (SD) age was 55.2 (13.8) years. Most had established RA; mean (SD) duration was 10.8 (9.5) years. The mean (SD) value for PTGL and GH were 4.01 (2.7) and 4.04 (2.59), respectively. All three study indices showed moderately active mean RA activity (see online supplementary table S1 for the study population characteristics).
Determinants of PTGL and GH
Pain, fatigue, HAQ, psych HAQ, TJC and gender were independent determinants of both PTGL and GH (table 2). In contrast to PTGL, GH was not associated with RA specific measures such as SJC, ESR and MS duration, but were with higher comorbidity burden, fibromyalgia and chronic back pain (table 2). Partial R-square plots, which show independent contribution of the variation of each variable after adjusting for all other remaining variables, showed important differences in relative contribution of individual variables in determining PTGL and GH scores (figure 1). Though pain was the single most important determinant for both PTGL and GH, it was relatively more important for PTGL score. The HAQ score was the second most important determinant of GH, while fatigue and SJC were more important for the PTGL score. Psychological distress influenced the GH rating relatively more than the PTGL rating. Female gender had a stronger negative association with GH than with PTGL.
Equivalence of PTGL and GH as individual measures of RA activity
The LCC was 0.64 (95% CI 0.62 to 0.65). Figure 2 shows the Bland-Altman plot. The lowess curve (dashed line)—a non-parametric smoothing function—shows no systematic difference between the means of PTGL and GH across 0–10 score range with differences varying from slightly <0 to slightly >0. The BALOA of −4.41 to 4.54 are very wide for a 0–10 scale. Although the LCC indicates substantial degree of agreement between PTGL and GH, the very wide BALOA imply they are not equivalent, and may not be used interchangeably as an individual measure for RA activity assessment.
Impact of using PTGL and GH interchangeably on composite indices for RA activity assessment
Table 3 shows the results of RA activity state classification, by DAS28, CDAI and RAPID3, calculated using either PTGL or GH score. There was >80% absolute agreement in disease activity state classification for all the three indices. The level of agreement, by the κ statistics, was excellent between DAS28-PTGL and DAS28-GH as well as CDAI-PTGL and CDAI-GH, and good between RAPID3-PTGL and RAPID3-GH. Figure 3 provides graphical representation of concordance between the PTGL and GH based indices. The LCC was 0.98 for DAS28-PTGL and DAS28-GH, 0.99 for CDAI-PTGL and CDAI-GH, and 0.95 for RAPID3-PTGL and RAPID3-GH. These values reflect almost perfect concordance between PTGL and GH based indices.
Discussion
Our study found that PTGL and GH are associated with shared and unique RA and non-RA related variables with differences in relative contribution of these variables to the two ‘patient global measures’. PTGL and GH are not equivalent as individual variables for RA activity assessment. However, they may be used interchangeably for calculating common composite indices with minimal effect on the RA activity assessment.
Although patient's ‘global score’ is widely used in RA research, only few studies have examined the factors that influence this score. All such studies have evaluated PTGL score determinants with heterogeneous results, partly from the comprehensiveness of variables used in statistical models of the studies. Pain and functional status were reported to be strongly associated with and of similar importance for PTGL score.35 ,36 In another study, PTGL variance was independently explained only by pain and depression, without contribution of HAQ, TJC, gender, RA duration, ESR, C reactive protein (CRP) and radiographic abnormalities.5 A recent study also found pain, depression and severity of stiffness, but not HAQ or DAS28, to be independently associated with PTGL.37 While confirming these associations, our study also found fatigue, SJC, HAQ, TJC, ESR and gender as being independently associated with PTGL score.
No study has specifically assessed determinants of GH or the differences in determinants of PTGL and GH among RA patients. A study that came close to such assessment compared PTGL with EUROQoL generic ‘feeling thermometer’ VAS (EQ-VAS), which is a measure resembling GH, in 663 RA patients.36 The patients were asked to indicate ‘how good or bad your own health is today, in your opinion’ on a vertical 0–100 VAS with ‘worst imaginable health state’ to ‘best imaginable health state’ as anchors. While pain and HAQ similarly and strongly associated with both scores, TJC had a stronger association with PTGL while comorbidities were more strongly associated with EQ-VAS. Sex and education were only associated with PTGL, while age was only associated with EQ-VAS. Though these results suggest some similarity to our findings (PTGL having stronger association with RA specific measures, while GH having stronger association with comorbidities), the two studies used different covariates, and are not directly comparable. For example, no assessment of fatigue, SJC or psychological distress was made in this study.
The impact of RA (RAID), a composite patient-derived measure comprising of pain, function, fatigue, sleep, physical wellbeing, emotional wellbeing and coping, has recently been developed upon European League Against Rheumatism (EULAR) initiative. PTGL had stronger correlation with all domains, compared with ‘global assessment of health status’ (ordinal response from ‘excellent’ to ‘poor’),38 further supporting our results that PTGL and GH represent different concepts in health status assessment.
While the mean difference was negligible and LCC showed substantial agreement between PTGL and GH scores, the BALOA showed that PTGL and GH scores can differ substantially in an individual patient. Hence, PTGL and GH may not be used interchangeably as individual variables for RA activity assessment. This issue assumes particular importance when considering the ‘patient global assessment’ measure for the ACR/EULAR provisional RA remission definition.39 PTGL is specifically recommended to assess Boolean-based definition of RA remission, and our results show that GH may not be used for this purpose. By contrast, we did find that PTGL and GH may be used interchangeably in calculating commonly used composite indices for RA activity assessment. This is in agreement with two recent studies that showed the interchangeability of PTGL and GH for DAS/DAS28 calculation.19 ,20 CRP was not used in the study because of the marked heterogeneity in measurement methods, normal range at local laboratories, reporting methods, and the unavailability of CRP measurement at many participating centres in this multinational study. However, given our data on three study composite indices, we think that PTGL and GH may be used interchangeably for calculating the CRP based SDAI. SDAI is recommended for composite index based provisional definition of ACR/EULAR remission criteria.39
We recommend PTGL as the single ‘patient global measure’ of choice for clinical care and research as it more directly relates to RA specific measures, is less affected by comorbidities, and may be used to assess ACR/EULAR Boolean-based remission criteria. Though GH contributes more in the assessment of domains, such as functional status and psychological distress and better reflects comorbidity burden, the additional value of GH in comprehensive ‘health status’ assessment of RA patients needs further studies. The need for global questions to focus on disease activity was recognised and identified as an important point to consider when the ACR core set is reviewed.40 Although specific methods for ‘patient global assessment’ have been suggested,41 ,42 a variety of nomenclature, phrasing, type of rating scale, and anchors (see online supplementary table S2 for selected examples) have been used in different studies.20 ,36 ,37 Though some evidence for similar validity among PTGL assessments using different techniques exists,24 ,37 further research is needed to understand the impact of using different methods on the patient's global score.
Our study has limitations. First, the PTGL question in our study specifically asked about RA activity assessment in terms of joint pain and swelling. This may not reflect the true extent of global RA effect, such as fatigue and functional limitation, even though these variables were among the strongest PTGL determinants. Second, the cross-sectional design of the QUEST-RA study precludes comparative assessment of sensitivity to change for PTGL and GH. Moreover, patient expectations and perceptions vary according to whether there has been an improvement or worsening of health compared with the past.43 Third, we do not have data on health-literacy of the QUEST-RA study patients. Health-literacy, which has moderate correlation with formal years of education, may affect the patient's understanding of PTGL and GH questions and hence their rating.44 Fourth, the QUEST-RA study was conceived to enrol RA patients from several countries with differing healthcare systems, and social, cultural and economic backgrounds. Multiple dimensions related to culture such as ethnicity; belief about disease causation, course and outcome; patient-physician relation dynamics; and economics of healthcare may impact the patient's perception of disease and their global ratings.45 ,46 To decrease variance from these non-RA related factors, every patient and physician in the study completed a standard protocol, validated and translated versions of the study questionnaires in patient's native language were used, and each study centre was included as a random effect in the statistical models used to assess PTGL and GH determinants to adjust for correlations between subjects seen at the same study centre. Finally, we lacked detailed data on socio-economic factors, and having patients from such varied backgrounds would make them difficult to be comparative. Hence, we used the broad category of education and ethnicity for our analyses.
In conclusion, we have shown that PTGL and GH scores are determined by shared, although with varying importance, and unique variables. PTGL is more influenced by RA related variables. Although PTGL and GH are not equivalent as individual variables for RA activity assessment, they may be used interchangeably for calculation of commonly used RA composite indices.
Acknowledgments
The authors are grateful to all investigators in the QUEST-RA project (whose names are listed in the online supplementary file).
References
Supplementary materials
Supplementary Data
This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.
Files in this Data Supplement:
- Web Only Data - This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.
- Web Only Data - This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.
Footnotes
-
Funding TS has received grants from Central Finland Health Care District (EVO-grants), the Finnish Academy and Abbott. This study was also supported, in part, by Award Number 1UL1RR029884 from the National Center For Research Resources. Funding sources did not participate in study design and the collection, management, analysis, and interpretation of data, and preparation, review, or approval of the manuscript and the decision to submit it for publication.
-
Collaborators On behalf of QUEST-RA group.
-
Competing interests None.
-
Patient consent Obtained.
-
Ethics approval The study was carried out in compliance with the Helsinki Declaration. Ethics Committees or Internal Review Boards of participating institutes approved the study.
-
Provenance and peer review Not commissioned; externally peer reviewed.