Statistics from Altmetric.com
We read with interest the recent work by Johnson and colleagues regarding their evaluation of the 2019 European League Against Rheumatism/American College of Rheumatology (EULAR/ACR) classification criteria for systemic lupus erythematosus (SLE) in early disease across patient groups with different ethnic background.1 Their work is important since SLE remains clinically heterogeneous, possibly due to underlying molecular diversity,2 and various sets of criteria may not necessarily perform equally well within all different populations or sexes.
To challenge new sets of classification criteria by using retrieved clinical and laboratory data from cases with confirmed disease and cases with suspected disease, and compare their performance with older classification grounds is fair, reasonable and important. In 2015, we applied the 2012 Systemic Lupus International Collaborating Clinics (SLICC-12) criteria to 243 patients with confirmed SLE from our regional cohort and 55 control subjects with possible systemic autoimmune disease and presence of ≥1 SLE-related autoantibody. We concluded that SLICC-12 had advantages compared with older criteria with regard to diagnostic sensitivity, whereas we found the diagnostic specificity to be surprisingly low.3
Last year, we performed a similar evaluation of the 2019 EULAR/ACR criteria by using data from Swedish patients of which the majority had Caucasian ethnicity. We achieved comparable results for the SLICC-12 and 2019 EULAR/ACR criteria with respect to diagnostic sensitivity, specificity and accuracy.4 Johnson and colleagues refer to our paper and claim that it is inappropriate to evaluate their new criteria as ‘diagnostic criteria’.4 In our view, these kind of comparisons are not wrong, and are exactly what they are doing themselves when comparing the performance of the ACR-97, SLICC-12 and 2019 EULAR/ACR criteria in their recent paper.1 The term ‘diagnostic criteria’ is however wrong, but not used by us.4 Our use of the terms ‘diagnostic sensitivity’ and ‘diagnostic specificity’, and the derived term from there ‘diagnostic accuracy’, should be understood in the original analytical sense, where ‘diagnostic’ sensitivity/specificity should be distinguished from ‘analytical’ sensitivity/specificity.5 Whereas ‘diagnostic sensitivity’ refers to the percentage of persons with a given disorder who are identified by a laboratory test, or in the present context, by a set of classification criteria, ‘analytical sensitivity’ refers to the smallest amount of substance that an assay can measure. The confusion between these terms may be substantial if not adding the correct adjectives, as has been discussed more than 20 years ago.5 We suggest to use the terms ‘diagnostic sensitivity’ and ‘diagnostic specificity’ in the original sense also when referring to patients classified according to criteria, and to refrain from omitting the significating adjectives, thus obscuring the language.5
In our evaluation of the 2019 EULAR/ACR criteria, 14/51 cases were misclassified as SLE and 4/60 patients were incorrectly classified as non-SLE.4 The most common diagnoses among those who were misclassified as SLE were primary Sjögren’s syndrome (pSS), rheumatoid arthritis and antiphospholipid syndrome (APS). We acknowledge, however, that patients initially showing phenotypes of pSS and APS may eventually transform into SLE later on.
A fixed antinuclear antibody (ANA) titre of ≥1:80 as an entry criterion is troublesome and may affect the performance of the criteria.1 Cut-off titres for immunofluorescence (IF) ANA should be based on the 95th percentile among healthy controls, that is blood donors. Tan et al stated as early as in 1982 that an ‘abnormal titre of ANA’ by IF microscopy (or an equivalent assay) is required to satisfy the ‘ANA criterion’ of the ACR-82.6 Importantly, however, a serum dilution (titre) corresponding to the 95th percentile among healthy referents differs across laboratories, depending on a number of variables, for example the microscope equipment, the antigen source, fluorochrome density, antigen specificity, dilution of the secondary antibodies and the subjective evaluation at ocular inspection in the microscope.7 8 When we for example, changed to use of light emitting diode (LED) lamps of different brands in our fluorescence microscopes in Linköping and Uppsala some years ago, both laboratories clearly noted increased fluorescence intensities in ANA samples, necessitating re-evaluation of the screening titre (‘abnormal ANA titre’) in healthy populations at a fixed percentage of maximal LED lamp intensity in our laboratories. These re-evaluations led to different screening titres: 200 in Uppsala and 800 in Linköping. As these differences were due to divergent local factors in our laboratories, it comes as no surprise that we thereafter obtained almost total agreement in occurrence of ANA in a defined group of patients with SLE investigated in both laboratories.9 Thus, cut-off titres for IF-ANA are, and should be, laboratory-specific, making it impossible to use the same cut-off worldwide. Thus, we find the addition of ‘or an equivalent positive test’ to the definition of the entry criterion in the 2019 EULAR/ACR criteria set highly relevant. Further requirement of the ANA result as ‘abnormal’ or ‘pathological’ to qualify would have been even more desired,8 9 including anti-Ro52/60 single positive individuals who often are negative in IF.10 11
Contributors JR, ÖD, CD and CS contributed substantially to conception and design, drafted the article, gave final approval of the version to be published and agreed to act as guarantors of the work.
Funding The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.
Competing interests None declared.
Patient and public involvement Patients and/or the public were not involved in the design, or conduct, or reporting or dissemination plans of this research.
Patient consent for publication Not required.
Provenance and peer review Not commissioned; internally peer reviewed.
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.