Article Text
Abstract
Background To develop preliminary classification criteria for the cryoglobulinaemic syndrome or cryoglobulinaemic vasculitis (CV).
Methods Study part I developed a questionnaire for CV to be included in the formal, second part (study part II). Positivity of serum cryoglobulins was defined by experts as an essential condition for CV classification. In study part II, a core set of classification items (questionnaire, clinical and laboratory items, as agreed) was tested in three groups of patients and controls—that is, group A (new patients with the CV), group B (controls with serum cryoglobulins but lacking CV) and group C (controls without serum cryoglobulins but with features which can be observed in CV).
Results In study part I (188 cases, 284 controls), a positive response to at least two of three selected questions showed a sensitivity of 81.9% and a specificity of 83.5% for CV. This questionnaire was employed and validated in study part II, which included 272 patients in group A and 228 controls in group B. The final classification criteria for CV, by pooling data from group A and group B, required the positivity of questionnaire plus clinical, questionnaire plus laboratory, or clinical plus laboratory items, or all the three, providing a sensitivity of 88.5% and a specificity of 93.6% for CV. By comparing data in group A versus group C (425 controls), the same classification criteria showed a sensitivity 88.5% and a specificity 97.0% for CV.
Conclusion Classification criteria for CV were developed, and now need validation.
This paper is freely available online under the BMJ Journals unlocked scheme, see http://ard.bmj.com/info/unlocked.dtl
Statistics from Altmetric.com
Cryoglobulinaemic syndrome or cryoglobulinaemic vasculitis (CV) is a systemic vasculitis associated with serum positive cryoglobulins—that is, immune complexes composed of rheumatoid factor (RF) monoclonal or polyclonal against polyclonal IgG (type II or type III cryoglobulins, respectively) or immunoglobulins without RF activity (type I), which reversibly precipitate or form a gel at a temperature below 37°C.1 2 CV is usually linked to non-malignant B-cell lymphoproliferation,3 often triggered by chronic hepatitis C virus (HCV) infection.4 5
Classification criteria developed with an accepted methodology are presently lacking for CV, while a correct classification is a key step for clinical practice, research and epidemiological studies.6,–,14 Previous criteria were not universal and lacked appropriate statistical support.9,–,12 This study was therefore started, involving different European experts. It was divided into two parts, the first dedicated to the development of a questionnaire showing the highest sensitivity and specificity for CV, which was then included in the second part of the study (part II), where the standard methodology for classification studies was used.13 14
Materials and methods
The study was proposed by GISC (Italian Study Group on Cryoglobulinemia). The experts agreed on four key points for the study development:
▶ Classification criteria are necessary for all the patients with CV, either HCV-related or HCV-unrelated.
▶ The presence of serum cryoglobulins (either type I, II, III, or not typifiable) is an essential condition for the classification of CV.
▶ The study protocol should be divided into two parts: part I, to develop a dedicated questionnaire for patients with CV, and part II—that is, the formal study, to develop the classification criteria, using a standard methodology and including the questions selected in study part I.13
▶ The core set of items for the classification of CV should include the dedicated questionnaire plus the presence of easily accessible clinical manifestations and laboratory tests. For this reason, histopathology, flow cytometry studies and novel laboratory biomarkers were excluded from the core set.
Agreement was also reached on the inclusion criteria for patients and controls, a dedicated paper chart, a glossary for the study and statistical analysis.
There was no financial support for the study. The final study protocol was developed by the coordinating centre.
Part I
Seventeen experts from 12 centres, experienced in the diagnosis and care of CV, proposed a panel of 83 questions for patients with CV. Redundant questions were then deleted and among the 33 remaining questions only those considered useful by at least two-thirds of the experts were selected: they included five questions on purpura, four on peripheral nerve or muscular symptoms, two each on fatigue, articular involvement and oral or ocular dryness, and one each on leg skin ulcers and hepatitis virus infection (table 1).
A questionnaire consisting of the 17 selected questions was then sent to each centre, where it was translated into the local language and administered to 20 consecutive unselected patients with CV (HCV-related or HCV-unrelated), and to 30 consecutive, unselected controls without CV in care in the same centre for at least 1 year. The controls, with or without serum cryoglobulins, included 10 patients with systemic vasculitis other than CV, four HCV antibody and HCV-RNA-positive patients without CV, four patients with primary Sjögren's syndrome (SS), four with other connective tissue diseases, four with rheumatoid arthritis, polymyalgia rheumatica or seronegative spondyloarthritis, and four with any other condition where the differential diagnosis with CV was considered. The presence of cryoglobulins was assessed according to the local laboratory standard, based on reference methodologies,15 and confirmed by at least two positive tests at ≥12 weeks' interval.
Part II
The second and formal part of the study was a cooperative study involving 16 centres, some of which were different from those involved in study part I. A dedicated paper chart was developed and included the following core set of items for classification:
a questionnaire for CV (with the questions selected in study part I);
data (89 items) on the pattern of organ involvement (present and past);
laboratory tests (28 items).
The classification of cases and controls as CV-positive and CV-negative was based on the ‘gold standard’ of an expert clinician, who had never examined that case/control before. If CV had been diagnosed previously, the expert clinician had to redetermine the diagnosis based on his/her gold standard judgement.
Patients and controls included additional, consecutive and unselected cases and controls not enrolled in part I of the study, subdivided as follows into three groups A, B and C:
▶ Group A: patients with CV, (20 per centre) essential or associated with other disorders (HCV-related or HCV-unrelated), with type I, II, III or non-typifiable circulating cryoglobulins15 confirmed by at least two positive tests at ≥12 weeks' interval.
▶ Group B: subjects (20 per centre) with serum cryoglobulins, but lacking a CV based on the gold standard judgement of the expert clinician (20 controls per centre), to try to answer the question “if a patient has positive serum cryoglobulins, when should a CV be classified?” For the inclusion of controls in this group, the minimum follow-up required was 1 year (ie, the expert did not notice any manifestations suggesting a CV, during all the available history of the patient, with a minimum of a 12-month history needed).
▶ Group C: subjects without serum cryoglobulins (by at least two repeated tests during a follow-up of at least 1 year), but with clinical or laboratory features which can be observed in the course of CV (40 controls per centre), to try to answer the question “if a patient has some features which pose a differential diagnosis from CV, even if negative for serum cryoglobulins by initial testing, when should a CV be suspected?”
Furthermore, a distinction in group C was made between patients with either systemic vasculitis (group C1: 20 controls per centre) or other diseases, which, however, should be distinguished from CV in clinical practice (group C2: 20 controls per centre). Patients in group C had a previous follow-up of at least 12 months to allow a definite diagnosis, other than CV.
The classification criteria for CV developed by comparing data in group A (CV) versus group B (positive serum cryoglobulins without CV) were then also tested by comparing group A versus group C (as a whole, or distinguishing C1 and C2).
All the patients and controls underwent a complete physical examination. The response to the selected questions, the clinical and laboratory core set data, plus instrumental tests and possibly additional investigations required by the clinician, were recorded in the chart. Chest x-ray and abdomen ultrasound examinations had to be performed in the 6 months before or at the time of the gold standard evaluation. If respiratory symptoms or abnormal thorax x-ray findings were present, a pulmonary function test, CO diffusion test and/or chest CT scanning had to be performed whenever possible, and electromyography was recommended if peripheral neuropathy was suspected.
All the data were entered and analysed by the coordinating centre of the study—namely, Rheumatology Clinic, Azienda Ospedaliero-Universitaria ‘S Maria della Misericordia’, Udine, Italy.
Data analysis methods
Sample size
Sample size estimation was derived from the accuracy of the estimation of the 95% CI (two-sided) for each sensitivity and specificity value.
Part I of the study
A sample size of 216 cases was necessary for a sensitivity of 90% with a precision of ±4% at a two-sided confidence level of 95%. With the same precision of ±4% at a two-sided confidence level of 95%, the sample size required to estimate a specificity of 85%, was 306 controls. A higher sensitivity of the questionnaire was then presumed a priori.
A univariate analysis was carried out using χ2 test to identify the questions associated with CV. A stepwise multiple logistic regression was used to select the questions with greater accuracy to correctly classify patients and controls and then to select the best combination for classification. When different ‘additive or multiplicative’ combinations of questions were tested, the rule for classification was that ‘for a given subject, at least s of the n questions were present’. If so, the subject was classified as having CV.
Part II of the study
Since classification criteria aim to have a high specificity, together with a reasonable sensitivity, a sample size of 216 controls was calculated, estimating a specificity of 90% with a precision of ±4% at a two-sided confidence level of 95%, while the sample size to estimate a sensitivity of 85% with the same precision of ±4% was 306 cases.
A univariate analysis was carried out to identify the questions, the clinical features and laboratory tests associated with CV. The items significantly associated with CV by univariate analysis were then analysed by a stepwise multiple logistic regression. This analysis was performed separately for questions, clinical features and laboratory tests.
Then, different ‘additive or multiplicative’ combinations of items were tested for sensitivity and specificity. The rule was that ‘for a given subject, at least s of the n items were present’.
Finally, with the same analysis, the best combination of the three sets of items—that is, the set of questions, the set of clinical features and the set of laboratory tests, was analysed to determine the final classification criteria.
A tree-based model was also used as an alternative method to correctly classify patients and controls.6 7 13 The model is fitted by binary recursive partitioning whereby a dataset is successively split into increasingly homogeneous subsets until it is infeasible to continue.
Results
Part I of the study
Of the 12 selected centres, 10 completed this part of the study, for a total of 484 questionnaires available. The results of the questionnaires were received in electronic form by the coordinating centre and were rechecked with the corresponding paper charts. Of the 484 questionnaires, 472 were used for statistical analysis (the remaining 12 were incomplete).
Cases comprised 188 subjects (68.1% women), with a mean age of 59.18±15.14 years; controls were 284 subjects (72.5% women), with a mean age of 53.76±15.24 years.
Univariate analysis identified questions 1, 2, 3, 4, 5, 10, 12, 13, 14 and 17 as associated with CV, but the logistic model showed that only questions 1, 4 and 17 contributed significantly to the predictability of the disease. The sensitivity and specificity of each question, and of all the possible combinations of positive answers to questions 1, 4 and 17, are shown in table 1.
The best rule for classification was a positive response to at least two of the three questions 1, 4 and 17, with a sensitivity of 81.9% (estimated with a precision of 5.5%) and a specificity of 83.5% (with a precision of 4.4%) for CV. In addition to questions 1, 4 and 17, questions 10, 12 and 14 were also included in part II of the study, since the experts considered that repeated investigation was worthwhile for skin ulcers and peripheral neuropathy, based on the results of univariate analysis.
Part II of the study
Overall, 925 charts were received by the coordinating centre, which performed the electronic data entry, checked three times before data analysis.
Group A included 272 patients with CV (73.5% women), with a mean age 62.8±11.8 years. Group B included 228 controls with serum cryoglobulins but lacking a CV (68.4% women), mean age 58.4±15.4 years. Group C included 425 controls lacking serum cryoglobulins though with clinical or laboratory features which can be observed in the course of CV (72.2% women), mean age 56.0±16.8 years, divided into 173 controls in group C1 (systemic vasculitis other than CV: 63.6% women, mean age 58.3±17.8 years) and 252 controls in group C2 (other diseases: 78.2% women, mean age 54.5±16.0 years). Cases in group C1 comprised 55 antineutrophil cytoplasmic antibody-associated vasculitis (Wegener's granulomatosis, Churg–Strauss syndrome, micropolyarteritis), 47 giant cell arteritis, 15 isolated cutaneous vasculitis, 14 Schönlein–Henoch purpura, 12 panarteritis nodosa, 9 Takayasu arteritis, 6 Beçhet disease, 2 Goodpasture's syndrome, 13 other vasculitis. Cases in group C2 were 52 SS, 36 systemic sclerosis, 35 systemic lupus erythematosus, 30 rheumatoid arthritis, 11 polymyositis or dermatomyositis, 10 spondyloarthritis, 7 polymyalgia rheumatica, 3 antiphospholipid syndrome, 3 undifferentiated connective tissue disease and 1 mixed connective tissue disease, and 64 with other diseases which should be distinguished from CV in clinical practice (including 31 chronic HCV infection, 20 haematological malignancies and various other conditions such as sarcoidosis, erythema nodosum, idiopathic thrombocytopenic purpura, palindromic rheumatism, venous insufficiency in lower limbs). The group distribution is reported in table 2.
Overall, about 89 000 clinical items and 18 000 laboratory items were filed.
Comparison of group A with group B (cryoglobulinaemic syndrome versus serum cryoglobulinaemia without syndrome) and development of the classification criteria
Questionnaire validation
All the six questions included in part II of the study were significantly associated with CV by the univariate analysis, but only questions 1, 4 and 17 (table 3) were also selected by the multivariate analysis. This fully replicated the results of part I of the study, even if the controls were selected differently in part II.
When different ‘additive or multiplicative’ combinations were tested on the three questions, the best criterion was ‘at least two out of the three questions’, giving a sensitivity of 83.8%, 95% CI (79.4% to 88.2%) and a specificity of 93.8%, 95% CI (90.7% to 97.0%) for CV. The sensitivity and specificity of this combination were higher in study part II than in study part I (81.9% and 83.5%, respectively). Thus, these results of part II of the study validated a three-question-based questionnaire for CV developed by study part I.
Clinical features
Constitutional symptoms fatigue, low-grade fever (37–37.9°C for more than 10 days) or fever (≥38°C), or fibromyalgia,16 articular involvement (arthralgias or arthritis), vascular involvement (purpura, skin ulcers, necrotic skin lesions or necrotising vasculitis biopsy-proven, Raynaud's phenomenon, or hyperviscosity syndrome according to clinical features and plasma viscosity test) and neurological involvement (peripheral neuropathy confirmed by electromyography or confirmed by a neurologist in electromyography-negative cases, cranial nerve involvement confirmed by a neurologist, or central nervous system vasculitic involvement documented by imaging) were the clinical items selected by the multivariate analysis, to establish CV in patients with positive serum cryoglobulins. Their sensitivity and specificity values by the univariate analysis are shown in table 3.
The criterion of ‘at least three of the four items’ gave a sensitivity of 70.2%, 95% CI (64.7% to 75.8%) and a specificity of 84.5%, 95% CI (79.5% to 89.4%) for CV, while the criterion of ‘at least two of the four items’ gave a higher sensitivity (90.1%, 95% CI 86.4% to 93.7%) but a much lower specificity (65.5%, 95% CI 59.0% to 72.1%) for CV.
Laboratory features
Reduced C4 levels, positive RF and the presence of serum M component (present in type I or II cryoglobulins, or detected by serum protein electrophoresis and immunofixation) were the laboratory items selected by the multivariate analysis, to establish a CV in patients with positive serum cryoglobulins. Sensitivity and specificity in the univariate analysis are shown in table 3. The criterion of ‘at least two out of the three features’ gave a sensitivity of 84.2%, 95% CI (79.4% to 89.0%) and a specificity of 79.6%, 95% CI (73.4% to 85.9%) for CV.
Classification criteria for the cryoglobulinaemic syndrome
By analysing the best combination of the three sets of items—that is, the set of questions (≥2 of 3), the set of clinical features (≥3 of 4), and the set of laboratory tests (≥2 of 3), to determine the final classification criteria, the criterion of at least two out of three questionnaire, clinical and laboratory sets of items (questionnaire + clinical; questionnaire + laboratory; or clinical + laboratory) provided a sensitivity of 88.5%, 95% CI (84.3% to 92.8%) with a precision of ±4.3%, and a specificity of 93.6%, 95% CI (89.5% to 97.7%) with a precision of ±4.1% for CV (table 4 and figure 1).
Other combinations, including the validated questions plus the positivity of lower or higher numbers of clinical or laboratory items, provided worse results, and the cost of a higher sensitivity was a low specificity for classification purposes.
A tree-based model for predicting CV, derived by applying the criterion of ‘at least two out of’ the three questionnaire (1), clinical (2) and laboratory (3) features, to 272 patients with CV and 228 controls with serum cryoglobulins but lacking a CV is shown in figure 2. The probability of CV for patients with positive questionnaire and laboratory criteria was 99.4%. The final probability of CV provided by the tree-based model (‘at least two out of the three questions’ → ‘at least two out of the three laboratory features’ → ‘at least three out of the four clinical features’) was 100%. Similarly, the probability of lacking CV for patients who did not satisfy the questionnaire and laboratory criteria was 92.1%, and the final probability of lacking CV provided by the tree-based model (‘less than two out of the three questions’ → ‘less than two out of the three laboratory features’ → ‘less than three out of the four clinical features’) was 94.6% (figure 2).
Comparison of group A with group C (cryoglobulinaemic syndrome versus other diseases which may mimic the syndrome)
The classification criteria developed in comparing group A with group B were applied for the comparison of group A with group C, to verify whether the classification criteria may also be useful to suspect a CV in patients cryoglobulin-negative by initial testing, though showing clinical or laboratory features suggestive of CV.
The results of statistical analyses for questions, clinical manifestations and laboratory features associated with CV are shown in table 4.
The criteria provided satisfactory results for sensitivity 88.5%, 95% CI (84.3% to 92.8%) and specificity 97.0%, 95% CI (94.6% to 99.4%).
When further analysing group A versus group C1 (including only patients with systemic vasculitis other than CV), similar results were noticed (table 4).
The final criteria provided a sensitivity of 88.5%, 95% CI (84.3% to 92.8%) and a specificity of 95.4%, 95% CI (90.9% to 99.8%). Thus, if a systemic vasculitis is suspected, positive CV criteria, even in the absence of positive serum cryoglobulins by initial testing, should warn the clinician of a possible CV, and repeated cryoglobulin testing is mandatory.
Discussion
The preliminary classification criteria for the CV are presented—the result of a multicentre European study. Classification criteria for CV developed by a standardised methodology were lacking, though they are crucial in clinical practice, scientific communication and epidemiological surveys. A methodology similar to that employed for the classification criteria for SS was used.13 14 This led, as a first step, to the development of a dedicated questionnaire. The questionnaire was then validated and the set of classification criteria for CV was defined, also including easily accessible clinical and laboratory items. The criteria showed a high specificity and a good sensitivity for CV. In addition, although this was not the main purpose of the study, the same criteria were also investigated and proved useful in classifying CV in patients with negative serum cryoglobulins by initial laboratory testing.
A uniform set of classification criteria for CV was needed. Previous criteria were non-universal, employed by the experts who had proposed them, and lacked appropriate statistical support.9,–,12 Guidelines for the management of CV have been recently proposed,8 but uniform criteria to classify CV were not available at that time.
This study, proposed by GISC9 included experts from five European countries and with different backgrounds. The methodology used, based on a gold standard preliminary diagnosis of CV, meets the current standards for classification criteria in disorders characterised by the lack of a single, reliable diagnostic test. For the final set of classification criteria, a combination showing a high specificity was needed. This goal was achieved (specificity of 93.6%), and a good sensitivity (88.5%) for CV was maintained, with a good precision for both. The questions selected in part I of the study proved relevant for classification in study part II, by comparing patients with cryoglobulins and CV (group A) with patients with cryoglobulins but without CV (group B).
The results of this study confirm that in CV, as in other autoimmune diseases, classification can be made by integrating different questionnaire, clinical and laboratory data. Of note, none of the three sets of items comprising the CV classification criteria herein developed (positive answer to ≥2/3 validated questions, presence of ≥3/4 clinical features, or presence of ≥2/3 laboratory abnormalities) is absolutely needed for classification itself, since classification is possible with positivity for any two of the three questionnaire, clinical or laboratory items. This is an advantage for patients with CV with difficulties in completing a questionnaire, for patients with clinical features less common in CV (eg, abdominal vasculitis, serositis, glomerulonephritis, etc), or where laboratory data are uncertain for any reason.
Although this study shows that no fixed combination of tests can be used to classify CV, the classification tree suggests a sequence of tests to be followed in the diagnostic approach to the disease. A validated three-item questionnaire is useful for initial evaluation of the patient: if a patient has positive serum cryoglobulins and is also positive for the questionnaire criterion, the probability of CV is 94.4%, with a further increase to 99.4% if the laboratory criterion is also positive. This approach may be particularly useful if CV is highly suspected by doctors without extensive experience of this disease, before the evaluation of the specialist. Conversely, if a patient with serum cryoglobulins is negative for the questionnaire criterion and is also lacking the CV laboratory features included in the laboratory criterion, CV can be excluded with a probability of 92.1%.
One main criticism of these criteria is that they cannot be applied to patients with CV with negative serum cryoglobulins. This point was thoroughly discussed in study planning, where positive serum cryoglobulins were finally designated as an essential condition for CV classification. For classification purposes it was established that it is not possible to classify the CV if the characterising feature—that is, positive serum cryoglobulins, is not demonstrated. However, it was agreed that if cryoglobulinaemia is absent at a definite evaluation point, but has been well documented in the past (eg, before antiviral or anti-CD20 treatment), cryoglobulin positivity rather than negativity must be considered.
There is a subset of CV in which serum cryoglobulins may appear to be negative by initial laboratory testing for various reasons, such as low cryoglobulin levels, problems in blood sample handling or testing, or owing to tissue deposition rather than blood circulation of immune complexes. Such patients deserve a careful follow-up if CV is suspected, and must undergo repeat cryoglobulin determination, while excluding other diseases. This led to an extensive expert discussion on classification problems in these cases, and the study was finally designed in an attempt to clarify whether classification criteria (developed by comparing cryoglobulin-positive patients with or without CV) might be of some relevance for CV diagnosis when serum cryoglobulins appear to be absent. By comparing data in group A with those in group C, it was shown that the classification criteria were useful in such cases, since positive criteria were rarely present in diseases that may mimic CV, including a group of patients (C1) with systemic vasculitis other than CV. Then, if CV is suspected, positive classification criteria for CV in that patient, even in the absence of detectable cryoglobulins by initial testing, warn the clinician to repeat the cryoglobulin determination, and classification of CV may be possible in the follow-up. This part of the study supported the clinical practice of repeating cryoglobulin laboratory determination if CV is highly suspected on clinical grounds, and the relevance of sample handling and high-quality laboratory referral for CV assessment.
Second, an extremely small number of patients with CV and type I cryoglobulins were included in this study, and this in part reflects the rarity of this subset, which usually occurs in the course of an overt B-cell lymphoproliferative disorder. All except one of these cases were correctly classified with the criteria developed (data not shown). However, these criteria cannot be formally proposed for patients with type I cryoglobulinaemia, and the experts agreed that this patient subset should be expanded in subsequent validation studies.
Furthermore, the distinction between classification and diagnostic criteria should be emphasised. Classification criteria are constructed mainly for investigation and epidemiological purposes, and aim at a higher specificity.6 7 By contrast, the diagnosis of a disease can be formulated by the expert clinician also in patients lacking the classification criteria for that disease, and prompt diagnosis and treatment decisions are certainly more relevant in clinical practice.13 17,–,19 We would at present discourage the use of these classification criteria for diagnostic purposes, and additional data analyses are under way.
In conclusion, preliminary classification criteria for CV have been developed by a cooperative study using a standardised methodology in a large number of real cases. They need a formal validation, possibly involving experts from a larger number of countries.20 21 In addition, they should be further tested in HCV-related versus HCV-unrelated CV. These studies, as well as more descriptive analyses and subanalyses, are continuing or have been planned.
Acknowledgments
The authors are grateful to Dr Leonard Calabrese, Cleveland, Ohio, USA, for his comments in manuscript preparation, and to Dr Alessandra Della Rossa, Pisa, Italy; Dr Sara Salvin, Udine, Italy and Dr Marta Maset, Udine, Italy, for their contribution to patient recruitment and data collection.
References
Supplementary materials
Web Only Data
Files in this Data Supplement:
Footnotes
-
Patient consent Obtained.
-
Ethics approval This study was conducted with the approval of the Udine ethics committee.
-
Provenance and peer review Not commissioned; externally peer reviewed.