Abstract
Objective. To identify candidate diagnostic criteria for macrophage activation syndrome (MAS) complicating systemic juvenile idiopathic arthritis (sJIA) using international consensus formation through a Delphi questionnaire survey.
Methods. A questionnaire listing 28 clinical, laboratory, and histopathologic features of MAS elicited by literature review was sent to 505 pediatric rheumatologists worldwide. Respondents were asked to select the 10 features that they felt were most important and useful in the diagnosis of MAS, and to order the 10 selected features by assigning the number 10 to the most important, and ending with 1 as the least important.
Results. The response rate was 46% (232 physicians from 47 countries). The items selected by more than 50% of respondents were, in order of frequency, falling platelet count, hyperferritinemia, evidence of macrophage hemophagocytosis in the bone marrow, increased liver enzymes, falling leukocyte count, persistent continuous fever ≥ 38°C, falling erythrocyte sedimentation rate, hypofibrinogenemia, and hypertriglyceridemia.
Conclusion. Our process led to identification of features that were felt to be most important as candidate diagnostic criteria for MAS by a large sample of international pediatric rheumatologists.
- MACROPHAGE ACTIVATION SYNDROME
- HEMOPHAGOCYTIC SYNDROME
- SYSTEMIC JUVENILE IDIOPATHIC ARTHRITIS
- HEMOPHAGOCYTIC LYMPHOHISTIOCYTOSIS
- DIAGNOSTIC CRITERIA
Macrophage activation syndrome (MAS) is a serious, potentially life-threatening complication of childhood rheumatic diseases, which occurs much more commonly in systemic juvenile idiopathic arthritis (sJIA)1,2,3,4,5. Because MAS can pursue a rapidly fatal course, prompt recognition of its clinical and laboratory features and immediate therapeutic intervention are imperative. However, diagnosis of MAS can be difficult and hard to distinguish from sepsis-like syndromes, although it may also be associated with sepsis, especially in cases of intraphagocytic pathogen infections. In addition, the recognition of subclinical forms of MAS in sJIA6,7 underscores the importance of establishing criteria sensitive enough to distinguish MAS from routine disease flare.
Although MAS bears a close resemblance to hemophagocytic lymphohistiocytosis (HLH), HLH criteria developed primarily for genetic disorders leading to hemophagocytosis8 are not necessarily useful in defining/identifying MAS in sJIA. The main shortcoming of HLH criteria in MAS is that certain criteria may not apply to patients with sJIA. Due to the prominent inflammatory expression of the latter disease, the occurrence of a relative decrease in white blood cell count, platelets, or fibrinogen rather than the absolute decrease required by the HLH criteria may be more relevant in making an early diagnosis. Further, the minimum threshold level for hyperferritinemia required for the diagnosis of HLH (500 μg/l) is not suitable to detect MAS. It is well known that many patients with active sJIA, in the absence of MAS, have ferritin levels above that threshold9. In the acute phase of MAS, the ferritin level generally peaks to more than 5000 μg/l. Thus, use of a 500 μg/l threshold may not help to discriminate MAS from a flare of sJIA.
Other HLH criteria that are not readily applicable to MAS are the demonstration of low or absent natural killer cell activity or soluble interleukin 2 (IL-2) receptor α above normal limits for age, as these tests are not routinely performed in pediatric rheumatology settings. We recently found that the diagnostic guidelines for HLH were highly specific in our patients with sJIA-associated MAS but lacked sensitivity10. Preliminary diagnostic guidelines for MAS in sJIA have been proposed11. However, that study has several limitations, including the lack of several laboratory measurements in a number of patients and insufficient data for some of the laboratory measures evaluated. Moreover, these criteria have yet to be validated.
In recent years, an international working group of pediatric rheumatologists with specific interest in MAS was established. One of the leading aims of the group was the development of a robust set of criteria for MAS complicating sJIA, based on expert consensus and analysis of a large sample of MAS and control patients. We present the results of the first step of the project, whose specific aim was to identify candidate items using international consensus formation through the Delphi survey technique.
MATERIALS AND METHODS
Questionnaire survey
A Delphi questionnaire12 compiled by a clinician (AR) and a statistician (AP) and revised and approved by the members of the MAS working group was circulated by e-mail to all center directors of the Pediatric Rheumatology International Trials Organization (PRINTO) and to all members of the Pediatric Rheumatology Collaborative Study Group (PRCSG), and the Childhood Arthritis and Rheumatology Research Alliance (CARRA). Not all organizations were represented equally, as many respondents belonged to more than one of these networks. A total of 505 pediatric rheumatologists worldwide were sent the survey. A reminder e-mail was sent after 6 weeks to all investigators who had not replied to the first e-mail. A further reminder e-mail was sent 6 weeks later to all investigators who had not replied to the second e-mail.
The questionnaire listed 28 clinical, laboratory, and histopathologic features thought most likely to be helpful and relevant in the diagnosis of MAS complicating sJIA, identified through literature review (Table 1). Respondents were first asked to select the 10 features that in their opinion were most important and useful in the diagnosis of MAS in sJIA. Second, they were asked to rank-order the 10 selected features by assigning the number 10 to the most important one, and end with 1 as the least important. They were instructed to use each rank only once, even though they could feel some features were equally important (i.e., no ties were allowed). At the end of the questionnaire, respondents were asked to add any feature that was considered relevant by them and was missing from the list. Importantly, no threshold level was provided for laboratory features, as the optimal diagnostic level is meant to be calculated in the second phase of the project, through analysis of data from patients with MAS and control patients.
Statistics
Comparison of percentage frequencies among groups was performed by means of the chi-square test, or the Fisher exact test in case of expected frequencies less than 5. Bonferroni adjustment was applied as a correction for multiple comparisons to explore post-hoc differences between pairs of patient groups. All statistical tests were 2-sided; a p value < 0.05 was considered statistically significant. The statistical package used for analyses was Statistica (StatSoft Corp., Tulsa, OK, USA).
RESULTS
Of the 505 pediatric rheumatologists who were sent the Delphi questionnaire, 232 (45.9%) from 47 countries provided feedback. Ninety-two respondents practiced in Europe, 90 in North America, and 50 in other continents (28 Latin America, 16 Asia, 3 Africa, and 3 in Oceania). There was more than one participant in less than 5% of the centers.
The frequency of selection of the 28 MAS features by questionnaire respondents is shown in Table 1, including the median and mean ranks. The percentage of respondents attributing high rank to each feature is shown in the last 2 columns. The items selected by more than 50% of respondents (9 in total) were, in order of frequency: falling platelet count, hyperferritinemia, evidence of macrophage hemophagocytosis in the bone marrow, increased liver enzymes, falling leukocyte count, persistent continuous fever ≥ 38°C, falling erythrocyte sedimentation rate (ESR), hypofibrinogenemia, and hypertriglyceridemia. Similarly, the items that achieved a median rank > 5 were, in order of median, evidence of macrophage hemophagocytosis in the bone marrow, hyperferritinemia, persistent continuous fever ≥ 38°C, falling platelet count, falling ESR, increased lactic dehydrogenase, hypofibrinogenemia, and increased soluble IL-2 receptor α.
Table 2 compares the frequencies of feature selection among respondents from centers in Europe, North America, and other continents. Overall, it appeared that North American physicians ascribed less importance to clinical manifestations [namely, persistent continuous fever ≥ 38°C, central nervous system (CNS) dysfunction, hemorrhagic manifestations, and liver enlargement] than did physicians from Europe or elsewhere. Physicians from other continents less frequently selected hyperferritinemia than did physicians from Europe or North America, whereas hypertriglyceridemia was selected most frequently by European physicians. European physicians also less commonly selected falling ESR, prolongation of clotting times, and increased D-dimer than did physicians from North America or other continents. Increased liver enzymes, increased soluble IL-2 receptor α, and increased soluble CD163 were indicated more frequently by North American physicians than by physicians from Europe or other continents.
Very few of the respondents added features not included in the list, which suggests that most participants agreed that the items listed in the survey were the most important diagnostic manifestations of MAS.
DISCUSSION
Using a consensus formation process that involved a large number of pediatric rheumatologists worldwide, we determined the relative diagnostic importance of 28 clinical, laboratory, and histopathologic features of sJIA-associated MAS. Of these 28 features, the following 9 were selected by more than 50% of respondents and were most frequently given the highest ranks: falling platelet count, hyperferritinemia, evidence of macrophage hemophagocytosis in the bone marrow, increased liver enzymes, falling leukocyte count, persistent continuous fever ≥ 38°C, falling ESR, hypofibrinogenemia, and hypertriglyceridemia. These features consistently remained the 9 most frequently selected and most highly scored when respondents were stratified by continent. This makes it unlikely that differences of opinion between physicians from different countries will alter the validation process. The top 9 features identified in this phase of the project may be the best candidates to be part of the final set of diagnostic criteria for the syndrome.
Importantly, 7 of the 9 features rated as most important by respondents refer to laboratory abnormalities, whereas only 1 is a clinical manifestation. This is in keeping with the common view that early suspicion of MAS is most commonly raised by the detection of subtle laboratory changes, whereas clinical symptoms are often delayed11. Of the 8 criteria that are part of the preliminary guidelines for sJIA-associated MAS11, only 5 (decreased platelet count, elevated liver enzymes, falling leukocyte count, hypofibrinogenemia, and evidence of macrophage hemophagocytosis in the bone marrow) entered the top 9 features, whereas all 3 clinical criteria (CNS dysfunction, hemorrhagic manifestations, and liver enlargement) did not. Considering the HLH diagnostic criteria8, only 5 (fever, cytopenia, hypertriglyceridemia and/or hypofibrinogenemia, evidence of macrophage hemophagocytosis in the bone marrow, and hyperferritinemia) entered the top 9 features, whereas 3 [splenomegaly, low or absent natural killer cell activity, and increased soluble IL-2 receptor α (CD25)] did not. This observation suggests that both these guidelines may not be entirely adequate for the diagnosis of MAS complicating sJIA, particularly earlier in the course of the syndrome. Along these lines, late findings such as renal failure, respiratory failure, and cardiac failure received some of the lowest median rankings (Table 1).
Although, as stated above, pediatric rheumatologists from different continents revealed a fair agreement about the greater importance of the 9 top features, there were some differences in the frequency of feature selection. This suggests the existence of disparities in the awareness of the features of MAS or in the diagnostic approach to the syndrome, which highlights the utility of well established diagnostic guidelines.
As MAS is becoming better studied and defined, novel associations and tests are being used more readily to diagnose and monitor MAS. It has been recently suggested that soluble IL-2 receptor α (sCD25), reflective of T cell activation, and soluble CD163 (sCD163), related to activation of phagocytic macrophages/histiocytes, might be useful as diagnostic markers of MAS and helpful in monitoring disease activity and response to treatment6,7. These parameters may also help identify patients with sJIA with subclinical MAS7. However, more information is needed to ascertain whether their inclusion adds significantly to the use of the more traditional laboratory indicators of MAS. Notably, as these tests are often costly, they may not be available (or affordable) in many pediatric rheumatology centers, particularly in developing countries. In addition, if these ELISA tests for sCD25 and sCD163 are not ordered frequently in a particular hospital setting, they may not be run in a timely fashion to aid in early diagnosis of MAS.
We intentionally did not ask questionnaire respondents to indicate the threshold level for each laboratory test that they felt was optimal for early identification of MAS. This objective will be pursued in the subsequent phase of the project, which is under way to collect real data from patients with sJIA-associated MAS and patients with conditions that may be confused with MAS, including sJIA flare without MAS and febrile systemic infections. This process is also meant to enable a data-driven assessment of the relative sensitivity and specificity of clinical, laboratory, and histopathologic features in discriminating MAS from the conditions with which it may be confused. Notably, the data collection is structured in such a way that it may lead to understanding whether laboratory criteria for the syndrome are more worthy of being assessed in terms of absolute threshold values, or percentage change over the preceding days, or both. Ultimately, we hope to develop a (sJIA) disease-specific core set of criteria for diagnosis of MAS that is both highly sensitive and specific.
This study should be viewed in light of some potential limitations. The rate of response to our questionnaire survey (45.9%) is in the low range of that obtained in similar initiatives performed previously in pediatric rheumatology, which varies from 49.8% to 80%13,14,15,16,17,18,19,20. However, previous surveys involved a much lower number of practitioners, up to 277. We mailed the survey to as many as 505 pediatric rheumatologists, who are currently part of the 3 largest international pediatric rheumatology research networks. Nevertheless, the relatively low response rate was expected, as MAS is a rare condition, likely to have been encountered or recognized only by physicians working in the largest tertiary care hospitals. However, since the number of respondents to our survey is the highest achieved so far in pediatric rheumatology, we feel that respondents were representative of pediatric rheumatologists internationally.
We identified the features of MAS that were felt to be the best potential diagnostic criteria for the syndrome in children with sJIA by a large sample of international pediatric rheumatologists. The diagnostic performance of these items will be scrutinized further in the next phase of the study, through analysis of real patient data.
Acknowledgment
The authors thank the steering committees of PRINTO, CARRA, and PRSCG, for allowing participation of members of their network in the survey.
Appendix
List of study collaborators: MAS Study Group: Physician members who contributed in study planning and revised the format of the Delphi questionnaire: Edward M. Behrens (Philadelphia, USA), Susan Benseler (Toronto, Canada), Alexei A. Grom (Cincinnati, USA), Maria Martha Katsicas (Buenos Aires, Argentina), Bianca Lang (Halifax, Canada), Paivi Miettunen (Calgary, Canada), Seza Ozen (Ankara, Turkey), Athimalaipet Ramanan (Bristol, UK), Ricardo Russo (Buenos Aires, Argentina), Rayfel Schneider (Toronto, Canada), Gary Sterba (Caracas, Venezuela), and Carine Wouters (Leuven, Belgium).
- Accepted for publication November 3, 2010.