Statistics from Altmetric.com
We read with interest the recent article by Bacon et al1 that used mediation analysis2 to understand the process by which cartilage loss changes joint pain. Given considerable investment in treatments that focus on chondroprotection, this is an important topic and the findings from this study have potential to inform patient management. The authors concluded that a small, non-clinically important effect of cartilage loss on joint pain was mediated by synovitis. To ensure this study accurately informs future research and practice, we ask the authors to clarify the reporting and interpretation of their results.
The results presented in tables 3 and 4 do not support the authors conclusion that synovitis mediated the effect of cartilage loss on joint pain. The 95% CIs for all of the indirect effects presented include the null. If correct, these indirect effects and their precision estimates clearly demonstrate that in this study, there was no evidence that synovitis and bone marrow lesions mediate the effect of cartilage loss on joint pain. We suspect the authors might have used the ‘proportion mediated’ estimates to draw their conclusions. However, in most settings, the indirect effect estimate is a more robust measure than the proportion mediated.3 Although the proportion mediated is intuitive for interpretation, it is subject to a number of limitations.4 For example, the proportion mediated is considered to be highly variable, particularly with small sample sizes and uncertain indirect and direct effect estimates.5 Therefore, the main conclusions of the study should primarily reflect the indirect effect, rather than the proportion mediated. We urge the authors to consider this and revise their conclusions appropriately.
We also have some concerns about the accuracy of the numbers presented in tables 3 and 4. The point estimates of the proportion mediated for synovitis are identical for both exposures (0.1 and 0.05 mm cartilage thickness loss) despite differences in their indirect and total effect estimates. If we assume that the proportion mediated is simply the ratio of the indirect effect and the total effect, on the difference scale,6 the proportion mediated should be 15.1% for 0.1 mm and 12.5% for 0.05 mm in table 3, and 25.0% for 0.1 mm and 20.0% for 0.05 mm in table 4. It would be helpful if the authors could verify these estimates or clearly state how the proportion mediated was estimated if they used a different method.
Finally, when mediators fail to explain a mechanism, the path specific exposure–mediator and mediator–outcome effects can be informative for explaining where the indirect effect broke down.3 In Bacon’s study, cartilage thickness may not be associated with synovitis or bone marrow lesions, or these mediators may not be associated with the outcome joint pain, or both. We encourage the authors to consider reporting these path specific effects to provide readers with a better understanding for why cartilage loss does not have an effect on joint pain via synovitis and bone marrow lesions.
Twitter @AidanCashin, @Pain_NeuRa, @hopinlee
Contributors All authors contributed to the concept, design and writing of the letter and have approved the final version.
Funding AGC is supported by the University of New South Wales Prince of Wales Clinical School Postgraduate Research Scholarship and a NeuRA PhD Candidature Supplementary Scholarship. HL is supported by a National Health and Medical Research Council research fellowship and by the National Institute for Health Research (NIHR) Collaboration for Leadership in Applied Health Research and Care Oxford at Oxford Health NHS Foundation Trust.
Competing interests None declared.
Patient and public involvement Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.
Patient consent for publication Not required.
Provenance and peer review Not commissioned; internally peer reviewed.
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.