Article Text


Evidence-based complementary medicine: A contradiction in terms?
  1. E ERNST
  1. Department of Complementary Medicine, School of Postgraduate Medicine and Health Sciences, University of Exeter, 25 Victoria Park Road, Exeter EX2 4NT

    Statistics from

    Complementary medicine (CM) has been defined as: “diagnosis, treatment and/or prevention which complements mainstream medicine by contributing to a common whole, by satisfying a demand not met by orthodoxy or by diversifying the conceptual frameworks of medicine.”1 It comprises well over 100 different therapies, each of which has little in common with the others, and proclaims to be a veritable panacea.2 Some of the most prevalent treatments are acupuncture, aromatherapy, herbalism, homoeopathy, reflexology, and spinal manipulation (chiropractic and osteopathy). To put it mildly, CM is a notoriously controversial area.3 At the same time, CM is immensely popular and increasingly profitable (for example, MacLennan et al.4) Up to one half of the general population is using some form of CM.4 5 With rheumatological patients, this figure is even higher.6 It is therefore timely to ask whether CM is, at all, evidence based.

    The apparently simple key question is, does it work? CM is often perceived as effective by those who use it. Perceived effectiveness can be viewed as being composed of specific and non-specific effectiveness,7 that is, therapeutic success can be brought about by a specific mechanism of the given treatment, for example, endorphin release after acupuncture, or by factors not directly related to the therapy itself, for example, empathy, time spent with the patient, expectation, etc. Each of the two elements can vary in size from almost 0–100% of the total therapeutic effect.7 It seems obvious therefore, that rigorous research should differentiate the non-specific from the specific effects—not least because, in the final analysis, this is in the interest of the patient.

    Recent studies suggest that around 80% of all acute orthodox interventions used in a hospital8 or general practice9 setting are based on evidence. This figure does not necessarily apply to conditions seen by complementary practitioners (nor to those seen by rheumatologists). How solid then is the evidence base in CM? There is still far too little rigorous research into the efficacy and effectiveness of CM. When available at all, studies are often methodologically flawed,10 and the emerging evidence is usually contradictory. Therefore systematic reviews will provide the most objective summary of the existing knowledge. (The selective citation of evidence fitting a particular hypothesis seems to be disappointingly prevalent in CM11 and can be seriously misleading). Examples of the conclusions of authoritative systematic reviews and meta-analyses are quoted below.

    • Acupuncture for chronic pain (including rheumatological conditions): “Various sources of bias ... precluded a conclusive finding”.12

    • Homoeopathy for all indications (including rheumatoid arthritis and other rheumatological conditions): “the clinical effects of homoeopathy are (not) completely due to placebo ...,”13implying that homoeopathy has, on average, clinical effects beyond the placebo effect.

    • Chiropractic for back pain: there is “no convincing evidence for the effectiveness of chiropractic for acute or chronic low back pain.”14

    Such reviews can be criticised, not least because of the heterogeneity of the original trials included. Systematic reviews on defined rheumatological conditions would therefore be more helpful. Unfortunately, the evidence emerging from work of this nature is even less compelling. A recent review of acupuncture as a treatment of inflammatory rheumatic diseases, for instance, concluded that this form of therapy “cannot be recommended.”15 My own review related to osteoarthritis found that “the most rigorous studies suggest that acupuncture is not superior to sham-needling.”16

    This most sobering state of affairs is difficult to reconcile with the success of CM in everyday clinical practice. Most of those who use CM are satisfied with it and many try CM because of disappointment with mainstream medicine.17 18 As argued above, the reasons for perceived effectiveness may often lie in the quality and character of care more than the specifics of the given therapy. A recent survey, for instance, implied that arthritis sufferers who use CM and mainstream medicine in parallel, consistently rate the quality of the therapeutic relationship with CM practitioners higher than that with conventional doctors.19

    If a given (complementary or orthodox) treatment were devoid of specific effects, this would not necessarily mean that it is totally useless. There may be a case for evidence-based placebo treatments. Non-specific effects can be an important part of the total therapeutic effect of any treatment, mainstream or complementary.7This area is much neglected by present research. We need to understand the “ins and outs” of non-specific effects better than we do at present.20 This type of inquiry is by no means aimed at denigrating CM but at determining how best to optimise non-specific effects and at finding out how they can be used more widely to the benefit of the patient. There may be important lessons to learn, also for mainstream rheumatology.

    One essential precondition would, however, be safety. CM is often promoted and perceived to be entirely safe. Yet, practitioners should know better. Quite simply, there will never be a therapy that is totally free of risk. In conventional medicine, risks are routinely recognised, monitored, and quantified. This is essential for balancing them against the benefit of a given treatment. Only if the potential benefits outweigh the potential risks will we use this therapy. What sounds like a platitude to physicians, amounts to a veritable revolution for complementary practitioners. In CM, comparable risk benefit analyses are rarely possible: not only are we uncertain about the benefits of most complementary therapies (see above), we also know far too little about the risks of CM. All we do know is that complications, even serious ones, are on record,21 but we cannot even begin to estimate their frequency. In addition to the issue of “direct” adverse effects, there is a further, neglected “indirect” safety issue: even if a given complementary therapy were entirely safe, the complementary therapists might not be. An example might be the over use of radiography by chiropractors.22

    Most experts agree that the best way ahead lies in conducting rigorous research. We all know that the randomised controlled trial is not a flawless research tool. But for establishing therapeutic efficacy there is, generally speaking, no better method for excluding bias. What applies to mainstream medicine also applies to CM; there can be no room for double standards.23 Future research efforts might be structured in the following way. Systematic reviews and meta-analyses should establish what is presently known and define specific research questions. In turn, these should be investigated with the most rigorous research design possible. It is true that in CM some trials cannot be conducted in a double blind and placebo controlled fashion. Yet, randomised controlled trials are practically always possible and desirable.23

    Areas of priority might lie in testing the efficacy of acupuncture and plant-based remedies for defined rheumatological conditions. Whenever possible, investigations into the biological, psychological and cultural mechanisms of action of CM should be conducted in parallel. Such research would establish how given treatments work once it is clear (or at least likely) that they work. As there is far less commercial interest in CM than in conventional (drug) therapy, the money for such research would need to come, to a large extent, from public funds.

    The bottom line of all this seems clear. “Evidence-based CM” must no longer remain a contradiction in terms. We need to be able to advise our patients responsibly about the risks and benefits of these treatments.24 Failing to take this challenge would be nothing less than disregarding the best interests of our patients.


    For all those who are interested in this topic, the Department of Complementary Medicine edits a journal that focuses on “evidence-based complementary medicine.” For details see our website at


    View Abstract

    Request permissions

    If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.