Antipsychotic effectiveness: the numbers don’t lie, check the scoreboard

Screen Shot 2018-03-12 at 15.16.57

Perhaps second only to antidepressants, the role, effectiveness, and harmfulness of antipsychotic medications remains a nexus of impassioned debate that seems to frequently step beyond the evidence base. A cornerstone of the treatment of psychoses since the 1950s, ‘big pharma’, hidden data, professional allegiances, accusations of other professionals’ blind-spots, and a lack of engagement with, or listening to, those who take the medications all come to the fore. Heat, and not light, is a common result. Quite why we argue in this way – usually with perfectly benign intent of wanting optimal outcomes – and often in an attacking and tribal way, is a sociologically fascinating but not yet well understood phenomenon. But let’s all wind our necks in, and go back to the data (though we’ll return to tribalism later).

We know that – like any other pharmacological, psychological, or social intervention – these medications don’t work for everyone; we know that drug trial methodology has varied and evolved considerably over the years; we know that placebo effects appear to have altered; we know that adherence is the elephant in the room. Has antipsychotic drug response changed over the last six decades since chlorpromazine’s introduction? There had been an argument that yes it had, with various proposals (usually entwining the aforementioned issues) put forth as to why.

So what does the best current evidence tell us? Enter an impressive team, led by Leucht et al, with an imposing proposal: analyse sixty years’ data, identify trial characteristics that may have changed over the years, and ascertain those that may have moderated drug–placebo efficacy differences.

Adherence to antipsychotic medication is the elephant in the room.

Adherence to antipsychotic medication is the elephant in the room.


The methodology used is complex, but appropriately so for this type of work, and one previously mastered and indeed developed and grown by this team: a Bayesian meta-analysis and meta-regression of efficacy predictors. In other words, they’re not doing the ‘standard’ systematic review: piling together a cluster of papers on a topic, and separating them by their outcomes into ‘yes’, ‘no’, and ‘maybe’ piles. Further, meta-analysis isn’t ‘just’ a forest-plot with an ‘answer’ hovering somewhere about a zero-effect line, as we strain to see if error bars cross it.

  • A systematic review of all acute-phase placebo-controlled antipsychotic drug trials in schizophrenia since 1953, 105 studies
  • Outcomes included overall efficacy (primary outcome), drop-out rates, quality of life, and side effects
  • Included published and unpublished work, assessed for risk of bias
  • The sensitivity analysis of primary outcome was conducted as a fixed-effects model, with odd ratios calculated; studies based on trial completers were excluded
  • Contour-enhanced funnel plots, a selection model from OpenBUGS software and the trim-and-fill method assessed if effect sizes were likely due to a publication bias
  • A meta-regression explored trial changes over time, particularly drug-placebo differences.


  • Individuals treated with antipsychotics were twice as likely to respond to treatment as those treated with placebo:
    • 51% and 23% on antipsychotics had a “minimal” or “good” response to treatment,
    • versus 23% and 14% on placebo;
    • medications better, but not as good as one would like
  • Positive symptoms improved more than negative and affective ones
  • Quality of life and social functioning improved even in the short term for those treated with antipsychotic medication, relative to those treated with placebo
  • Drop-out rates were greater for those on placebo.

Next, focusing on changing trial characteristics over the sixty years, the research identified several relevant study design and drug-related factors, most of which were also significant predictors of drug-placebo differences. This included:

  • The number of participants and study sites, the number of male participants, the use of the PANSS, the number of studies conducted outside of the USA, and industry sponsorship
  • Placebo response did increase with time, while the washout period, study duration, risk of bias from incomplete outcome data decreased over time
  • Only pharmaceutical sponsorship and the degree of placebo response were significant moderators of antipsychotic efficacy, with both found to reduce overall drug efficacy.
Individuals treated with antipsychotics were twice as likely to respond to treatment as those treated with placebo.

Individuals treated with antipsychotics were twice as likely to respond to treatment as those treated with placebo.


This is the first exhaustive meta-analysis of all placebo-controlled acute phase antipsychotic trials: the drugs work. However, importantly the authors subdivided response type, and only 23% on them attained a ‘good’ response by eight weeks (versus 14% on placebo). ‘Good’ is not good enough, though it’s noted that none of the evaluated studies were confined to first episode participants, where one might expect better results.

There are caveats with interpreting the effects on negative and affective symptoms, but the data – more cautiously – support therapeutic actions. Side-effects were, sadly but unsurprisingly, common, but quite heterogeneous across different medications. This won’t shock clinicians, but makes interpretation of the data harder, albeit it suggests that clinicians and patients can work together to try find a drug to minimise a given individual’s side-effects. Perhaps surprisingly given the short trial durations, social functioning was hearteningly seen to improve.

Like all medical fields, trials have changed with time, growing larger and with generally more rigorous oversight and standardisation; this inevitably shifts outcomes. Again consistent with other branches of healthcare, it has led to a reduction in medication effect size over the years. However, fascinatingly, whilst the degree of placebo response and industry sponsorship was a statistically significant moderator of response, it was associated with smaller effect sizes. It’s not clear how to explain this counter-intuitive finding, but the authors suggest some methodological shifts including biases in who volunteers to engage in such trials.

Side-effects were common.

Side-effects were common.

Strengths and limitations

We expect the Mandy Rice-Davies rebuttal from some: “well they would say that, wouldn’t they?” The authors have track records of publications that by-and-large endorse medication effectiveness, and – shock, horror – some are psychiatrists. Sadly in the sometimes binary social media world, this will place them, for some, in the camp of bought-off big pharma advocates. We suspect that for others, the findings will remain ever-poisoned by the impossibility of removing sponsored trials, the unprovability of remaining (intentionally or otherwise) hidden data-sets, and concern about author allegiances and biases.

Objectively, methodologically, this study is remarkably robust; the analysis is complex but detailed and sound; the trial and participant numbers are very large.

One can inevitably throw in some caveats, not least that this study is on acute effects when most treated individuals stay on such medications for years (and notably a recent blog by chief Elf André Tomlin on Cipriani et al’s analysis of antidepressants had a similar key debate point).

Participants with predominantly negative symptoms or major concomitant psychiatric illness were excluded, leading to a less naturalistic sample, and further, retaining a group with symptoms ‘suited’ to antipsychotics.

The authors note the difficulty of unpacking the older studies, and also, analysing a pharmacodynamically heterogeneous group of compounds as a single class.

But accepting these, the findings are as strong as we are likely to obtain. Crucially, this work focused on drug-placebo difference, not placebo response, and that is of far more interest to clinicians and patients.

Participants with predominantly negative symptoms or major concomitant psychiatric illness were excluded, so these results may not reflect the efficacy of antipsychotics in a more real world sample of patients.

Participants with predominantly negative symptoms or major concomitant psychiatric illness were excluded, so these results may not reflect the efficacy of antipsychotics in a more real world sample of patients.

Implications for practice

These data matter. As the authors note, medication criticism “makes the lay public, patients, general physicians, and policy makers sceptical”; this is especially problematic given the enduring problem of medication adherence in this clinical population. The findings don’t gloss over the enormous problem of inadequate effectiveness for many, and side effects – to varying degrees – for almost all. They do not argue the drugs to be a panacea – the lack of effectiveness in negative and cognitive symptoms remains noteworthy, something true for all interventions in psychosis. A case is not made for these to be anything other than one aspect of a multifaceted package of care and interventions, but in such a position antipsychotics clearly have a key role. The science is unambiguous: to quote the great Jay-Z, the numbers don’t lie, check the scoreboard.

The numbers don’t lie, check the scoreboard.

The numbers don’t lie, check the scoreboard.

Conflicts of interest

Dawn Albertson, Andrea Du Preez, Agnieszka Kepa and Derek Tracy teach pharmacotherapy at King’s College London.

Blogging team

Our thanks go to the students from the pharmacotherapy module of the King’s College London PNoMH Distance Learning MSc: Susan Crawford, Anne-Marie Ford and Helena Reason, who were ably assisted by Dawn Albertson, Andrea Du Preez, Agnieszka Kepa and Derek Tracy from King’s College London in writing this blog.


Primary paper

Leucht S, Leucht C, Huhn M, Chaimani A, Mavridis D, Helfer B, Samara M, Rabaioli M, Bächer S, Cipriani A, Geddes JR, Salanti G, Davis JM. Sixty years of placebo-controlled antipsychotic drug trials in acute schizophrenia: Systematic review, Bayesian meta-analysis, and meta-regression of efficacy predictors. Am J Psychiatry. 2017 Oct 1;174(10):927-942. doi: 10.1176/appi.ajp.2017.16121358. Epub 2017 May 25.

Other references

Cipriani A, Furukawa TA, Salanti G, et al. (2018) Comparative efficacy and acceptability of 21 antidepressant drugs for the acute treatment of adults with major depressive disorder: a systematic review and network meta-analysis. Lancet 2018; published online Feb 21.

Kahn RS, Sommer IE, Murray RM, Meyer-Lindenberg A, Weinberger DA, Cannon TD, O’Donovan M, Correll CU, Kane JM, van Os J, Insel TR. (2015) Schizophrenia. Nat Rev Dis Primers, doi: 10.1038/nrdp.2015.67.

Tomlin A. (2018) Antidepressants can help adults with major depression. The Mental Elf, 22 Feb 2018.

Photo credits

Share on Facebook Tweet this on Twitter Share on LinkedIn Share on Google+
Mark as read
Create a personal elf note about this blog
Profile photo of KCL PNoMH MSc


The online Psychology & Neuroscience of Mental Health (PNoMH) course at King's College London promotes an understanding of the evidence base for comprehending the biological, psychological and socio-environmental factors important in the development and maintenance of mental health, and evidence underlining the development and efficacy of the range of treatments of mental health problems.

More posts

Follow me here –

Profile photo of Derek Tracy

Derek Tracy

Derek is a Consultant Psychiatrist and Clinical Director at Oxleas NHS Foundation Trust, London. His clinical and managerial interests include clinical outcomes; his digitised PROM dashboard has received national awards and was profiled by NHS England during the launch of the Mental Health Taskforce. He is currently working with NHS England and NICE on national standards for achieving better access in acute care that will be published in 2018, and is an expert member of the NIHR Dissemination Centre external advisory group. He is a Senior Lecturer at the Institute of Psychiatry, Psychology, and Neuroscience, King’s College London, and at the Department of Psychiatry, University College London, runnings three MSc modules. In 2015 he was awarded the IoPPN’s Teaching Excellence Award. Derek has published over sixty peer review papers and seven book chapters, most on psychopharmacology and psychosis, and his current research interests include novel psychoactive substances. He is a member of the Advisory Committee on the Misuse of Drugs that provides expert scientific advice to the UK Home Office. Derek is a board member of the British Journal of Psychiatry, writing its Kaleidoscope and Highlights columns, and leads the BJP’s social media arm that runs its twitter, podcast, and blogs. He sits on the executive of the Royal College of Psychiatry’s academic faculty and is its quality improvement (QI) lead. He is a Fellow of the Higher Education Academy, the Faculty of Medical Leadership and Management, the Royal Society of Arts, and the Royal College of Psychiatrists. He likes running, the Stone Roses, and enthusiastic people; he hates butter, cats, and whinging.

More posts - Website

Follow me here –