The Mental Elf

A meta-analysis of cognitive-behavioral therapy for adult depression: the winner takes it all?

Cognitive-behavioral therapy (CBT) is widely researched and recommended as an evidence-based treatment for adult depression, but despite the strength of research comparing CBT approaches with other forms of care, there are few recent systematic reviews on this topic.

Cuijpers and collaborators provide such a review in a recent meta-analysis published in The Canadian Journal of Psychiatry, where they examine the efficacy of CBT for adult depression, both alone and in combination with other treatments.

Methods

The authors included randomised clinical trials in adults, comparing CBT with a control intervention (wait-list, treatment as usual, placebo or other) or with another form of treatment (psychotherapy or  medication). Studies were included if the primary clinical problem being treated was depression, evaluated either by a diagnostic interview or by self-report scales. Studies comparing the combination of CBT and pharmacotherapy with pharmacotherapy alone were also included.

Two independent raters evaluated included studies for methodological quality, using four criteria from the risk of bias assessment tool developed by the Cochrane Collaboration:

  1. Adequate sequence generation
  2. Allocation concealment
  3. Blinding of outcome assessors
  4. Incomplete outcome data

Effect sizes (ES) were calculated for each comparison between CBT and another group at post-test (standardised mean difference) and then transformed into Hedges’ g in order to adjust for bias due to small size (.20, .50 and .80 correspond to small, moderate and respectively large ES). The standardised mean difference was also transformed in an index more amenable to clinical interpretation, the NNT, indicating the number of patients that have to be treated to generate one additional positive outcome.

Results

115 studies met the inclusion criteria and were included in the meta-analysis.

This review confirms what we already know about CBT, that it's a safe and effective treatment for adult depression
This review confirms what we already know about CBT, that it’s a safe and effective treatment for adult depression
  • CBT vs control (wait-list, treatment as usual, placebo or other):
    • The mean ES (g) was 0.71 (95% CI 0.62 to 0.79)
    • Corresponding to a NNT of 2.60

However, it is important to note that the authors evidenced considerable publication bias (confirmed by three methods), and also that study quality was a significant moderator of the results, with ES decreasing with the increase of study quality (a decrease of .14  with each of the quality criteria that was not met).

Additionally, effect sizes were smaller in clinical samples in studies conducted in the United States (as opposed to other countries), and in comparison with placebo and (or) other control groups, different than treatment as usual or waitlist.

  • CBT plus pharmacotherapy vs pharmacotherapy:
    • The mean ES (g) was 0.49 (95% CI 0.29 to 0.69)
    • Corresponding to an NNT of 3.68
  • CBT vs pharmacotherapy:
    • The mean ES (g) was 0.03 (95% CI –0.13 to 0.18, P > 0.05)
    • Indicating no significant overall difference in outcomes
  • CBT vs other psychotherapies:
    • The ESs ranged from -0.02 to 0.25 and were all non-significant
    • But for some of the alternative forms of therapy considered, there were only a small number of RCTs comparing them with CBT

Conclusions

The authors conclude that:

Based on a large number of comparisons of CBT with a control or alternate intervention group, our meta-analysis found that CBT is an efficacious treatment for adult depression.

However they also add:

But the review also cautions that the true impact of CBT might not be as positive as the research suggests
But the review also cautions that the true impact of CBT might not be as positive as the research suggests

This effect size is an overestimation of the true ES, because we also found clear indications for publication bias. Further, the inclusion of a considerable number of lower quality studies has probably also led to an overestimation of the mean ES.

Other important conclusions:

  • The combination of CBT and pharmacotherapy was superior to pharmacotherapy alone for the treatment of adult depression
  • However, in contrast to previous meta-analysis, Cuijpers et al found no difference in efficacy between CBT and pharmacotherapy
  • Comparisons with other forms of psychotherapy indicate CBT is no less and no more efficient, but for some of these forms of psychotherapy there are only a few studies comparing them with CBT

Limitations

  • The methodological quality of many of the studies included in the meta-analysis was subpar, with only  37% (43/115) of the studies meeting at least 3 of the 4 quality criteria
  • Although the number of included studies was substantial, some of the subgroup contrasts were based on a small number of studies, which may have contributed to the failure to show significant differences between subgroups of studies
  • The meta-analysis only examined the short-term outcomes of CBT

Link

Cuijpers, P., Berking, M., Andersson, G., Quigley, L., Kleiboer, A., Dobson, K.S., 2013. A meta-analysis of cognitive-behavioural therapy for adult depression, alone and in comparison with other treatments. Can J Psychiatry 58, 376–385. [PubMed abstract]

Add a comment
  • Instead of CBT, we should be worrying about meta-analyses

    Instead of CBT, we should be worrying about meta-analyses

    10 years ago
    […] psychotherapy, CBT has nonetheless been been shown to have some problems (see my previous blogs on CBT for adult depression and wait-list control exaggerating the efficacy of […]
  • David

    David

    12 years ago
    @Mental_ELF I am having a hard time finding out if the Meta considered only individual therapy or group therapy as well because the appendix is not published with the article. Do you have access to the appendix or know the what designs they included?
  • Sofie Vandevelde

    Sofie Vandevelde

    12 years ago
    Sofie Vandevelde liked this on Facebook.
  • mhequalities

    mhequalities

    12 years ago
    RT @Mental_Elf: Most popular blog this week: @Zia_Julia Publication bias & overestimating the effectiveness of CBT for depression http://t.…
  • SofieVDV2

    SofieVDV2

    12 years ago
    RT @Mental_Elf: Most popular blog this week: @Zia_Julia Publication bias & overestimating the effectiveness of CBT for depression http://t.…
  • Dr_A_Rashid

    Dr_A_Rashid

    12 years ago
    RT @Mental_Elf: Most popular blog this week: @Zia_Julia Publication bias & overestimating the effectiveness of CBT for depression http://t.…
  • catheresults

    catheresults

    12 years ago
    RT @Mental_Elf: Most popular blog this week: @Zia_Julia Publication bias & overestimating the effectiveness of CBT for depression http://t.…
  • samhenleysmith

    samhenleysmith

    12 years ago
    RT @Mental_Elf: Most popular blog this week: @Zia_Julia Publication bias & overestimating the effectiveness of CBT for depression http://t.…
  • angliacounsel

    angliacounsel

    12 years ago
    RT @Mental_Elf: Most popular blog this week: @Zia_Julia Publication bias & overestimating the effectiveness of CBT for depression http://t.…
  • cprjournal

    cprjournal

    12 years ago
    RT @Mental_Elf: Most popular blog this week: @Zia_Julia Publication bias & overestimating the effectiveness of CBT for depression http://t.…
  • Zia_Julia

    Zia_Julia

    12 years ago
    RT @Mental_Elf: Most popular blog this week: @Zia_Julia Publication bias & overestimating the effectiveness of CBT for depression http://t.…
  • mumwastheword

    mumwastheword

    12 years ago
    RT @Mental_Elf: Most popular blog this week: @Zia_Julia Publication bias & overestimating the effectiveness of CBT for depression http://t.…
  • NeilOConnell

    NeilOConnell

    12 years ago
    RT @Mental_Elf: Most popular blog this week: @Zia_Julia Publication bias & overestimating the effectiveness of CBT for depression http://t.…
  • DuckBeaki

    DuckBeaki

    12 years ago
    RT @Mental_Elf: Most popular blog this week: @Zia_Julia Publication bias & overestimating the effectiveness of CBT for depression http://t.…
  • Mental_Elf

    Mental_Elf

    12 years ago
    Most popular blog this week: @Zia_Julia Publication bias & overestimating the effectiveness of CBT for depression http://t.co/fKxZi3XvyB
  • psiquicritic

    psiquicritic

    12 years ago
    RT @Mental_Elf: Meta-analysis concludes that publication bias means we are overestimating the effectiveness of CBT for depression http://t.…
  • la_gaia

    la_gaia

    12 years ago
    RT @dr_know: Excellent blog-should we start questioning CBT's ruling status? @Mental_Elf by @Zia_Julia CBT efficacy for depression http://t…
  • tigerloun

    tigerloun

    12 years ago
    RT @Mental_Elf: Wow! Yesterday's blog on questioning CBT's ruling status has had a fantastic response http://t.co/fKxZi3XvyB Congats @Zia_J…
  • Mental_Elf

    Mental_Elf

    12 years ago
    Wow! Yesterday's blog on questioning CBT's ruling status has had a fantastic response http://t.co/fKxZi3XvyB Congats @Zia_Julia
  • emilijatru

    emilijatru

    12 years ago
    RT @Mental_Elf: In case you missed it: A meta-analysis of cognitive-behavioral therapy for adult depression: the winner takes it all? http:…
  • aghoury79

    aghoury79

    12 years ago
    Mental Elf: A meta-analysis of cognitive-behavioral therapy for adult depression: the winner takes it all? http://t.co/C5pqfxfcbx
  • SofieVDV2

    SofieVDV2

    12 years ago
    @Mental_Elf ...different psychotherapeutic interventions for depression have comparable, moderate-to-large effects... http://t.co/L9uU883AQP
  • SofieVDV2

    SofieVDV2

    12 years ago
    @Mental_Elf Recent meta-analyses, from Cuijpers & lot of other researchers, are clear: The Dodo Bird verdict (for depression) is +/- a fact.
  • C_2me

    C_2me

    12 years ago
    RT @Mental_Elf: In case you missed it: A meta-analysis of cognitive-behavioral therapy for adult depression: the winner takes it all? http:…
  • rjonesplymouth

    rjonesplymouth

    12 years ago
    RT @Mental_Elf: In case you missed it: A meta-analysis of cognitive-behavioral therapy for adult depression: the winner takes it all? http:…
  • erikwennstrom

    erikwennstrom

    12 years ago
    RT @Mental_Elf: In case you missed it: A meta-analysis of cognitive-behavioral therapy for adult depression: the winner takes it all? http:…
  • eskbankbooks

    eskbankbooks

    12 years ago
    RT @Mental_Elf: New meta-analysis of CBT vs antidepressants vs other talking treatments for depression http://t.co/fKxZi3XvyB
  • betty_watson

    betty_watson

    12 years ago
    RT @Mental_Elf: Meta-analysis concludes that publication bias means we are overestimating the effectiveness of CBT for depression http://t.…
  • StephanHermsen

    StephanHermsen

    12 years ago
    RT @Mental_Elf: In case you missed it: A meta-analysis of cognitive-behavioral therapy for adult depression: the winner takes it all? http:…
  • NickiH

    NickiH

    12 years ago
    RT @Mental_Elf: In case you missed it: A meta-analysis of cognitive-behavioral therapy for adult depression: the winner takes it all? http:…
  • mhequalities

    mhequalities

    12 years ago
    RT @Mental_Elf: In case you missed it: A meta-analysis of cognitive-behavioral therapy for adult depression: the winner takes it all? http:…
  • 121Therapy

    121Therapy

    12 years ago
    RT @Mental_Elf: In case you missed it: A meta-analysis of cognitive-behavioral therapy for adult depression: the winner takes it all? http:…
  • MarkOneinFour

    MarkOneinFour

    12 years ago
    RT @Mental_Elf: In case you missed it: A meta-analysis of cognitive-behavioral therapy for adult depression: the winner takes it all? http:…
  • hullodave

    hullodave

    12 years ago
    RT @Mental_Elf: In case you missed it: A meta-analysis of cognitive-behavioral therapy for adult depression: the winner takes it all? http:…
  • living_as_if

    living_as_if

    12 years ago
    RT @Mental_Elf: In case you missed it: A meta-analysis of cognitive-behavioral therapy for adult depression: the winner takes it all? http:…
  • Mental_Elf

    Mental_Elf

    12 years ago
    In case you missed it: A meta-analysis of cognitive-behavioral therapy for adult depression: the winner takes it all? http://t.co/fKxZi3XvyB
  • dr_know

    dr_know

    12 years ago
    @121Therapy @Mental_Elf @Zia_Julia lots of evidence for so-called 'common factors' in therapy (eg. Therapeutic alliance, empathy).
  • 121Therapy

    121Therapy

    12 years ago
    @dr_know @Mental_Elf @Zia_Julia How much recovery is actually down to the quality of the therapeutic relationship?
  • 121Therapy

    121Therapy

    12 years ago
    RT @Mental_Elf: Meta-analysis concludes that publication bias means we are overestimating the effectiveness of CBT for depression http://t.…
  • hipp0campus

    hipp0campus

    12 years ago
    RT @Mental_Elf: New meta-analysis of CBT vs antidepressants vs other talking treatments for depression http://t.co/fKxZi3XvyB
  • AlieshiaCBT

    AlieshiaCBT

    12 years ago
    @bdocs @Mental_Elf I guess what I take from it is that CBT is still an effective therapy but it's not the only one.
  • bdocs

    bdocs

    12 years ago
    @Mental_Elf @AlieshiaCBT https://t.co/5pCKUbsp20 The comments after the "however"s indicates loser takes all. Damned with faint praise.
  • Nicola Davies

    Nicola Davies

    12 years ago
    Nicola Davies liked this on Facebook.
  • ali_pals

    ali_pals

    12 years ago
    RT @Mental_Elf: Meta-analysis concludes that publication bias means we are overestimating the effectiveness of CBT for depression http://t.…
  • CoyneoftheRealm

    CoyneoftheRealm

    12 years ago
    Meta-analysis of cognitive-behavioral therapy for adult depression: the winner takes it all? http://t.co/1rlo2onmpp
  • angliacounsel

    angliacounsel

    12 years ago
    RT @Mental_Elf: Meta-analysis concludes that publication bias means we are overestimating the effectiveness of CBT for depression http://t.…
  • docbloomfield

    docbloomfield

    12 years ago
    RT @Mental_Elf: Meta-analysis concludes that publication bias means we are overestimating the effectiveness of CBT for depression http://t.…
  • ukasfp

    ukasfp

    12 years ago
    RT @Mental_Elf: New meta-analysis of CBT vs antidepressants vs other talking treatments for depression http://t.co/fKxZi3XvyB
  • ukasfp

    ukasfp

    12 years ago
    RT @Mental_Elf: Meta-analysis concludes that publication bias means we are overestimating the effectiveness of CBT for depression http://t.…
  • jen_unwin

    jen_unwin

    12 years ago
    RT @Mental_Elf: New meta-analysis of CBT vs antidepressants vs other talking treatments for depression http://t.co/fKxZi3XvyB
  • jen_unwin

    jen_unwin

    12 years ago
    RT @Mental_Elf: Meta-analysis concludes that publication bias means we are overestimating the effectiveness of CBT for depression http://t.…
  • MMU_DLister

    MMU_DLister

    12 years ago
    RT @Mental_Elf: Meta-analysis concludes that publication bias means we are overestimating the effectiveness of CBT for depression http://t.…
  • LizHughesDD

    LizHughesDD

    12 years ago
    RT @Mental_Elf: Meta-analysis concludes that publication bias means we are overestimating the effectiveness of CBT for depression http://t.…
  • elafarrell

    elafarrell

    12 years ago
    RT @Mental_Elf: Meta-analysis concludes that publication bias means we are overestimating the effectiveness of CBT for depression http://t.…
  • lypftlib

    lypftlib

    12 years ago
    A meta-analysis of cognitive-behavioral therapy for adult depression: the winner takes it all? http://t.co/IYfFspDo5l via @Mental_Elf
  • SchrebersSister

    SchrebersSister

    12 years ago
    RT @Mental_Elf: Meta-analysis concludes that publication bias means we are overestimating the effectiveness of CBT for depression http://t.…
  • CherryMakes

    CherryMakes

    12 years ago
    RT @Mental_Elf: Meta-analysis concludes that publication bias means we are overestimating the effectiveness of CBT for depression http://t.…
  • Hellsbell_

    Hellsbell_

    12 years ago
    RT @Mental_Elf: Meta-analysis concludes that publication bias means we are overestimating the effectiveness of CBT for depression http://t.…
  • HelenMcStravick

    HelenMcStravick

    12 years ago
    @Mental_Elf do you have any info on EYe movement threapy
  • Keith_Laws

    Keith_Laws

    12 years ago
    Depression meta analysis - Minority (37%) of the studies met at least 3 of 4 quality criteria used http://t.co/mcGzdYD7eX
  • mahatmaspen

    mahatmaspen

    12 years ago
    RT @Mental_Elf: New meta-analysis of CBT vs antidepressants vs other talking treatments for depression http://t.co/fKxZi3XvyB
  • Keith_Laws

    Keith_Laws

    12 years ago
    Meta-analysis: CBT vs antideprss vs other talking Txs for depression http://t.co/NFh7GvtrKz via @PsychiatrySHO Large CBT pub bias & no diffs
  • mrsjotaylor

    mrsjotaylor

    12 years ago
    RT @Mental_Elf: New meta-analysis of CBT vs antidepressants vs other talking treatments for depression http://t.co/fKxZi3XvyB
  • realmindfulness

    realmindfulness

    12 years ago
    RT @Mental_Elf: New meta-analysis of CBT vs antidepressants vs other talking treatments for depression http://t.co/fKxZi3XvyB
  • PsychiatrySHO

    PsychiatrySHO

    12 years ago
    RT @Mental_Elf: New meta-analysis of CBT vs antidepressants vs other talking treatments for depression http://t.co/fKxZi3XvyB
  • karenwhatever

    karenwhatever

    12 years ago
    New meta-analysis (via @Mental_Elf) indicates no difference in efficacy between CBT & pharmacotherapy for depression http://t.co/V0weoml9nw
  • Mental_Elf

    Mental_Elf

    12 years ago
    New meta-analysis of CBT vs antidepressants vs other talking treatments for depression http://t.co/fKxZi3XvyB
  • zoilogb

    zoilogb

    12 years ago
    " A meta-analysis of cognitive-behavioral therapy for adult depression: the winner takes it all? http://t.co/s9jPcSgEQZ"
  • h_meryl

    h_meryl

    12 years ago
    @dr_know @Mental_Elf @Zia_Julia Definitely. Just because it's easy to quantify doesn't make it the only way!
  • tapchat

    tapchat

    12 years ago
    A meta-analysis of cognitive-behavioral therapy for adult depression: the winner takes it all? http://t.co/pYiEj3li4s via @sharethis
  • mhequalities

    mhequalities

    12 years ago
    RT @Mental_Elf: Debut blog from @Zia_Julia summarising a recent review which examines the efficacy of CBT for adult depression http://t.co/…
  • dr_know

    dr_know

    12 years ago
    @hannahhypno @Mental_Elf @Zia_Julia think some service users really benefit from it, but evidence base overstated, alternatives neglected?
  • lypftlib

    lypftlib

    12 years ago
    A meta-analysis of cognitive-behavioral therapy for adult depression: the winner takes it all? http://t.co/IYfFspDo5l via @Mental_Elf
  • HHLibService

    HHLibService

    12 years ago
    A meta-analysis of cognitive-behavioral therapy for adult depression: the winner takes it all? -... http://t.co/MWGDHsCUKj
  • BlackRabbitInle

    BlackRabbitInle

    12 years ago
    RT @dr_know: Excellent blog-should we start questioning CBT's ruling status? @Mental_Elf by @Zia_Julia CBT efficacy for depression http://t…
  • dallsop

    dallsop

    12 years ago
    RT @dr_know: Excellent blog-should we start questioning CBT's ruling status? @Mental_Elf by @Zia_Julia CBT efficacy for depression http://t…
  • LincsCllgNtwk

    LincsCllgNtwk

    12 years ago
    RT @dr_know: Excellent blog-should we start questioning CBT's ruling status? @Mental_Elf by @Zia_Julia CBT efficacy for depression http://t…
  • hannahhypno

    hannahhypno

    12 years ago
    @dr_know @Mental_Elf @Zia_Julia I think plenty folk already are questioning it - good to see more research backing up service users' doubts!
  • Mental_Elf

    Mental_Elf

    12 years ago
    RT @dr_know: Excellent blog-should we start questioning CBT's ruling status? @Mental_Elf by @Zia_Julia CBT efficacy for depression http://t…
  • BigAmbitionsCIC

    BigAmbitionsCIC

    12 years ago
    RT @Mental_Elf: Debut blog from @Zia_Julia summarising a recent review which examines the efficacy of CBT for adult depression http://t.co/…
  • Daniella Doon-Joseph

    Daniella Doon-Joseph

    12 years ago
    Daniella Doon-Joseph liked this on Facebook.
  • The Mental Elf

    The Mental Elf

    12 years ago
    The Mental Elf liked this on Facebook.
  • hullodave

    hullodave

    12 years ago
    RT @Mental_Elf: Debut blog from @Zia_Julia summarising a recent review which examines the efficacy of CBT for adult depression http://t.co/…
  • LawsonPamela

    LawsonPamela

    12 years ago
    RT @Mental_Elf: Debut blog from @Zia_Julia summarising a recent review which examines the efficacy of CBT for adult depression http://t.co/…
  • dr_know

    dr_know

    12 years ago
    Excellent blog-should we start questioning CBT's ruling status? @Mental_Elf by @Zia_Julia CBT efficacy for depression http://t.co/p0h1E4HRCW
  • diana_candea

    diana_candea

    12 years ago
    A meta-analysis of cognitive-behavioral therapy for adult depression: the winner takes it all? http://t.co/3xJxKCZbsj via @sharethis
  • Zia_Julia

    Zia_Julia

    12 years ago
    RT @Mental_Elf: Debut blog from @Zia_Julia summarising a recent review which examines the efficacy of CBT for adult depression http://t.co/…
  • Mental_Elf

    Mental_Elf

    12 years ago
    Debut blog from @Zia_Julia summarising a recent review which examines the efficacy of CBT for adult depression http://t.co/fKxZi3XvyB
  • PusiGalor

    PusiGalor

    12 years ago
    @Mental_Elf or another case of garbage in - garbage out? #CBT on #NHS is certainly getting to that stage and that's if you manage to get it
  • Leona Allan

    Leona Allan

    12 years ago
    Leona Allan liked this on Facebook.
  • EloiseTierney

    EloiseTierney

    12 years ago
    RT @Mental_Elf: A meta-analysis of cognitive-behavioral therapy for adult depression: the winner takes it all? http://t.co/2acplALrzS
  • LivveyKirtley

    LivveyKirtley

    12 years ago
    Interesting findings re study quality & pub bias MT @Mental_Elf: Meta-analysis of CBT for adult depression: http://t.co/bJSxiG7pQd
  • concaff

    concaff

    12 years ago
    RT @aghoury79: A meta-analysis of cognitive-behavioral therapy for adult depression: the winner takes it all?: Cognitive-beha... http://t.c…
  • psynthesisblog

    psynthesisblog

    12 years ago
    RT @Mental_Elf: A meta-analysis of cognitive-behavioral therapy for adult depression: the winner takes it all? http://t.co/2acplALrzS
  • Insightfulness_

    Insightfulness_

    12 years ago
    @Mental_Elf Let us hope #NICE take notice of these conclusions and facilitate access to other psychological therapies.
  • Kirsten Corden

    Kirsten Corden

    12 years ago
    Kirsten Corden liked this on Facebook.
  • Av Rajiv Rai

    Av Rajiv Rai

    12 years ago
    Av Rajiv Rai liked this on Facebook.
  • missdasein

    missdasein

    12 years ago
    "@Mental_Elf: A meta-analysis of cognitive-behavioral therapy for adult depression: the winner takes it all? http://t.co/x3ds0qJeH8"
  • AlieshiaCBT

    AlieshiaCBT

    12 years ago
    RT @Mental_Elf: A meta-analysis of cognitive-behavioral therapy for adult depression: the winner takes it all? http://t.co/2acplALrzS
  • InfoECH

    InfoECH

    12 years ago
    RT @Mental_Elf: A meta-analysis of cognitive-behavioral therapy for adult depression: the winner takes it all? http://t.co/2acplALrzS
  • NIHRSPCR

    NIHRSPCR

    12 years ago
    RT @Mental_Elf: A meta-analysis of cognitive-behavioral therapy for adult depression: the winner takes it all? http://t.co/2acplALrzS
  • aghoury79

    aghoury79

    12 years ago
    A meta-analysis of cognitive-behavioral therapy for adult depression: the winner takes it all?: Cognitive-beha... http://t.co/dTnFIk1Dq6
  • ali_pals

    ali_pals

    12 years ago
    RT @Mental_Elf: A meta-analysis of cognitive-behavioral therapy for adult depression: the winner takes it all? http://t.co/2acplALrzS