In order to gain a license for treatment in a specific mental disorder a drug must demonstrate its superiority against placebo in the form of a randomised control trial. Comparisons versus other drugs allow establishment of treatment hierarchy but also require larger clinical trials to detect differences between agents.
Clinical trials are complex affairs, commonly bedevilled by a range of problems; not least the loss of participants to follow-up. When participants do not complete the trial a range of measures have been proposed to compensate for their being missing in the final analysis.
For example, the ‘Last outcome carried forward’ approach uses the last recorded data for the missing participants within the final analysis. The impact of missing data on analysis is clearly hard to predict and problematic, particularly in trials where the number of missing participants can approach half of those originally taking part, meaning that more than half of the final data gathered may be based on estimates from the data.
In order to explore the potential impact of missing data on clinical trials, researchers from around the United Kingdom have reported the findings from a meta-analysis into the efficacy of Quetiapine in the treatment of schizophrenia. Quetiapine is available in two formulations: Immediate (IR) and sustained release. For this project the Quetiapine IR formulation was considered.
The researchers defined two aims for their review:
- To assess the efficacy and adverse effects of Quetiapine IR in the treatment of schizophrenia in comparison with placebo
- To explore the potential impact of missing data on research findings
The team searched the published academic literature in order to identify studies in which participants were randomised in a blind fashion to receive either Quetiapine IR or placebo.
Data was extracted from the identified studies to address defined primary and secondary outcome measures:
- Primary measures:
- Average reduction of severity rating scale (PANSS) at the end of the trial
- Number of people achieving a clinically important response to medication (more than 50% reduction in PANSS)
- The authors assessed for clinically significant findings by considering a threshold reduction in PANSS necessary to produce a change perceived as beneficial by patients or providers. In this case, the minimal necessary change was identified as 11 points on the PANSS
- Secondary measures:
- Evidence of relapse
- Positive symptoms
- Negative symptoms
- Quality of life
- Need for additional antipsychotic medication
- The number of participants leaving studies was also identified
- Adverse effects were noted
- Movement disorders (noted through prescription of anti-Parkinsonian medication)
- Withdrawal from the trial due to sedation
- Number of drug attributable adverse events
- Weight gain
- Weight loss
- Results from identified trials were combined through meta-analysis
- The effects of missing data were assessed against the hypothesis that: trials with more than half of participants lost to follow up would have smaller drug-placebo differences than other trials (i.e. loss to follow up of participants masks drug efficacy)
- 15 trials were included in the analysis
- 11 assessed only short-term efficacy
- Trials were assessed for a risk of bias; the authors identified the following domains as being of concern:
- Selective reporting of secondary outcome measures and adverse effects
- Risk of attrition bias from loss to follow up
- Risk of unblinding due to sedation side-effects
Primary outcome measures
- Quetiapine outperformed placebo over the range of 2-12 weeks assessed
- The effect size was small and confidence intervals did not include the level identified as being the minimum for clinical significance
- Longer trial duration was associated with a more positive outcome
- The authors found no evidence that loss of participants to follow-up may have masked treatment efficacy
- Quetiapine was associated with a slight reduction in need for hospital care over 2-6 weeks
- Small effects were observed for change in positive and negative symptom subclass
- A slight reduction in need for additional sedative medication was noted
- No change in quality of life was observed
- Quetiapine was associated with a slight increased risk of minor, but not major, adverse events
- Quetiapine was associated with increased weight gain
The authors concluded:
Quetiapine IR has a small beneficial effect on overall psychotic symptoms over 2-12 weeks, but also leads to weight gain and sedation.
- In this review, the authors have sought to re-appraise the efficacy of Quetiapine in the light of an increased volume of data; they have also considered the impact of missing data from clinical trials; particularly the common claim that loss of participants to follow-up may mask true drug efficacy.
- Their choice to use a measure of clinical efficacy as a yard-stick could be considered controversial by some, although they do take steps to justify their choice of measure, notably comparison with previous pragmatic clinical trials and pre-stated predicted values of efficacy from the included studies in their review.
- That Quetiapine IR fails to meet this specified standard of clinical efficacy is hardly surprising as very few current psychotropic or psychological treatments do meet these standards.
The study can be criticised in that the authors have deviated in a number of methods from their pre-report study protocol, which was registered within a database of systematic reviews. The authors justify this deviation as being an adaptation in the face of newly available statistical techniques, and also in the light of peer review comments. Indeed, given the language employed throughout the paper it would seem apparent that this review has been through a fairly bruising, and arduous, peer review process before this final report was produced.
Loss of participants to follow-up in many of the trials included in this review was marked, and the authors call for steps to be taken to ensure that these participants can be included in analysis wherever possible since no amount of statistical modelling, or corrective technique, can fully account for the potential impact of participant loss.
What is particularly important about this review however is the steps the authors have taken to obtain previously unpublished data from trial coordinators. This is an essential step in such a reappraisal, but depressingly draws comment from the authors with regard to the difficulty of obtaining this data. The authors end their report with a well justified plea that all clinical trial data be made readily and transparently available through resources such as the All Trials campaign.
Hutton P, Taylor PJ, Mulligan L, Tully S, Moncrieff J. (2015). Quetiapine immediate release v. placebo for schizophrenia: systematic review, meta-analysis and reappraisal. The British Journal of Psychiatry, 206(5), 360–370. http://doi.org/10.1192/bjp.bp.114.154377 [Royal College of Psychiatry paywall :( ]
Quetiapine for schizophrenia: more transparency needed in clinical trial reporting: Andrew Shepherd reports on… http://t.co/ejnWjtFQBq
@Mental_Elf timely blog given the announcement of a review of medicines #trust
#Quetiapine for #schizophrenia http://t.co/ewhhv6FFcb
Quetiapine for schizophrenia: more transparency needed in clinical trial… http://t.co/zoZ5erXCRn #MentalHealth http://t.co/1ZLIUwJzQv
Today @shrinking81 reports on a systematic review, meta-analysis & reappraisal of #quetiapine for #schizophrenia http://t.co/lt30x1pkbA
@mental_elf May be @shrinking81 should stay away from ECT & drugs to scrutinize methods his heart&minds belong to.;) #ElfCredibility
@mental_elf I am not going to comment on this blogpost @shrinking81 anymore than I commented his blogpost on ECT @sameiHuda is a saint !;)
@SameiHuda: No COI declaration by Moncrieff who writes books attacking psych meds & expecting unrealistic effect sizes . This minimum clinical difference threshold seen on average in every patient is deliberately set too high in order to say quetiapine is ineffective
@SameiHuda: Hutton was part of CBTP unmedicated Lancet trial. If expected a -11 PANNS difference then CBTP would be ineffective as they got a mean of about -6.5. Funnily enough they didn’t come up with this proposed threshold for CBTP papers
Regarding the clinical significance score. Authors in the paper do state that few treatments would meet this criteria – the use of the measure is clearly up for debate but is not too far in magnitude from thresholds used in CATIE for example?
It’s a threshold set too high deliberately
For antidepressants Moncrieff calculated effect size of >0.8 needed to meet it ie a large effect size.
Effect size and CI is more informative
And Moncrieff should have declared her COI
As she writes books minimising the effects of meds she has a financial interest as well as prior cognitive bias on the subject that should have been declared
Some news from @Mental_Elf on testing the efficacy of a new drug for #schizophrenia. http://t.co/KlfoHESHyT As always, v. well presented.
@joannamoncrieff @Mental_Elf Sorry – with link http://t.co/UozyPxVjws
Reminds patients and family to learn about meds.
Don’t miss: Quetiapine for schizophrenia: more transparency needed in clinical trial reporting http://t.co/lt30x1GVAa #EBP
“Quetiapine – it works a bit and makes you fat” Research report via @Mental_Elf #schizophrenia http://t.co/5VmSf4AnVG #EBP”
Quetiapine for schizophrenia: more transparency needed in clinical trial reporting https://t.co/apdt9eYUHP
Quetiapine for schizophrenia: more transparency needed in clinical trial reporting https://t.co/8icOJw3Hq2 via @sharethis
Quetiapine for schizophrenia: more transparency needed in clinical trial reporting https://t.co/4W60c4qjaa via @sharethis
Quetiapine for schizophrenia: more transparency needed in clinical trial reporting
Excellent summary of our recent systematic review of quetiapine for schizophrenia via @mental_elf http://t.co/Hb4T2sK3Z1
@JoannaMoncrieff @Mental_Elf unclear how any research makes provision for individuals who realise they have to lie to avoid #Coercion
@JoannaMoncrieff @Mental_Elf Paddy McGowan , head of service user/carer involvement @HSElive http://t.co/EVdaV67szC ‘A full life’ @ShareThis
@JoannaMoncrieff How d’you respond to claim that 11 PANSS pts for “minimum clinically important difference” rules out almost all treatments?
@Mental_Elf Good point. Maybe indicates nothing has much effect, especially in people with chronic problems as in most trials
.@JoannaMoncrieff Indeed. Perhaps only Clozapine & Amisulpride would be effective on that measure? (11 PANSS points) Certainly not CBTp.
El incierto papel de la quetiapina en el tratamiento de la esquizofrenia
vía @JoannaMoncrieff @Mental_Elf
Worth a read if you work in mental health.
Quetiapine for schizophrenia http://t.co/YccXRKm24i