Mirroring everyday clinical practice in clinical trial design: a new concept to improve the external validity of randomized double-blind placebo-controlled trials in the pharmacological treatment of major depression
© Severus et al; licensee BioMed Central Ltd. 2012
Received: 4 January 2012
Accepted: 2 July 2012
Published: 2 July 2012
Randomized, double-blind, placebo-controlled trials constitute the gold standard in clinical research when testing the efficacy of new psychopharmacological interventions in the treatment of major depression. However, the blinded use of placebo has been found to influence clinical trial outcomes and may bias patient selection.
To improve clinical trial design in major depression so as to reflect clinical practice more closely we propose to present patients with a balanced view of the benefits of study participation irrespective of their assignment to placebo or active treatment. In addition every participant should be given the option to finally receive the active medication. A research agenda is outlined to evaluate the impact of the proposed changes on the efficacy of the drug to be evaluated and on the demographic and clinical characteristics of the enrollment fraction with regard to its representativeness of the eligible population.
We propose a list of measures to be taken to improve the external validity of double-blind, placebo-controlled trials in major depression. The recommended changes to clinical trial design may also be relevant for other psychiatric as well as medical disorders in which expectations regarding treatment outcome may affect the outcome itself.
Keywordsmajor depression clinical trials randomized controlled trials psychopharmacology
The treatment of patients with major depression remains one of the major challenges in psychiatry in the 21st century [1–3]. There is a general consensus that antidepressant medications are an essential component of the treatment plan at any stage of the illness and particularly in severe cases [4, 5].
In the era of evidence-based medicine, randomized, double-blind, placebo-controlled, trials constitute the gold standard for testing the efficacy of new pharmacological interventions for major depression [6, 7]. Their unique strength derives from the fact that they allow comparisons of a psychopharmacologically active medicine to an identical looking 'medicine' which does not contain any active ingredient (placebo). Randomization is thought to ensure unbiased allocation of patients to each treatment arm while blinding both patients and investigators to treatment allocation safeguards against biased reporting of potential benefits or adverse effects .
During the last few years however it has become increasingly evident that the very strength of this type of trial, that is, the blinded use of placebo, may itself influence antidepressant and placebo response and remission rates [9, 10] and consequently clinical trial outcome . As neither randomization nor double-blinded placebo administration are part of normal clinical practice the external validity of results obtained from randomized, double-blind, placebo-controlled trials may not represent real life outcomes [12, 13]. Some of these limitations are introduced by the stringent eligibility criteria of clinical trials that routinely exclude patients with complex presentations [14, 15]. In addition, the acceptability of eligible patients to be randomized to the placebo arm is considered to be highly variable thus further limiting the number of participants to enroll in such studies . In many cases differences in outcome-relevant demographic and clinical characteristics of eligible patients that were enrolled (enrollment fraction) versus those that refused are not described in detail, which makes it difficult to draw reliable conclusions regarding the external validity of the trial . Therefore, a new study design is needed which reconciles the needs of clinical research meeting highest methodological standards (double-blinding, placebo-control) and at the same time preserves the external validity of the findings derived from these studies .
While clinical trials in major depression focus on the antidepressant efficacy of medications, clinical care has a wider remit and is concerned with the overall treatment of individual patients suffering from this disorder. In the context of clinical care the medication offered is already approved and the choice of the specific antidepressant does not happen in a randomized fashion but through a process of shared decision making between the treating physician (primary care doctor, psychiatrist) and the patient [19–21]. During this process patients are informed of the potential consequences of treatment choices including expected benefits. The combination of using an approved antidepressant and the patients' active participation in treatment choices creates positive expectations regarding the effectiveness of the treatment agreed upon and may positively affect the overall outcome . In contrast, in any randomized double-blind placebo-controlled trial, and particularly in Phase III trials, the expectation of a positive outcome is lessened by the knowledge that participants may be randomized to the placebo arm [9–11, 23–26]. However, in the absence of alternatives, only those drugs proven efficacious in the aforementioned double-blind, placebo-controlled randomized trials have been approved for use for the treatment of major depression. To improve external validity of randomized, double-blind, placebo-controlled trials in major depression we propose to introduce two core features of everyday clinical practice, namely shared decision making and availability of the active medication to all participants, into randomized, double-blind, placebo-controlled trials and to study the effects of this intervention on study outcome and recruitment.
Mirroring clinical practice in double-blind, placebo-controlled trials
Active medication for all study participants: At the end of late phase III clinical trials study participants could be offered the option of receiving the active medication or to remain on the study medication if it had been efficacious and well tolerated. The duration of this non-randomized phase could vary according to clinical need and patient preference.
Detailed explanation of potential benefits: Placebo is often referred to as an 'inert and deceptive intervention intended to please or placate the patient but without any potential to produce meaningful therapeutic results' . While not explicitly stated in the informed consent form (ICF) patients may consequently conclude that only if they are assigned to the active medication will they have a reasonable chance to improve regarding their depression. As this is not true we propose to reconceptualize what a placebo - and being randomized to the placebo arm - constitutes. This would involve explaining to study participants that improvement in their depressive symptoms may occur spontaneously while on the placebo arm, in which case they may have been spared unnecessary medication . Additionally it should be emphasized that study participation is likely to result in increased and more regular contact with clinicians and closer monitoring of their symptoms which can be beneficial in its own right .
The combination of these features mirrors clinical practice and redresses patients' fears of a negative outcome following study participation . An appropriate tool to convey the above mentioned information seems to be the informed consent form . Traditional informed consent forms currently state that 'A placebo or inactive medicine looks like real medicine but it is not. It is a dummy or pretend medicine. It has no effect on a person because it has no real medicine in it' (World Health Organization Research Ethics Review Committee). In contrast to this statement we propose the following (or similar) wording for a double-blind placebo-controlled randomized trial in major depression:
'The goal of this trial is to find out whether patients receiving drug 'X' will have an additional benefit compared to those receiving a placebo. A placebo or inactive medicine looks like real medicine, but contrary to a real medicine, it does not contain any substance believed to influence brain mechanisms relevant to depression. However, patients receiving placebo in clinical trials for depression often report significant improvements in their symptoms. There may be several reasons for this. Firstly, depressive symptoms are known to improve even without treatment as part of the natural course of the illness. Second, having frequent and regular discussion about your feelings and progress with the study clinicians may be therapeutic in itself. Third, being positive about getting better during the clinical trial may actually contribute to improving your symptoms [22, 30]. Therefore, regardless of the type of medicine you might receive (X or placebo) you may benefit from participating in this trial. Finally, at the end of the study you will be offered the option of receiving the active medication or remaining on the study medication. You can then decide together with your doctor what would be the appropriate next steps. If the study medication had been of benefit to you, you may want to continue on this medicine. In contrast, if you and your study doctor feel that you had not responded satisfactorily to the study medication, you may want to vote for the option of being given X if clinically appropriate'.
In order to test the impact of shared decision making and of study drug availability to all participants we propose to start with a number of Phase IV trials. In this agenda we will refer to a study design incorporating these proposed changes as an 'enhanced randomized controlled trial (RCT)'. This agenda should focus on comparing the antidepressant efficacy of study drug 'X' when evaluated using a traditional double-blind RCT versus the proposed enhanced RCT design. The evaluation will consist of comparisons of the effect size of placebo-active treatment arms differences on depressive symptoms and on outcome-relevant demographic and clinical characteristics of enrolled patients. This would then allow an estimation of the representativeness of the enrolled patients compared to all patients in the eligible target patient population.
The set of trials we propose to conduct consists of two steps:
traditional double-blind, randomized, placebo-controlled eight-week trial, including a traditional informed consent form, no option for extension period; or
enhanced double-blind, randomized, placebo-controlled eight-week trial, including the novel informed consent form outlined above, option for extension period.
The two treatment trials will be conducted by independent research teams who will be unaware that the two trial designs will be compared. Each clinical trial team will approach patients randomized to their study design (traditional or enhanced) and will ask them for their consent to participate. The wording of the ICF#2 will differ between the two trial designs. Patients approached to participate in the traditional trial will be presented with the traditional version of the ICF#2 while patients approached to participate in the enhanced trial will be given the new proposed ICF#2 outlined above.
Efficacy, by comparing the outcomes of the two trial designs based on the effect size symptom score improvement, number of responders, number of patients in remission, number of patients withdrawing, and Number Needed to Treat;
Tolerability, by comparing the outcomes of the two trial designs based on number and type of reported adverse events; and
Representativeness of study participants, by comparing outcome-relevant demographic and clinical characteristics of enrolled patients in each design (enrollment fraction) to the respective eligible target clinical population.
Comparisons between the two study designs can be straightforward and performed using ordinary linear models with treatment success being explained by study arm, study design and their interaction. As the goal is to assess study designs rather than specific drugs, the active medication to begin with, in both the traditional and enhanced clinical trials outlined, will be sertraline which has already been approved for the treatment of depressive disorder and is thought to have a balanced profile of efficacy and tolerability [31, 32]. For the purpose of this project, the research teams on both clinical trial designs will be blind to the active drug so as not to influence their evaluation. Equally patients will be told in the ICF#2 that they will be randomized 'either to placebo or to a drug thought to be helpful in depression'. In addition precise information will be provided about potential side effects which will be reassuring to all study participants. In this way we will be able to use existing literature on sertraline for power calculations for the traditional and enhanced clinical trials examined here. Additionally, this availability of multiple previous sources of information about sertraline will allow us to discuss findings from this project in the context of the wider literature.
In the era of evidence-based medicine it is paramount that we produce clinically relevant scientific evidence for the pharmacological treatment of patients with major depression. We therefore propose to enhance double-blind, placebo-controlled trials in such a way as to reflect clinical practice more closely. This could be achieved by adding extensions, thus offering every patient the possibility of receiving active treatment and formally integrating the process of shared decision making while obtaining informed consent. The proposed changes in the process of informed consent focus on a balanced presentation of evidence regarding the benefit of study participation irrespective of whether patients are assigned to active or placebo treatment. In order to evaluate the impact of the study designs on the efficacy and enrollment fraction of an intervention we further outlined a research agenda involving direct comparison of traditional and enhanced trial designs. While we feel that our approach represents an important step towards a more comprehensive assessment of the efficacy and external validity of the treatment options available, further research is needed in this area to improve the clinical care of patients suffering from this complex and often severely debilitating psychiatric illness . Finally, while our proposal primarily targets major depression its central idea may also be relevant for other psychiatric disorders as well as medical disorders such as asthma, in which expectations regarding treatment outcome may affect the outcome itself [34, 35].
List of abbreviations
informed consent form
randomized controlled trial.
The authors would like to thank Ilya Lipkovich, Ph.D. for stimulating discussions on the manuscript. There were no external sources of funding for any of the authors or for the manuscript preparation.
- Kennedy SH, Lam RW, Parikh SV, Patten SB, Ravindran AV: Canadian Network for Mood and Anxiety Treatments (CANMAT) clinical guidelines for the management of major depressive disorder in adults. Introduction. J Affect Disord. 2009, 117 (Suppl 1): S1-S2.View ArticlePubMedGoogle Scholar
- Patten SB, Kennedy SH, Lam RW, O'Donovan C, Filteau MJ, Parikh SV, Ravindran AV, Canadian Network for Mood and Anxiety Treatments (CANMAT): Canadian Network for Mood and Anxiety Treatments (CANMAT) clinical guidelines for the management of major depressive disorder in adults. I. Classification, burden and principles of management. J Affect Disord. 2009, 117 (Suppl 1): S5-14.View ArticlePubMedGoogle Scholar
- Wittchen HU, Jacobi F, Rehm J, Gustavsson A, Svensson M, Jonsson B, Olesen J, Allgulander C, Alonso J, Faravelli C, Fratiglioni L, Jennum P, Lieb R, Maercker A, van Os J, Preisig M, Salvador-Carulla L, Simon R, Steinhausen HC: The size and burden of mental disorders and other disorders of the brain in Europe 2010. Eur Neuropsychopharmacol. 2011, 21: 655-679. 10.1016/j.euroneuro.2011.07.018.View ArticlePubMedGoogle Scholar
- Moller HJ, Bitter I, Bobes J, Fountoulakis K, Hoschl C, Kasper S: Position statement of the European Psychiatric Association (EPA) on the value of antidepressants in the treatment of unipolar depression. Eur Psychiatry. 2012, 27: 114-128. 10.1016/j.eurpsy.2011.08.002.View ArticlePubMedGoogle Scholar
- Lam RW, Kennedy SH, Grigoriadis S, McIntyre RS, Milev R, Ramasubbu R, Parikh SV, Patten SB, Ravindran AV, Canadian Network for Mood and Anxiety Treatments (CANMAT): Canadian Network for Mood and Anxiety Treatments (CANMAT) clinical guidelines for the management of major depressive disorder in adults. III. Pharmacotherapy. J Affect Disord. 2009, 117 (Suppl 1): S26-S43.View ArticlePubMedGoogle Scholar
- Moller HJ: Are placebo-controlled studies required in order to prove efficacy of antidepressants?. World J Biol Psychiatry. 2005, 6: 130-131. 10.1080/15622970510030108.View ArticlePubMedGoogle Scholar
- Sackett DL, Rosenberg WM, Gray JA, Haynes RB, Richardson WS: Evidence based medicine: what it is and what it isn't. BMJ. 1996, 312: 71-72. 10.1136/bmj.312.7023.71.PubMed CentralView ArticlePubMedGoogle Scholar
- Hegerl U, Allgaier AK, Henkel V, Mergl R: Can effects of antidepressants in patients with mild depression be considered as clinically significant?. J Affect Disord. 2012, 138: 183-191. 10.1016/j.jad.2011.05.015.View ArticlePubMedGoogle Scholar
- Sinyor M, Levitt AJ, Cheung AH, Schaffer A, Kiss A, Dowlati Y, Lanctot KL: Does inclusion of a placebo arm influence response to active antidepressant treatment in randomized controlled trials? Results from pooled and meta-analyses. J Clin Psychiatry. 2010, 71: 270-279. 10.4088/JCP.08r04516blu.View ArticlePubMedGoogle Scholar
- Rutherford BR, Sneed JR, Roose SP: Does study design influence outcome? The effects of placebo control and treatment duration in antidepressant trials. Psychother Psychosom. 2009, 78: 172-181. 10.1159/000209348.PubMed CentralView ArticlePubMedGoogle Scholar
- Papakostas GI, Fava M: Does the probability of receiving placebo influence clinical trial outcome? A meta-regression of double-blind, randomized clinical trials in MDD. Eur Neuropsychopharmacol. 2009, 19: 34-40. 10.1016/j.euroneuro.2008.08.009.View ArticlePubMedGoogle Scholar
- Odgaard-Jensen J, Vist GE, Timmer A, Kunz R, Akl EA, Schunemann H, Briel M, Nordmann AJ, Pregno S, Oxman AD: Randomisation to protect against selection bias in healthcare trials. Cochrane Database Syst Rev. 2011, MR000012, 4View ArticleGoogle Scholar
- Parker G: Antidepressants on trial: how valid is the evidence?. Br J Psychiatry. 2009, 194: 1-3. 10.1192/bjp.bp.108.054767.View ArticlePubMedGoogle Scholar
- Seemuller F, Moller HJ, Obermeier M, Adli M, Bauer M, Kronmuller K, Holsboer F, Brieger P, Laux G, Bender W, Heuser I, Zeiler J, Gaebel W, Schennach-Wolff R, Henkel V, Riedel M: Do efficacy and effectiveness samples differ in antidepressant treatment outcome? an analysis of eligibility criteria in randomized controlled trials. J Clin Psychiatry. 2010, 71: 1425-1433. 10.4088/JCP.09m05166blu.View ArticlePubMedGoogle Scholar
- Wisniewski SR, Rush AJ, Nierenberg AA, Gaynes BN, Warden D, Luther JF, McGrath PJ, Lavori PW, Thase ME, Fava M, Trivedi MH: Can phase III trial results of antidepressant medications be generalized to clinical practice? A STAR*D report. Am J Psychiatry. 2009, 166: 599-607. 10.1176/appi.ajp.2008.08071027.View ArticlePubMedGoogle Scholar
- Jones R, Jones RO, McCowan C, Montgomery AA, Fahey T: The external validity of published randomized controlled trials in primary care. BMC Fam Pract. 2009, 10: 5-10.1186/1471-2296-10-5.PubMed CentralView ArticlePubMedGoogle Scholar
- Gross CP, Mallory R, Heiat A, Krumholz HM: Reporting the recruitment process in clinical trials: who are these patients and how did they get there?. Ann Intern Med. 2002, 137: 10-16.View ArticlePubMedGoogle Scholar
- Largent EA, Joffe S, Miller FG: Can research and care be ethically integrated?. Hastings Cent Rep. 2011, 41: 37-46.View ArticlePubMedGoogle Scholar
- Loh A, Simon D, Wills CE, Kriston L, Niebling W, Harter M: The effects of a shared decision-making intervention in primary care of depression: a cluster-randomized controlled trial. Patient Educ Couns. 2007, 67: 324-332. 10.1016/j.pec.2007.03.023.View ArticlePubMedGoogle Scholar
- Drake RE, Cimpean D, Torrey WC: Shared decision making in mental health: prospects for personalized medicine. Dialogues Clin Neurosci. 2009, 11: 455-463.PubMed CentralPubMedGoogle Scholar
- Brody H, Colloca L, Miller FG: The placebo phenomenon: implications for the ethics of shared decision-making. J Gen Intern Med. 2012, 27: 739-742. 10.1007/s11606-011-1977-1.PubMed CentralView ArticlePubMedGoogle Scholar
- Colloca L, Miller FG: Role of expectations in health. Curr Opin Psychiatry. 2011, 24: 149-155. 10.1097/YCO.0b013e328343803b.View ArticlePubMedGoogle Scholar
- Hegerl U, Mergl R: The clinical significance of antidepressant treatment effects cannot be derived from placebo-verum response differences. J Psychopharmacol. 2010, 24: 445-448. 10.1177/0269881109106930.View ArticlePubMedGoogle Scholar
- Moller HJ, Maier W: Evidence-based medicine in psychopharmacotherapy: possibilities, problems and limitations. Eur Arch Psychiatry Clin Neurosci. 2010, 260: 25-39. 10.1007/s00406-009-0070-9.View ArticlePubMedGoogle Scholar
- Hrobjartsson A, Kaptchuk TJ, Miller FG: Placebo effect studies are susceptible to response bias and to other types of biases. J Clin Epidemiol. 2011, 64: 1223-1229. 10.1016/j.jclinepi.2011.01.008.PubMed CentralView ArticlePubMedGoogle Scholar
- Colloca L, Lopiano L, Lanotte M, Benedetti F: Overt versus covert treatment for pain, anxiety, and Parkinson's disease. Lancet Neurol. 2004, 3: 679-684. 10.1016/S1474-4422(04)00908-1.View ArticlePubMedGoogle Scholar
- Brody H, Miller FG: Lessons from recent research about the placebo effect--from art to science. JAMA. 2011, 306: 2612-2613. 10.1001/jama.2011.1850.View ArticlePubMedGoogle Scholar
- Posternak MA, Zimmerman M: Therapeutic effect of follow-up assessments on antidepressant and placebo response rates in antidepressant efficacy trials: meta-analysis. Br J Psychiatry. 2007, 190: 287-292. 10.1192/bjp.bp.106.028555.View ArticlePubMedGoogle Scholar
- Miller FG, Colloca L: The placebo phenomenon and medical ethics: rethinking the relationship between informed consent and risk-benefit assessment. Theor Med Bioeth. 2011, 32: 229-243. 10.1007/s11017-011-9179-8.View ArticlePubMedGoogle Scholar
- Krell HV, Leuchter AF, Morgan M, Cook IA, Abrams M: Subject expectations of treatment effectiveness and outcome of treatment with an experimental antidepressant. J Clin Psychiatry. 2004, 65: 1174-1179. 10.4088/JCP.v65n0904.View ArticlePubMedGoogle Scholar
- Cipriani A, Furukawa TA, Salanti G, Geddes JR, Higgins JP, Churchill R, Watanabe N, Nakagawa A, Omori IM, McGuire H, Tansella M, Barbui C: Comparative efficacy and acceptability of 12 new-generation antidepressants: a multiple-treatments meta-analysis. Lancet. 2009, 373: 746-758. 10.1016/S0140-6736(09)60046-5.View ArticlePubMedGoogle Scholar
- Cipriani A, Furukawa TA, Geddes JR, Malvini L, Signoretti A, McGuire H, Churchill R, Nakagawa A, Barbui C, MANGA Study Group: Does randomized evidence support sertraline as first-line antidepressant for adults with acute major depression? A systematic review and meta-analysis. J Clin Psychiatry. 2008, 69: 1732-1742. 10.4088/JCP.v69n1108.View ArticlePubMedGoogle Scholar
- Severus E, Lipkovich I, Seemuller F, Obermeier M, Grunze H, Bernhard B, Dittmann S, Riedel M, Möller HJ: The potential role of Marginal Structural Models (MSMs) in testing the effectiveness of antidepressants in the treatment of patients with major depression in everyday clinical practice. World J Biol Psychiatry.
- Wechsler ME, Kelley JM, Boyd IO, Dutile S, Marigowda G, Kirsch I, Israel E, Kaptchuk TJ: Active albuterol or placebo, sham acupuncture, or no intervention in asthma. N Engl J Med. 2011, 365: 119-126. 10.1056/NEJMoa1103319.PubMed CentralView ArticlePubMedGoogle Scholar
- Moerman DE: Meaningful placebos--controlling the uncontrollable. N Engl J Med. 2011, 365: 171-172. 10.1056/NEJMe1104010.View ArticlePubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1741-7015/10/67/prepub