Opinion
Open Access
Open Peer Review

This article has Open Peer Review reports available.

How does Open Peer Review work?

Mirroring everyday clinical practice in clinical trial design: a new concept to improve the external validity of randomized double-blind placebo-controlled trials in the pharmacological treatment of major depression

  • Emanuel Severus1, 2Email author,
  • Florian Seemüller2,
  • Michael Berger2,
  • Sandra Dittmann2,
  • Michael Obermeier2,
  • Andrea Pfennig1,
  • Michael Riedel2, 3,
  • Sophia Frangou4,
  • Hans-Jürgen Möller2 and
  • Michael Bauer1
BMC Medicine201210:67

https://doi.org/10.1186/1741-7015-10-67

©  Severus et al; licensee BioMed Central Ltd. 2012

Received: 4 January 2012

Accepted: 2 July 2012

Published: 2 July 2012

Open Peer Review reports

Abstract

Background

Randomized, double-blind, placebo-controlled trials constitute the gold standard in clinical research when testing the efficacy of new psychopharmacological interventions in the treatment of major depression. However, the blinded use of placebo has been found to influence clinical trial outcomes and may bias patient selection.

Discussion

To improve clinical trial design in major depression so as to reflect clinical practice more closely we propose to present patients with a balanced view of the benefits of study participation irrespective of their assignment to placebo or active treatment. In addition every participant should be given the option to finally receive the active medication. A research agenda is outlined to evaluate the impact of the proposed changes on the efficacy of the drug to be evaluated and on the demographic and clinical characteristics of the enrollment fraction with regard to its representativeness of the eligible population.

Summary

We propose a list of measures to be taken to improve the external validity of double-blind, placebo-controlled trials in major depression. The recommended changes to clinical trial design may also be relevant for other psychiatric as well as medical disorders in which expectations regarding treatment outcome may affect the outcome itself.

Keywords

major depression clinical trials randomized controlled trials psychopharmacology

Background

The treatment of patients with major depression remains one of the major challenges in psychiatry in the 21st century [1–3]. There is a general consensus that antidepressant medications are an essential component of the treatment plan at any stage of the illness and particularly in severe cases [4, 5].

In the era of evidence-based medicine, randomized, double-blind, placebo-controlled, trials constitute the gold standard for testing the efficacy of new pharmacological interventions for major depression [6, 7]. Their unique strength derives from the fact that they allow comparisons of a psychopharmacologically active medicine to an identical looking 'medicine' which does not contain any active ingredient (placebo). Randomization is thought to ensure unbiased allocation of patients to each treatment arm while blinding both patients and investigators to treatment allocation safeguards against biased reporting of potential benefits or adverse effects [8].

During the last few years however it has become increasingly evident that the very strength of this type of trial, that is, the blinded use of placebo, may itself influence antidepressant and placebo response and remission rates [9, 10] and consequently clinical trial outcome [11]. As neither randomization nor double-blinded placebo administration are part of normal clinical practice the external validity of results obtained from randomized, double-blind, placebo-controlled trials may not represent real life outcomes [12, 13]. Some of these limitations are introduced by the stringent eligibility criteria of clinical trials that routinely exclude patients with complex presentations [14, 15]. In addition, the acceptability of eligible patients to be randomized to the placebo arm is considered to be highly variable thus further limiting the number of participants to enroll in such studies [16]. In many cases differences in outcome-relevant demographic and clinical characteristics of eligible patients that were enrolled (enrollment fraction) versus those that refused are not described in detail, which makes it difficult to draw reliable conclusions regarding the external validity of the trial [17]. Therefore, a new study design is needed which reconciles the needs of clinical research meeting highest methodological standards (double-blinding, placebo-control) and at the same time preserves the external validity of the findings derived from these studies [18].

Discussion

While clinical trials in major depression focus on the antidepressant efficacy of medications, clinical care has a wider remit and is concerned with the overall treatment of individual patients suffering from this disorder. In the context of clinical care the medication offered is already approved and the choice of the specific antidepressant does not happen in a randomized fashion but through a process of shared decision making between the treating physician (primary care doctor, psychiatrist) and the patient [19–21]. During this process patients are informed of the potential consequences of treatment choices including expected benefits. The combination of using an approved antidepressant and the patients' active participation in treatment choices creates positive expectations regarding the effectiveness of the treatment agreed upon and may positively affect the overall outcome [22]. In contrast, in any randomized double-blind placebo-controlled trial, and particularly in Phase III trials, the expectation of a positive outcome is lessened by the knowledge that participants may be randomized to the placebo arm [9–11, 23–26]. However, in the absence of alternatives, only those drugs proven efficacious in the aforementioned double-blind, placebo-controlled randomized trials have been approved for use for the treatment of major depression. To improve external validity of randomized, double-blind, placebo-controlled trials in major depression we propose to introduce two core features of everyday clinical practice, namely shared decision making and availability of the active medication to all participants, into randomized, double-blind, placebo-controlled trials and to study the effects of this intervention on study outcome and recruitment.

Mirroring clinical practice in double-blind, placebo-controlled trials

The introduction of the core features outlined above will be achieved in a number of steps:
  1. 1)

    Active medication for all study participants: At the end of late phase III clinical trials study participants could be offered the option of receiving the active medication or to remain on the study medication if it had been efficacious and well tolerated. The duration of this non-randomized phase could vary according to clinical need and patient preference.

     
  2. 2)

    Detailed explanation of potential benefits: Placebo is often referred to as an 'inert and deceptive intervention intended to please or placate the patient but without any potential to produce meaningful therapeutic results' [27]. While not explicitly stated in the informed consent form (ICF) patients may consequently conclude that only if they are assigned to the active medication will they have a reasonable chance to improve regarding their depression. As this is not true we propose to reconceptualize what a placebo - and being randomized to the placebo arm - constitutes. This would involve explaining to study participants that improvement in their depressive symptoms may occur spontaneously while on the placebo arm, in which case they may have been spared unnecessary medication [25]. Additionally it should be emphasized that study participation is likely to result in increased and more regular contact with clinicians and closer monitoring of their symptoms which can be beneficial in its own right [28].

     

The combination of these features mirrors clinical practice and redresses patients' fears of a negative outcome following study participation [22]. An appropriate tool to convey the above mentioned information seems to be the informed consent form [29]. Traditional informed consent forms currently state that 'A placebo or inactive medicine looks like real medicine but it is not. It is a dummy or pretend medicine. It has no effect on a person because it has no real medicine in it' (World Health Organization Research Ethics Review Committee). In contrast to this statement we propose the following (or similar) wording for a double-blind placebo-controlled randomized trial in major depression:

'The goal of this trial is to find out whether patients receiving drug 'X' will have an additional benefit compared to those receiving a placebo. A placebo or inactive medicine looks like real medicine, but contrary to a real medicine, it does not contain any substance believed to influence brain mechanisms relevant to depression. However, patients receiving placebo in clinical trials for depression often report significant improvements in their symptoms. There may be several reasons for this. Firstly, depressive symptoms are known to improve even without treatment as part of the natural course of the illness. Second, having frequent and regular discussion about your feelings and progress with the study clinicians may be therapeutic in itself. Third, being positive about getting better during the clinical trial may actually contribute to improving your symptoms [22, 30]. Therefore, regardless of the type of medicine you might receive (X or placebo) you may benefit from participating in this trial. Finally, at the end of the study you will be offered the option of receiving the active medication or remaining on the study medication. You can then decide together with your doctor what would be the appropriate next steps. If the study medication had been of benefit to you, you may want to continue on this medicine. In contrast, if you and your study doctor feel that you had not responded satisfactorily to the study medication, you may want to vote for the option of being given X if clinically appropriate'.

Research agenda

In order to test the impact of shared decision making and of study drug availability to all participants we propose to start with a number of Phase IV trials. In this agenda we will refer to a study design incorporating these proposed changes as an 'enhanced randomized controlled trial (RCT)'. This agenda should focus on comparing the antidepressant efficacy of study drug 'X' when evaluated using a traditional double-blind RCT versus the proposed enhanced RCT design. The evaluation will consist of comparisons of the effect size of placebo-active treatment arms differences on depressive symptoms and on outcome-relevant demographic and clinical characteristics of enrolled patients. This would then allow an estimation of the representativeness of the enrolled patients compared to all patients in the eligible target patient population.

The set of trials we propose to conduct consists of two steps:

In the first step potentially eligible patients suffering from a major depressive episode in the context of a major depressive disorder will be asked about their willingness, in general, to participate in clinical trials to evaluate different study designs on antidepressant efficacy. They will be given a first informed consent form (ICF#1) which will outline the general purpose of the trial but will not include details regarding study design. If patients are interested they will be asked to sign ICF#1. By doing so they give permission to study clinicians to access and analyze outcome relevant demographic and illness-related variables and check their eligibility for inclusion in clinical trials. This may also involve drawing blood for laboratory tests. Those signing ICF#1, and who fulfill eligibility criteria, will then be randomized to one of the following two treatment trial set ups (not treatment arms):
  1. 1)

    traditional double-blind, randomized, placebo-controlled eight-week trial, including a traditional informed consent form, no option for extension period; or

     
  2. 2)

    enhanced double-blind, randomized, placebo-controlled eight-week trial, including the novel informed consent form outlined above, option for extension period.

     

The two treatment trials will be conducted by independent research teams who will be unaware that the two trial designs will be compared. Each clinical trial team will approach patients randomized to their study design (traditional or enhanced) and will ask them for their consent to participate. The wording of the ICF#2 will differ between the two trial designs. Patients approached to participate in the traditional trial will be presented with the traditional version of the ICF#2 while patients approached to participate in the enhanced trial will be given the new proposed ICF#2 outlined above.

At study completion the traditional and enhanced designs will be compared in terms of:
  1. 1)

    Efficacy, by comparing the outcomes of the two trial designs based on the effect size symptom score improvement, number of responders, number of patients in remission, number of patients withdrawing, and Number Needed to Treat;

     
  2. 2)

    Tolerability, by comparing the outcomes of the two trial designs based on number and type of reported adverse events; and

     
  3. 3)

    Representativeness of study participants, by comparing outcome-relevant demographic and clinical characteristics of enrolled patients in each design (enrollment fraction) to the respective eligible target clinical population.

     

Comparisons between the two study designs can be straightforward and performed using ordinary linear models with treatment success being explained by study arm, study design and their interaction. As the goal is to assess study designs rather than specific drugs, the active medication to begin with, in both the traditional and enhanced clinical trials outlined, will be sertraline which has already been approved for the treatment of depressive disorder and is thought to have a balanced profile of efficacy and tolerability [31, 32]. For the purpose of this project, the research teams on both clinical trial designs will be blind to the active drug so as not to influence their evaluation. Equally patients will be told in the ICF#2 that they will be randomized 'either to placebo or to a drug thought to be helpful in depression'. In addition precise information will be provided about potential side effects which will be reassuring to all study participants. In this way we will be able to use existing literature on sertraline for power calculations for the traditional and enhanced clinical trials examined here. Additionally, this availability of multiple previous sources of information about sertraline will allow us to discuss findings from this project in the context of the wider literature.

Summary

In the era of evidence-based medicine it is paramount that we produce clinically relevant scientific evidence for the pharmacological treatment of patients with major depression. We therefore propose to enhance double-blind, placebo-controlled trials in such a way as to reflect clinical practice more closely. This could be achieved by adding extensions, thus offering every patient the possibility of receiving active treatment and formally integrating the process of shared decision making while obtaining informed consent. The proposed changes in the process of informed consent focus on a balanced presentation of evidence regarding the benefit of study participation irrespective of whether patients are assigned to active or placebo treatment. In order to evaluate the impact of the study designs on the efficacy and enrollment fraction of an intervention we further outlined a research agenda involving direct comparison of traditional and enhanced trial designs. While we feel that our approach represents an important step towards a more comprehensive assessment of the efficacy and external validity of the treatment options available, further research is needed in this area to improve the clinical care of patients suffering from this complex and often severely debilitating psychiatric illness [33]. Finally, while our proposal primarily targets major depression its central idea may also be relevant for other psychiatric disorders as well as medical disorders such as asthma, in which expectations regarding treatment outcome may affect the outcome itself [34, 35].

List of abbreviations

ICF: 

informed consent form

RCT: 

randomized controlled trial.

Declarations

Acknowledgements

The authors would like to thank Ilya Lipkovich, Ph.D. for stimulating discussions on the manuscript. There were no external sources of funding for any of the authors or for the manuscript preparation.

Authors’ Affiliations

(1)
Department of Psychiatry and Psychotherapy, University Hospital Carl Gustav Carus, Technical University Dresden
(2)
Department of Psychiatry and Psychotherapy, LMU Munich
(3)
Vinzenz von Paul Hospital
(4)
Institute of Psychiatry, King's College London

References

  1. Kennedy SH, Lam RW, Parikh SV, Patten SB, Ravindran AV: Canadian Network for Mood and Anxiety Treatments (CANMAT) clinical guidelines for the management of major depressive disorder in adults. Introduction. J Affect Disord. 2009, 117 (Suppl 1): S1-S2.View ArticlePubMedGoogle Scholar
  2. Patten SB, Kennedy SH, Lam RW, O'Donovan C, Filteau MJ, Parikh SV, Ravindran AV, Canadian Network for Mood and Anxiety Treatments (CANMAT): Canadian Network for Mood and Anxiety Treatments (CANMAT) clinical guidelines for the management of major depressive disorder in adults. I. Classification, burden and principles of management. J Affect Disord. 2009, 117 (Suppl 1): S5-14.View ArticlePubMedGoogle Scholar
  3. Wittchen HU, Jacobi F, Rehm J, Gustavsson A, Svensson M, Jonsson B, Olesen J, Allgulander C, Alonso J, Faravelli C, Fratiglioni L, Jennum P, Lieb R, Maercker A, van Os J, Preisig M, Salvador-Carulla L, Simon R, Steinhausen HC: The size and burden of mental disorders and other disorders of the brain in Europe 2010. Eur Neuropsychopharmacol. 2011, 21: 655-679. 10.1016/j.euroneuro.2011.07.018.View ArticlePubMedGoogle Scholar
  4. Moller HJ, Bitter I, Bobes J, Fountoulakis K, Hoschl C, Kasper S: Position statement of the European Psychiatric Association (EPA) on the value of antidepressants in the treatment of unipolar depression. Eur Psychiatry. 2012, 27: 114-128. 10.1016/j.eurpsy.2011.08.002.View ArticlePubMedGoogle Scholar
  5. Lam RW, Kennedy SH, Grigoriadis S, McIntyre RS, Milev R, Ramasubbu R, Parikh SV, Patten SB, Ravindran AV, Canadian Network for Mood and Anxiety Treatments (CANMAT): Canadian Network for Mood and Anxiety Treatments (CANMAT) clinical guidelines for the management of major depressive disorder in adults. III. Pharmacotherapy. J Affect Disord. 2009, 117 (Suppl 1): S26-S43.View ArticlePubMedGoogle Scholar
  6. Moller HJ: Are placebo-controlled studies required in order to prove efficacy of antidepressants?. World J Biol Psychiatry. 2005, 6: 130-131. 10.1080/15622970510030108.View ArticlePubMedGoogle Scholar
  7. Sackett DL, Rosenberg WM, Gray JA, Haynes RB, Richardson WS: Evidence based medicine: what it is and what it isn't. BMJ. 1996, 312: 71-72. 10.1136/bmj.312.7023.71.View ArticlePubMedPubMed CentralGoogle Scholar
  8. Hegerl U, Allgaier AK, Henkel V, Mergl R: Can effects of antidepressants in patients with mild depression be considered as clinically significant?. J Affect Disord. 2012, 138: 183-191. 10.1016/j.jad.2011.05.015.View ArticlePubMedGoogle Scholar
  9. Sinyor M, Levitt AJ, Cheung AH, Schaffer A, Kiss A, Dowlati Y, Lanctot KL: Does inclusion of a placebo arm influence response to active antidepressant treatment in randomized controlled trials? Results from pooled and meta-analyses. J Clin Psychiatry. 2010, 71: 270-279. 10.4088/JCP.08r04516blu.View ArticlePubMedGoogle Scholar
  10. Rutherford BR, Sneed JR, Roose SP: Does study design influence outcome? The effects of placebo control and treatment duration in antidepressant trials. Psychother Psychosom. 2009, 78: 172-181. 10.1159/000209348.View ArticlePubMedPubMed CentralGoogle Scholar
  11. Papakostas GI, Fava M: Does the probability of receiving placebo influence clinical trial outcome? A meta-regression of double-blind, randomized clinical trials in MDD. Eur Neuropsychopharmacol. 2009, 19: 34-40. 10.1016/j.euroneuro.2008.08.009.View ArticlePubMedGoogle Scholar
  12. Odgaard-Jensen J, Vist GE, Timmer A, Kunz R, Akl EA, Schunemann H, Briel M, Nordmann AJ, Pregno S, Oxman AD: Randomisation to protect against selection bias in healthcare trials. Cochrane Database Syst Rev. 2011, MR000012, 4View ArticleGoogle Scholar
  13. Parker G: Antidepressants on trial: how valid is the evidence?. Br J Psychiatry. 2009, 194: 1-3. 10.1192/bjp.bp.108.054767.View ArticlePubMedGoogle Scholar
  14. Seemuller F, Moller HJ, Obermeier M, Adli M, Bauer M, Kronmuller K, Holsboer F, Brieger P, Laux G, Bender W, Heuser I, Zeiler J, Gaebel W, Schennach-Wolff R, Henkel V, Riedel M: Do efficacy and effectiveness samples differ in antidepressant treatment outcome? an analysis of eligibility criteria in randomized controlled trials. J Clin Psychiatry. 2010, 71: 1425-1433. 10.4088/JCP.09m05166blu.View ArticlePubMedGoogle Scholar
  15. Wisniewski SR, Rush AJ, Nierenberg AA, Gaynes BN, Warden D, Luther JF, McGrath PJ, Lavori PW, Thase ME, Fava M, Trivedi MH: Can phase III trial results of antidepressant medications be generalized to clinical practice? A STAR*D report. Am J Psychiatry. 2009, 166: 599-607. 10.1176/appi.ajp.2008.08071027.View ArticlePubMedGoogle Scholar
  16. Jones R, Jones RO, McCowan C, Montgomery AA, Fahey T: The external validity of published randomized controlled trials in primary care. BMC Fam Pract. 2009, 10: 5-10.1186/1471-2296-10-5.View ArticlePubMedPubMed CentralGoogle Scholar
  17. Gross CP, Mallory R, Heiat A, Krumholz HM: Reporting the recruitment process in clinical trials: who are these patients and how did they get there?. Ann Intern Med. 2002, 137: 10-16.View ArticlePubMedGoogle Scholar
  18. Largent EA, Joffe S, Miller FG: Can research and care be ethically integrated?. Hastings Cent Rep. 2011, 41: 37-46.View ArticlePubMedGoogle Scholar
  19. Loh A, Simon D, Wills CE, Kriston L, Niebling W, Harter M: The effects of a shared decision-making intervention in primary care of depression: a cluster-randomized controlled trial. Patient Educ Couns. 2007, 67: 324-332. 10.1016/j.pec.2007.03.023.View ArticlePubMedGoogle Scholar
  20. Drake RE, Cimpean D, Torrey WC: Shared decision making in mental health: prospects for personalized medicine. Dialogues Clin Neurosci. 2009, 11: 455-463.PubMedPubMed CentralGoogle Scholar
  21. Brody H, Colloca L, Miller FG: The placebo phenomenon: implications for the ethics of shared decision-making. J Gen Intern Med. 2012, 27: 739-742. 10.1007/s11606-011-1977-1.View ArticlePubMedPubMed CentralGoogle Scholar
  22. Colloca L, Miller FG: Role of expectations in health. Curr Opin Psychiatry. 2011, 24: 149-155. 10.1097/YCO.0b013e328343803b.View ArticlePubMedGoogle Scholar
  23. Hegerl U, Mergl R: The clinical significance of antidepressant treatment effects cannot be derived from placebo-verum response differences. J Psychopharmacol. 2010, 24: 445-448. 10.1177/0269881109106930.View ArticlePubMedGoogle Scholar
  24. Moller HJ, Maier W: Evidence-based medicine in psychopharmacotherapy: possibilities, problems and limitations. Eur Arch Psychiatry Clin Neurosci. 2010, 260: 25-39. 10.1007/s00406-009-0070-9.View ArticlePubMedGoogle Scholar
  25. Hrobjartsson A, Kaptchuk TJ, Miller FG: Placebo effect studies are susceptible to response bias and to other types of biases. J Clin Epidemiol. 2011, 64: 1223-1229. 10.1016/j.jclinepi.2011.01.008.View ArticlePubMedPubMed CentralGoogle Scholar
  26. Colloca L, Lopiano L, Lanotte M, Benedetti F: Overt versus covert treatment for pain, anxiety, and Parkinson's disease. Lancet Neurol. 2004, 3: 679-684. 10.1016/S1474-4422(04)00908-1.View ArticlePubMedGoogle Scholar
  27. Brody H, Miller FG: Lessons from recent research about the placebo effect--from art to science. JAMA. 2011, 306: 2612-2613. 10.1001/jama.2011.1850.View ArticlePubMedGoogle Scholar
  28. Posternak MA, Zimmerman M: Therapeutic effect of follow-up assessments on antidepressant and placebo response rates in antidepressant efficacy trials: meta-analysis. Br J Psychiatry. 2007, 190: 287-292. 10.1192/bjp.bp.106.028555.View ArticlePubMedGoogle Scholar
  29. Miller FG, Colloca L: The placebo phenomenon and medical ethics: rethinking the relationship between informed consent and risk-benefit assessment. Theor Med Bioeth. 2011, 32: 229-243. 10.1007/s11017-011-9179-8.View ArticlePubMedGoogle Scholar
  30. Krell HV, Leuchter AF, Morgan M, Cook IA, Abrams M: Subject expectations of treatment effectiveness and outcome of treatment with an experimental antidepressant. J Clin Psychiatry. 2004, 65: 1174-1179. 10.4088/JCP.v65n0904.View ArticlePubMedGoogle Scholar
  31. Cipriani A, Furukawa TA, Salanti G, Geddes JR, Higgins JP, Churchill R, Watanabe N, Nakagawa A, Omori IM, McGuire H, Tansella M, Barbui C: Comparative efficacy and acceptability of 12 new-generation antidepressants: a multiple-treatments meta-analysis. Lancet. 2009, 373: 746-758. 10.1016/S0140-6736(09)60046-5.View ArticlePubMedGoogle Scholar
  32. Cipriani A, Furukawa TA, Geddes JR, Malvini L, Signoretti A, McGuire H, Churchill R, Nakagawa A, Barbui C, MANGA Study Group: Does randomized evidence support sertraline as first-line antidepressant for adults with acute major depression? A systematic review and meta-analysis. J Clin Psychiatry. 2008, 69: 1732-1742. 10.4088/JCP.v69n1108.View ArticlePubMedGoogle Scholar
  33. Severus E, Lipkovich I, Seemuller F, Obermeier M, Grunze H, Bernhard B, Dittmann S, Riedel M, Möller HJ: The potential role of Marginal Structural Models (MSMs) in testing the effectiveness of antidepressants in the treatment of patients with major depression in everyday clinical practice. World J Biol Psychiatry.Google Scholar
  34. Wechsler ME, Kelley JM, Boyd IO, Dutile S, Marigowda G, Kirsch I, Israel E, Kaptchuk TJ: Active albuterol or placebo, sham acupuncture, or no intervention in asthma. N Engl J Med. 2011, 365: 119-126. 10.1056/NEJMoa1103319.View ArticlePubMedPubMed CentralGoogle Scholar
  35. Moerman DE: Meaningful placebos--controlling the uncontrollable. N Engl J Med. 2011, 365: 171-172. 10.1056/NEJMe1104010.View ArticlePubMedGoogle Scholar

    36. Pre-publication history

    1. The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1741-7015/10/67/prepub

Copyright

© Severus et al; licensee BioMed Central Ltd. 2012

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Advertisement