Skip to main content
Download PDF

The research burden of randomized controlled trial participation: a systematic thematic synthesis of qualitative evidence

BMC Medicine volume 18, Article number: 6 (2020) Cite this article

Abstract

Background

Participation in randomized controlled trials (RCTs) may be quite demanding and could represent an important burden for patients. We aimed to explore this research burden (i.e., the psychological, physical, and financial burdens) experienced by patients through their participation in a RCT.

Methods

We conducted a systematic review of qualitative studies exploring adult patients’ experiences with RCT participation. We searched MEDLINE (PubMed), CINAHL, PSYCHINFO, and Embase (search date March 2018) for eligible reports. Qualitative data coding and indexing were assisted by NVivo. The quality of reports was assessed by using the Critical Appraisal Skills Program (CASP) tool.

Results

We included 45 qualitative studies that involved 1732 RCT participants. Important psychological burdens were identified at every stage of the trial process. Participants reported feeling anxiety and being afraid of “being a ‘guinea pig’” and described undergoing randomization and allocation to a placebo as particularly difficult resulting in disappointment, anger, and depression. Patients’ follow-up and trial closure were also responsible for a wide range of psychological, physical, and financial burdens. Furthermore, factors related to burdensome impacts and consequences were discerned. These factors involved trial information, poorly organized and too-demanding follow-up, and lack of appropriate management when the patient’s participation ended. Trial participation was also associated with beneficial effects such as the satisfaction of feeling “useful,” gaining “a sense of control,” and receiving special attention.

Conclusions

Our finding provides a detailed description of research burden across the whole RCT process. Many of the burdens described could be anticipated, and some avoided in a movement toward minimally disruptive clinical research. Such an approach could improve trial recruitment and retention.

Review registration

PROSPERO CRD42018098994

Peer Review reports

Background

Randomized controlled trials (RCTs), and the systematic reviews that they contribute to, are considered the gold standard in clinical interventional research [1]. However, RCT participation may be quite challenging. Patients who are already trying to manage burdens associated with their illness and treatment could face additional burdens related to their trial participation. They may be required to travel, attend trial visits [2], undergo supplementary procedures (some of which may be invasive) [3], and complete trial questionnaires, among other demands that would not be necessary if they were not in a trial. All these tasks could be responsible for important psychological, physical, and financial burdens for patients, which may affect their willingness to begin and complete participation in a trial [4] and consequently have some implications for implementation science. However, despite hundreds of thousands of RCTs, relatively few studies have considered the burden of research participation on patients within the context of the trial itself.

Qualitative studies embedded or associated with RCTs could help understand patients’ experiences of RCT participation and the possible burdens encountered. To our knowledge, there are systematic reviews of qualitative studies to identify barriers and facilitators to recruitment and retention in RCTs [5,6,7]; however, no review yet has specifically explored patients’ research burden.

This study aimed to explore research burdens and benefits of adult patients’ participation in RCTs. This should allow the subsequent improvement of research planning and conduct.

In the context of this study, we defined “research burden” as encompassing the psychological, physical, and financial burdens to patients because of their participation in an RCT. We also defined patients as people with an illness.

Methods

Study design

We performed a systematic review and synthesis of qualitative research. We used thematic synthesis methods outlined by Thomas and Harden [8] and guidelines from the Cochrane Qualitative Methods Group [9]. We used an interpretative approach to go beyond the content of the original studies to develop analytical themes encompassing research burden. To ensure transparency, we adhered to the reporting guidelines set out by PRISMA [10] and ENTREQ (Additional file 1) [11].

Search strategy

A preplanned search strategy was developed and structured around our research objective (Additional file 1) [12,13,14,15,16]. We searched MEDLINE (PubMed), CINAHL, PSYCHINFO, and Embase to identify qualitative studies including RCT participants to explore participants’ experiences. We also searched Google Scholar and retrieved all studies that cited each of 3 pre-specified “seed” publications [3, 17, 18]. All searches were performed in March 2018.

For each qualitative study, we systematically searched for the embedded or associated trial using the reference when available. When no data were available, we contacted the authors of the qualitative study.

Screening

Inclusion criteria: We included all English-language reports of qualitative studies of patient participants of RCTs that explored their perspectives and experiences. We defined a qualitative study as having used or reported using qualitative methods for qualitative data collection and analysis. We also included studies using mixed methods if a clearly identifiable qualitative component was present. We defined an RCT as a study in which participants were randomly allocated to receive an intervention or a control.

Exclusion criteria: We excluded qualitative studies focusing on RCTs that included only children as well as RCTs that included only participants who had decreased decisional capacity or who required a proxy to consent to participate in the RCT. We also excluded qualitative studies of participants in screening trials, prevention trials, or only early-phase clinical trials as they may raise specific issues. Studies with mixed populations (e.g., patients and carers) were included, but only data related to patients were recorded. We also excluded studies including only potential participants or people who declined to join an RCT. Studies with both decliners and consenters were included, but only data related to consenters were recorded.

One review author (NN) independently screened all retrieved citations assisted by Covidence software. Full texts of eligible reports were retrieved and independently screened by one review author (NN).

Data extraction

Quantitative data extraction

One review author (NN) extracted the following descriptive information from the qualitative reports using a standard data extraction form (Additional file 1): study design, data collection methods, data analysis methods, number of participants in the qualitative study, number of RCTs the participants were sourced from, whether the study was nested in the RCT, and which clinical domain(s) were involved.

Two review authors (NN, VNT) independently appraised the methodological quality [11, 19] by using the Critical Appraisal Skills Program (CASP) tool (Additional file 1), a widely used qualitative research appraisal checklist [20]. Disagreements were resolved by consensus and when needed, a third reviewer (IB). The weighted Cohen’s Kappa for agreement on CASP criteria ranged from 0.80 to 0.92.

We extracted the following information from the associated RCT reports by using a standard data extraction form (Additional file 1): clinical setting, geographical location, funding sources, number of trial arms, intervention, comparator, estimated sample size, number randomized, masking of allocation, and issues encountered.

Qualitative data extraction, analysis, and synthesis

We followed the detailed methods for thematic synthesis outlined by Thomas and Harden [8]. Each included full-text report underwent coding and analysis assisted by NVivo Pro v12. First, three independent review authors [NN, VNT, IB] inductively line-by-line coded a set of 10 reports. We pre-specified and coded the results/findings and discussion sections covering the authors’ interpretation of their data as well as any text reported as direct/verbatim patient quotes. Second, three reviewers (NN, VNT, IB) independently organized the open codes into structured descriptive themes based on similarities and differences between codes. Third, the three reviewers met to reach consensus on the codes and themes, with further interpretative discussion focused on the research question to generate analytical themes. Next, one reviewer (NN) independently coded the remaining reports, adding new excerpts to the pre-existing codes and themes in the codebook (Additional file 1) as well as creating new codes and themes as appropriate. Throughout the coding process, the review authors met regularly to cross-check newly generated codes and themes against the data, discuss interpretation, and synthesize analytical themes encompassing “research burden” and “research benefit.”

We presented examples of coded text excerpts in quoted italics followed by [PC] or [SC]. PC stands for “primary code,” i.e., the excerpt represents a verbatim patient quote, and SC stands for “secondary code,” i.e., the excerpt represents the author’s interpretation.

Patient and public involvement

The manuscript, codebook, figures, tables, and appendices were reviewed by a patient representative (DS), and helpful points further clarifying the wording of the interpretative analysis were adjusted for accordingly.

Results

Characteristics of qualitative studies

Of the 3587 records screened, we included 45 qualitative studies (Fig. 1; Additional file 1) involving 1732 patients who had participated in an RCT (Table 1). A qualitative design was used in 37 (82%) studies. The main methods used were interviews (n = 39; 87%) and thematic analysis (n = 21; 47%). The median number of participants in each study was 21 (Q1 to Q3: 15 to 38). The studies were mainly in the field of cancer (n = 14; 31%) and chronic diseases (n = 12; 27%). Six (13.3%) qualitative studies were published before 2005. Participants were sourced from a single RCT in 31 (71%) studies and from more than one RCT in 8 (16%). For 6 (13%) studies, the number of RCTs involved was unclear. The methodological quality is reported in Table 1. We were able to retrieve 42 RCTs: 37 were published final reports and 5 were published protocols (Table 2). Issues encountered during trial implementation were reported for 10 trials, 8 related to suboptimal recruitment such as slow accrual or high refusal rate and 2 to obtaining informed consent in an emergency setting.

Fig. 1
figure1

Systematic review flowchart

Full size image
Table 1 Characteristics of the primary qualitative reports
Full size table
Table 2 Characteristics of the RCT reports from which primary qualitative studies sourced participants
Full size table

Burdensome impacts and consequences of trial participation

Psychological impacts

The research burden experienced by participants in RCTs is detailed in Additional file 1 and summarized in Fig. 2. Participants endured a diverse array of psychological burdens at every stage of the trial process. The decision to commit to a trial, understand trial information, and provide consent was responsible for anxiety and fear of “being a ‘guinea pig’ and being used to “further the career of a scientist without benefit to one’s present condition” [SC]. Many participants felt stressed and overwhelmed when dealing with the “load of information” [PC], “intimidated” [SC] and confused by the complicated and technical terminologies used and embarrassed to admit not understanding trial information. Moreover, undergoing randomization carried significant psychological burden. Some struggled to accept the concept of random allocation: “deep inside, I believed the new treatment being better, and now I [agreed] to participate in a drawing of lots. I was not certain of winning the draw, if you understand? If I had got the standard treatment I maybe would have felt… it’s not as good as the one I’ve got. I think it’s wrong” [PC]. Patients expressed fear and anxiety associated with the possibility of placebo allocation: “Patients ‘run the risk’ of receiving the placebo (i.e., getting no treatment) and dying sooner” [SC]. Allocation to the control arm was associated with disappointment, anger and depression that was quite devastating: “…no hope for me… extremely depressed …went home and cried. To leave the hospital after an hour of filling forms … empty handed. I felt no one really understood how bad I felt” [PC].

Fig. 2
figure2

Classification of theme “Research Burden” and sub-themes “Burdensome Impacts and Consequences” and “Factors related to Burden”

Full size image

Patients’ follow-up was also responsible for important psychological burdens. Frustration and dissatisfaction were associated with completing trial questionnaires: “Questionnaires are always terrible because you never can express by checking a box what one wants to say” [PC]. Finally, patients struggled to deal with the end of their participation in the trial and their transition to usual care. A sense of loss, isolation, and anxiety was associated with the end of the trial: “‘It was a bit of a blow.’; ‘in a way I suppose I was a bit anxious.’; ‘I felt as though I was losing friends here.’” [PC].

Physical impacts

Patients’ follow-up was also responsible for physical burdens. Particularly, “participants indicated they had experienced some negative effects from completing the outcome measures, chiefly that reading and rating their level of nausea and vomiting at a time when they were feeling nauseous had at times worsened their experience” [SC], which demonstrates direct physical burden. We also found that time consumed by trial participation was an important burden. One patient was “surprised by the fact that professionals presume that you have plenty of time” and further explained that “they did not take my possibilities and preferences into account” [PC]. Patients “had to travel to appointments in rush-hour traffic” [SC] and were forced to adapt their schedules to suit the trial. Patients reported allocation to the control arm or a placebo as a “waste of time” [PC], and there was a “personal belief [that patients] have little time left and their time would be shortened by participating in a clinical trial” [SC].

Cost impacts

It is also essential to consider the financial burden of trial participation: “the patient also lived a considerable distance from the hospital, and it seems he incurred considerable expense and inconvenience every time he attended an appointment” [SC].

Factors related to burden of trial participation

We further discerned factors related to research burden, which we differentiated into patients’ interpretation and trial logistics (Fig. 2; Additional file 1). Many factors were distinctly associated with trial information. Patients were overwhelmed due to inappropriate timing, excessive volume, inadequate format, and the variety and complexity of the information. Furthermore, some essential information related to participation risks was insufficient: “It would be good for people to be told up front how bad the chemo is. How incredibly tired you feel. That can’t be said enough.” [PC]. Factors related to beliefs and understanding featured prominently as a compounding issue such as “little or no understanding or consideration of the unknown and potentially equal risks and benefits of participating in the trial, and the principle of equipoise” [SC] induced or worsened burdensome impacts. Other important RCT concepts (such as reasons for using randomization) were similarly misunderstood by patients, contributing to discomfort and discontent related to being randomized. We also identified that factors related to patients’ follow-up, for example, frequency and length of trial questionnaires, worsened the additional workload: “It [questionnaire] was hard work because there were so many pages” [PC] and “I would have favored a weekly diary rather than a daily one” [PC]. Furthermore, attending poorly organized and inconveniently timed trial visits led to irritation: “The things that have annoyed me so far is you go to the [name of principal hospital in city 3], you’ve got to be there for eight o’clock in the morning, [and] they got no bed for you. So they can’t do anything until they have found a bed for you, and I’ve been there from eight until half past one, um, just hanging around” [PC].

Finally, disappointment at trial closure was punctuated by a lack of feedback related to results or allocation.

Beneficial effects of trial participation

Trial participation was also associated with beneficial effects (Table 3; Additional file 1). Patients believed their altruistic motivations and intentions to participate as being a “feel-good factor associated with their participation in a trial. Patients remarked that participation “makes you feel useful and gives satisfaction to take part in a trial [SC/PC]” and “it makes you feel better, doesn’t it, if you feel you are contributing something” [PC]. We also noted an emphasis on the relevance of patients’ participation for future research and the next generation of patients as “worthwhile” and appreciation for the opportunity to contribute meaningfully. Benefits were also reported, such as a newfound personal insight from completing trial questionnaires: “It gave me food for thought, it gave me more insight into perhaps what was really bothering me...some of the questions would bring to light, maybe some of the things I had been feeling, but didn’t realize it until I had to answer.” [PC] We also found that a sense of control may be regained: “And actually it helped because it was something positive to do, on certain days and ticking the boxes and all that sort of thing. I felt because I think part of having cancer is you lose control, and I am quite, the sort of person that likes to be in control and this is enabling me a little bit of control back” [PC]. Notably, an improved relationship with the trial staff and healthcare providers was identified, with trust, support, and encouragement being important components. Indeed, some patients described the trial clinic as being “like home from home [PC]” and a “safe haven or a pseudo-surrogate family” [PC]. Furthermore, receiving special attention such as closer supervision of illness and contact with healthcare staff, extra efforts, and superior facilities was considered as greatly advantageous. One impressed patient “felt privileged to be on a trial. We had a separate chemo facility and we all knew we were at the Ritz” [PC].

Table 3 Theme “Trial Participation Benefits”
Full size table

Discussion

To our knowledge, this is the first study providing a detailed description of the burdensome impacts experienced by participants in clinical trials and identification of factors associated with this burden.

This systematic review of 45 qualitative studies that involved 1732 RCT participants in various fields provides a detailed description of the diverse psychological, physical, and financial burdens experienced by patients when they participate in a trial. Burden arises across all stages of the trial: the informed consent process, randomization and masking, follow-up, and at the end of study participation. We further discerned factors associated with trial implementation as well as factors related to patients’ interpretation of trial concepts that are related to research burdens.

Research burden was initially conceptualized in the field of survey research with respondent burden, depending on the amount of effort required by the respondent, the amount of stress, and the length and frequency of interviews. This concept has progressively been extended to other types of research, with a particular focus on seriously ill patients [18]. Lingler and colleagues proposed a broader conceptualization of research burden and suggested the term “perceived participant burden” [21]. Some evidence shows that research burden can be common in RCTs. For example, half the respondents in an international survey of 2194 clinical trial participants considered trial participation as disruptive to their daily routine [22]. The concept of research burden has featured prominently in recent priority-setting partnerships for trial methodology research [23, 24].

Implications

Impact on trial recruitment and retention

The high burden of trial participation could be an important barrier to trial participation and increase trial withdrawal. For instance, a study showed that the complexity and stringency of the protocol were among the most common reasons cited by patients as barriers to participation in clinical trials of cancer treatments [25]. Additional procedures and appointments, as well as travel time and travel costs, are frequent reasons for declining participation, missing appointments, and “withdrawing” from a trial [26]. These sentiments are an important issue because the success of RCTs depends on their ability to recruit a sufficient number of patients and to ensure that as few participants as possible withdraw from the research or become lost to follow-up. Yet, trial recruitment is generally slower than expected [27]. Many trials fail to reach their planned sample size within the timescale and funding originally envisaged. For example, less than one third of the trials from two UK academic funding institutions recruited 100% of their original target and 45% failed to recruit even 80% of the target sample size [28]. Similarly, a study of RCTs in the USA found that about one third of the trials recruited less than 75% of their planned sample [29]. The number of eligible participants declining participation varies according to the context of the study and can represent up to 50% of the patients invited to participate [30, 31]. Our results also have some implications for implementation science. Indeed, successful intervention implementation requires that patients accept trial participation. Slow recruitment increases cost and delays the transposition of results into practice. Results are less reliable if the planned sample size is not achieved [32, 33], and a high refusal rate raises important concerns about the external validity. The extrapolation of the findings to the target population will not be guaranteed [34,35,36,37], and the financial investment in the research might be wasted. This situation raises doubts about the extrapolation of trial findings to the future, target population [28, 34,35,36,37].

Ethical considerations

Further, there are important moral and ethical reasons for seeking to avoid unduly burdening patients. The process of seeking informed consent can, for example, be responsible for burden participants psychologically; it has even been considered cruel [38]. It can be very stressful for patients to listen to a physician describing the potential benefits of the new treatment and then be informed that the treatment will be decided by randomization. Nevertheless, research burden is probably insufficiently considered by regulatory agencies, which mainly focus on the direct risk induced by the interventions and data collection. This burden is also inadequately considered by researchers who may be too busy focusing on the comprehensiveness, quality, and appropriate standardization of the data collected.

Toward minimally disruptive and compassionate clinical research

Funders, trialists, and methodologists should rethink the planning and conduct of trials. First, they must minimize research burdens and should implement “minimally disruptive and compassionate clinical research [39]”. Second, in the same way, a framework has been developed for the humanization of healthcare [40]; we need to move toward compassionate clinical research. Indeed, our results highlight that most of the burden experienced by participants are psychological burdens. While it is impossible to completely reduce this burden, trialists could implement interventions to favor compassionate and empathic support to patients. Such support has demonstrated its beneficial effect for healthcare [41]. The results of this review could help improve the design and conduct of RCTs by helping researchers to identify and implements strategies to reduce research burden. Such strategies might be implemented and evaluated in a Study Within A Trial (SWAT) [42] and thereby add to the evidence base on recruitment and retention in trials [5, 6]. Further, we need to explore other study designs that could reduce burden and improve external validity such as trials embedded in registries, cohorts, or routinely collected data [43] but also observational studies and use of routinely collected data. Patient and public involvement at the planning stage of the trial could also help reduce the burden [44,45,46] and drawing on patients’ experiential knowledge, ideas, and input when designing interventions to reduce research burden is essential [47,48,49,50]. The amount of data recorded as well as the modalities for recording data could also be questioned. For instance, O’Leary and colleagues showed that the median number of items collected per participant in a sample of cancer RCTs was 599 (range 186 to 1035), but only 18% of the data collected was actually used and reported in the resulting articles [46]. Similarly, a retrospective study of patient travel burden in cancer clinical trials using a Google Maps calculator showed that the median unidirectional distance traveled from home to the study site was 40 km (interquartile range 17.7 to 120.7) [51]. The benefits of trial participation identified in this study should also be considered for the planning and conducting of future research although it is important to acknowledge that some factors (e.g., completion of questionnaire) were considered as beneficial for some patients and burdensome by others.

Limitations

There are limitations to our study. First, although our search strategy aimed to be comprehensive, we cannot exclude that we may have missed some studies. Nevertheless, the guidance for qualitative reviews focuses more on confidence in the synthesized findings, rather than on comprehensiveness [52]. Second, privacy and confidentiality reasons meant that we did not contact the authors of the included studies to request their complete data, and therefore, our thematic analysis and synthesis was limited to the findings and patient quotes published in the qualitative reports. Further, for feasibility reasons, we excluded some types of patients from this research burden project, such as adults with decreased decisional capacity for consent or requiring a proxy and children. We did not consider decliners although they have a potentially valuable perspective on research burden. We also excluded early-phase trials as well as screening trials or prevention trials.

Finally, we could not take into account participants’ individual health status, i.e., disease progression and treatment burdens, as well as their personal capacity which could highly impact the burden experienced.

Conclusion

Our findings provide a detailed description of research burden across the whole RCT process. This compendious representation further elucidates key factors related to burden. The consideration of these modifiable factors in the planning and design of RCTs, such as the timing, volume, complexity, or format of trial information or the organization of patients’ follow-up, could help perform better RCTs. Many of the burdensome impacts described could be anticipated, and some avoided in a movement toward minimally disruptive clinical research. Such approach could improve trial recruitment and retention.

Availability of data and materials

Dataset available from the corresponding author (isabelle.boutron@aphp.fr).

Abbreviations

CASP:

Critical Appraisal Skills Program

PC:

Primary code

RCT:

Randomized controlled trial

SC:

Secondary code

References

  1. 1.

    Chlebowski RT, Hendrix SL, Langer RD, et al. Influence of estrogen plus progestin on breast cancer and mammography in healthy postmenopausal women: the Women’s Health Initiative randomized trial. JAMA. 2003;289(24):3243–53.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  2. 2.

    Nipp RD, Powell E, Chabner B, Moy B. Recognizing the financial burden of cancer patients in clinical trials. Oncologist. 2015;20(6):572–5.

    PubMed  PubMed Central  Article  Google Scholar 

  3. 3.

    Kimmelman J, Resnik DB, Peppercorn J, Ratain MJ: Burdensome research procedures in trials: why less is more. J Natl Cancer Inst. 2017;109(4):djw315.

  4. 4.

    Townsley CA, Selby R, Siu LL. Systematic review of barriers to the recruitment of older patients with cancer onto clinical trials. J Clin Oncol. 2005;23(13):3112–24.

    PubMed  Article  PubMed Central  Google Scholar 

  5. 5.

    Treweek S, Pitkethly M, Cook J, Fraser C, Mitchell E, Sullivan F, Jackson C, Taskila TK, Gardner H. Strategies to improve recruitment to randomised trials. Cochrane Database Syst Rev. 2018;2:MR000013.

    PubMed  PubMed Central  Google Scholar 

  6. 6.

    Brueton VC, Tierney J, Stenning S, Harding S, Meredith S, Nazareth I, Rait G. Strategies to improve retention in randomised trials. Cochrane Database Syst Rev. 2013;12:MR000032.

    Google Scholar 

  7. 7.

    Skea ZC, Newlands R, Gillies K. Exploring non-retention in clinical trials: a meta-ethnographic synthesis of studies reporting participant reasons for drop out. BMJ Open. 2019;9(6):e021959.

    PubMed  PubMed Central  Article  Google Scholar 

  8. 8.

    Thomas J, Harden A. Methods for the thematic synthesis of qualitative research in systematic reviews. BMC Med Res Methodol. 2008;8:45.

    PubMed  PubMed Central  Article  Google Scholar 

  9. 9.

    Harris JL, Booth A, Cargo M, Hannes K, Harden A, Flemming K, Garside R, Pantoja T, Thomas J, Noyes J. Cochrane Qualitative and Implementation Methods Group guidance paper 6: methods for question formulation, searching, and protocol development for qualitative evidence synthesis. J Clin Epidemiol. 2017.

  10. 10.

    Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7):e1000097.

    PubMed  PubMed Central  Article  Google Scholar 

  11. 11.

    Tong A, Flemming K, McInnes E, Oliver S, Craig J. Enhancing transparency in reporting the synthesis of qualitative research: ENTREQ. BMC Med Res Methodol. 2012;12(1):181.

    PubMed  PubMed Central  Article  Google Scholar 

  12. 12.

    Methley AM, Campbell S, Chew-Graham C, McNally R, Cheraghi-Sohi S. PICO, PICOS and SPIDER: a comparison study of specificity and sensitivity in three search tools for qualitative systematic reviews. BMC Health Serv Res. 2014;14:579.

    PubMed  PubMed Central  Article  Google Scholar 

  13. 13.

    Shaw RL, Booth A, Sutton AJ, Miller T, Smith JA, Young B, Jones DR, Dixon-Woods M. Finding qualitative research: an evaluation of search strategies. BMC Med Res Methodol. 2004;4:5–5.

    PubMed  PubMed Central  Article  Google Scholar 

  14. 14.

    Evans D. Database searches for qualitative research. J Med Library Association. 2002;90(3):290–3.

    Google Scholar 

  15. 15.

    Booth A: Chapter 3: searching for studies. In: Supplementary guidance for inclusion of qualitative research in Cochrane systematic reviews of interventions. Edited by Noyes J BA, Hannes K, Harden A, Harris J, Lewin S, Lockwood C, vol. version 1 (updated August 2011): Cochrane Collaboration Qualitative Methods Group, 2011; 2011.

  16. 16.

    Booth A. Searching for qualitative research for inclusion in systematic reviews: a structured methodological review. Syst Rev. 2016;5:74.

    PubMed  PubMed Central  Article  Google Scholar 

  17. 17.

    Lingler JH, Schmidt K, Gentry A, Hu L, Terhorst L. Perceived Research Burden Assessment (PeRBA): instrument development and psychometric evaluation. JERHRE. 2014;9(4):46–9.

    PubMed  Article  Google Scholar 

  18. 18.

    Ulrich CM, Wallen GR, Feister A, Grady C. Respondent burden in clinical research: when are we asking too much of subjects? IRB. 2005;27(4):17–20.

    PubMed  Article  Google Scholar 

  19. 19.

    Mays N, Pope C. Rigour and qualitative research. Br Med J. 1995;311(6997):109–12.

    CAS  Article  Google Scholar 

  20. 20.

    Verboom B, Montgomery P, Bennett S. What factors affect evidence-informed policymaking in public health? Protocol for a systematic review of qualitative evidence using thematic synthesis. Syst Rev. 2016;5:61.

    PubMed  PubMed Central  Article  Google Scholar 

  21. 21.

    Lingler JH, Schmidt KL, Gentry AL, Hu L, Terhorst LA. A new measure of research participant burden: brief report. J Empir Res Hum Res Ethics. 2014;9(4):46–9.

    PubMed  PubMed Central  Article  Google Scholar 

  22. 22.

    Anderson A, Borfitz D, Getz K. Global public attitudes about clinical research and patient experiences with clinical trials. JAMA Netw Open. 2018;1(6):e182969.

    PubMed  PubMed Central  Article  Google Scholar 

  23. 23.

    Healy P, Galvin S, Williamson PR, Treweek S, Whiting C, Maeso B, Bray C, Brocklehurst P, Moloney MC, Douiri A, et al. Identifying trial recruitment uncertainties using a James Lind Alliance Priority Setting Partnership - the PRioRiTy (Prioritising Recruitment in Randomised Trials) study. Trials. 2018;19(1):147.

    PubMed  PubMed Central  Article  Google Scholar 

  24. 24.

    What are the most important unanswered questions in trial retention? A James Lind Alliance Priority Setting Partnership - The PRioRiTy 2 (Prioritising Retention in Randomised Trials) Study [https://www.researchsquare.com/article/588284a5-b216-40cb-a405-25138610efa2/v1]. Accessed 10 Dec.

  25. 25.

    Mills EJ, Seely D, Rachlis B, Griffith L, Wu P, Wilson K, Ellis P, Wright JR. Barriers to participation in clinical trials of cancer: a meta-analysis and systematic review of patient-reported factors. Lancet Oncol. 2006;7(2):141–8.

    PubMed  Article  Google Scholar 

  26. 26.

    Ross S, Grant A, Counsell C, Gillespie W, Russell I, Prescott R. Barriers to participation in randomised controlled trials: a systematic review. J Clin Epidemiol. 1999;52(12):1143–56.

    CAS  PubMed  Article  Google Scholar 

  27. 27.

    Gross CP, Mallory R, Heiat A, Krumholz HM. Reporting the recruitment process in clinical trials: who are these patients and how did they get there? Ann Intern Med. 2002;137(1):10–6.

    PubMed  Article  Google Scholar 

  28. 28.

    McDonald AM, Knight RC, Campbell MK, Entwistle VA, Grant AM, Cook JA, Elbourne DR, Francis D, Garcia J, Roberts I, et al. What influences recruitment to randomised controlled trials? A review of trials funded by two UK funding agencies. Trials. 2006;7:9.

    PubMed  PubMed Central  Article  Google Scholar 

  29. 29.

    Fletcher B, Gheorghe A, Moore D, Wilson S, Damery S. Improving the recruitment activity of clinicians in randomised controlled trials: a systematic review. BMJ Open. 2012;2(1):e000496.

    PubMed  PubMed Central  Article  Google Scholar 

  30. 30.

    Shimm DS, Spece RG. Rate of refusal to participate in clinical trials. IRB. 1992;14(2):7–9.

    PubMed  Article  PubMed Central  Google Scholar 

  31. 31.

    Toerien M, Brookes ST, Metcalfe C, de Salis I, Tomlin Z, Peters TJ, Sterne J, Donovan JL. A review of reporting of participant recruitment and retention in RCTs in six major journals. Trials. 2009;10:52.

    PubMed  PubMed Central  Article  Google Scholar 

  32. 32.

    Dechartres A, Trinquart L, Boutron I, Ravaud P. Influence of trial sample size on treatment effect estimates: meta-epidemiological study. BMJ. 2013;346:f2304.

    PubMed  PubMed Central  Article  Google Scholar 

  33. 33.

    Montori VM, Devereaux PJ, Adhikari NK, Burns KE, Eggert CH, Briel M, Lacchetti C, Leung TW, Darling E, Bryant DM, et al. Randomized trials stopped early for benefit: a systematic review. JAMA. 2005;294(17):2203–9.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  34. 34.

    Rothwell PM. External validity of randomised controlled trials: “to whom do the results of this trial apply?”. Lancet. 2005;365(9453):82–93.

    PubMed  Article  PubMed Central  Google Scholar 

  35. 35.

    Ahmad N, Boutron I, Moher D, Pitrou I, Roy C, Ravaud P. Neglected external validity in reports of randomized trials: the example of hip and knee osteoarthritis. Arthritis Rheum. 2009;61(3):361–9.

    PubMed  PubMed Central  Article  Google Scholar 

  36. 36.

    Dekkers OM, von Elm E, Algra A, Romijn JA, Vandenbroucke JP. How to assess the external validity of therapeutic trials: a conceptual approach. Int J Epidemiol. 2009;39(1):89–94.

    PubMed  Article  PubMed Central  Google Scholar 

  37. 37.

    Ethgen M, Boutron L, Steg PG, Roy C, Ravaud P. Quality of reporting internal and external validity data from randomized controlled trials evaluating stents for percutaneous coronary intervention. BMC Med Res Methodol. 2009;9:24.

    PubMed  PubMed Central  Article  Google Scholar 

  38. 38.

    Tobias JS, Souhami RL. Fully informed consent can be needlessly cruel. BMJ. 1993;307(6913):1199–201.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  39. 39.

    Sara Dick M, CCRP: minimally disruptive research: a respectful approach to conducting clinical studies. In. Edited by UNIT K; 2017.

  40. 40.

    Todres L, Galvin KT, Holloway I. The humanization of healthcare: a value framework for qualitative research. Int J Qual Stud Health Well Being. 2009;4(2):68–77.

    Article  Google Scholar 

  41. 41.

    Youngson R, Blennerhassett M. Humanising healthcare. BMJ. 2016;355:i6262.

    PubMed  Article  Google Scholar 

  42. 42.

    Treweek S, Bevan S, Bower P, Campbell M, Christie J, Clarke M, Collett C, Cotton S, Devane D, El Feky A, et al. Trial forge guidance 1: what is a Study Within A Trial (SWAT)? Trials. 2018;19(1):139.

    PubMed  PubMed Central  Article  Google Scholar 

  43. 43.

    Relton C, Torgerson D, O’Cathain A, Nicholl J. Rethinking pragmatic randomised controlled trials: introducing the “cohort multiple randomised controlled trial” design. BMJ. 2010;340:c1066.

    PubMed  Article  Google Scholar 

  44. 44.

    Wicks P, Richards T, Denegri S, Godlee F. Patients’ roles and rights in research. BMJ. 2018;362:k3193.

    PubMed  Article  Google Scholar 

  45. 45.

    Montori V. Why we revolt: a patient revolution for careful and kind care: patient revolution; 2017.

    Google Scholar 

  46. 46.

    O'Leary E, Seow H, Julian J, Levine M, Pond GR. Data collection in cancer clinical trials: too much of a good thing? Clin Trials. 2013;10(4):624–32.

    PubMed  Article  Google Scholar 

  47. 47.

    Caron-Flinterman JF, Broerse JE, Bunders JF. The experiential knowledge of patients: a new resource for biomedical research? Soc Sci Med. 2005;60(11):2575–84.

    PubMed  Article  Google Scholar 

  48. 48.

    Domecq JP, Prutsky G, Elraiyah T, Wang Z, Nabhan M, Shippee N, Brito JP, Boehmer K, Hasan R, Firwana B, et al. Patient engagement in research: a systematic review. BMC Health Serv Res. 2014;14:89.

    PubMed  PubMed Central  Article  Google Scholar 

  49. 49.

    Rolfe DE, Ramsden VR, Banner D, Graham ID. Using qualitative Health Research methods to improve patient and public involvement and engagement in research. Res Involvement Engagement. 2018;4:49.

    Article  Google Scholar 

  50. 50.

    Price A, Albarqouni L, Kirkpatrick J, Clarke M, Liew SM, Roberts N, Burls A. Patient and public involvement in the design of clinical trials: an overview of systematic reviews. J Eval Clin Pract. 2018;24(1):240–53.

    PubMed  PubMed Central  Article  Google Scholar 

  51. 51.

    Borno HT, Zhang L, Siegel A, Chang E, Ryan CJ. At what cost to clinical trial enrollment? A retrospective study of patient travel burden in cancer clinical trials. Oncologist. 2018;23(10):1242–9.

    PubMed  PubMed Central  Article  Google Scholar 

  52. 52.

    Noyes J, Booth A, Flemming K, Garside R, Harden A, Lewin S, Pantoja T, Hannes K, Cargo M, Thomas J. Cochrane Qualitative and Implementation Methods Group guidance paper 3: methods for assessing methodological limitations, data extraction and synthesis, and confidence in synthesized qualitative findings. J Clin Epidemiol. 2018;97:49–58.

    PubMed  Article  PubMed Central  Google Scholar 

Download references

Acknowledgements

We thank Elise Diard for developing the figures.

We thank Laura Smalesfor proofreading this manuscript.

Funding

This project was funded by the Institut National du Cancer (INCA), France.

Author information

Affiliations

  1. Université de Paris, CRESS, INSERM, INRA, F-75004, Paris, France

    Nivantha Naidoo, Van Thu Nguyen, Philippe Ravaud & Isabelle Boutron

  2. Centre d’Epidémiologie Clinique, AP-HP, Hôpital Hôtel Dieu, F-75004, Paris, France

    Nivantha Naidoo, Philippe Ravaud & Isabelle Boutron

  3. Department of Health Services Research, Institute of Population Health Sciences, University of Liverpool, Liverpool, L69 3GB, UK

    Van Thu Nguyen & Bridget Young

  4. Department of Epidemiology, Mailman School of Public Health, Columbia University, New York, NY, USA

    Philippe Ravaud

  5. INSERM U 1123 ECEVE (Clinical Epidemiology, Economic, Evaluation, Vulnerable populations), University Paris Diderot, Paris, France

    Philippe Amiel

  6. Jusqu’A La Mort Accompagner la Vie (JALMALV), Strasbourg, France

    Daniel Schanté

  7. Comité des Utilisateurs et Professionnels, Institut National du Cancer (INCa), Paris, France

    Daniel Schanté

  8. Queen’s University Belfast School of Medicine Dentistry and Biomedical Sciences, Belfast, UK

    Mike Clarke

Authors
  1. Nivantha Naidoo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Van Thu Nguyen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Philippe Ravaud
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Bridget Young
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Philippe Amiel
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Daniel Schanté
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Mike Clarke
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Isabelle Boutron
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

NN, VNT, PR, and IB were responsible for the conception and design. NN, VNT, PR, DS, and IB were responsible for the acquisition of data and analysis. All were responsible for the interpretation of data. NN and IB were responsible for the manuscript draft. VNT, PR, BY, PA, DS, and MC critically appraised and improved the manuscript. All approved the submitted final version.

Corresponding author

Correspondence to Isabelle Boutron.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

Isabelle Boutron is Editorial Board Member for BMC Medicine.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Naidoo, N., Nguyen, V.T., Ravaud, P. et al. The research burden of randomized controlled trial participation: a systematic thematic synthesis of qualitative evidence. BMC Med 18, 6 (2020). https://doi.org/10.1186/s12916-019-1476-5

Download citation

Keywords

  • Randomized controlled trials
  • Research burden
  • Trial participation

BMC Medicine

ISSN: 1741-7015

Contact us