Skip to main content
Download PDF

A core outcome set for studies evaluating interventions to prevent and/or treat delirium for adults requiring an acute care hospital admission: an international key stakeholder informed consensus study

BMC Medicine volume 19, Article number: 143 (2021) Cite this article

Abstract

Background

Trials of interventions to prevent or treat delirium in adults in an acute hospital setting report heterogeneous outcomes. Our objective was to develop international consensus among key stakeholders for a core outcome set (COS) for future trials of interventions to prevent and/or treat delirium in adults with an acute care hospital admission and not admitted to an intensive care unit.

Methods

A rigorous COS development process was used including a systematic review, qualitative interviews, modified Delphi consensus process, and in-person consensus using nominal group technique (registration http://www.comet- initiative.org/studies/details/796).

Participants in qualitative interviews were delirium survivors or family members. Participants in consensus methods comprised international representatives from three stakeholder groups: researchers, clinicians, and delirium survivors and family members.

Results

Item generation identified 8 delirium-specific outcomes and 71 other outcomes from 183 studies, and 30 outcomes from 18 qualitative interviews, including 2 that were not extracted from the systematic review. De-duplication of outcomes and formal consensus processes involving 110 experts including researchers (N = 32), clinicians (N = 63), and delirium survivors and family members (N = 15) resulted in a COS comprising 6 outcomes: delirium occurrence and reoccurrence, delirium severity, delirium duration, cognition, emotional distress, and health-related quality of life. Study limitations included exclusion of non-English studies and stakeholders and small representation of delirium survivors/family at the in-person consensus meeting.

Conclusions

This COS, endorsed by the American and Australian Delirium Societies and European Delirium Association, is recommended for future clinical trials evaluating delirium prevention or treatment interventions in adults presenting to an acute care hospital and not admitted to an intensive care unit.

Peer Review reports

Background

Adults requiring admission to an acute care hospital who are at risk of delirium comprise a heterogeneous group including those undergoing major surgery [1], older adults with non-surgical indications for acute hospital admission such as pneumonia and urosepsis [2], and in recent times the SARS-CoV-2 virus [3]. Delirium is a syndrome characterized by fluctuating mental status with marked inattention and other cognitive disturbance [4] that is attributable to one or more etiologies. Post-operative delirium is a common complication, with prevalence as high as 50% depending on surgery type and patient risk [2]. Among older adults admitted to an acute care hospital ward, 1 in 5 experience delirium [5].

The consequences of delirium are serious and include neurocognitive disturbance and cognitive decline [6], prolonged hospitalization [7], discharge to post-acute care facilities, increased caregiver burden [8], decreased functional status [9, 10], adverse events such as falls [11], and mortality [12, 13]. As delirium persists, the risk of mortality at 6 months increases [14]. Many patients whose hospitalization is complicated by delirium never return to baseline functional status. Delirium poses substantial additional costs to healthcare systems; with US healthcare costs attributable to delirium estimated to exceed $182 billion annually [15, 16].

While strong evidence indicates delirium is partially preventable through multi-component nonpharmacologic approaches [17], pharmacological prevention or treatment strategies have yet to be proven effective [18, 19]. Disparate outcome selection in trials evaluating the same intervention is an important barrier to effectively synthesizing study results, precluding the ability to developing evidence-based practices and policies [20, 21]. Core outcomes sets (COS) are an agreed-upon minimum set of outcomes to be measured and reported in all studies relating to a specific health condition [22]. COS offer a solution to reducing heterogeneity of trial outcome selection. Therefore, our objective was to undertake a rigorous international consensus process for a COS for trials of interventions, designed to prevent and/or treat delirium, for adults requiring an acute care hospital admission, but who do not require intensive care unit (ICU) admission. We elected to develop a single COS for prevention and treatment trials as many evaluate an intervention as a continuum of prevention to treatment, particularly in participant groups (those receiving anesthesia or sedation, or those with concomitant cognitive issues) in whom early confirmation of delirium is challenging. We excluded trials conducted in the ICU in this COS as we hypothesized outcomes specific to critically ill patients such as ventilation duration might be considered important.

Methods

We followed Core Outcome Measures in Effectiveness Trials (COMET) guidelines [23] for this COS development study and report on it in accordance with Core Outcome Set–STAndards for Reporting [24]. To commence the item generation process required for a COS, we conducted a systematic review of outcomes reported in published trials (1980 to December 2016) and registered trial protocols (January 2014 to December 2016) via (1) search term development in collaboration with two senior information specialists and conduct of the search across ten publication databases and grey literature; (2) two authors independently screening citations and extracting data on study characteristics, outcomes, and measures (with a third author as arbiter if needed); and (3) assignment of outcomes according to COMET taxonomy [25]. We included randomized, quasi-randomized, or non-randomized intervention studies of pharmacological (e.g., haloperidol) or non-pharmacological (e.g., reorientation, music) interventions for delirium prevention, treatment, or both, conducted in adults or children experiencing an acute hospital admission. We excluded studies conducted in ICUs and those reporting interventions to treat pediatric or adult agitation on emergence from general anesthesia. In addition, our item generation process included semi-structured qualitative interviews exploring outcomes important to delirium survivors and family members.

Item reduction and consensus methods comprised a two-round, web-based modified Delphi consensus process. To gain final consensus, this Delphi process was followed by an in-person consensus meeting, hosted by the European Delirium Association, using a modified nominal group technique [26].

Recruitment of participants for qualitative interviews, Delphi panel, and consensus meeting

We sought a purposive and international sample from three stakeholder groups: (1) clinical researchers, (2) clinicians, and (3) delirium survivors and family. We recruited delirium survivor and family participants using a multi-modal strategy, including a designated study Twitter account, snowballing (i.e., research participants passing on recruitment materials to other potential participants), and personal contacts. Our multi-modal strategy to recruit expert clinicians and delirium researchers included recruitment flyers sent through membership lists of the American Delirium Society and Australian Delirium Association and to attendees of the European Delirium Association 2019 meeting (in-person consensus meeting), announcements at the American Delirium Society 2019 meeting, personalized recruitment emails sent to corresponding authors of studies included in our systematic review, flyers posted in UK National Health Service organizations, snowballing, and personal contacts.

Semi-structured interviews

Semi-structured interviews with delirium survivors and family members were conducted by telephone by a single experienced interviewer (LR). The interview guide incorporated COMET plain language [27] to orient participants to the terms “study outcomes” and “COS.” Interviews were audio recorded, transcribed verbatim, and content analyzed by one author [28].

Delphi methods

Item reduction for identified outcomes occurred via de-duplication (i.e., removing redundant outcomes), removing outcomes related to aggregate population data rather than individual patient outcomes (e.g., number of patients receiving analgesia), and grouping similar outcomes [29]. We grouped into a single outcome those describing adverse events, side effects, and complications, and those describing study-related feasibility or process outcomes. As more items are associated with lower COS Delphi response rates [30], we further reduced outcomes by removing those identified in < 5% of studies, unless specifically mentioned in survivor/family member interview transcripts. The final list of outcomes was then reviewed for wording clarity (with lay descriptions of medical terms to aid understanding) and for domain grouping.

To conduct the Delphi, we used the bespoke DelphiManager software, Version 4 (COMET Initiative, Liverpool, UK). Participants were directed to self-select their key stakeholder group (i.e., patient/family; clinician; researcher) and to score the importance of each outcome for COS inclusion, without consideration of measurability or feasibility. Importance was scored using the Grading of Recommendations Assessment, Development and Evaluations (GRADE) Scale [31]. This is a 9-point Likert scale with scores 1 to 3 considered not important, 4 to 6 important but not critical, and 7 to 9 as critical for inclusion. This scoring method is recommended by COMET to facilitate maximum discrimination between questionnaire items [32, 33]. Participants were provided an “Unable to Score” response option and the opportunity to suggest additional outcomes. To avoid presentation bias, the DelphiManager software randomized outcome domain presentation order.

For Delphi round 1 scores, we calculated mean and standard deviation (SD) of GRADE importance scores and determined the proportion of participants rating each outcome with scores of 7 to 9 (critically important), 4 to 6 (important but not critical), and 1 to 3 (not important) for the entire expert panel, and separately for each stakeholder group. Additional suggested outcomes were deduplicated and worded appropriately for inclusion in round 2. For round 2, participants received their own round 1 scores and summarized scores, with visual representation using histograms. Participants were asked to re-score outcome importance. If a participant changed their scoring so that it moved into a new category (e.g., from “important but not critical” to “critical for inclusion”), participants were requested to provide a free-text reason for this change. For both rounds, we sent three email reminders regarding completion using the DelphiManager software.

In-person consensus meeting and nominal group technique

To inform our in-person consensus meeting, we calculated mean (SD) Delphi round 2 importance scores and determined the proportion of participants rating each outcome as critical for inclusion overall and by stakeholder group. As recommended by COMET [22], outcomes brought to the consensus meeting met the following criteria: scored as “critical for inclusion” by ≥ 70% of respondents and “not important” by < 15% considering all participants and for each of the three key stakeholder groups. No outcome that was rated by < 70% of participants as critically important overall or within a stakeholder group was brought forward to the consensus meeting.

For pragmatic reasons, we timed our consensus meeting with the 2019 European Delirium Association annual conference. We provided an overview of our meeting’s aim and structure and the Delphi results. We provided the importance scoring for the outcomes by stakeholder group to consensus meeting participants, for consideration during outcome ranking. Using nominal group technique methods, we held iterative rounds of small group and then whole group discussion. To avoid negating the Delphi process, participants were not permitted to suggest new outcomes. Participants ranked outcomes from most critical to least critical for COS inclusion at the end of each discussion.

The study was funded by the Canadian Institutes of Health Research. It received approval from the Research Ethics Boards of the University of Toronto, King’s College London, Sunnybrook Health Sciences Centre (Toronto, Canada), and the UK Health Research Authority (HRA) and Health and Care Research Wales (HCRW). Ethics approvals to recruit via social media, snowballing, and networking methods enabled recruitment from multiple countries including the USA, Europe, Asia, Oceania, and South America. Written informed consent was obtained from all study participants. The Del-CORs project is registered with the COMET initiative (http://www.comet- initiative. org/studies/details/796). We previously published the study protocol [34].

Results

Item generation via systematic review

We screened 18,933 citations, identified and extracted data pertaining to study outcomes and measures from 183 studies meeting our inclusion criteria (Fig. 1). Of the 183 included studies, 150 (88%) recruited older adults only (classified according to the study author’s participant description); most (109/183, 60%) were in post-operative patients. Delirium prevention was the primary intervention aim for 125 (68%) studies (Table 1). We extracted information on 79 outcomes reported in more than one study. These included 8 delirium-specific outcomes (Additional File Table 1) and 71 other outcomes categorized using COMET taxonomy [25] (Additional File Table 2).

Fig. 1
figure 1

PRISMA flow diagram

Full size image
Table 1 Systematic review study characteristics
Full size table

Item generation via interviews with delirium survivors and family members

We recruited 18 delirium survivors or family members from Canada, USA, and UK. From these interviews, 30 potential outcomes were identified (Table 2). The most commonly identified outcomes in the interview dataset were (1) “emotional distress, i.e., fear and anxiety related to delirium symptoms such as delusions” and (2) “delirium severity” (both identified by 50% of interview participants). Only two outcomes, “ability to return to previous lifestyle/work” and “subsyndromal delirium” (named as such by a family member with medical background) were not identified in the systematic review and brought forward for consideration for inclusion in the round 1 Delphi.

Table 2 Outcomes identified by delirium survivor and family interview participants
Full size table

Consensus building

Deduplication decisions (Additional File Table 3) resulted in selection of 31 outcomes for the Delphi round 1 (see outcomes listed in Additional File Table 4). We recruited 110 participants for the Delphi international expert panel; 15 (14%) were delirium survivors or family members of whom 7 were also healthcare providers or researchers (Table 3). Of the 31 outcomes provided in round 1, 20 (65%) met a priori consensus criteria for COS inclusion considering all participant responses, 8 (26%) by all three stakeholder groups (Additional file 1: Table 4). Compared to clinicians or survivors/family, researchers were less likely to consider outcomes critical for inclusion that related to emotional well-being, sleep, or agitation and its management (i.e., physical restraint).

Table 3 Round 1 Delphi participants
Full size table

For Delphi round 2, 8 additional outcomes were included based on suggestions in round 1. These included (1) development of incontinence, (2) nutritional status, (3) workload, (4) use of sitters, (5) family caregiver burden, (6) staff satisfaction, (7) new onset dementia, and (8) ability to participate in rehabilitation. Of the 110 round 1 participants, 77 (70%) participated in round 2. Of the 39 outcomes provided, 22 (56%) met consensus criteria for inclusion in the COS considering all participant responses, 17 (44%) by all three stakeholder groups (Table 4). Of the 8 added outcomes, none met inclusion criteria.

Table 4 Round 2 Delphi scores
Full size table

Twelve experts (including 1 delirium survivor) participated in the in-person consensus meeting. After the first round of small and then large group discussion using nominal group technique ranking exercises, 6 of the 17 (35%) outcomes were excluded. “Falls and other injuries” and “agitation” were voted out by one small group but not the second. On further discussion and ranking, these outcomes as well as mortality (causes of falls and mortality were considered multi-factorial and not delirium specific) were excluded. Delirium occurrence and reoccurrence was collapsed into a single outcome. The 6 outcomes selected for the COS for trials of interventions to prevent and/or treat delirium in adults requiring an acute care hospital admission comprised: (1) delirium occurrence and reoccurrence, (2) delirium severity, (3) delirium duration, (4) cognition, (5) emotional distress, and (6) health-related quality of life (Fig. 2).

Fig. 2
figure 2

Development of COS for trials of interventions to prevent or treat delirium in hospitalized adults

Full size image

Discussion

This study is the first to establish a COS for use in future efficacy and effectiveness trials of interventions focused on preventing and/or treating delirium experienced by adults required an acute care hospital admission, without an ICU admission. This study rigorously followed established COMET methods for COS development. We used systematic review methods and qualitative interviews with delirium survivors and family members to generate a comprehensive list of potential outcomes. Robust consensus building (Delphi and nominal group technique) methods were then used to establish six outcomes for inclusion in the final COS. This COS addresses one of the priority areas identified by the 2019 Scientific Think Tank report from NIH-funded Network for Investigation of Delirium: Unifying Scientists (NIDUS) group [35] and an Agency for Healthcare Research and Quality report recommendation [36]. The use of this COS in future trials of hospitalized adults is endorsed by the American and Australian Delirium Societies and European Delirium Association.

This COS includes three outcomes that characterize delirium itself, i.e., “occurrence and reoccurrence,” “severity,” and “duration.” Measurement of delirium occurrence, an umbrella term for incidence and prevalence, is imperative to determine the effect of interventions designed to prevent delirium. Delirium reoccurrence is relevant to trials of interventions designed to treat delirium. Fear of delirium reoccurrence was emphasized in interviews with delirium survivors and family members further highlighting the emotional distress associated with delirium. Inclusion of delirium severity reflects growing interest in its measurement as a way of understanding symptom burden, risk stratification, selection of appropriate interventions, clinical course, and prognosis [37]. Greater delirium severity is associated with worse outcomes, such as discharge to a post-acute healthcare facility and death. Similarly prolonged delirium duration is associated with worse outcomes after hospital discharge [38].

Inclusion of “cognition” and “health-related quality of life” as core outcomes is understandable considering that delirium is associated with long-term cognitive decline, including incident dementia in older adults, and has an adverse impact on health-related quality of life [6]. Similarly, inclusion of “emotional distress” is reasonable as delirium can cause considerable subjective distress such as fear, anxiety, depression, and post-traumatic stress disorder [39]. Emotional distress at the time of delirium may manifest as psychomotor agitation, an outcome that was ranked highly in the Delphi rounds despite being voted out of the final COS. Emotional distress and burden to family members is also substantial [40]; however, researcher participants in our study, in particular, rated this outcome as unimportant for COS inclusion. However, the COS represents the minimum set of outcomes recommended for inclusion in all studies; hence, these outcomes can be included in future studies despite not included in the final COS.

A group with high delirium prevalence is the critically ill [41]. Our group recently completed a COS for future trials of interventions for preventing or treating delirium experienced by critically ill adults [42]. Interestingly, the outcomes selected for this COS, that used the same processes but an expert panel with experience of critical care, were similar, with five outcomes included in both COS. Rather than “delirium duration,” participants in the critical care COS selected the outcome “time to delirium resolution” as this was felt more indicative of the end of delirium. Mortality was included as a seventh outcome which likely reflects the increased risk of death of critically ill patients [43]. Ongoing work for both these COS is to establish the measurement instruments and the time horizon for measurement for each of the outcomes.

Strengths of this study are inclusion of interviews with delirium survivors and family members in the item generation phase, a relatively large and international stakeholder panel, and adherence to COMET COS development methods. Study limitations include exclusion of non-English studies reporting outcomes as well as observational studies and non-English speaking research participants. International representation in the interview phase was limited to three nations. The majority of published studies included in our systematic review phase included post-operative patients which may limit the generalizability of our findings. Our decision to exclude outcomes identified in < 5% of studies with our systematic review may have led to exclusion of important outcomes. However, this was mitigated by their inclusion if mentioned in survivor/family member interviews and enabling Delphi round 1 participants to suggest additional outcomes for consideration. We did not ask Delphi participants to identify themselves as a survivor or family member. As such, we cannot confirm if we have sufficient representation of these distinct groups. Due to the timing of the Delphi and the in-person consensus meeting, we were unable to conduct a third Delphi round confirming importance scores of the eight additional outcomes suggested in round 1. Although patient and family representation in the Delphi was reasonable, only one delirium survivor was able to attend the in-person consensus meeting.

Conclusion

With development of this COS, we seek to promote standardized outcome selection and reporting in future trials of interventions to prevent and/or treat delirium in adults experiencing an acute care hospital admission and without an ICU admission. We anticipate widespread dissemination and adoption of this COS will facilitate faster detection of effective interventions to prevent or treat delirium due to enhanced ability to pool trial data, ultimately improving patient outcomes. Further work is now needed to operationally define the six core outcomes that will include consensus in selecting validated measurement instruments, the time horizon for measurement, analysis metrics, and method of aggregation.

References

  1. Saller T, MacLullich A, Schäfer S, Crispin A, Neitzert R, Schüle C, et al. Screening for delirium after surgery: validation of the 4 A’s test (4AT) in the post-anaesthesia care unit. Anaesthesia. 2019;74(10):1260–6. https://doi.org/10.1111/anae.14682.

    CAS  Article  PubMed  Google Scholar 

  2. Inouye S, Westendorp R, Saczynski J. Delirium in elderly people. Lancet. 2014;383(9920):911–22. https://doi.org/10.1016/S0140-6736(13)60688-1.

    Article  PubMed  Google Scholar 

  3. Helms J, Kremer S, Merdji H, Clere-Jehl R, Schenck M, Kummerlen C, et al. Neurologic features in severe SARS-CoV-2 infection. N Engl J Med. 2020;382(23):2268–70. https://doi.org/10.1056/NEJMc2008597.

    Article  PubMed  Google Scholar 

  4. Slooter A, Otte W, Devlin J, Arora R, Bleck T, Claassen J, et al. Updated nomenclature of delirium and acute encephalopathy: statement of ten Societies. Intensive Care Med. 2020;46(5):1020–2. https://doi.org/10.1007/s00134-019-05907-4.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Gibb K, Seeley A, Quinn T, Siddiqi N, Shenkin S, Rockwood K, et al. The consistent burden in published estimates of delirium occurrence in medical inpatients over four decades: a systematic review and meta-analysis study. Age Ageing. 2020;49(3):352–60. https://doi.org/10.1093/ageing/afaa040.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Saczynski J, Marcantonio E, Quach L, Fong T, Gross A, Inouye S, et al. Cognitive trajectories after postoperative delirium. N Engl J Med. 2012;367(1):30–9. https://doi.org/10.1056/NEJMoa1112923.

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  7. Brown C, Laflam A, Max J, Lymar D, Neufeld K, Tian J, et al. The impact of delirium after cardiac surgical procedures on postoperative resource use. Ann Thoracic Surg. 2016;101(5):1663–9. https://doi.org/10.1016/j.athoracsur.2015.12.074.

    Article  Google Scholar 

  8. Morandi A, Lucchi E, Turco R, Morghen S, Guerini F, Santi R, et al. Delirium superimposed on dementia: a quantitative and qualitative evaluation of patient experience. J Psychosom Res. 2015;79(4):281–7. https://doi.org/10.1016/j.jpsychores.2015.07.010.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Hshieh T, Saczynski J, Gou R, Marcantonio E, Jones R, Schmitt E, et al. Trajectory of functional recovery after postoperative delirium in elective surgery. Ann Surg. 2017;265(4):647–53. https://doi.org/10.1097/SLA.0000000000001952.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Shi Z, Mei X, Li C, Chen Y, Zheng H, Wu Y, et al. Postoperative delirium is associated with long-term decline in activities of daily living. Anesthesiol. 2019;131(3):492–500. https://doi.org/10.1097/ALN.0000000000002849.

    Article  Google Scholar 

  11. Reston J, Schoelles K. In-facility delirium prevention programs as a patient safety strategy: a systematic review. Ann Intern Med. 2013;158(5_Part_2):375–80. https://doi.org/10.7326/0003-4819-158-5-201303051-00003.

    Article  PubMed  Google Scholar 

  12. Gottesman R, Grega M, Bailey M, Pham L, Zeger S, Baumgartner W, et al. Delirium after coronary artery bypass graft surgery and late mortality. Ann Neurol. 2010;67(3):338–44. https://doi.org/10.1002/ana.21899.

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  13. Witlox J, Eurelings L, de Jonghe J, Kalisvaart K, Eikelenboom P, van Gool W. Delirium in elderly patients and the risk of postdischarge mortality, institutionalization, and dementia: A meta-analysis. JAMA. 2010;304(4):443–51. https://doi.org/10.1001/jama.2010.1013.

    CAS  Article  PubMed  Google Scholar 

  14. Bellelli G, Mazzola P, Morandi A, Bruni A, Carnevali L, Corsi M, et al. Duration of postoperative delirium is an independent predictor of 6-month mortality in older adults after hip fracture. J Am Geriatr Soc. 2014;62(7):1335–40. https://doi.org/10.1111/jgs.12885.

    Article  PubMed  Google Scholar 

  15. Leslie D, Inouye S. The importance of delirium: economic and societal costs. J Am Geriatr Soc. 2011;59:S241–3. https://doi.org/10.1111/j.1532-5415.2011.03671.x.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Leslie D, Marcantonio E, Zhang Y, Leo-Summers L, Inouye S. One-year health care costs associated with delirium in the elderly population. Arch Intern Med. 2008;14:27–32.

    Article  Google Scholar 

  17. Siddiqi N, Harrison J, Clegg A, Teale E, Young J, Taylor J, et al. Interventions for preventing delirium in hospitalised non-ICU patients. Cochrane Database Syst Rev. 2016;3:CD005563.

    PubMed  Google Scholar 

  18. Oh E, Fong T, Hshieh T, Inouye S. Delirium in older persons: advances in diagnosis and treatment. JAMA. 2017;318(12):1161–74. https://doi.org/10.1001/jama.2017.12067.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Hughes C, Boncyk C, Culley D, Fleisher L, Leung J, McDonagh D, et al. American society for enhanced recovery and perioperative quality initiative joint consensus statement on postoperative delirium prevention. Anesth Analg. 2020;130(6):1572–90. https://doi.org/10.1213/ANE.0000000000004641.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Clarke M, Williamson P. Core outcome sets and systematic reviews. Syst Rev. 2016;5(11). https://doi.org/10.1186/s13643-016-0188-6.

  21. Moloney R, Messner D, Tunis S. The increasing complexity of the core outcomes landscape. J Clin Epidemiol. 2019;116:150–4. https://doi.org/10.1016/j.jclinepi.2019.05.016.

    Article  PubMed  Google Scholar 

  22. Williamson P, Altman D, Blazeby J, Clarke M, Devane D, Gargon E, et al. Developing core outcome sets for clinical trials: issues to consider. Trials. 2012;13(1):132. https://doi.org/10.1186/1745-6215-13-132.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Williamson P, Altman D, Bagley H, Barnes K, Blazeby J, Brookes S, et al. The COMET Handbook: version 1.0. Trials. 2017;18(S3):280. https://doi.org/10.1186/s13063-017-1978-4.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Kirkham J, Gorst S, Altman D, Blazeby J, Clarke M, Devane D, et al. Core outcome set-STAndards for reporting: the COS-STAR statement. Plos Med. 2016;13(10):e1002148. https://doi.org/10.1371/journal.pmed.1002148.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Dodd S, Clarke M, Becker L, Mavergames C, Fish R, Williamson P. A taxonomy has been developed for outcomes in medical research to help improve knowledge discovery. J Clin Epidemiol. 2018;96:84–92. https://doi.org/10.1016/j.jclinepi.2017.12.020.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Harvey N, Holmes C. Nominal group technique: an effective method for obtaining group consensus. Int J Nurs Prac. 2012;18(2):188–94. https://doi.org/10.1111/j.1440-172X.2012.02017.x.

    Article  Google Scholar 

  27. COMET initiative. COMET plain language summary Liverpool: Liverpool University; 2018 from: http://www.comet-initiative.org/assets/downloads/COMET%20Plain%20Language%20Summary%20v4.pdf. Accessed 4 Nov 2019.

  28. Vaismoradi M, Turunen H, Bondas T. Content analysis and thematic analysis: implications for conducting a qualitative descriptive study. Nurs Health Sci. 2013;15(3):398–405. https://doi.org/10.1111/nhs.12048.

    Article  PubMed  Google Scholar 

  29. Young A, Brookes S, Avery K, Davies A, Metcalfe C, Blazeby J. A systematic review of core outcome set development studies demonstrates difficulties in defining unique outcomes. J Clin Epidemiol. 2019;115:14–24. https://doi.org/10.1016/j.jclinepi.2019.06.016.

    Article  PubMed  Google Scholar 

  30. Gargon E, Crew R, Burnside G, Williamson P. Higher number of items associated with significantly lower response rates in COS Delphi surveys. J Clin Epidemiol. 2019;108:110–20. https://doi.org/10.1016/j.jclinepi.2018.12.010.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Guyatt G, Oxman A, Kunz R, Vist G, Falck-Ytter Y, Schünemann H, et al. What is “quality of evidence” and why is it important to clinicians? BMJ. 2008;336(7651):995–8. https://doi.org/10.1136/bmj.39490.551019.BE.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Sinha I, Smyth R, Williamson P. Using the Delphi technique to determine which outcomes to measure in clinical trials: recommendations for the future based on a systematic review of existing studies. Plos Med. 2011;8(1):e1000393. https://doi.org/10.1371/journal.pmed.1000393.

    Article  PubMed  PubMed Central  Google Scholar 

  33. The COMET Initiative. 2011 from: http://www.comet-initiative.org. Accessed 29 Aug 2019.

  34. Rose L, Agar M, Burry L, Campbell N, Clarke M, Lee J, et al. Development of core outcome sets for effectiveness trials of interventions to prevent and/or treat delirium (Del-COrS): study protocol. BMJ Open. 2017;7(9):e016371. https://doi.org/10.1136/bmjopen-2017-016371.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Oh E, Akeju O, Avidan M, Cunningham C, Hayden K, Jones R, et al. A roadmap to advance delirium research: recommendations from the NIDUS Scientific Think Tank. Alzheimers Dement. 2020;16(5):726–33. https://doi.org/10.1002/alz.12076.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Neufeld K, Needham D, Oh E, Wilson L, Nikooie R, Zhang A, et al. Antipsychotics for the prevention and treatment of delirium. Rockville: Agency for Healthcare Research and Quality (US); 2019.

    Book  Google Scholar 

  37. Hshieh T, Fong T, Schmitt E, Marcantonio E, Xu G, Gou Y, et al. Does Alzheimer's disease and related dementias modify delirium severity and hospital outcomes? J Am Geriatr Soc. 2020;68(8):1722–30. https://doi.org/10.1111/jgs.16420.

    Article  PubMed  Google Scholar 

  38. Vasunilashorn S, Marcantonio E, Gou Y, Pisani M, Travison T, Schmitt E, et al. Quantifying the severity of a delirium episode throughout hospitalization: the combined importance of intensity and duration. J Gen Intern Med. 2016;31:1164–71.

    Article  Google Scholar 

  39. Schmitt E, Gallagher J, Albuquerque A, Tabloski P, Lee H, Gleason L, et al. Perspectives on the delirium experience and its burden: common themes among older patients, their family caregivers, and nurses. Gerontologist. 2019;59(2):327–37. https://doi.org/10.1093/geront/gnx153.

    Article  PubMed  Google Scholar 

  40. Fong T, Racine A, Fick D, Tabloski P, Gou Y, Schmitt E, et al. The caregiver burden of delirium in older adults with Alzheimer disease and related disorders. J Am Geriatr Soc. 2019;67(12):2587–92. https://doi.org/10.1111/jgs.16199.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Zaal IJ, Slooter AJ. Delirium in critically ill patients: epidemiology, pathophysiology, diagnosis and management. Drugs. 2012;72(11):1457–71. https://doi.org/10.2165/11635520-000000000-00000.

    CAS  Article  PubMed  Google Scholar 

  42. Rose L, Burry L, Agar M, Campbell N, Clarke M, Lee J, et al. A core outcome set for research evaluating interventions to prevent and/or treat delirium in critically ill adults: an international consensus study (Del-COrS). Crit Care Med. 2020;48(4):e316–24. https://doi.org/10.1097/CCM.0000000000004238.

    Article  PubMed  Google Scholar 

  43. Siddiqi S. Mortality profile across our intensive care units: a 5-year database report from a Singapore restructured hospital. Indian J Crit Care Med. 2015;19(12):726–7. https://doi.org/10.4103/0972-5229.171401.

    CAS  Article  Google Scholar 

Download references

Acknowledgements

We thank Becky Skidmore for assistance with search strategy development, Viviane Grassmann for coordinating the systematic review, Angela Sung for help with data extraction, Shelley Gershman for assisting with participant recruitment including managing the Twitter account, and the European Delirium Association for hosting the consensus meeting. DMN acknowledges funding from NIH/NIA (R24AG054259).

This Core Outcome Set is registered on the COMET website (http://www.comet-initiative.org/studies/details/796).

The systematic review is registered on PROSPERO-ID: CRD42016052704 (https://www.crd.york.ac.uk/PROSPERO/display_record.asp?ID = CRD42016052704).

Funding

This work was funded by the Canadian Institutes of Health Research (CIHR). Prof Dale Needham holds NIH/NIA NIDUS funding: grant R24AG054259

Author information

Authors and Affiliations

  1. Florence Nightingale Faculty of Nursing, Midwifery and Palliative Care, King’s College London, Rm 1.13, James Clerk Maxwell Building, 57 Waterloo Rd, London, SE1 8WA, UK

    Louise Rose

  2. Leslie Dan Faculty of Pharmacy, University of Toronto, Toronto, Canada

    Lisa Burry

  3. Mount Sinai Hospital, Sinai Health System, Toronto, Canada

    Lisa Burry

  4. Faculty of Health, University of Technology Sydney, Sydney, Australia

    Meera Agar

  5. Wellcome-Wolfson Institute of Experimental Medicine, Queen’s University Belfast, Belfast, Northern Ireland, UK

    Bronagh Blackwood

  6. College of Pharmacy, Purdue University, West Lafayette, IN, USA

    Noll L. Campbell

  7. School of Medicine, Dentistry and Biomedical Sciences, Queen’s University Belfast, Belfast, Northern Ireland

    Mike Clarke

  8. School of Pharmacy, Northeastern University, Boston, MA, USA

    John W. Devlin

  9. Inaugural Research Chair in Geriatric Emergency Medicine, Schwartz/Reisman Emergency Medicine Institute, Sinai Health System, Toronto, Ontario, Canada

    Jacques Lee

  10. St Michael’s Hospital and Li Ka Shing Research Institute, Toronto, Canada

    John C. Marshall

  11. School of Medicine, Johns Hopkins University, Baltimore, MD, USA

    Dale M. Needham

  12. Hull York Medical School, University of York, York, UK

    Najma Siddiqi

  13. Watford General Hospital, Watford, UK

    Valerie Page

Authors
  1. Louise Rose
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Lisa Burry
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Meera Agar
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Bronagh Blackwood
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Noll L. Campbell
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Mike Clarke
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. John W. Devlin
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Jacques Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. John C. Marshall
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Dale M. Needham
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Najma Siddiqi
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Valerie Page
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

LR and VP conceived the delirium COS; LR, MA, LB, NC, MC, JL, JDW, JM, DMN, NS, and VP contributed to the protocol development and the systematic review; LR conducted the interviews; LR, DMN, and VP recruited the participants; LR led the Delphi exercise; LR,VP led the consensus meeting. LR wrote the first manuscript draft, and all authors including BB, JWD, and DMN from the Del-CORs group critically revised the paper for important contents and approved the final version.

Corresponding author

Correspondence to Louise Rose.

Ethics declarations

Ethics approval and consent to participate

The ethical approval for participants recruited from the US was not required given the methods utilized to recruit them are in accordance to national guidelines. For participants from Canada and the UK, we received approval from the Research Ethics Boards of the University of Toronto, King’s College London, Sunnybrook Health Sciences Centre (Toronto, Canada) and the UK Health Research Authority (HRA) and Health and Care Research Wales (HCRW). All participants provided consent to be part of this study.

Competing interests

We declare no competing interests to declare.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This work was conducted at Sunnybrook Health Sciences Centre, the University of Toronto and King’s College London

Supplementary Information

Additional file 1: Table 1.

Delirium Specific Outcomes extracted from 183 studies during the item generation stage. Table 2. Other outcomes extracted from 183 studies during the item generation stage grouped according to COMET taxonomy. Table 3. Deduplication decisions for Delphi Round1 Questionnaire. Table 4. Round 1 Delphi Scores.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Rose, L., Burry, L., Agar, M. et al. A core outcome set for studies evaluating interventions to prevent and/or treat delirium for adults requiring an acute care hospital admission: an international key stakeholder informed consensus study. BMC Med 19, 143 (2021). https://doi.org/10.1186/s12916-021-02015-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12916-021-02015-3

Keywords

  • Delirium
  • Hospitalization
  • Core outcome set
  • Clinical trials

BMC Medicine

ISSN: 1741-7015

Contact us