We’re sorry, something doesn't seem to be working properly.
Please try refreshing the page. If that doesn't work, please contact us so we can address the problem.
Development and evaluation of the feasibility and effects on staff, patients, and families of a new tool, the Psychosocial Assessment and Communication Evaluation (PACE), to improve communication and palliative care in intensive care and during clinical uncertainty
There are widespread concerns about communication and support for patients and families, especially when they face clinical uncertainty, a situation most marked in intensive care units (ICUs). Therefore, we aimed to develop and evaluate an interventional tool to improve communication and palliative care, using the ICU as an example of where this is difficult.
Our design was a phase I-II study following the Medical Research Council Guidance for the Development and Evaluation of Complex Interventions and the (Methods of Researching End-of-life Care (MORECare) statement. In two ICUs, with over 1900 admissions annually, phase I modeled a new intervention comprising implementation training and an assessment tool. We conducted a literature review, qualitative interviews, and focus groups with 40 staff and 13 family members. This resulted in the new tool, the Psychosocial Assessment and Communication Evaluation (PACE). Phase II evaluated the feasibility and effects of PACE, using observation, record audit, and surveys of staff and family members. Qualitative data were analyzed using the framework approach. The statistical tests used on quantitative data were t-tests (for normally distributed characteristics), the χ2 or Fisher’s exact test (for non-normally distributed characteristics) and the Mann–Whitney U-test (for experience assessments) to compare the characteristics and experience for cases with and without PACE recorded.
PACE provides individualized assessments of all patients entering the ICU. It is completed within 24 to 48 hours of admission, and covers five aspects (key relationships, social details and needs, patient preferences, communication and information status, and other concerns), followed by recording of an ongoing communication evaluation. Implementation is supported by a training program with specialist palliative care. A post-implementation survey of 95 ICU staff found that 89% rated PACE assessment as very or generally useful. Of 213 family members, 165 (78%) responded to their survey, and two-thirds had PACE completed. Those for whom PACE was completed reported significantly higher satisfaction with symptom control, and the honesty and consistency of information from staff (Mann–Whitney U-test ranged from 616 to 1247, P-values ranged from 0.041 to 0.010) compared with those who did not.
PACE is a feasible interventional tool that has the potential to improve communication, information consistency, and family perceptions of symptom control.
Palliative careCommunicationUncertaintyCritical care unitIntensive therapy unitEnd-of-life careIntensive care unitPsychosocial
Communication and support for patients and their families are of central concern in healthcare, and yet too often are poorly addressed, especially at times of rapid changes in health status and in clinical uncertainty. The intensive care unit (ICU) is one setting in which patients’ circumstances can change rapidly. Although the central goal in the ICU is to preserve or extend life, the nature of illness or trauma means that more than one in five people admitted to an ICU die there . Many (36 to 70%, depending on type of the ICU) deaths occurring in ICUs are preceded by a decision to limit or withhold life-sustaining treatment [1, 2]. Recent initiatives, such as care pathways, have sought to improve end-of-life care, but these have focused on patients who are already known to be dying . There is a need to develop a wider range of interventions before this point to improve symptom control, communication, and support in ways appropriate both for patients who may recover, and for those who deteriorate or die . This is particularly important for the growing number of people who experience co-morbidities and because of the advances in medical treatments, both making prognostication ever more difficult. Palliative care is an area of healthcare focused on relieving and preventing the suffering of patients with complex needs and their families, including physical, emotional, communication, social, and spiritual aspects. Unlike much hospice care, palliative care is relevant at all stages of illness, including during curative treatment and at the end of life.
Summary of existing literature on levels of need and interventions
We searched electronic databases to identify literature on the needs of patients and families in the ICU and potential interventions. Systematic reviews and research have highlighted concerns about support for patients and families, symptom control, communication, and decision-making, especially regarding when to stop invasive treatments, and attention to individual wishes and to dignity, respect, and peace in the ICU (Table 1) [5–25]. To address these problems, initiatives have sought to increase specialist palliative care input and/or to to embed the principles of palliative or hospice care into everyday practice [26, 27]. Interventions include having a palliative care team presence at family meetings and on ward rounds, providing education and support for ICU staff, making recommendations for symptom management, and directly supporting patients and families in shared care and implementation of care pathways. However, evidence of best practice in this area is limited . A randomized, controlled, feasibility study evaluating palliative care teams in an Australian ICU found no significant differences in satisfaction with care of families and staff or in length of stay, but the study was underpowered (10 patients randomized to each arm) . A prospective, observational study of a structured palliative care intervention for trauma patients in the ICU  applied the intervention to all trauma patients because of the high mortality (15 to 20%). The study found that Do Not Resuscitate orders, life support withdrawal, and discussions of symptom management occurred significantly earlier, with no change in mortality rate, but the effect on families or patients was not assessed. The Liverpool Care Pathway for the care of the dying patient (LCP) is adapted for ICU, but needs comparative evaluation .
Commonly identified concerns of patients and families in ICU care, in progressive illness: data from literature, phase I interviews and observation
Areas of concern identified in the background literature review
Results from the family member and patient interviews, and from observation
Results from the staff interviews and focus groups
Symptom management, with distressing symptoms sometimes not addressed [5–16, 31]
There was a general perception among family members that symptoms were well controlled, and that timely action was taken when the patient appeared to be distressed. There was varying documentation of assessment of symptoms and symptom assessment tools changed frequently, for example, from one nursing shift to the next
Most interviewees thought that end-of-life care was well provided by the medical and nursing workforce, which was considered very experienced
Communication issues, in particular communicating the changing circumstances to patients and families; [17, 31–39]
The importance of being able to ask questions and have them answered was emphasized by family members, but there was also a sense that family members felt they were responsible for getting information by asking the right questions of the right people. Particular words stood out for some people, reinforcing the need for careful choice of the words in this context. Factors described by family members as affecting communication included: their poor memory of the details of a discussion; shock affecting their ability to take in information; and their poor knowledge of medical issues making it hard for them to understand all the information given. There was an overall sense that the information given was complete and honest, that family members found it helpful if bad news could be tempered with good news, and that the uncertainty of outcome was explained well
Improved information for families including what to do in the event of a death; better privacy/side rooms for patients and family members; private space to talk to families; a position on reception for someone to greet and support family members; more support for family members and provision of on-site accommodation
Dealing with prognostic uncertainty and decision-making, which may lead to prolonged dying [25, 40], or conversely, very rapid deterioration of the patient once a decision to withdraw treatment is made, with families sometimes feeling abandoned [31, 33, 35, 36, 41–44]
The greatest factor influencing involvement in decision-making was patient capacity. Preferences of family members for involvement varied; generally most of them wanted information about the process but not greater input (some preferring less). Some types of decision were more likely to be influenced by family members (place of care, aim of care, some interventions for example, tracheotomy) whereas others were more often directed by the clinician (for example, resuscitation status)
Decision-making towards the end-of-life in ICU is complex and multifactorial. Although not everyone was aware of it, the LCP was reported to be used particularly on the medical ICU. It was thought to be useful for patients on a longer dying trajectory and for those discharged to the wards, to ensure continuity of care. There were concerns about its length, but also some support because it included components of basic nursing care. It was felt by some to be unnecessary in contexts where there was one-to-one nursing care and where many patients died too quickly to benefit
Meeting individual wishes, expectations and spiritual needs that vary between different social and cultural groups [21–24]. Resource use, organ donation, and surrogate decision-making, all of which may involve conflict [21, 22, 33, 45, 46]
Family members identified factors such as financial and legal concerns; parking and transport; information needs; religious, cultural and spiritual needs assessment; and documentation and management. The importance of understanding family structures was emphasized by some family members, along with ensuring that information about the patient was given to the correct family members. When this was done well it was praised by those interviewed, but there were instances of family members feeling that their relationship was not respected by staff or that information was being given to someone other than a person designated to receive this information, and these situations caused distress
Greater support for staff and debriefing in difficult cases, although there were contrasting views about the usefulness of debriefing; a support group for nurses, particularly for those new and less experienced; better support for staff, for example the opportunity of access to an external counseling service; and more educational opportunities
Supporting dignity, respect and peace of patients and supporting the family 
Family members often described not knowing when discussions with staff would take place, and a few suggested that having a plan for future communications would be beneficial
Staff suggested changes to practice including: a ‘home to die’ service; more spiritual support; more hands-on nursing, massage, washing, support for family members; overt recognition of the importance of caring for the dying so that junior staff do not see it as a failure; reducing noise levels where possible; a bereavement service; and improved communication with other teams, including palliative care
Abbreviations: ICU intensive care unit, LCP Liverpool Care Pathway for the care of the dying patient.
Therefore, our study aimed to adapt or develop and evaluate a new evidence-based tool to better meet patient and family communication and holistic care needs in ICU.
Design and approval
The study had ethics approval from the South East London Research Ethics Committee (08/H0805/65 and 08/H808/103), and full hospital Research and Development approval.
Development, implementation, and preliminary evaluation of the tool followed the Medical Research Council guidance for the development and evaluation complex interventions . Phase I explored concerns using interviews of staff and families, and observed the process of care for them, leading to tool development. Phase II tested the feasibility and effects of the tool on staff and families (see Figure 1). We used the Methods of Researching End-of-life Care (MORECare) statement of good practice to aid our procedures  (for compliance details, see Additional file 1).
The study took place in two adult ICUs (general medical and surgical) in a 950-bed south London teaching hospital, serving a socially and culturally heterogeneous population. The two ICUs have 32 beds, and an annual intake of more than 1,900 admissions (1,800 excluding readmissions), associated with 250 to 300 deaths in the ICU. Most (70 the 80%) of these deaths follow life-sustaining treatment limitations. The ICU standardized mortality ratio (SMR; Knauss Acute Physiology and Chronic Health Evaluation (APACHE) II) was 0.62 during the study, and these ICUs have a lower SMR than the median SMR within the UK casemix program . The ICUs service the local population and also provide support to regional trauma, neurosciences, transplantation, and cardiac services for the southeast of England. Of the admissions, 75% are white British, and 25% are non-white British (80% black Caribbean or African, and 20% from other groups). The hospital has 1,200 deaths annually (20 to 25% of deaths in the hospital occur in the ICU).
Phase I: development and implementation of the intervention
We conducted qualitative interviews with families and staff, and observed their process of care and staff activity (see Additional file 2). Semi-structured interviews were conducted face-to-face with a lead family member (for one patient, with two family members at the family’s request), and were recorded and transcribed verbatim. A topic guide was developed from a literature review, initial observations, and discussion with service users. We conducted focus groups with ICU doctors, nurses, and other professionals involved in the delivery of care to patients and their families and palliative care practitioners to explore the experience and views of an end-of-life care pathway for the intensive care setting, using a topic guide. Staff participants were purposively selected to gain perspectives from a broad range of health care professionals, taking into account differences in age, gender, length of time working on the units, and nursing grade.
Results were presented to a working group of clinicians from ICU and palliative care, who developed the new interventional tool, termed the Psychosocial Assessment and Communication Evaluation (PACE). Initial versions were tested in three 6-week pilot periods, and amended as necessary.
Training and implementation
Training to support PACE implementation (Additional file 3) was followed by two further audits of the records (Figure 1). We conducted non-participant observation during and after implementation, and collected completed and de-identified copies of PACE logs. We conducted qualitative interviews with families, broadly similar in characteristics to those interviewed before PACE was introduced. These interviews explored experiences of care, and checked for any adverse effects of PACE.
Phase II evaluation: staff views of PACE and survey of family members
We evaluated PACE using two approaches: a survey of staff about PACE, and a survey of family members’ satisfaction with care. A staff questionnaire survey was emailed to all ICU doctors and nurses, with two reminders. The survey asked about any difficulties experienced in completing the PACE, views of its use, and its effect on care.
We attempted to survey one family member for each patient cared for on the ICU during the period of PACE implementation and use. Family members were identified and given information about the study, and then on a subsequent visit were given the questionnaire. We excluded family members whom the staff deemed were too distressed to complete the questionnaire, family members of patients admitted for less than 12 hours or family members who had visited the ICU fewer than 3 times. The questionnaire had mainly closed questions with a few open questions, and was administered by the researchers, unless the family wished to self-complete. It included the 24-item Family Satisfaction in the Intensive Care Unit questionnaire (FS-ICU) , validated to measure family member satisfaction with a patient’s admission in ICU. We compared responses according to whether a PACE was or was not completed for the corresponding patient.
Analysis and sample sizes
All data were anonymized. All qualitative interviews (both phases) and focus groups were digitally audio-recorded, transcribed verbatim, and entered into NVivo9 (supplier via King’s College London, QSR International, http://www.qsrinternational.com). Qualitative data were analyzed using the framework approach , which enabled the systematic identification of themes both from questions and from emergent issues. This was undertaken independently by two researchers (CS, CR), with the Project Advisory Group agreeing the thematic framework. Issues (sub-themes) were then identified within these broader themes, followed by a process of charting both the patient/family and staff datasets to allow comparison between cases (specific patient care/professional group). The process of synthesis also involved mapping data from the open coding onto the broad categories identified in the preliminary literature review (Table 1).
Quantitative data were analyzed using simple descriptive statistics to describe PACE use and staff opinions. For the survey of family members we used t-tests (for normally distributed characteristics), χ2 or Fisher’s exact test (for non-normally distributed characteristics), and the Mann–Whitney U-test (for experience assessments) to compare the characteristics and experience of families for cases that had PACE completed with those that had not. When equality of variances was not assumed adjusted values are given (t, degrees of freedom, P, 95% CI for mean differences). All tests were two-sided.
Qualitative samples aimed to capture different groups in terms of age, gender, length of time in ICU, diagnosis, and social and cultural background, and thus capture the range of views. In the family members’ survey, most of the analysis was descriptive. However, if we assume 20% (a likely level based on previous research) of families have serious concerns, we needed 76 respondents to achieve a margin of error of 9% (95% confidence interval). Therefore, we estimated that 150 participants would provide reasonable descriptive accuracy and allow for subgroup analysis (sample stratified by age, gender, ethnicity, and disease). Allowing for refusals, we aimed to approach 200 participants. For both the qualitative and quantitative data, the samples aimed to be sufficient for preliminary exploration, as we were not formally testing PACE but to exploring its potentially beneficial or adverse effects.
We first interviewed 13 family members, representing 11 patients, and conducted observations on the care of these patients. Four the patients were women, age range 23 to 87 years) with diagnoses including infection, injury, and malignancy (Table 2). Observation periods for of patient care ranged from 1 to 46 days. Communication was a central theme, influencing issues such as decision-making and family support. Individualized issues of care, such as information regarding practical matters such as parking, were also important (Table 1).
Demographics of family members involved in qualitative data collection in phases I and II
* note in each group for one patient two family members wanted to be interviewed.
Abbreviations: COPD chronic obstructive pulmonary disease, PE pulmonary embolism.
In total, 32 staff from the ICU, 4 members of the hospital palliative care team, and 4 referring clinicians took part in individual interviews and/or focus groups, with 25 attending individual interviews, 14 attending one of three focus groups, and 7 attending both interview and focus groups (Table 3). These results also emphasized the need for psychosocial assessment and communication to be tailored to individual needs, with documentation of who had received what information when teams changed (Table 1) to improve continuity of care. However, although documentation was needed, staff wanted to ensure any tool was ‘paper-light’ and did not result in large amounts of extensive form filling. Therefore, one challenge presented in tool development was to ensure that key aspects were captured while keeping the document to one, or maximum two, pages.
Staff participants in phases I and II of the study
Grade 5: 43; 65%); grade 6 (n= 16; 24%); grade 7 (n= 7; 11%); grade not given (n = 1); total: n = 67
Hospital palliative care team
4 (focus group)
Professions allied to medicine (ICU staff)
The intervention: PACE
PACE draws on the work by Mosenthal et al. of providing a holistic assessment for all patients and families . The goal of developing the tool was to improve assessment and communication for all patients in the ICU, not just those at the end of life. Thus PACE sought to improve care for patients who may deteriorate, and equally those who may recover. PACE comprises a training program and a record in the clinical notes, as detailed below.
PACE Training program
One week training prior to implementation by ICU and palliative care staff - to enable all staff the opportunity to attend and to improve communication skills and awareness
A side room on the unit housed a poster and leaflet display of relevant materials and PACE
Members of the hospital palliative care team and researchers were present for 3–4 hours each day to introduce PACE and answer questions to foster collaboration between ICU and palliative care staff.
PACE record The PACE record is brief, on two sides of paper. It first asks for assessment of five aspects within 24 hours of admission to ICU:
Family details: key relationships; children; guardianship issues; vulnerable adults
Social details: financial concerns; religious/spiritual needs; language/cultural needs; transport/parking needs; other needs
Patient preferences: previously expressed wishes; preferred place of care; presence of advance directive / statement or will
Communication and information: patient / NOK awareness of situation; people to be given information; explanation of ICU
Any other issues: which patient, family or staff feel is important.
The next section of PACE gives space for a continuing log of any communication update.
The final section of PACE provides a list of useful resources - as a prompt to seek additional support for patients and families. Additional file 3 shows the PACE in full.
The PACE is logged by the admitting key worker, usually an ICU nurse. It is kept in the clinical records and can be updated by any member of the clinical team. The rationale for keeping PACE in the clinical record is to avoid miscommunication and improve continuity by holding psychosocial information in one place. The goal is that the assessment prompts changes in actions by staff in response to the assessment findings. The continuing log of communication enables information to flow between teams recording communication about new issues or changes in the patient or family circumstances.
PACE requires staff to explain if an aspect is not explored (e.g. staff must give a reason if it is not appropriate to discuss preferences).
Implementation of PACE
In total, 43 nurses, 11 doctors and staff from palliative care, pharmacy, physiotherapy, occupational therapy, speech and language therapy, and chaplaincy departments attended the training during the launch week. The research process and feedback of the results led to much discussion about decision-making, communication, and end-of-life issues. In addition, there was increased input from the palliative care team on the units and psychosocial support by different providers, including chaplaincy and the palliative care team, as a consequence of the heightened awareness and identification of needs through the use of PACE.
PACE was launched in the ICU after the three piloting phases. Further revisions were undertaken on two occasions, at 6 weeks and 4 months after the original launch, to address concerns and suggestions by staff. The PACE log was usually filed in the nursing notes. An audit of the completion of PACE logs of 81 consecutive patients found that half (41) were completed within 24 hours, and the remainder within 48 hours of admission to ICU. All aspects were completed for at least some patients, the most complete being family history, next of kin, and family understanding of the condition (both completed for over 90% of cases), and social history (70% of cases).
Effect of PACE: the views of ICU staff
Responses were received from 95/176 (54%) staff members, of whom 80% (76/95) had seen a PACE log. In the main; nurses (84%; 52/62) reported completing PACE rather than doctors (17%; 3/18). Just over half (61%; 51/84) reported completing PACE within 24 hours of admission all or most of the time (similar to the audit results), but 34% (27/80) had difficulty completing some sections, especially recording patient preferences. Most (80%; 67/84) reported having seen a completed PACE in patients’ notes. The majority (89%; 71/80) reported that PACE was very or generally useful, with only 3 respondents saying it was not useful, and 6 responses being neutral. The components of PACE most often judged to be useful were family details (65 respondents), social details (52 respondents), and communication/information (25 respondents).
Questionnaire survey of family members
Response rate from the family members was 165/213(78%). Figure 2 shows a flow chart of those eligible, and reasons for exclusion/non-response. The characteristics of the patients relating to these 165 relatives were: mean age 59 years; 48% women; 81% white, 12% black African/Caribbean/British, 5% Asian and 2% other; and had been on average 3 days on the ICU (range 1 to 56 days). We were able to compare the characteristics and experiences reported in cases when a PACE had (n = 88) and had not (n = 42) been completed (note there were instances when we could not match to PACE completion because of confidentiality and the nature of responses).
There were no differences in the demographic and clinical characteristics of relatives or patients with and without PACE completion, except that those with PACE had more severe disease and a higher risk of death (indicated by higher APACHE II scores; mean ± SD score 15.55 ± 7.22 for those with PACE completed and 13.36 ± 5.27 for those with PACE not completed, t = 1.95, P = 0.05) (see Additional file 4). Those cases for which PACE was completed had significantly better levels of satisfaction with the assessment and treatment of all symptoms (pain, breathlessness, nausea/vomiting, agitation, and confusion and communication difficulties), and for both the honesty and consistency of the information provided to relatives about the patient’s condition (Table 4). Other aspects measured also showed a trend towards improvement in the PACE group, although this did not reach statistical significance. Secondary analysis of our data did not identify cultural or ethnic differences in the reported experience or satisfaction of relatives, or the use of the PACE.
Differences in satisfaction of family members in cases when PACE was and was not completeda
No PACE, n
Completed, median (range)
Not completed, median (range)
Assessment and treatment of:
1 (1 to 4)
1 (1 to 5)
1 (1 to 3)
1 (1 to 5)
1 (1 to 3)
1.5 (1 to 4)
1 (1 to 3)
2 (1 to 4)
1 (1 to 4)
2 (1 to 5)
1 (1 to 4)
2 (1 to 4)
Consistency of information provided to relatives about patient’s condition
2 (1 to 5)
2 (1 to 5)
How well ICU staff informed relatives about what was happening to patients
1 (1 to 5)
2 (1 to 5)
Communication about patient’s condition from nurses
1 (1 to 5)
2 (1 to 4)
Communication about patient’s condition from doctors
2 (1 to 5)
2 (1 to 5)
Willingness of ICU staff to answer questions
1 (1 to 5)
2 (1 to 4)
ICU staff provided explanations that you understood
1 (1 to 5)
2 (1 to 5)
Prognostic uncertainty and decision-making
Honesty of information provided to relatives about patient’s condition
1 (1 to 5)
2 (1 to 4)
Feeling included in the decision-making process
2 (1 to 5)
2 (1 to 5)
Feeling supported in the decision-making process
2 (1 to 5)
2 (1 to 4)
Meeting individual wishes
ICU staff interest in relative’s needs
1 (1 to 5)
1 (1 to 5)
Information about patients given to the right people (that is, those close to them)
1 (1 to 5)
2 (1 to 4)
Enough time to ask questions
1 (1 to 4)
2 (1 to 4)
ICU staff provided emotional support for relative
1 (1 to 4)
2 (1 to 5)
Quality of care relative and patient received in ICU
1 (1 to 4)
1 (1 to 5)
Supporting dignity, respect, and peace
Courtesy, respect, and compassion for patient
1 (1 to 5)
1 (1 to 5)
Courtesy, respect, and compassion for relative
1 (1 to 4)
1 (1 to 5)
Care for patient from nurses
1 (1 to 5)
1 (1 to 4)
Care for patient from doctors
1 (1 to 4)
1 (1 to 5)
Atmosphere in the ICU
2 (1 to 4)
2 (1 to 4)
Atmosphere in the ICU waiting room
2 (1 to 5)
3 (1 to 5)
Abbreviations: ICU intensive care unit, PACE Psychosocial Assessment and Communication Evaluation.
aLower scores indicate higher satisfaction.
bSignificant at p<0.05.
Qualitative interviews with families and observation post-PACE implementation
In total, 11 interviews were undertaken representing 10 patients (in 7 of these cases there was a completed PACE in the clinical records). Variation in cases between phase I and II made comparison difficult; however, the comments shed light on the quantitative results (Table 5). One interviewee (in the PACE group) highlighted the value of being able to plan a meeting with the doctor out of hours. This enabled relatives who were working to attend meetings. In both phases, preferences for involvement in decision-making varied, but relatives had a positive reaction to being asked about their preferences, even though they often did not want to be more involved in actually making the decision, as they felt this should be made by the medical staff. In one of the post-PACE instances, the palliative care social worker supported the young children of the patient visiting, promoted by the PACE tool. No adverse events related to PACE use were observed.
Quotations from post-intervention qualitative interviews with family members, which helped to interpret the quantitative results
…when he’s been on the bed he’s sort of moved and he’s gone ‘Oh’, and he said he’s in pain. I’ve then called the nurse over and automatically she’s given him painkillers, or she’s checked the chart to see when he’s had his last painkillers and given him painkillers… (Family member of patient 5, Phase 2)
…there were reasons why it was hard to identify that actually it was… she was complaining of the abdominal pains, but because of the complications it was hard to actually sort out the factors, you know, what was the reason for it. It turned out to be the most serious of the three but that, I mean that was identified and then they flew into action… (Family member of patient 7, Phase 2)
…because I do ask… I said to them ‘is he under any sedation and have you taken him off this, have you taken him off that?’ and they’re saying about his sodium level is a bit low and I asked them what that meant and they explained that to me so, you know, they are really good… I’ve got no qualms with asking the nurses anything.. (Family member of patient 10, Phase 2)
…some of the doctors are really good and they explain things or they say ‘do you want to talk to us?’ and then I will, I’ll ask as many questions as, you know, as I can… (Family Member of patient 1, Phase 2)
Prognostic uncertainty and decision-making
…I have to say that everybody without exception explained everything very patiently and, um, you know, could take the time to explain what was happening, what the risks were, what the likely outcomes were or could be, um, and equally to admit that on occasions they didn’t know, which was also refreshing, yeah… (Family member of patient 10, Phase 2)
…I mean it’s been a bit sort of touch and go, um, when was it, not last weekend, the weekend before, we were told he’d only got 12 to 24 hours to live, um, and it was a bit, because it was such a shock, because he’s not had any symptoms, he’s never been ill in his life… (Family member of patient 1, Phase 2)
Meeting individual wishes
…he doesn’t want any tubes down him, he’s made that quite clear. Even if he gets worse, they were telling me his breathing, they can put a tube in to help his breathing, doesn’t want it, he said he does not want it, and his wish, you know, I said ‘Well that’s his reply, then stick to that, that’s what he wants’… (Family member of patient 5 Phase 2)
Supporting dignity, respect and peace
…they move him all the time because of sores and, you know, they’ve had to put things on his legs because his legs was turning in and, you know, when I, when I said ‘oh’, you know, and they’ve said ‘oh we put them on to straighten the leg’ and I think ‘god I wouldn’t think of things like that’. They’ve been really, really marvelous, as I said I can’t knock ‘em and I take my hats off to ‘em, and they have every time I’ve come in they’re washing and shaving him, which you don’t think of stuff like that while he’s there, d’you know what I mean? And, um, absolutely fantastic really. (Family member of patient 10, Phase 2)
PACE was developed and tested to help improve care in ICU, a setting in which uncertainty is common. PACE is a straightforward tool, building on the work of Mosenthal et al. in a trauma unit of having an approach suitable for all patients irrespective of prognosis , but formally integrating training, an initial assessment, and an ongoing log of communication. We found that PACE was acceptable and feasible for staff to use. The close working between palliative care and ICU staff in its development and implementation led to sustained working. It was mainly completed by nurses, which this is not unexpected, as other work has suggested the central role of nurses in ICU care . Results from the survey of relatives suggest that PACE improves symptom control, communication, and information provision. An examination of the qualitative responses shed light on these results; family members were appreciative of the greater emphasis on communication and managing symptoms, which might have been supported in turn by a greater emphasis on support of the family members and of the patient’s individual needs.
Comparison with other studies and wider implications
To embed palliative care principals and practice into ICUs, several countries and national and international associations have published recommendations, practice guides, and quality indicators [20, 52–54]. Specific tools, care pathways, or bundles can also embed new approaches more formally into routine care. Some of these approaches have been used in general hospitals. Care pathways were proposed in the National Institute for Health and Clinical Excellence Guidance on Supportive and Palliative Care  as a possible means to improve end-of-life care, although needing more evaluation. In the USA, three before-and-after studies of care pathways suggested that there was a reduction in the number of therapies ordered, although outcomes were not studied [56–58]. Studies on the LCP in the UK found similar data using documentation and staff appraisals [59–61], and caregiver reports . However, studying only processes of care rather than patient and family outcomes is flawed: Mularski et al. found that better documentation of pain does not in itself lead to better treatment . Thus, we felt it was important, even in this preliminary evaluation, to assess outcomes, rather than the treatments received or other process measures.
In the ICU, it is difficult to accurately identify those who will die, and there is often a very short window to introduce palliative or end-of-life care and to support families. There is also a need to manage distressing and often complex symptoms, and at the same time, provide support and information to families at a time of clinical uncertainty and/or devastating news. A major problem is deciding on a trigger to use any pathway, something which has caused considerable debate in the UK with regard to the LCP [63, 64]. For the ICU, integrated approaches that might benefit all patients are recommended , and our findings support this approach. We suggest that PACE may be suitable in cases of uncertainty in general hospital settings, possibly for all patients on admission. Recent research has shown that at the point of admission, family members feel they move from being ‘conductor’ at home, to ‘second fiddle’ where their experience and perspectives are missed . Indeed, the improved communication and care at an early stage may help if any difficult decisions and conversations are needed later, at which point other tools, suitable for patients who are more likely to be deteriorating or dying, are useful.
To underpin our results and to enable future evaluation, we developed a theoretical model of how PACE may be influencing the outcomes found in our study (Figure 3). This builds on the communication framework developed by Curtis et al. , and Nelson et al. [26, 27] in developing models based on changing skills, attitudes, and behavior to improve communication and end-of-life care in the ICU, and the work of McCorkle et al.  in enhancing illness self-management through improved patient/clinician partnerships. As Figure 3 shows, the combination of training plus the greater individual patient/family-focused assessment in PACE (shown in yellow) can lead to improved interactions, co-ordination, and support, which in turn leads to the improved symptom control, and feelings of honesty and communication. One major goal in developing PACE was to keep the tool short and with little paperwork. Staff wanted PACE to help them do the right thing for patients and families, but not to increase documentation. Work is now underway to integrate PACE into the electronic record.
Limitations and strengths of the study
Our study is limited by being based in two ICUs in a single hospital. However, PACE was used on a wide range of patients, with different ages, conditions, and cultural backgrounds. The findings from the surveys of staff and family members did not suggest that it was suitable for only some particular groups or circumstances. We found that PACE was used more often when patients were more critically ill, as indicated by the APACHE II score. This suggests that staff prioritized PACE for instances of greatest uncertainty. ICU wards have higher levels of staffing than general wards, and this may have supported the implementation of PACE. Therefore, wider testing of PACE in ICU units, and ideally general wards, is needed. Even if PACE is suitable only for the ICU, this represented over one-fifth of the deaths in our hospital, and so would affect a high number of patients and families.
Our comparison of family members’ satisfaction when PACE was and was not used was restricted to the ICUs participating in this study. All ICU staff had been exposed to the palliative care training and awareness engendered by PACE implementation. This may have reduced the likelihood of finding a difference between groups, because the care of all patients (including those who did not have PACE completed) was influenced. Despite this limitation, our findings of a difference between groups suggests that PACE does improve care over and above that provided by general training, although we cannot exclude the possibility that some other factor reduced the quality of care for the ‘non-PACE’ patients, which also resulted in them not receiving PACE. For example, it may have been that those staff members choosing to complete PACE were also more skilled in communication and symptom management than those who did not complete PACE. The use of PACE increased during the project, so it might also have been that care generally improved during this time. To test PACE fully, a comparative trial is required, with before-and-after assessment of care experience, including units where PACE is not used. Finally, our study was limited by the high level of satisfaction found in the survey of family members’ experiences.
PACE is an acceptable and feasible tool that has the potential to improve care of ICU patients and their families. Moreover, it appears to improve communication, information-sharing and family perceptions of symptom control. We did not find any harmful effects of the tool. PACE may help the better implementation of other tools or care bundles by establishing early an assessment of the patient and family circumstances beyond medical diagnosis and improving communication. It would need to be introduced using integrated working between specialist palliative care and ICU staff, with a shared training program, and now warrants evaluation and further development in comparative trials in the ICU. PACE may also be relevant for other hospital circumstances where there is a high level of clinical uncertainty.
Intensive Care Unit
Liverpool Care Pathway for the care of the dying patient
Methods of Researching End-of-life Care
Psychosocial Assessment and Communication Evaluation tool.
We thank the family and patients who participated in our study, and the ICU and palliative care staff for participation and PACE implementation.
This paper presents independent research funded by the National Institute for Health Research (NIHR) under its Research for Patient Benefit (RfPB) Programme (Grant Reference Number PB-PG-0107-12109). The views expressed are those of the authors, and are not necessarily those of the National Health Service, the National Institute for Health Research, the NIHR, or the Department of Health.
Department of Palliative Care, Policy and Rehabilitation, Cicely Saunders Institute, King’s College London, School of Medicine
Intensive Care Unit, King’s College Hospital NHS Foundation Trust
Division of Health and Social Care Research, King’s College London
Azoulay E, Timsit JF, Sprung CL, Soares M, Rusinovj K, Lafabrie A, Abizanda R, Svantesson M, Rubulotta F, Ricou B, Benoit D, Heyland D, Joynt G, Francxais A, Azeivedo-Maia P, Owczuk R, Benbenishty J, De Vita M, Valentin A, Ksomos A, Cohen S, Kompan L, Ho K, Abroug F, Kaarlola A, Gerlach H, Kyprianou T, Michalsen A, Chevret S, Schlemmer B: Prevalence and factors of intensive care unit conflicts: the conflicus study. Am J Respir Crit Care Med. 2009, 180: 853-860. 10.1164/rccm.200810-1614OC.View ArticlePubMedGoogle Scholar
Sprung CL, Woodcock T, Sjokvist P, Ricou B, Bulow HH, Lippert A, Maia P, Cohen S, Baras M, Hovilehto S, Ledoux D, Phelan D, Wennberg E, Schobersberger W: Reasons, considerations, difficulties and documentation of end-of-life decisions in European intensive care units: the ETHICUS Study. Intensive Care Med. 2008, 34: 271-277. 10.1007/s00134-007-0927-1.View ArticlePubMedGoogle Scholar
Smith D: Development of an end-of-life care pathway for patients with advanced heart failure in a community setting. Int J Palliat Nurs. 2012, 18: 295-300.View ArticlePubMedGoogle Scholar
Parker MJ: We need an alternative to the Liverpool care pathway for patients who might recover. BMJ. 2013, 346: f3702-10.1136/bmj.f3702.View ArticlePubMedGoogle Scholar
Morgan J: End-of-life care in UK critical care units–a literature review. Nurs Crit Care. 2008, 13: 152-161. 10.1111/j.1478-5153.2008.00274.x.View ArticlePubMedGoogle Scholar
Truog RD, Campbell ML, Curtis JR, Haas CE, Luce JM, Rubenfeld GD, Rushton CH, Kaufman DC: Recommendations for end-of-life care in the intensive care unit: a consensus statement by the American College [corrected] of Critical Care Medicine. Crit Care Med. 2008, 36: 953-963. 10.1097/CCM.0B013E3181659096.View ArticlePubMedGoogle Scholar
Browning AM: Empowering family members in end-of-life care decision making in the intensive care unit. Dimens Crit Care Nurs. 2009, 28: 18-23. 10.1097/01.DCC.0000325092.39154.4a.View ArticlePubMedGoogle Scholar
Mularski RA, Puntillo K, Varkey B, Erstad BL, Grap MJ, Gilbert HC, Li D, Medina J, Pasero C, Sessler CN: Pain management within the palliative and end-of-life care experience in the ICU. Chest. 2009, 135: 1360-1369. 10.1378/chest.08-2328.View ArticlePubMedGoogle Scholar
Curtis JR, Vincent JL: Ethics and end-of-life care for adults in the intensive care unit. Lancet. 2010, 376: 1347-1353. 10.1016/S0140-6736(10)60143-2.View ArticlePubMedGoogle Scholar
Levin TT, Moreno B, Silvester W, Kissane DW: End-of-life communication in the intensive care unit. Gen Hosp Psychiatry. 2010, 32: 433-442. 10.1016/j.genhosppsych.2010.04.007.View ArticlePubMedGoogle Scholar
Luce JM: A history of resolving conflicts over end-of-life care in intensive care units in the United States. Crit Care Med. 2010, 38: 1623-1629. 10.1097/CCM.0b013e3181e71530.View ArticlePubMedGoogle Scholar
Luce JM: End-of-life decision making in the intensive care unit. Am J Respir Crit Care Med. 2010, 182: 6-11. 10.1164/rccm.201001-0071CI.View ArticlePubMedGoogle Scholar
Aslakson R, Pronovost PJ: Health care quality in end-of-life care: promoting palliative care in the intensive care unit. Anesthesiol Clin. 2011, 29: 111-122. 10.1016/j.anclin.2010.11.001.View ArticlePubMedGoogle Scholar
Morgan L, Howe L, Whitcomb J, Smith K: Improving communication and cost-effectiveness in the intensive care unit through palliative care: a review of literature. Dimens Crit Care Nurs. 2011, 30: 133-138. 10.1097/DCC.0b013e31820d2114.View ArticlePubMedGoogle Scholar
Tyrie LS, Mosenthal AC: Care of the family in the surgical intensive care unit. Anesthesiol Clin. 2012, 30: 37-46. 10.1016/j.anclin.2011.11.003.View ArticlePubMedGoogle Scholar
Curtis JR: Communicating about end-of-life care with patients and families in the intensive care unit. Crit Care Clin. 2004, 20: 363-380. 10.1016/j.ccc.2004.03.001.View ArticlePubMedGoogle Scholar
Mosenthal AC, Weissman DE, Curtis JR, Hays RM, Lustbader DR, Mulkerin C, Puntillo KA, Ray DE, Bassett R, Boss RD, Brasel KJ, Campbell M, Nelson JE: Integrating palliative care in the surgical and trauma intensive care unit: a report from the Improving Palliative Care in the Intensive Care Unit (IPAL-ICU) Project Advisory Board and the Center to Advance Palliative Care. Crit Care Med. 2012, 40: 1199-1206. 10.1097/CCM.0b013e31823bc8e7.View ArticlePubMedPubMed CentralGoogle Scholar
Mularski RA, Heine CE, Osborne ML, Ganzini L, Curtis JR: Quality of dying in the ICU: Ratings by family members. Chest. 2005, 128: 280-287. 10.1378/chest.128.1.280.View ArticlePubMedGoogle Scholar
SIAARTI: End-of-life care and the intensivist: SIAARTI recommendations on the management of the dying patient. Minerva Anestesiol. 2006, 72: 927-963.Google Scholar
Boyle DK, Miller PA, Forbes-Thompson SA: Communication and end-of-life care in the intensive care unit: Patient, family, and clinician outcomes. Crit Care Nurs Q. 2005, 28: 302-316.View ArticlePubMedGoogle Scholar
Halcomb E, Daly J, Jackson D, Davidson P: An insight into Australian nurses’ experience of withdrawal/withholding of treatment in the ICU. Intensive Crit Care Nurs. 2004, 20: 214-222. 10.1016/j.iccn.2004.05.010.View ArticlePubMedGoogle Scholar
Yaguchi A, Truog RD, Curtis JR, Luce JM, Levy MM, Mélot C, Vincent JL: International differences in end-of-life attitudes in the intensive care unit: Results of a survey. Arch Intern Med. 2005, 165: 1970-1975. 10.1001/archinte.165.17.1970.View ArticlePubMedGoogle Scholar
Nelson JE, Bassett R, Boss RD, Brasel KJ, Campbell ML, Cortez TB, Curtis JR, Lustbader DR, Mulkerin C, Puntillo KA, Ray DE, Weissman DE: Models for structuring a clinical initiative to enhance palliative care in the intensive care unit: a report from the IPAL-ICU Project (Improving Palliative Care in the ICU). Crit Care Med. 2010, 38: 1765-1772. 10.1097/CCM.0b013e3181e8ad23.View ArticlePubMedPubMed CentralGoogle Scholar
Nelson JE, Cortez TB, Curtis JR, Lustbader DR, Mosenthal AC, Mulkerin C, Ray DE, Bassett R, Boss RD, Brasel KJ, Campbell ML, Weissman DE, Puntillo KA: Integrating Palliative Care in the ICU: The Nurse in a Leading Role. J Hosp Palliat Nurs. 2011, 13: 89-94. 10.1097/NJH.0b013e318203d9ff.View ArticlePubMedPubMed CentralGoogle Scholar
Cheung W, Aggarwal G, Fugaccia E, Thanakrishnan G, Milliss D, Anderson R, Stock D, Bird H, Tan J, Fryc AC: Palliative care teams in the intensive care unit: a randomised, controlled, feasibility study. Crit Care Resusc. 2010, 12: 28-35.PubMedGoogle Scholar
Mosenthal AC, Murphy PA, Barker LK, Lavery R, Retano A, Livingston DH: Changing the culture around end-of-life care in the trauma intensive care unit. J Trauma. 2008, 64: 1587-1593. 10.1097/TA.0b013e318174f112.View ArticlePubMedGoogle Scholar
Chapman L: Adapting the Liverpool Care Pathway for intensive care units. Eur J Palliative Care. 2009, 16: 116-118.Google Scholar
Investigators SUPPORT: A controlled trial to improve care for seriously ill hospitalized patients. The study to understand prognoses and preferences for outcomes and risks of treatments (SUPPORT). The SUPPORT Principal Investigators. JAMA. 1995, 274: 1591-1598. 10.1001/jama.1995.03530200027032.View ArticleGoogle Scholar
Fridh I, Forsberg A, Bergbom I: Family presence and environmental factors at the time of a patient’s death in an ICU. Acta Anaesthesiol Scand. 2007, 51: 395-401. 10.1111/j.1399-6576.2006.01250.x.View ArticlePubMedGoogle Scholar
Abbott KH, Sago JG, Breen CM, Abernethy AP, Tulsky JA: Families looking back: one year after discussion of withdrawal or withholding of life-sustaining support. Crit Care Med. 2001, 29: 197-201. 10.1097/00003246-200101000-00040.View ArticlePubMedGoogle Scholar
Ahrens T, Yancey V, Kollef M: Improving family communications at the end of life: implications for length of stay in the intensive care unit and resource use. Am J Crit Care. 2003, 12: 317-324.PubMedGoogle Scholar
Curtis JR, Engelberg RA, Wenrich MD, Shannon SE, Treece PD, Rubenfeld GD: Missed opportunities during family conferences about end-of-life care in the intensive care unit. Am J Respir Crit Care Med. 2005, 171: 844-849. 10.1164/rccm.200409-1267OC.View ArticlePubMedGoogle Scholar
Hsieh HF, Shannon SE, Curtis JR: Contradictions and communication strategies during end-of-life decision making in the intensive care unit. J Crit Care. 2006, 21: 294-304. 10.1016/j.jcrc.2006.06.003.View ArticlePubMedGoogle Scholar
Puntillo KA, McAdam JL: Communication between physicians and nurses as a target for improving end-of-life care in the intensive care unit: challenges and opportunities for moving forward. Crit Care Med. 2006, 34: S332-S340. 10.1097/01.CCM.0000237047.31376.28.View ArticlePubMedGoogle Scholar
Vincent JL, Berré J, Creteur J: Withholding and withdrawing life prolonging treatment in the intensive care unit: a current European perspective. Chron Respir Dis. 2004, 1: 115-120. 10.1191/1479972304cd021rs.View ArticlePubMedGoogle Scholar
West HF, Engelberg RA, Wenrich MD, Curtis JR: Expressions of nonabandonment during the intensive care unit family conference. J Palliat Med. 2005, 8: 797-807. 10.1089/jpm.2005.8.797.View ArticlePubMedGoogle Scholar
Palda VA, Bowman KW, McLean RF, Chapman MG: “Futile” care: Do we provide it? Why? A semistructured, Canada-wide survey of intensive care unit doctors and nurses. J Crit Care. 2005, 20: 207-213. 10.1016/j.jcrc.2005.05.006.View ArticlePubMedGoogle Scholar
Fassier T, Lautrette A, Ciroldi M, Azoulay E: Care at the end of life in critically ill patients: the European perspective. Curr Opin Crit Care. 2005, 11: 616-623. 10.1097/01.ccx.0000184299.91254.ff.View ArticlePubMedGoogle Scholar
Kirchhoff KT, Walker L, Hutton A, Spuhler V, Cole BV, Clemmer T: The vortex: families’ experiences with death in the intensive care unit. Am J Crit Care. 2002, 11: 200-209.PubMedGoogle Scholar
Kopelman AE: Understanding, avoiding, and resolving end-of-life conflicts in the NICU. Mt Sinai J Med. 2006, 73: 580-586.PubMedGoogle Scholar
Lautrette A, Ciroldi M, Ksibi H, Azoulay E: End-of-life family conferences: rooted in the evidence. Crit Care Med. 2006, 34: S364-S372. 10.1097/01.CCM.0000237049.44246.8C.View ArticlePubMedGoogle Scholar
Chaitin E, Stiller R, Jacobs S, Hershl J, Grogen T, Weinberg J: Physician-patient relationship in the intensive care unit: erosion of the sacred trust?. Crit Care Med. 2003, 31: S367-S372. 10.1097/01.CCM.0000066452.48589.F4.View ArticlePubMedGoogle Scholar
White DB, Curtis JR: Care near the end-of-life in critically ill patients: A North American perspective. Curr Opin Crit Care. 2005, 11: 610-615. 10.1097/01.ccx.0000184301.76007.70.View ArticlePubMedGoogle Scholar
Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M: Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008, 337: a1655-10.1136/bmj.a1655.View ArticlePubMedPubMed CentralGoogle Scholar
Higginson IJ, Evans CJ, Grande G, Preston N, Morgan M, McCrone P, Lewis P, Fayers P, Harding R, Hotopf M, Murray SA, Benalia H, Gysels M, Farquhar M, Todd C: Evaluating complex interventions in end of life care: the MORECare statement on good practice generated by a synthesis of transparent expert consultations and systematic reviews. BMC Med. 2013, 11: 111-10.1186/1741-7015-11-111.View ArticlePubMedPubMed CentralGoogle Scholar
(ICNARC) ICNARC: Electronic Data Analysis Report. 2012, London: Intensive Care National Audit & Research Centre (ICNARC)Google Scholar
Lewis-Newby M, Curtis JR, Martin DP, Engelberg RA: Measuring family satisfaction with care and quality of dying in the intensive care unit: does patient age matter?. J Palliat Med. 2011, 14: 1284-1290. 10.1089/jpm.2011.0138.View ArticlePubMedPubMed CentralGoogle Scholar
Ritchie J, Spencer L, O’Connor W: Carrying out qualitative analysis. In Qualitative Research Practice. Edited by Ritchie J, Lewis J. 2003, New York: SageGoogle Scholar
Clarke EB, Curtis JR, Luce JM, Levy M, Danis M, Nelson J, Solomon MZ: Quality indicators for end-of-life care in the intensive care unit. Crit Care Med. 2003, 31: 2255-2262. 10.1097/01.CCM.0000084849.96385.85.View ArticlePubMedGoogle Scholar
Cook D, Rocker G, Heyland D: Dying in the ICU: strategies that may improve end-of-life care. Can J Anaesth. 2004, 51: 266-272. 10.1007/BF03019109.View ArticlePubMedGoogle Scholar
Giannini A, Pessina A, Tacchi EM: End-of-life decisions in intensive care units: attitudes of physicians in an Italian urban setting. Intensive Care Med. 2003, 29: 1902-1910. 10.1007/s00134-003-1919-4.View ArticlePubMedGoogle Scholar
Gysels M, Higginson IJ: Improving supportive and palliative care for adults with cancer: Research Evidence. 2004, London: National Institute of Clinical ExcellenceGoogle Scholar
Bailey FA, Burgio KL, Woodby LL, Williams BR, Redden DT, Kovac SH, Durham RM, Goode PS: Improving processes of hospital care during the last hours of life. Arch Intern Med. 2005, 165: 1722-1727. 10.1001/archinte.165.15.1722.View ArticlePubMedGoogle Scholar
Bookbinder M, Blank AE, Arney E, Wollner D, Lesage P, McHugh M, Indelicato RA, Harding S, Barenboim A, Mirozyev T, Portenoy RK: Improving end-of-life care: development and pilot-test of a clinical pathway. J Pain Symptom Manage. 2005, 29: 529-543. 10.1016/j.jpainsymman.2004.05.011.View ArticlePubMedGoogle Scholar
Luhrs CA, Meghani S, Homel P, Drayton M, O’Toole E, Paccione M, Daratsos L, Wollner D, Bookbinder M: Pilot of a pathway to improve the care of imminently dying oncology inpatients in a Veterans Affairs Medical Center. J Pain Symptom Manage. 2005, 29: 544-551. 10.1016/j.jpainsymman.2005.02.010.View ArticlePubMedGoogle Scholar
Di Leo S, Beccaro M, Finelli S, Borreani C, Costantini M: Expectations about and impact of the Liverpool Care Pathway for the dying patient in an Italian hospital. Palliat Med. 2011, 25: 293-303. 10.1177/0269216310392436.View ArticlePubMedGoogle Scholar
Veerbeek L, van der Heide A, de Vogel-Voogt E, de Bakker R, van der Rijt CC, Swart SJ, van der Maas PJ, van Zuylen L: Using the LCP: bereaved relatives’ assessments of communication and bereavement. Am J Hosp Palliat Care. 2008, 25: 207-214. 10.1177/1049909108315515.View ArticlePubMedGoogle Scholar
Veerbeek L, van Zuylen L, Swart SJ, van der Maas PJ, de Vogel-Voogt E, van der Rijt CC, van der Heide A: The effect of the Liverpool Care Pathway for the dying: a multi-centre study. Palliat Med. 2008, 22: 145-151. 10.1177/0269216307087164.View ArticlePubMedGoogle Scholar
Mularski RA, White-Chu F, Overbay D, Miller L, Asch SM, Ganzini L: Measuring pain as the 5th vital sign does not improve quality of pain management. J Gen Intern Med. 2006, 21: 607-612. 10.1111/j.1525-1497.2006.00415.x.View ArticlePubMedPubMed CentralGoogle Scholar
Lowson E, Hanratty B, Holmes L, Addington-Hall J, Grande G, Payne S, Seymour J: From ‘conductor’ to ‘second fiddle’: Older adult care recipients’ perspectives on transitions in family caring at hospital admission. Int J Nurs Stud. 2013, 50: 1197-1205. 10.1016/j.ijnurstu.2012.02.005.View ArticlePubMedGoogle Scholar
Curtis JR, Ciechanowski PS, Downey L, Gold J, Nielsen EL, Shannon SE, Treece PD, Young JP, Engelberg RA: Development and evaluation of an interprofessional communication intervention to improve family outcomes in the ICU. Contemp Clin Trials. 2012, 33: 1245-1254. 10.1016/j.cct.2012.06.010.View ArticlePubMedGoogle Scholar
McCorkle R, Ercolano E, Lazenby M, Schulman-Green D, Schilling LS, Lorig K, Wagner EH: Self-management: enabling and empowering patients living with cancer as a chronic illness. CA Cancer J Clin. 2011, 61: 50-62. 10.3322/caac.20093.View ArticlePubMedPubMed CentralGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.