Skip to main content

Decreased costs and retained QoL due to the ‘PACE Steps to Success’ intervention in LTCFs: cost-effectiveness analysis of a randomized controlled trial



The number of residents in long-term care facilities (LTCFs) in need of palliative care is growing in the Western world. Therefore, it is foreseen that significantly higher percentages of budgets will be spent on palliative care. However, cost-effectiveness analyses of palliative care interventions in these settings are lacking. Therefore, the objective of this paper was to assess the cost-effectiveness of the ‘PACE Steps to Success’ intervention. PACE (Palliative Care for Older People) is a 1-year palliative care programme aiming at integrating general palliative care into day-to-day routines in LTCFs, throughout seven EU countries.


A cluster RCT was conducted. LTCFs were randomly assigned to intervention or usual care. LTCFs reported deaths of residents, about whom questionnaires were filled in retrospectively about resource use and quality of the last month of life. A health care perspective was adopted. Direct medical costs, QALYs based on the EQ-5D-5L and costs per quality increase measured with the QOD-LTC were outcome measures.


Although outcomes on the EQ-5D-5L remained the same, a significant increase on the QOD-LTC (3.19 points, p value 0.00) and significant cost-savings were achieved in the intervention group (€983.28, p value 0.020). The cost reduction mainly resulted from decreased hospitalization-related costs (€919.51, p value 0.018).


Costs decreased and QoL was retained due to the PACE Steps to Success intervention. Significant cost savings and improvement in quality of end of life (care) as measured with the QOD-LTC were achieved. A clinically relevant difference of almost 3 nights shorter hospitalizations in favour of the intervention group was found. This indicates that timely palliative care in the LTCF setting can prevent lengthy hospitalizations while retaining QoL. In line with earlier findings, we conclude that integrating general palliative care into daily routine in LTCFs can be cost-effective.

Trial registration


Peer Review reports


Health care costs rise while resources remain limited. Therefore, providing evidence on health economic evaluations to guide decisions is increasingly important, especially in palliative care and in long-term care facilities (LTCFs) [1], because the need for long-term institutional care for older people is growing as a result of the great leap in life expectancy achieved in the twentieth century in Western societies and the related increase in prolonged and more complex illness trajectories [2,3,4]. Consequently, a significant number of frail older people live in LTCFs and will develop palliative care needs as they approach the end of life. At the same time, a number of descriptive studies show that palliative care for this patient group can be suboptimal: it is not always available, symptoms appear under-estimated and burdensome treatments are continued or initiated without having explored residents’ individual preferences [5,6,7,8,9]. Furthermore, potentially avoidable hospital admissions are common among LTCF residents [10].

According to the Economist Intelligence Unit, the growing number of people that might benefit from palliative care will significantly increase the percentage of budgets spent on palliative care [11]. There are indications that palliative care interventions are less costly than usual care or even cost-effective [12]. However, mostly home, hospital and hospice-based palliative care programs have been evaluated [12,13,14,15,16]. Therefore, evidence on the cost-effectiveness of palliative care interventions specifically in LTCFs is needed. In our study, the EU-funded PACE (Palliative Care for Older People) Steps to Success intervention, aimed at training LTCF staff to deliver palliative care to residents, was provided [17]. Van den Block et al. showed that residents’ comfort in the last week of life did not change, and that staff had statistically significantly better knowledge of palliative care [18].

In this study, new evidence regarding effects on costs and quality of end of life (care) due to the PACE Steps to Success intervention is introduced. It aimed to evaluate the cost-effectiveness of the intervention throughout seven counties.


Study design

This study was part of the EU PACE project [19]. In PACE, a cluster randomized controlled trial (cRCT) of a palliative care intervention for residents in LTCFs was conducted in Belgium (Flanders), Finland, Italy, Netherlands, Poland, England and Switzerland. In each country, LTCFs were randomly assigned to either the intervention condition or to usual care, using stratified randomization. Pre-specified outcome measures in the cost-effectiveness analysis were direct medical costs, quality-adjusted life years (QALYs) based on the EuroQol-5D-5L (EQ-5D-5L) and costs per quality increase as measured with a specific end of life questionnaire (QOD-LTC). As suggested by the EQUATOR Network, the CHEERS guideline for economic evaluations was used [20].

The PACE Steps to Success intervention was implemented over a 12-month period between 2016 and 2017. Respondents gave informed consent in writing prior to filling in questionnaires. In Poland and the Netherlands, this was not required, as questionnaires were filled in anonymously. The study protocol was approved by the relevant ethics committees in all participating countries and was registered at – ISRCTN14741671 (FP7-HEALTH-2013-INNOVATION-1 603111) on July 30, 2015. This study was supported by the EU 7th Framework Program, grant agreement 6031111. The funding organization was not involved in the study design, collection, analysis and interpretation of the data nor in the decision to approve publication of this manuscript.


In each country, researchers randomly selected LTCFs (clusters) from predefined regions. For eligibility criteria, see the PACE protocol paper [19]. In each LTCF, residents who had died over the previous 4-month period were listed.


The ‘PACE Steps to Success’ intervention aims at integrating general palliative care into day-to-day routines in LTCFs by means of a train-the-trainer approach [19]. The intervention is based on the ‘Route to Success in Long-term Care Facilities’, developed in the UK [17]. Table 1 shows the six steps of the PACE Steps to Success intervention. It was hypothesized that through the training of facility staff, residents would receive high-quality palliative care, which in turn would improve the quality of end of life of these residents. LTCFs assigned to usual care were allowed to use all (supportive) services without restriction.

Table 1 The six steps of the ‘PACE Steps to Success intervention’

Data collection and instruments

The cost-effectiveness of the PACE ‘Steps to Success’ intervention was assessed from a health care perspective, including direct medical and intervention-related costs. A cross-sectional study of resident deaths in participating LTCFs was conducted. LTCFs reported deaths of residents during the previous 4 months, irrespective of the place of death. For each case, multiple structured after-death questionnaires were filled in by a staff member most involved (preferably a nurse, otherwise a care assistant) and a relative at baseline (T0), and post-intervention at month 13 (T1) and month 17 (T2). See flowchart in Additional file 1: Fig. S1.

Since the impact of the intervention on both costs and effects was anticipated to mainly take place in the terminal phase of life, a time horizon of 1 month was chosen. Questions regarding care services received, which could be validated by administrative data (filled in by a staff member) and quality of life (QoL) during the last month of life (filled in by a staff member and a relative), were used to determine effects and direct medical resource use on a per resident basis. Using data from proxy respondents is a commonly employed approach in studies of this type and appears to be an acceptable source of data [21, 22].


Quantities of resources used in the last month of life (hospital admissions, visits of health care professionals, received intensive treatments like CPR or surgery (yes or no), see Additional file 2: Table S1) were multiplied by standard unit costs in euros. These unit costs were based on reference prices from 2017, the year the intervention was provided, calculated by the Dutch National Health Care Institute (ZN) and average per unit sales prices established by the Dutch Health Care Authority (NZA). If prices were only available for other years, they were adjusted using the consumer price index published by Statistics Netherlands [23]. If they were not available, health insurer contract rates were used. By using standard unit costs, the price parameter was kept constant over countries, so that results of the cost-effectiveness analysis could be explained by variances in volumes resource use only. See Additional file 2: Table S1 for the clustered care units that were used to measure resource use, including tariffs.

Mean costs associated with the intervention (hours dedicated to the intervention of coordinators and trainers, materials, accommodation) were identified and calculated back to resident level by multiplying the LTCFs’ number of beds by the occupancy rate. See Additional file 2: Fig. S2. In this calculation, the turnover rate of residents was considered. Since little is known about the sustainability of complex interventions in long-term care [24], a comprehensive discussion within the PACE consortium was held. As a conclusion, a depreciation period of 3 years was chosen as base-case. Subsequently, sensitivity analyses to determine the impact of the depreciation period were conducted in which it was assumed the effect of the intervention would wear off a shorter period of time.


The 5-level EQ-5D version (EQ-5D-5L) and the Quality of Dying in Long-Term Care (QOD-LTC) were used to measure intervention effects. The EQ-5D-5L measures five health-related QoL domains: mobility, self-care, usual activities, pain/discomfort and anxiety/depression. Preferences for the EQ-5D-5L were based on value sets from England [25, 26] and were elicited by means of both time trade-off and discrete choice experiments [26]. The use of the EQ-5D is recommended by international guidelines on economic evaluation [27, 28], making it the most often used outcome measure in economic evaluations in health care, increasing the comparability of results across literature. As suggested in earlier work [29], in this study, a specific QoL instrument for palliative care was used in addition to the EQ-5D. The QOD-LTC covers both quality of care (64%) and quality of dying (36%) items, measures psychosocial quality of end of life (care) and comprises three subscales: personhood, closure and preparatory tasks [30].

Statistical analyses

Differences in both costs and effects were analysed by means of regression analyses, with LTCF as the cluster. A mixed model approach was used, as this is able to capture the design complexity and correlation structures. Cost-effectiveness was integrated in one outcome measure, the net monetary benefit (NMB), and used as a dependent variable in the mixed model [31]. The NMB is a summary statistic representing the value of the intervention in monetary terms when a willingness-to-pay for a unit of effect, such as the QALY, is assumed. If the net value of the benefits outweighs the costs, the investment is said to increase health. If a reduction in costs at equal effects is realized, cost-minimization is pursued.

Covariates considered were age, gender, disease severity (measured with the Bedford Alzheimer Nursing Severity Scale – BANS-S, range 7–28), baseline measurement and the treatment dummy (intervention vs. control). Baseline measurement was taken into account to control for differences on baseline in case mix (regarding characteristics of residents) between LTCFs, both between and within countries. Since costs normally are right skewed—there are no negative costs, and some patients incur high costs (outliers)—a non-parametric bootstrap, in which we randomly sampled with replacement, was performed. This approach avoids the need to make assumptions about the shape of the distribution but instead uses the observed distributions of the studies’ cost data [32]. Analyses were on an intention-to-treat and complete case analysis was pursued.


Deceased residents from 73 LTCFsFootnote 1 from seven countries were identified. Concerning deceased residents, we collected 551 of 610 questionnaires from staff at baseline (90.3%) and 984 of 1178 post-intervention (83.5%) in 37 intervention and 36 control homes. Two hundred fifty-nine of 467 questionnaires from relatives were collected at baseline (55.5%) and 498 of 939 post-intervention (53.0%). We report on findings from both groups but focus on findings from staff questionnaires because of the considerably higher response rate. In addition, within the European context, nurses’ perceptions seem to align more closely with those of patients than perceptions of relatives do [33, 34].

The mean age of the deceased residents was 85.7 years, with a BANS-S disease severity score of 19.1 (range 7–28), and 65% was female. Resident characteristics in intervention and control LTCFs at baseline (T0) and post-intervention (T1 + T2) were broadly comparable. See Table 2.

Table 2 Resident characteristics control and intervention LTCFs on baseline and post-intervention


Between baseline and post-intervention, costs in the last month of life increased by €600.75 for residents dying in control LTCFs and decreased by €257.52 for residents dying in LTCFs receiving the PACE Steps to Success intervention. See Table 3. After bootstrapping and controlling for age, gender, residents’ disease severity, country, baseline measurement and group, a significantly lower cost of €983.23 for residents dying in intervention LTCFs was found. See Table 4. This decrease in cost was mainly due to significantly lower costs related to hospital admission (− €919.51, see Additional file 3: Table S2). This decrease can be explained by a combination of shorter length of hospitalizations and the type of wards residents were admitted to, although both elements did not decrease significantly on their own. Of those residents admitted, between pre- and post-test admission decreased with 2.2 nights in the intervention group and increased with 0.7 nights in the control group (a difference of 2.9 nights in favour of the intervention group). Moreover, mainly costs related to hospitalizations on the geriatric, general and ICU ward decreased (80.6% of total cost decrease). The above figures are based on a 3-year depreciation period, resulting in intervention-related costs of €124.08 per resident in the intervention arm. When bringing back the depreciation period to 1 year, the intervention still brought about significantly lower costs (− €934,84, 95% CI − €1713,78 to − €273,02, p value 0.023).

Table 3 Mean costs resource use and quality of end of life effects last month of life for control and intervention LTCFs on baseline and post intervention (unadjusted)
Table 4 Adjusted mean differences in costs resource use and quality of end of life effects last month of life, incl. 95% CIs and P values


After bootstrapping and controlling for age, gender, residents’ disease severity, country, baseline measurement and group, no significant differences in quality of end of life as measured with the EQ-5D-5L were found between intervention and control LTCFs between baseline and post-intervention. The QOD-LTC significantly improved for residents dying in LTCFs receiving the intervention (3.19, 95% CI 1.72–4.65, p value 0.00). See Tables 3 and 4. The fact both measures show a low correlation (Pearson’s coefficient, 0.14) confirms the relevance of not only measuring HR-QoL through the EQ-5D-5L when doing CEAs in palliative care, as suggested in earlier work [29].


The PACE Steps to Success intervention dominated the common practice alternative (control). It appeared both cheaper (− €983,28, p 0.02) and more effective on the QOD-LTC or not significantly different on the EQ-5D-5L. See Table 4. The NMB over the total relevant willingness-to-pay range for a QALY gained, from €20.000 to €80.000, in this study is therefore always bigger than zero, meaning added value. Because no significant differences were found on the EQ-5D-5L, the NMB was not considered in a mixed model as the decision rule changed to cost-minimization.


Costs decreased and QoL was retained due to the PACE Steps to Success intervention. The 1-year palliative care programme realized significant cost savings and improved quality of end of life (care) in the last month of life (QOD-LTC), meaning it strengthened sense of personhood, closure and preparatory tasks. Outcomes on the EQ-5D-5L were unchanged. Cost savings mainly resulted from decreased hospitalization-related costs. A clinically relevant difference of almost 3 nights shorter (from 9 to 6 nights; a decrease of 30%) hospitalizations in favour of the intervention group was found, indicating residents are returning to their LTCF earlier. Mainly costs related to hospitalizations on the geriatric, general and ICU ward decreased (80.6% of total cost decrease). Although the length of hospitalization and the cost decrease on the mentioned wards did not decrease significantly, the combination of both components of the composite outcome pointing in the same direction resulted in a significant cost decrease.

The decrease on these specific wards plausibly is not by chance. Patients entering the hospital normally are screened on the general ward, and on the geriatric ward, the desirability of care is discussed. In our study, this work was already done in the LTCF through the PACE intervention. Regarding the decrease on the ICU, the discussions with residents and families to elicit wishes and preferences around EoL as part of the PACE intervention in the LTCF presumably made residents and staff not prefer intensive hospital care anymore, mostly as the condition of the resident is too frail to profit from such intensive care and might even be harmful. A recent review showed that comparable interventions are found to decrease life-sustaining treatment and prevent hospitalization [35]. A JAMDA review found that in the nursing home population, ACP decreased hospitalization rates up to a quarter [36]. In line with these findings, we therefore conclude that investing in palliative care training for LTCF staff can increase quality of care and the last phase of life and reduce direct medical costs.

Concerning the effects on the cost side, our finding that the PACE Steps to Success intervention influences costs related to hospitalizations in the last month of life is in line with earlier research showing hospital admission in the last phase of life generally speaking are found to be undesirable, as patients mostly prefer less intensive treatment and desire comfort care during the end of life [37, 38]. One study even showed that higher health care costs in the last phase of life were associated with worse quality of death [39]. Also from a health care perspective, this finding is highly relevant as potentially avoidable hospital admissions are common among LTCF residents [10], and costs involved with hospital admissions typically represent a considerable percentage of total spending in the last months of life [40]. Nevertheless, there seems to be room for improvement as the number of hospitalizations and intensive treatments did not decrease. Further research is needed focusing on identifying those residents most at risk for hospitalizations and decreasing those that are avoidable.

Moreover, with regard to the impact on the effect side, the realized improvement on the QOD-LTC, measuring both items related to quality of care and quality of dying [41], evidently is highly desirable as palliative care for the subject patient group can be suboptimal, and opportunities for improvement in terms of QoL in the last phase of life in LTCFs are notable [5,6,7,8,9]. As communication, assessment and care planning are core components of the PACE Steps to Success intervention, the significant improvement on the QOD-LTC is plausible. Since no significant differences were found on the EQ-5D-5L, utilities are not available for the QOD-LTC, and survival effects were not to be expected [42], QALYs were not calculated in this study. If survival would have been influenced though, this was missed.

Strengths and weaknesses

This pioneering large-scale study is the first to internationally consider the cost-effectiveness of a palliative care intervention in LTCFs. As suggested in earlier work [29], a specific QoL instrument for palliative care in the form of the QOD-LTC was used in addition to the EQ-5D-5L as the latter is mainly concerned with health and the recovery of health and contains domains often seen as less relevant in the context of palliative care, in which values such as patient dignity, spiritual and psychosocial wellbeing and bereavement support are central. Another strength is the homogeneous study group: only data concerning the last weeks of life of residents were used.

In earlier research, it was argued that using backward counting to chart health care utilization might not give full insight in costs involved [43], as patients receiving palliative care might live longer, resulting in higher costs for additional care which might eclipse the savings accrued through lower intensity of care at the end of life [44,45,46]. However, these findings could not be replicated in recent systematic reviews [42, 47]. Moreover, the fact our study was assessed from a health care perspective, excluding informal care costs such as out-of-pocket payments of relatives and costs associated with loss in productivity (such as absenteeism), plausibly has not caused considerable bias as presumably fairly limited informal care costs (e.g. out-of-pocket expenses and productivity losses) are involved with residents living in LTCFs. As the focus was on volume changes, not on price effects, the fixed tariffs for care were used. Nevertheless, when using a general tariff for nights spent in the hospital, a significant cost decrease was still found. However, national profits evidently differed per country, as for example labour cost is lower in Poland than the Netherlands. Combining of post-intervention data (at T1 and T2) because of a lower-than-expected response rate did not influence our findings: significant cost-savings were found on both time points.

The fact treatments received had to be dichotomized is a limitation though, as it was not captured if residents had multiple same treatments. Moreover, value sets from England were used to achieve utility scores for the EQ-5D-5L—ranging from 0 (death) to 1 (perfect health)—since value sets were not available for all participating countries [25, 26]. It would be valuable for future studies to be able to use population-specific valuation sets better reflecting cultural differences and so increase validity of the measurement [48]. Also, the UK National Institute for health and Care Excellence (NICE) does not recommend using the EQ-5D-5L value set [49], because of concerns regarding its quality and reliability [50, 51]. Furthermore, using a 3-month period has been tested in previous research and has been shown to limit recall bias [7, 52,53,54]. In the PACE study, this period was lengthened to 4 months when LTCFs exceptionally did not meet minimal numbers of inclusion. Because of this, some memory bias might have occurred. Additionally, data were collected retrospectively over the last month of life in the PACE project [2]. Therefore, sensitivity analysis considering longer time horizons was not possible. Lastly, respondents were not blinded post-intervention. This might have influenced their responses, as staff may have wanted to report better quality after the intervention. However, the fact the study did not find improvements on staff-reported comfort in the last week of life in the intervention group [18] suggests that this will have been limited.

Generalizability and future research

Although a pattern of palliative care interventions being less costly than their comparators was also recently found in a review study [12], relatively little is known on the cost-effectiveness of palliative care, especially within LTCFs. Only O’Sullivan et al. on a national level looked at this specific setting and in line with our findings saw a significant decrease in hospitalization related costs [55]. Future research could look into possibilities of using better fitting QoL measurement tools—for example building on the capabilities approach [56]—for patient groups for which health-related QoL outcomes are too narrow [29, 57], and calculating utilities for these tools. Moreover, we suggest looking into possibilities of investing savings due to interventions like ‘PACE Steps to Success’ in quality palliative care in LTCFs.


Costs decreased and QoL was retained due to the PACE Steps to Success intervention. This study showed that the PACE Steps to Success intervention is cost-effective. Direct medical costs significantly decreased, mainly due to significantly lower hospitalization related costs (− €983.28, 95% CI − €1762.22 to − €321.46, p value 0.02) and quality of end of life (care) in the last month of life (QOD-LTC) significantly improved (3.19, 95% CI 1.72–4.65, p value 0.00). There is room for improvement though. Further zooming in on which hospitalizations are justifiable and which are not is recommended. Furthermore, rolling out the intervention by continuous training might also positively impact the number of hospitalizations and intensive treatments in the last month of life.

Availability of data and materials

Deidentified participant data are available for research purposes on request by the PACE consortium.


  1. 1.

    Of the 78 recruited LTCFs, three dropped out; one had no deaths to report on, and one returned no questionnaires post-intervention.



Bedford Alzheimer Nursing Severity Scale




Long-term care facilities


Net monetary benefit


Dutch Health Care Authority


Palliative Care for Older People (PACE)


Quality-adjusted life year


Quality of Dying in Long-Term Care (QOD-LTC)


Quality of life (QoL)


Dutch National Health Care Institute


  1. 1.

    Gomes B, Harding R, Foley KM, Higginson IJ. Optimal approaches to the health economics of palliative care: report of an international think tank. J Pain Symptom Manag. 2009;38(1):4–10.

    Google Scholar 

  2. 2.

    Life expectancy at birth, total (years): The World Bank; 2018 [Available from:

  3. 3.

    EuroStat. A look at the lives of the elderly in the EU today 2017 [Available from:].

  4. 4.

    Temkin-Greener H, Ladwig S, Caprio T, Norton S, Quill T, Olsan T, et al. Developing palliative care practice guidelines and standards for nursing home–based palliative care teams: a Delphi study. J Am Med Directors Assoc. 2015;16(1):86. e1-. e7.

  5. 5.

    Hall S, Petkova H, Tsouros A, Costantini M, Higginson IJ. Palliative care for older people: better practices. World Health Organization (WHO); 2011.

  6. 6.

    Gott M, Ingleton C. Living with ageing and dying: palliative and end of life care for older people: Oxford University press; 2011.

    Google Scholar 

  7. 7.

    De Gendt C, Bilsen J, Vander Stichele R, Deliens L. Advance care planning and dying in nursing homes in Flanders, Belgium: a nationwide survey. J Pain Symptom Manag. 2013;45(2):223–34.

    Google Scholar 

  8. 8.

    Estabrooks CA, Hoben M, Poss JW, Chamberlain SA, Thompson GN, Silvius JL, et al. Dying in a nursing home: treatable symptom burden and its link to modifiable features of work context. J Am Med Dir Assoc. 2015;16(6):515–20.

    PubMed  Google Scholar 

  9. 9.

    Teno JM, Clarridge BR, Casey V, Welch LC, Wetle T, Shield R, et al. Family perspectives on end-of-life care at the last place of care. JAMA. 2004;291(1):88–93.

    CAS  PubMed  Google Scholar 

  10. 10.

    Allers K, Hoffmann F, Schnakenberg R. Hospitalizations of nursing home residents at the end of life: a systematic review. Palliat Med. 2019;33(10):1282–98.

    PubMed  PubMed Central  Google Scholar 

  11. 11.

    Murray S. The quality of death: ranking end-of-life care across the world. Economist Intelligence Unit; 2010.

    Google Scholar 

  12. 12.

    Smith S, Brick A, O'Hara S, Normand C. Evidence on the cost and cost-effectiveness of palliative care: a literature review. Palliat Med. 2014;28(2):130–50.

    PubMed  Google Scholar 

  13. 13.

    Gomes B, Calanzani N, Curiale V, McCrone P, Higginson IJ. Effectiveness and cost-effectiveness of home palliative care services for adults with advanced illness and their caregivers. Cochrane Database Systematic Reviews. 2013;6:CD007760.

    Google Scholar 

  14. 14.

    Salamanca-Balen N, Seymour J, Caswell G, Whynes D, Tod A. The costs, resource use and cost-effectiveness of clinical nurse specialist–led interventions for patients with palliative care needs: a systematic review of international evidence. Palliat Med. 2017;0269216317711570.

  15. 15.

    Zimmermann C, Riechelmann R, Krzyzanowska M, Rodin G, Tannock I. Effectiveness of specialized palliative care. A systematic review. JAMA. 2008;229(14):1698-709.

  16. 16.

    Morrison RS, Penrod JD, Cassel JB, Caust-Ellenbogen M, Litke A, Spragens L, et al. Cost savings associated with US hospital palliative care consultation programs. Arch Intern Med. 2008;168(16):1783–90.

    PubMed  PubMed Central  Google Scholar 

  17. 17.

    NHS. End of Life Care Programme The Route to Success in End of Life Care – Achieving Quality in Care Homes. 2010 [Available from:].

  18. 18.

    Van den Block L, Honinx E, Pivodic L, Miranda R, Onwuteaka-Philipsen BD, van Hout H, et al. Evaluation of a palliative care program for nursing homes in 7 countries: the PACE cluster-randomized clinical trial. JAMA Intern Med. 2019:1–10.

  19. 19.

    Smets T, Onwuteaka-Philipsen BB, Miranda R, Pivodic L, Tanghe M, van Hout H, et al. Integrating palliative care in long-term care facilities across Europe (PACE): protocol of a cluster randomized controlled trial of the ‘PACE Steps to Success’ intervention in seven countries. BMC Palliative Care. 2018;17(1):47.

    PubMed  PubMed Central  Google Scholar 

  20. 20.

    Husereau D, Drummond M, Petrou S, Carswell C, Moher D, Greenberg D, et al. Consolidated health economic evaluation reporting standards (CHEERS) statement. Cost Effectiveness and Resource Allocation. 2013;11(1):6.

    PubMed  Google Scholar 

  21. 21.

    Devine A, Taylor SJ, Spencer A, Diaz-Ordaz K, Eldridge S, Underwood M. The agreement between proxy and self-completed EQ-5D for care home residents was better for index scores than individual domains. J Clin Epidemiol. 2014;67(9):1035–43.

    PubMed  PubMed Central  Google Scholar 

  22. 22.

    Robertson S, Cooper C, Hoe J, Hamilton O, Stringer A, Livingston G. Proxy rated quality of life of care home residents with dementia: a systematic review. Int Psychogeriatr. 2017;29(4):569–81.

    PubMed  PubMed Central  Google Scholar 

  23. 23.

    (CBS) CBvdS. 2018 [Available from:].

  24. 24.

    Colón-Emeric C, Toles M, Cary MP, Batchelor-Murphy M, Yap T, Song Y, et al. Sustaining complex interventions in long-term care: a qualitative study of direct care staff and managers. Implement Sci. 2015;11(1):94.

    Google Scholar 

  25. 25.

    EuroQol. EQ-5D 5L | Valuation 2017 [Available from:].

  26. 26.

    Devlin N, Shah K, Feng Y, Mulhern B, van Hout B. Valuing health-related quality of life: an EQ-5D-5L value set for England. Research paper. London: Office of Health Economics; 2016.

    Google Scholar 

  27. 27.

    NICE. Guide to the methods of technology appraisal 2013. National Institute for Health and Care Excellence; 2013 4 april 2013.

  28. 28.

    ZiNL. Richtlijn voor het uitvoeren van economische evaluaties in de gezondheidszorg. Zorginstituut Nederland; 2015 17 november 2015. Contract No.: 2015026324.

  29. 29.

    Wichmann AB, Adang EM, Stalmeier PF, Kristanti S, Van den Block L, Vernooij-Dassen MJ, et al. The use of quality-adjusted life years in cost-effectiveness analyses in palliative care: mapping the debate through an integrative review. Palliat Med. 2017;0269216316689652.

  30. 30.

    van Soest-Poortvliet MC, van der Steen JT, Zimmerman S, Cohen LW, Klapwijk MS, Bezemer M, et al. Psychometric properties of instruments to measure the quality of end-of-life care and dying for long-term care residents with dementia. Qual Life Res. 2012;21(4):671–84.

    PubMed  Google Scholar 

  31. 31.

    Hoch JS, Briggs AH, Willan AR. Something old, something new, something borrowed, something blue: a framework for the marriage of health econometrics and cost-effectiveness analysis. Health Econ. 2002;11(5):415–30.

    PubMed  Google Scholar 

  32. 32.

    Barber JA, Thompson SG. Analysis of cost data in randomized trials: an application of the non-parametric bootstrap. Stat Med. 2000;19(23):3219–36.

    CAS  PubMed  Google Scholar 

  33. 33.

    Boyer F, Novella JL, Morrone I, Jolly D, Blanchard F. Agreement between dementia patient report and proxy reports using the Nottingham Health Profile. Int J Geriatr Psychiatry. 2004;19(11):1026–34.

    CAS  PubMed  Google Scholar 

  34. 34.

    Sneeuw K, Aaronson N, Sprangers M, Detmar S, Wever L, Schornagel J. Evaluating the quality of life of cancer patients: assessments by patients, significant others, physicians and nurses. Br J Cancer. 1999;81(1):87–94.

    CAS  PubMed  PubMed Central  Google Scholar 

  35. 35.

    Brinkman-Stoppelenburg A, Rietjens JA, van der Heide A. The effects of advance care planning on end-of-life care: a systematic review. Palliat Med. 2014;28(8):1000–25.

    PubMed  Google Scholar 

  36. 36.

    Martin RS, Hayes B, Gregorevic K, Lim WK. The effects of advance care planning interventions on nursing home residents: a systematic review. J Am Med Dir Assoc. 2016;17(4):284–93.

    PubMed  Google Scholar 

  37. 37.

    Higginson IJ, Sen-Gupta G. Place of care in advanced cancer: a qualitative systematic literature review of patient preferences. J Palliat Med. 2000;3(3):287–300.

    CAS  PubMed  Google Scholar 

  38. 38.

    Steinhauser KE, Christakis NA, Clipp EC, McNeilly M, McIntyre L, Tulsky JA. Factors considered important at the end of life by patients, family, physicians, and other care providers. JAMA. 2000;284(19):2476–82.

    CAS  PubMed  Google Scholar 

  39. 39.

    Zhang B, Wright AA, Huskamp HA, Nilsson ME, Maciejewski ML, Earle CC, et al. Health care costs in the last week of life: associations with end-of-life conversations. Arch Intern Med. 2009;169(5):480–8.

    PubMed  PubMed Central  Google Scholar 

  40. 40.

    French EB, McCauley J, Aragon M, Bakx P, Chalkley M, Chen SH, et al. End-of-life medical spending in last twelve months of life is lower than previously reported. Health Aff (Millwood). 2017;36(7):1211–7.

    Google Scholar 

  41. 41.

    van Soest-Poortvliet MC, van der Steen JT, Zimmerman S, Cohen LW, Munn J, Achterberg WP, et al. Measuring the quality of dying and quality of care when dying in long-term care settings: a qualitative content analysis of available instruments. J Pain Symptom Manag. 2011;42(6):852–63.

    Google Scholar 

  42. 42.

    Kavalieratos D, Corbelli J, Zhang D, Dionne-Odom JN, Ernecoff NC, Hanmer J, et al. Association between palliative care and patient and caregiver outcomes: a systematic review and meta-analysis. JAMA. 2016;316(20):2104–14.

    PubMed  PubMed Central  Google Scholar 

  43. 43.

    Johnston BM, Normand C, May P. Economics of palliative care: measuring the full value of an intervention. Mary Ann Liebert, Inc. 140 Huguenot Street, 3rd Floor New Rochelle, NY 10801 USA; 2016.

  44. 44.

    Temel JS, Greer JA, Muzikansky A, Gallagher ER, Admane S, Jackson VA, et al. Early palliative care for patients with metastatic non–small-cell lung cancer. N Engl J Med. 2010;363(8):733–42.

    CAS  PubMed  Google Scholar 

  45. 45.

    Greer JA, Tramontano AC, McMahon PM, Pirl WF, Jackson VA, El-Jawahri A, et al. Cost analysis of a randomized trial of early palliative care in patients with metastatic nonsmall-cell lung cancer. J Palliative Med. 2016;19(8):842-8.

  46. 46.

    Langton JM, Blanch B, Drew AK, Haas M, Ingham JM, Pearson S-A. Retrospective studies of end-of-life resource utilization and costs in cancer care using health administrative data: a systematic review. Palliat Med. 2014;28(10):1167–96.

    PubMed  Google Scholar 

  47. 47.

    Haun MW, Estel S, Ruecker G, Friederich H-C, Villalobos M, Thomas M, et al. Early palliative care for adults with advanced cancer. Cochrane Database Syst Reviews. 2017;6:CD011129-CD.

  48. 48.

    Norman R, Cronin P, Viney R, King M, Street D, Ratcliffe J. International comparisons in valuing EQ-5D health states: a review and analysis. Value Health. 2009;12(8):1194–200.

    PubMed  Google Scholar 

  49. 49.

    NICE. Position statement on use of the EQ-5D-5L value set for England 2019 [Available from:].

  50. 50.

    Alava MH, Wailoo A, Grimm S, Pudney S, Gomes M, Sadique Z, et al. EQ-5D-5L versus EQ-5D-3L: the impact on cost effectiveness in the United Kingdom. Value Health. 2018;21(1):49–56.

    Google Scholar 

  51. 51.

    Alava MH, Pudney S, Wailoo A. The EQ-5D-5L value set for England: findings of a quality assurance program. Value Health. 2020;23(5):642-8.

  52. 52.

    Vandervoort A, Van den Block L, van der Steen JT, Volicer L, Vander Stichele R, Houttekier D, et al. Nursing home residents dying with dementia in Flanders, Belgium: a nationwide postmortem study on clinical characteristics and quality of dying. J Am Med Dir Assoc. 2013;14(7):485–92.

    PubMed  Google Scholar 

  53. 53.

    van der Steen JT, Ribbe MW, Deliens L, Gutschow G, Onwuteaka-Philipsen BD. Retrospective and prospective data collection compared in the Dutch End of Life in Dementia (DEOLD) study. Alzheimer Dis Assoc Disord. 2014;28(1):88–94.

    PubMed  Google Scholar 

  54. 54.

    Van den Block L, Deschepper R, Bossuyt N, Drieskens K, Bauwens S, Van Casteren V, et al. Care for patients in the last months of life: the Belgian Sentinel Network Monitoring End-of-Life Care study. Arch Intern Med. 2008;168(16):1747–54.

    PubMed  Google Scholar 

  55. 55.

    O’Sullivan R, Murphy A, O’Caoimh R, Cornally N, Svendrovski A, Daly B, et al. Economic (gross cost) analysis of systematically implementing a programme of advance care planning in three Irish nursing homes. BMC research notes. 2016;9(1):237.

    PubMed  PubMed Central  Google Scholar 

  56. 56.

    Coast J, Smith R, Lorgelly P. Should the capability approach be applied in health economics? Health Econ. 2008;17(6):667–70.

    PubMed  Google Scholar 

  57. 57.

    Sutton EJ, Coast J. Development of a supportive care measure for economic evaluation of end-of-life care using qualitative methods. Palliat Med. 2014;28(2):151–7.

    PubMed  Google Scholar 

Download references


We thank all LTCFs and their staff for participating in this project, as well as all physicians and relatives. Other PACE collaborators not in the author list: Paula Andreasen, MSc; Ilona Barańska, MSc; Catherine Bassal, PhD; Danni Collingridge Moore, MSc; Harriet Finne-Soveri, MD, PhD; Katherine Froggatt, PhD; Teija Hammar, PhD; Rauha Heikkilä, MSc; Jo Hockley, PhD; Elisabeth Honinx, MSc; Hein van Hout, PhD; Violetta Kijowska, Msc; Maud Ten Koppel, MSc; Outi Kuitunen-Kaija, MSc; Suvi Leppäaho, MSc; Federica Mammarella, MD, PhD; Martina Mercuri, MSc; Rose Miranda, MSc; Emilie Morgan de Paula, Msc; Nele Van Den Noortgate, PhD; Mariska Oosterveld-Vlug, PhD; Agnieszka Pac, PhD; H. Roeline W. Pasman, PhD; Sophie Pautex, PhD; Sheila Payne, PhD; Ruth Piers, PhD; Lara Pivodic, PhD; Paola Rossi, MSc; Katarzyna Szczerbińska, PhD; Ivan Segat, Msc; Jenny T. van der Steen, PhD; Agata Stodolska, Msc; Marc Tanghe, MSc.

Palliative Care for Older People in Care and Nursing Homes in Europe (PACE). An EU-funded FP7 international research project. In collaboration with Age Platform Europe, Alzheimer Europe, the European Association for Palliative Care and the European Forum for Primary Care.


EU 7th FP, grant agreement 6031111.

Author information





Study concept and design: Wichmann, Adang, Engels, Vissers, Vernooij, Van den Block. Acquisition, analysis, or interpretation of data: Van den Block, Onwuteaka-Philipsen, Engels, Vernooij-Dassen, Froggatt, Szczerbińska, Kylänen, Gambassi, Smets. Drafting of the manuscript: Wichmann, Adang, Engels. Critical revision of the manuscript for important intellectual content: all authors. Statistical analysis: Wichmann, Adang, Van den Block, Smets. Obtained funding: Van den Block, Engels, Froggatt, Szczerbińska, Pautex, Deliens. Administrative, technical or material support: Wichmann, Adang. Study supervision: Adang, Vissers, Engels, Vernooij-Dassen, Van den Block. All authors read and approved the manuscript.

Corresponding author

Correspondence to Anne B. Wichmann.

Ethics declarations

Ethics approval and consent to participate

Respondents gave informed consent in writing prior to filling in questionnaires. In Poland and the Netherlands, this was not required, as questionnaires were filled in anonymously. Ethics approval was obtained from relevant IRB’s in all countries [19].

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1 Fig. S1:

Flowchart PACE cluster RCT.

Additional file 2 Table S1.

Care units tariffs used. Fig. S2. Calculation mean intervention costs.

Additional file 3 Table S2.

Cost differences per care cluster.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Wichmann, A.B., Adang, E.M.M., Vissers, K.C.P. et al. Decreased costs and retained QoL due to the ‘PACE Steps to Success’ intervention in LTCFs: cost-effectiveness analysis of a randomized controlled trial. BMC Med 18, 258 (2020).

Download citation


  • Cost-benefit analysis
  • Palliative care
  • Nursing homes
  • Teaching