Open Access

Stepping Stones Triple P: the importance of putting the findings into context

BMC Medicine201513:25

https://doi.org/10.1186/s12916-014-0260-9

Received: 17 December 2014

Accepted: 17 December 2014

Published: 4 February 2015

Abstract

The Stepping Stones Triple P (SSTP) parenting program is an evidence-based program for parents of children with a disability. A trial of SSTP was recently published in BMC Medicine, which reported results of a randomized controlled trial comparing SSTP to care-as-usual. Although the paper described what should be an important replication trial of SSTP, there are significant shortcomings to the scientific approach of the reporting that need to be addressed. The paper initially cites only a few published SSTP studies and describes evidence for the efficacy of the program as “very scarce”. A meta-analysis of studies evaluating SSTP published prior to submission of this paper was not cited. The results are inconsistent with previous evidence for SSTP, yet the authors provide scant interpretation for this inconsistency. Similarly, the unusually high dropout rate of 49% was not adequately explained. The claims that previous research has only been conducted by the developers, has not included children with intellectual disability, and has not used care-as-usual comparison groups, are inaccurate. This commentary explores these issues further in order to place the findings from the recent trial into context.

Please see related article: http://www.biomedcentral.com/1741-7015/12/191.

Keywords

Commentary Evidence Stepping Stones Triple P

Background

Stepping Stones Triple P (SSTP) is an evidence-based parenting program for parents of a child with a disability. The system of programs available includes brief “light touch” versions as well as more intensive group and individual programs. All programs have been subjected to evaluation in randomized controlled trials (RCTs). Kleefman, Jansen, Stewart, and Reijneveld recently published a paper in this journal describing an RCT evaluating the SSTP in a population of parents of children with borderline to mild intellectual disability in the Netherlands [1]. The authors should be applauded for conducting an independent replication trial of an existing parenting program within a specific population, and in a new country. However, there are some important concerns to be raised about this paper. Firstly, the authors present a rationale for conducting the study that does not accurately represent the current state of evidence for SSTP. Secondly, the authors present an impoverished interpretation of the findings within the paper. The lack of long term effects and very high dropout rate were inconsistent with previous SSTP trials, and require proper consideration. This commentary addresses the misrepresentation of the evidence base for SSTP and highlights concerns around the interpretation of findings reported in this recent trial.

Representation of evidence for SSTP

The authors describe the previous research on SSTP as being ‘weak’ or ‘very scarce’, stating: “Although SSTP seems promising, evidence of its effectiveness is very scarce” [1]. While the authors use the term ‘effectiveness’ in this sentence, they seem to be referring instead to efficacy research and therefore this comment will be interpreted accordingly. The authors reference only four RCTs evaluating the efficacy of SSTP programs and one uncontrolled study. At the time of submission, there were numerous other published and unpublished trials. A more accurate representation of the current evidence base would have cited the SSTP meta-analysis published in 2013, which included 12 studies combining data from 659 families [2]. Figure 1 displays a summary of the effect sizes from the SSTP meta-analysis [2] on child problem data for the different levels of SSTP interventions. In total, there have been nine published RCTs evaluating SSTP, and only four of these were selected for citation. According to standard guidelines, two rigorous RCTs with significant short- and long-term effects are needed for an intervention to be considered efficacious [3]. It is clear that SSTP meets the criteria for an efficacious intervention, and to describe the evidence as ‘very scarce’ is a significant misrepresentation.
Figure 1

Effect sizes for different levels of SSTP interventions based on data from the SSTP meta-analysis [ 2 ] . d, standardized difference effect size; n, number of trials; SSTP, Stepping Stones Triple P-Positive Parenting Program.

In further descriptions of SSTP evidence, the authors state that “the Australian developers were involved in all the effectiveness studies” [1]. However, the authors fail to acknowledge that it is typical in intervention research for initial efficacy trials to be developer led, followed by further replication trials led by independent researchers. This is the case for SSTP, with replication trials conducted independently in Australia [4], Japan [5], Germany [6-9], and Canada [10]. The authors made a series of further incorrect assertions: that previous research did not include children with borderline to mild intellectual disability, when trials have included parents of children with intellectual disability (e.g., [11-14]); that previous studies did not compare effects with a care-as-usual (CAU) group, when trials have been conducted with CAU comparisons [4,15]; and that previous studies had small sample sizes when the majority of trials used power analyses to determine appropriate sample sizes.

Interpretation of findings

The authors reported that, while there were some short-term effects for the intervention, there were no long-term effects for SSTP compared to CAU. This is inconsistent with the results of previous research on SSTP [2,4-9,11-15]; however, the authors make little attempt to explain this inconsistency. For example, an examination of the mean scores on the measures suggests that the lack of long-term effects might be explained by parents in the CAU group continuing to improve over the follow-up period. In contrast, the parents in the intervention group maintained improvements that were seen at short-term; hence, both groups show some improvement. It would not be surprising that parents in the CAU group continued to improve given the large number of parents who received parenting support in that condition. Further exploration of these results could suggest a different interpretation of the effectiveness of the intervention.

The study had an unusually high dropout rate of 49% in the SSTP group. This dropout rate is considerably higher than previous RCTs on SSTP. The average rate of attrition in the intervention group from available data in 11 studies in the SSTP meta-analysis was 13.7% [2]. The authors do not attempt to explain why the dropout rate is much higher in this study except to suggest that the intervention may not fit this population. There is little explanation of why this should be the case or in what respects these families differ from families who have participated in other evaluations of SSTP. Moreover, there was no information provided on fidelity or program adherence for those who did participate, which is standard protocol in intervention research.

It is reported that 34 participants “did not start the intervention after the intake” [1], and of the 54 parents that did not complete at least five sessions of SSTP, 46% started another parenting intervention. The main reasons for dropout included starting a comparable parenting support intervention, expectations that the intervention would be too intensive, lack of time, or parents’ non-recognition of child’s psychosocial problems. These reported reasons lead the reader to question the appropriateness of offering this intervention to this population in the way that it was done. The authors provide inadequate information about randomization other than to say that families were blind to condition. What were families told about the programs that they might receive and how were families prepared for an intervention? SSTP is a system of interventions and it could well have been more appropriate to offer some parents a lower intensity level of intervention (such as a Level 2 SSTP parenting seminar, or one or more Level 3 SSTP brief individual consultation sessions [16,17]).

Conclusions

The results from the recent SSTP trial reported in BMC Medicine need to be interpreted in the context of the issues identified with reporting. The recent SSTP trial provided a misrepresentation of the current evidence base for SSTP and failed to fully explore the reasons for the inconsistency of the findings with previous research. It is imperative that future trials of SSTP are conducted following clear and transparent protocols, providing fidelity reports of program delivery, and managing the issue of dropout that seems to have befallen this trial.

In the interests of maintaining scientific integrity, it is also important to acknowledge that a null finding requires replication to the same extent as a positive finding.

Abbreviations

CAU: 

Care-as-usual

RCT: 

Randomized controlled trial

SSTP: 

Stepping Stones Triple P

Declarations

Authors’ Affiliations

(1)
Parenting and Family Support Centre, The University of Queensland
(2)
School of Psychology, The University of Queensland

References

  1. Kleefman M, Jansen DEMC, Stewart RE, Reijneveld SA. The effectiveness of Stepping Stones Triple P parenting support in parents of children with borderline to mild intellectual disability and psychosocial problems: a randomised controlled trial. BMC Med. 2014;12:191.PubMed CentralPubMedView ArticleGoogle Scholar
  2. Tellegen CL, Sanders MR. Stepping Stones Triple P-Positive Parenting Program for children with disability: a systematic review and meta-analysis. Res Dev Disabil. 2013;34:1556–71.PubMedView ArticleGoogle Scholar
  3. Flay BR, Biglan A, Boruch RF, Castro FG, Gottfredson D, Kellam S, et al. Standards of evidence: criteria for efficacy, effectiveness and dissemination. Prev Sci. 2005;6:151–75.PubMedView ArticleGoogle Scholar
  4. Brown FL, Whittingham K, Boyd RN, McKinlay L, Sofronoff K. Improving child and parent outcomes following paediatric acquired brain injury: a randomised controlled trial of Stepping Stones Triple P plus Acceptance and Commitment Therapy. J Child Psychol Psychiatr. 2014;55:1172–83.View ArticleGoogle Scholar
  5. Yanagawa T, Hirao K, Kato N, Ueno M, Kitano N, Iemoto M, et al. Implementation of Stepping Stones Triple P (Positive Parenting Program) with parents of a child with an autism spectrum disorder. Japanese J Child Abuse Negl. 2012;14:135–52.Google Scholar
  6. Hasmann R, Schaadt AK, Hampel O, Karpinski N, Holl RW, Petermann F. Rehabilitation behinderter kinder und deren eltern mit Stepping Stones Triple P: Welche therapieeffekte haben einfluss auf die subjective behandlungszufriedenheit? Monatsschr Kinderheilkd. 2012;160:146–54.View ArticleGoogle Scholar
  7. Hasmann SE, Hampel OA, Schaadt AK, Bohm R, Engler-Plorer S, Mundt D, et al. Psychosoziale aspekte bei motorischen behinderungen: Wie profitieren familien mit verschiedenartig behinderten kindern von einem elterngruppentraining? Monatsschr Kinderheilkd. 2010;158:463–70.View ArticleGoogle Scholar
  8. Hampel OA, Schaadt AK, Hasmann SE, Petermann F, Holl R, Hasmann R. Evaluation von Stepping Stones Triple P: Zwischenergebnisse der Stepping-Stones-SPZMulticenterstudie. Klin Padiatr. 2010;222:18–25.PubMedView ArticleGoogle Scholar
  9. Hampel O, Hasmann SE, Schaadt AK, Holl RW, Petermann F, Hasmann R. Effekte des Stepping Stones elterngruppentrainings fur familien mit behinderten kindern. Kindheit und Entwicklung. 2010;19:36–46.View ArticleGoogle Scholar
  10. Hodgetts S, Savage A, McConnell D. Experience and outcomes of stepping stones triple P for families of children with autism. Res Dev Disabil. 2013;34:2572–85.PubMedView ArticleGoogle Scholar
  11. Roux G, Sofronoff K, Sanders MR. A randomized controlled trial of Group Stepping Stones Triple P: a mixed-disability trial. Fam Process. 2013;2013:411–24.View ArticleGoogle Scholar
  12. Sofronoff K, Jahnel D, Sanders MR. Stepping Stones Triple P seminars for parents of a child with a disability: a randomized controlled trial. Res Dev Disabil. 2011;32:2253–62.PubMedView ArticleGoogle Scholar
  13. Whittingham K, Sofronoff K, Sheffield J, Sanders MR. Stepping Stones Triple P: an RCT of a parenting program with parents of a child diagnosed with an autism spectrum disorder. J Abnorm Child Psychol. 2009;37:469–80.PubMedView ArticleGoogle Scholar
  14. Roberts C, Mazzucchelli T, Studman L, Sanders MR. Behavioral family intervention for children with developmental disabilities and behavioral problems. J Clin Child Adolesc Psychol. 2006;2006:180–93.View ArticleGoogle Scholar
  15. Tellegen CL, Sanders MR. A randomised controlled trial of Primary Care Stepping Stones Triple P with parents of children with Autism Spectrum Disorders. J Consult Clin Psychol. 2014;82:1193–200.PubMedView ArticleGoogle Scholar
  16. Mazzucchelli TG, Sanders MR. Preventing behavioural and emotional problems in children who have a developmental disability: a public health approach. Res Dev Disabil. 2011;32:2148–56.PubMedView ArticleGoogle Scholar
  17. Mazzucchelli TG, Sanders MR. Stepping Stones Triple P: a population approach to the promotion of competent parenting of children with disability. In: Parenting Research and Practice Monograph No. 2. Brisbane, Australia: University of Queensland; 2012.Google Scholar

Copyright

© Tellegen and Sofronoff; licensee BioMed Central. 2015

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Advertisement