Although comprehensive school-based physical activity interventions are efficacious when tested under research conditions, they often require adaptation in order for implementation at scale. This ...paper reports the effectiveness of an adapted efficacious school-based intervention in improving children’s moderate to vigorous physical activity. The impact of strategies to support program implementation was also assessed.
A cluster RCT of low socioeconomic elementary schools in New South Wales, Australia.
Consenting schools were randomized (25 intervention, 21 control) using a computerized random number function. Follow-up measures were taken at 6 months post-randomization (May–August 2015) by blinded research assistants. The multicomponent school-based intervention, based on an efficacious school-based physical activity program (Supporting Children’s Outcomes using Rewards, Exercise and Skills), consisted of four physical activity strategies and seven implementation support strategies. The intervention was adapted for scalability and delivery by a local health service over 6 months. The primary outcome was accelerometer assessed, student mean daily minutes spent in moderate to vigorous physical activity. Physical education lesson quality and other school physical activity practices were also assessed.
Participants (n=1,139, 49% male) were third- through sixth-grade students at follow-up (May–August 2015). Valid wear time and analysis of data were provided for 989 (86%) participants (571 intervention, 568 control). At 6-month follow-up, there were no significant effects in overall daily minutes of moderate to vigorous physical activity between groups (1.96 minutes, 95% CI= –3.49, 7.41, p=0.48). However, adjusted difference in mean minutes of overall vigorous physical activity (2.19, 95% CI=0.06, 4.32, p=0.04); mean minutes of school day moderate to vigorous physical activity (2.90, 95% CI=0.06, 5.85, p=0.05); and mean minutes of school day vigorous physical activity (1.81, 95% CI=0.78, 2.83, p≤0.01) were significantly different in favor of the intervention group. Physical education lesson quality and school physical activity practices were significantly different favoring the intervention group (analyzed October 2015–January 2016).
The modified intervention was not effective in increasing children’s overall daily minutes of moderate to vigorous physical activity, when adapted for implementation at scale. However, the intervention did improve daily minutes of vigorous physical activity and school day moderate to vigorous physical activity, lesson quality, and school physical activity practices.
Australian New Zealand Clinical Trials Registry: ACTRN12615000437561.
To maximise their potential health benefits, school-based physical activity policies need to be implemented at scale. This paper describes the third in a sequence of trials that sought to optimise an ...effective strategy (PACE) to assist schools' implementation of a physical activity policy. Specifically, it aimed to determine the probability that a multi-strategy intervention adapted to reduce in-person contact (Adapted PACE) was "as good as" the original intervention (PACE) in increasing the weekly minutes of structured physical activity implemented by classroom teachers. A noninferiority cluster randomised controlled trial was undertaken with 48 primary schools in New South Wales, Australia. Schools were randomised to receive PACE or a model with adaptations made to the delivery modes (Adapted PACE). Teachers' scheduled minutes of weekly physical activity was assessed at baseline (Oct 2018-Feb 2019) and 12-month follow-up (Oct-Dec 2019). The noninferiority margin was set at - 16.4 minutes based on previous data and decision panel consensus. A linear mixed model analysed within a Bayesian framework was used to explore noninferiority between the two PACE models. A cost minimisation analysis was conducted from the health service provider perspective, using the Australian dollar (AUD). The posterior estimate for the between group difference at follow-up was - 2.3 minutes (95% credible interval = - 18.02, 14.45 minutes). There was an estimated 96% probability of Adapted PACE being considered noninferior (only 4% of the posterior samples crossed the noninferiority margin of - 16.4 minutes). That is, the minutes of physical activity implemented by teachers at Adapted PACE schools was not meaningfully less than the minutes of physical activity implemented by teachers at PACE schools. The mean total cost was AUD$25,375 (95% uncertainty interval = $21,499, $29,106) for PACE and AUD$16,421 (95% uncertainty interval = $13,974, $19,656) for Adapted PACE; an estimated reduction of AUD$373 (95% uncertainty interval = $173, $560) per school. It is highly probable that Adapted PACE is noninferior to the original model. It is a cost-efficient alternative also likely to be a more suitable approach to supporting large scale implementation of school physical activity policies.
Abstract
Background
Audit and feedback (A&F) is a widely used implementation strategy to influence health professionals’ behavior that is often tested in implementation trials. This study examines ...how A&F trials describe sustainability, spread, and scale.
Methods
This is a theory-informed, descriptive, secondary analysis of an update of the Cochrane systematic review of A&F trials, including all trials published since 2011. Keyword searches related to sustainability, spread, and scale were conducted. Trials with at least one keyword, and those identified from a forward citation search, were extracted to examine how they described sustainability, spread, and scale. Results were qualitatively analyzed using the Integrated Sustainability Framework (ISF) and the Framework for Going to Full Scale (FGFS).
Results
From the larger review,
n
= 161 studies met eligibility criteria. Seventy-eight percent (
n
= 126) of trials included at least one keyword on sustainability, and 49% (
n
= 62) of those studies (39% overall) frequently mentioned sustainability based on inclusion of relevant text in multiple sections of the paper. For spread/scale, 62% (
n
= 100) of trials included at least one relevant keyword and 51% (
n
= 51) of those studies (31% overall) frequently mentioned spread/scale. A total of
n
= 38 studies from the forward citation search were included in the qualitative analysis. Although many studies mentioned the need to consider sustainability, there was limited detail on how this was planned, implemented, or assessed. The most frequent sustainability period duration was 12 months. Qualitative results mapped to the ISF, but not all determinants were represented. Strong alignment was found with the FGFS for phases of scale-up and support systems (infrastructure), but not for adoption mechanisms. New spread/scale themes included (1) aligning affordability and scalability; (2) balancing fidelity and scalability; and (3) balancing effect size and scalability.
Conclusion
A&F trials should plan for sustainability, spread, and scale so that if the trial is effective, the benefits can continue. A deeper empirical understanding of the factors impacting A&F sustainability is needed. Scalability planning should go beyond cost and infrastructure to consider other adoption mechanisms, such as leadership, policy, and communication, that may support further scalability.
Trial registration
Registered with Prospero in May 2022. CRD42022332606.
To assess the effectiveness of lunchbox interventions aiming to improve the foods and beverages packed and consumed by children at centre-based care or school; and subsequent impact on children's ...adiposity.
Systematic search of nine databases for controlled trials published in English between 1995-January 2017. Where appropriate, data were pooled in a random effects meta-analysis.
Of the 1601 articles identified, ten studies (centre-based care n = 4, school n = 6) were included of which eight were RCTs. The impact of interventions on the packing of discretionary foods, sugar-sweetened drinks and other core foods was inconsistent. Meta-analysis of four RCTs trials found a moderate increase in provision of vegetables (SMD = 0.40 95% CI 0.16 to 0.64, p = 0.001, I
= 82%; equivalent to a mean difference of 0.28 serves) but not fruit. Four studies reported impact on children's dietary intake, one reported no significant effect on consumption of discretionary foods, one reported improvements in the consumption of sugar-sweetened drinks and water, and two reported improvements in consumption of vegetables and fruit. Two studies, that were broader obesity prevention interventions, reported no significant impact on adiposity.
There is some evidence that lunchbox interventions are effective in improving the packing of vegetables in children's lunchboxes, however more robust research is required to determine the impact on children's dietary intake and adiposity.
PROSPERO 2016: CRD42016035646 .
Abstract
Background
We aimed to: (1) identify school-level factors associated with the sustainment of weekly physical activity (PA) scheduled in elementary schools following withdrawal of effective ...implementation support; and (2) determine teacher’s perceived usefulness of suggested strategies for sustaining the scheduling of weekly PA.
Methods
A secondary exploratory analysis was employed of data from the intervention arm (
n
= 31 schools) of a randomised controlled trial. Self-report survey data from 134 classroom teachers in New South Wales, Australia, collected following withdrawal of initial implementation support (follow-up T1) and six-months following completion of support (follow-up T2) were used. The outcomes of sustainment of weekly overall PA and energisers (short classroom PA breaks) scheduled were measured via teachers’ completion of a daily activity logbook, with results presented as the difference in mean minutes of PA and energisers scheduled at T1 and T2. An adapted version of the Program Sustainability Assessment Tool (PSAT) was used to measure capacity for program sustainability across seven key domains at follow-up T2. Linear mixed regressions were conducted to evaluate associations between school-level sociodemographic characteristics (e.g., school size, remoteness, and type), teacher-reported school factors (i.e., seven adapted PSAT domains) and the sustainment of PA and energisers scheduled across the school week. Perceived usefulness of 14 proposed sustainability strategies was measured via the teacher survey at follow-up T2 and reported descriptively.
Results
No school-level factor was statistically associated with the sustainment of overall weekly PA or energisers scheduled. Teacher-reported factors in two PSAT domains – ‘strategic planning’ and ‘program evaluation’ were statistically negatively associated with the sustainment of weekly energisers scheduled (− 6.74, 95% CI: − 13.02; − 0.47,
p
= 0.036 and − 6.65, 95% CI: − 12.17; − 1.12,
p
= 0.019 respectively). The proposed support sustainability strategy – ‘provision of PA equipment packs that enable energisers or integrated lessons’ was perceived useful by the most teachers (85%).
Conclusions
Further research is required to explore additional contextual-specific, and end-user appropriate factors associated with schools’ sustainment of weekly PA scheduled. This will help accurately inform the development of strategies to address these determinants and support the sustainment and long-term benefits of school-based health interventions more broadly.
Increased outdoor play time in young children is associated with many health and developmental benefits. This study aims to evaluate the impact of a multi-strategy implementation strategy delivered ...at scale, to increase opportunities for outdoor free play in Early Childhood Education and Care (ECEC) services.
The study will employ a parallel-group randomised controlled trial design. One hundred ECEC services in the Hunter New England region of New South Wales, Australia, will be recruited and randomised to receive either a 6-month implementation strategy or usual care. The trial will seek to increase the implementation of an indoor-outdoor routine (whereby children are allowed to move freely between indoor and outdoor spaces during periods of free play), to increase their opportunity to engage in outdoor free play. Development of the strategy was informed by the Behaviour Change Wheel to address determinants identified in the Theoretical Domains Framework. ECEC services allocated to the control group will receive 'usual' implementation support delivered as part of state-wide obesity prevention programs. The primary trial outcome is the mean minutes/day (calculated across 5 consecutive days) of outdoor free play opportunities provided in ECEC services measured at baseline, 6-months (primary end point) and 18-months post baseline. Analyses will be performed using an intention-to-treat approach with ECEC services as the unit of analysis, using a linear mixed effects regression model to assess between-group differences. A sensitivity analysis will be undertaken, adjusting for service characteristics that appear imbalanced between groups at baseline, and a subgroup analysis examining potential intervention effect among services with the lowest baseline outdoor free play opportunities.
Identifying effective strategies to support the implementation of indoor-outdoor routines in the ECEC setting at scale is essential to improve child population health.
Australian New Zealand Clinical Trials Registry ( ACTRN12621000987864 ). Prospectively registered 27th July 2021, ANZCTR - Registration.
Population health prevention programmes are needed to reduce the prevalence of chronic diseases. Nevertheless, sustaining programmes at a population level is challenging. Population health is highly ...influenced by social, economic and political environments and is vulnerable to these system-level changes. The aim of this research was to examine the factors and mechanisms contributing to the sustainment of population prevention programmes taking a systems thinking approach.
We conducted a qualitative study through interviews with population health experts working within Australian government and non-government agencies experienced in sustaining public health programs at the local, state or national level (n = 13). We used a deductive thematic approach, grounded in systems thinking to analyse data.
We identified four key barriers affecting program sustainment: 1) short term political and funding cycles; 2) competing interests; 3) silo thinking within health service delivery; and 4) the fit of a program to population needs. To overcome these barriers various approaches have centred on the importance of long-range planning and resourcing, flexible program design and management, leadership and partnerships, evidence generation, and system support structures.
This study provides key insights for overcoming challenges to the sustainment of population health programmes amidst complex system-wide changes.
Internationally, the implementation of evidence-based healthy eating policies and practices within early childhood education and care (ECEC) settings that encourage children's healthy diet is ...recommended. Despite the existence of evidence-based healthy eating practices, research indicates that current implementation rates are inadequate. Web-based approaches provide a potentially effective and less costly approach to support ECEC staff with implementing nutrition policies and practices.
The broad aim of this pilot randomized controlled trial is to assess the feasibility of assessing the impact of a web-based program together with health promotion officer (HPO) support on ECEC center implementation of healthy eating policies and practices. Specifically, we seek to describe the completion rate of study evaluation processes (participant consent and data collection rates); examine ECEC center uptake, acceptability, and appropriateness of the intervention and implementation strategies; understand the potential cost of delivering and receiving implementation support strategies; and describe the potential impact of the web-based intervention on the implementation of targeted healthy eating practices among centers in the intervention group.
A 6-month pilot implementation trial using a cluster-randomized controlled trial design was conducted in 22 ECEC centers within the Hunter New England region of New South Wales, Australia. Potentially eligible centers were distributed a recruitment package and telephoned by the research team to assess eligibility and obtain consent. Centers randomly allocated to the intervention group received access to a web-based program, together with HPO support (eg, educational outreach visit and local technical assistance) to implement 5 healthy eating practices. The web-based program incorporated audit with feedback, development of formal implementation blueprints, and educational materials to facilitate improvement in implementation. The centers allocated to the control group received the usual care.
Of the 57 centers approached for the study, 22 (47%) provided consent to participate. Data collection components were completed by 100% (22/22) of the centers. High uptake for implementation strategies provided by HPOs (10/11, 91% to 11/11, 100%) and the web-based program (11/11, 100%) was observed. At follow-up, intervention centers had logged on to the program at an average of 5.18 (SD 2.52) times. The web-based program and implementation support strategies were highly acceptable (10/11, 91% to 11/11, 100%). Implementation of 4 healthy eating practices improved in the intervention group, ranging from 19% (2/11) to 64% (7/11).
This study provides promising pilot data to warrant the conduct of a fully powered implementation trial to assess the impact of the program on ECEC healthy eating practice implementation.
Australian New Zealand Clinical Trials Registry (ANZCTR) ACTRN12619001158156; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=378099.
RR2-10.1186/s40814-020-00707-w.
Physically Active Children in Education (PACE) is composed of eight implementation strategies that improves schools' implementation of a government physical activity policy. A greater understanding ...of each discrete implementation strategy could inform improvements to PACE for delivery at-scale. This study aimed to: (A) measure the dose delivered, fidelity, adoption and acceptability of each strategy using quantitative data; (B) identify implementation barriers and facilitators using qualitative data; and (C) explore the importance of each strategy by integrating both data sets (mixed methods).
This study used data from a cluster randomised noninferiority trial comparing PACE with an adapted version (Adapted PACE) that was delivered with reduced in-person external support to reduce costs and increase scalability. Data were collected from both trials arms for between-group comparison. Descriptive statistics were produced using surveys of principals, in-school champions and teachers; and project records maintained by PACE project officers (objective A). Thematic analysis was performed using in-school champion and project officer interviews (objective B). Both data sets were integrated via a triangulation protocol and findings synthesized in the form of meta-inferences (objective C).
Eleven in-school champions and six project officers completed interviews; 33 principals, 51 in-school champions and 260 teachers completed surveys. Regardless of group allocation, implementation indicators were high for at least one component of each strategy: dose delivered =100%, fidelity ≥95%, adoption ≥83%, acceptability ≥50%; and several implementation barriers and facilitators were identified within three broad categories: external policy landscape, inner organizational structure/context of schools, and intervention characteristics and processes. All strategies were considered important as use varied by school, however support from a school executive and in-school champions' interest were suggested as especially important for optimal implementation.
This study highlights the importance of both executive support and in-school champions for successful implementation of school physical activity policies. In particular, identifying and supporting an in-school champion to have high power and high interest is recommended for future implementation strategies. This may reduce the need for intensive external support, thus improving intervention scalability.
Scientific investigation of how to sustain the implementation of evidence-based interventions (EBI) is emerging. Sustaining the implementation of EBIs helps ensure their effects on improving health ...endure. External policy or practice agencies, such as government health departments, are often tasked with supporting individual organisations with sustaining their delivery of EBIs, for example, through financing, training or the provision of other supports. However, to our knowledge, the approaches taken by policy and practice agencies to support the sustainment of EBIs have not been consolidated, categorised and described as a typology.
To improve conceptual clarity and support both research and practice, we developed an initial working typology of the practical approaches to sustain implementation of EBIs (i.e. sustainment) in order to improve long term health from the perspective of these agencies. The working typology includes three broad approaches. The first, termed 'Self-Sustainment', is when implementation of the EBI by an organisation (e.g. hospital, clinic, school) is expected to continue (sustain) in the absence of external (agency) support. The second, termed 'Static Sustainment Support', involves the provision of pre-defined external (agency) support to assist organisations to continue implementation of an EBI. The final approach is termed 'Dynamic Sustainment Support', whereby support provided by an external agency is dynamic (continues to be adapted) overtime to assist organisations continue implementation of an intervention which may itself also evolve.
We describe the contexts and circumstances where each may be most appropriate in achieving sustained implementation and discuss their research and practice implications.
PDF
