Many Canadian adolescents and young adults with mental health problems face delayed detection, long waiting lists, poorly accessible services, care of inconsistent quality and abrupt or absent ...inter-service transitions. To address these issues, ACCESS Open Minds, a multi-stakeholder network, is implementing and systematically evaluating a transformation of mental health services for youth aged 11 to 25 at 14 sites across Canada. The transformation plan has five key foci: early identification, rapid access, appropriate care, the elimination of age-based transitions between services, and the engagement of youth and families.
The ACCESS Open Minds Research Protocol has multiple components including a minimum evaluation protocol and a stepped-wedge cluster randomized trial, that are detailed in this paper. Additional components include qualitative methods and cost-effectiveness analyses. The services transformation is being evaluated at all sites via a minimum evaluation protocol. Six sites are participating in the stepped-wedge trial whereby the intervention (a service transformation along the key foci) was rolled out in three waves, each commencing six months apart. Two sites, one high-population and one low-population, were randomly assigned to each of the three waves, i.e., randomization was stratified by population size. Our primary hypotheses pertain to increased referral numbers, and reduced wait times to initial assessment and to the commencement of appropriate care. Secondary hypotheses pertain to simplified pathways to care; improved clinical, functional and subjective outcomes; and increased satisfaction among youth and families. Quantitative measures addressing these hypotheses are being used to determine the effectiveness of the intervention.
Data from our overall research strategy will help test the effectiveness of the ACCESS Open Minds transformation, refine it further, and inform its scale-up. The process by which our research strategy was developed has implications for the practice of research itself in that it highlights the need to actively engage all stakeholder groups and address unique considerations in designing evaluations of complex healthcare interventions in multiple, diverse contexts. Our approach will generate both concrete evidence and nuanced insights, including about the challenges of conducting research in real-world settings. More such innovative approaches are needed to advance youth mental health services research.
Clinicaltrials.gov, ISRCTN23349893 (Retrospectively registered: 16/02/2017).
Camino Verde (the Green Way) is an evidence-based community mobilisation tool for prevention of dengue and other mosquito-borne viral diseases. Its effectiveness was demonstrated in a ...cluster-randomised controlled trial conducted in 2010-2013 in Nicaragua and Mexico. The common approach that brought functional consistency to the Camino Verde intervention in both Mexico and Nicaragua is Socialisation of Evidence for Participatory Action (SEPA). In this article, we explain the SEPA concept and its theoretical origins, giving examples of its previous application in different countries and contexts. We describe how the approach was used in the Camino Verde intervention, with details that show commonalities and differences in the application of the approach in Mexico and Nicaragua. We discuss issues of cost, replicability and sustainability, and comment on which components of the intervention were most important to its success. In complex interventions, multiple components act in synergy to produce change. Among key factors in the success of Camino Verde were the use of community volunteers called brigadistas, the house-to-house visits they conducted, the use of evidence derived from the communities themselves, and community ownership of the undertaking. Communities received the intervention by random assignment; dengue was not necessarily their greatest concern. The very nature of the dengue threat dictated many of the actions that needed to be taken at household and neighbourhood levels to control it. But within these parameters, communities exercised a large degree of control over the intervention and displayed considerable ingenuity in the process.
ISRCTN27581154 .
Fuzzy cognitive mapping (FCM) is a graphic technique to describe causal understanding in a wide range of applications. This practice review summarises the experience of a group of participatory ...research specialists and trainees who used FCM to include stakeholder views in addressing health challenges. From a meeting of the research group, this practice review reports 25 experiences with FCM in nine countries between 2016 and 2023.
The methods, challenges and adjustments focus on participatory research practice. FCM portrayed multiple sources of knowledge: stakeholder knowledge, systematic reviews of literature, and survey data. Methodological advances included techniques to contrast and combine maps from different sources using Bayesian procedures, protocols to enhance the quality of data collection, and tools to facilitate analysis. Summary graphs communicating FCM findings sacrificed detail but facilitated stakeholder discussion of the most important relationships. We used maps not as predictive models but to surface and share perspectives of how change could happen and to inform dialogue. Analysis included simple manual techniques and sophisticated computer-based solutions. A wide range of experience in initiating, drawing, analysing, and communicating the maps illustrates FCM flexibility for different contexts and skill bases.
A strong core procedure can contribute to more robust applications of the technique while adapting FCM for different research settings. Decision-making often involves choices between plausible interventions in a context of uncertainty and multiple possible answers to the same question. FCM offers systematic and traceable ways to document, contrast and sometimes to combine perspectives, incorporating stakeholder experience and causal models to inform decision-making. Different depths of FCM analysis open opportunities for applying the technique in skill-limited settings.
A trial of evidence-based health promotion home visits to pregnant women and their spouses in northern Nigeria found significant improvements in maternal and child health outcomes. This study tested ...the added value for these outcomes of including video edutainment in the visits.
In total, 19,718 households in three randomly allocated intervention wards (administrative areas) received home visits including short videos on android handsets to spark discussion about local risk factors for maternal and child health; 16,751 households in three control wards received visits with only verbal discussion about risk factors. We compared outcomes between wards with and without videos in the visits, calculating the odds ratio (OR) and 95% confidence interval (95%CI) of differences, in bivariate and then multivariate analysis adjusting for socio-economic differences between the video and non-video wards.
Pregnant women from video wards were more likely than those from non-video wards to have discussed pregnancy and childbirth often with their husbands (OR 2.22, 95%CI 1.07-4.59). Male spouses in video wards were more likely to know to give more fluids and continued feeding to a child with diarrhoea (OR 1.61, 95%CI 1.21-2.13). For most outcomes there was no significant difference between video and non-video wards. The home visitors who shared videos considered they helped pregnant women and their spouses to appreciate the information about risk factors.
The lack of added value of the videos in the context of a research study may reflect the intensive training of home visitors and the effective evidence-based discussions included in all the visits. Further research could rollout routine home visits with and without videos and test the impact of video edutainment added to home visits carried out in a routine service context.
The Most Significant Change is a story-based evaluation approach used in many international development programs. This practice review summarises practical experience with the approach in complex ...health interventions in ten countries, with the objective of making it more accessible in evaluation of other complex health interventions.
Participatory research practitioners and trainees discussed five themes following brief presentations by each of the seven attendees who led the exercise: (i) sampling and recruitment; (ii) phrasing the questions to elicit stories; (iii) story collection strategies; (iv) quality assurance; and (v) analysis. Notes taken during the meeting provided the framework for this article. Recruitment strategies in small studies included universal engagement and, in larger studies, a purposive, systematic or random sampling. Meeting attendees recommended careful phrasing and piloting of the question(s) as this affects the quality and focus of the stories generated. They stressed the importance of careful training and monitoring of fieldworkers collecting stories to ensure full stories are elicited and recorded. For recording, in most settings they preferred note taking with back-checking or self-writing of stories by story tellers, rather than audio-recording. Analysis can combine participatory selection of a small number of stories, deductive or inductive thematic analysis and discourse analysis. Meeting attendees noted that involvement in collection of the stories and their analysis and discussion had a positive impact for research team members.
Our review confirms the plasticity, feasibility and acceptability of the Most Significant Change technique across different sociopolitical, cultural and environmental contexts of complex interventions. Although the approach can surface unexpected impacts, it is not a 360-degree evaluation. Its strength lies in characterising the changes, where these happen, in the words of the beneficiaries. We hope this distillation of our practice makes the technique more readily available to health sector researchers.
Evaluation of mine risk education in Afghanistan used population weighted raster maps as an evaluation tool to assess mine education performance, coverage and costs. A stratified last-stage random ...cluster sample produced representative data on mine risk and exposure to education. Clusters were weighted by the population they represented, rather than the land area. A "friction surface" hooked the population weight into interpolation of cluster-specific indicators. The resulting population weighted raster contours offer a model of the population effects of landmine risks and risk education. Five indicator levels ordered the evidence from simple description of the population-weighted indicators (level 0), through risk analysis (levels 1-3) to modelling programme investment and local variations (level 4). Using graphic overlay techniques, it was possible to metamorphose the map, portraying the prediction of what might happen over time, based on the causality models developed in the epidemiological analysis. Based on a lattice of local site-specific predictions, each cluster being a small universe, the "average" prediction was immediately interpretable without losing the spatial complexity.
Dengue vector entomological indices are widely used to monitor vector density and disease control activities. But the value of these indices as predictors of dengue infection is not established. We ...used data from the impact assessment of a trial of community mobilization for dengue prevention (Camino Verde) to examine the associations between vector indices and evidence of dengue infection and their value for predicting dengue infection levels. In 150 clusters in Mexico and Nicaragua, two entomological surveys, three months apart, allowed calculation of the mean Container Index, Breteau index, Pupae per Household Index, and Pupae per Container Index across the two surveys. We measured recent dengue virus infection in children, indicated by a doubling of dengue antibodies in paired saliva samples over the three-month period. We examined the associations between each of the vector indices and evidence of dengue infection at household level and at cluster level, accounting for trial intervention status. To examine the predictive value for dengue infection, we constructed receiver operating characteristic (ROC) curves at household and cluster level, considering the four vector indices as continuous variables, and calculated the positive and negative likelihood ratios for different levels of the indices. None of the vector indices was associated with recent dengue infection at household level. The Breteau Index was associated with recent infection at cluster level (Odds ratio 1.36, 95% confidence interval 1.14-1.61). The ROC curve confirmed the weak predictive value for dengue infection of the Breteau Index at cluster level. Other indices showed no predictive value. Conventional vector indices were not useful in predicting dengue infection in Mexico and Nicaragua. The findings are compatible with the idea of sources of infection outside the household which were tackled by community action in the Camino Verde trial.
After election in 1994, the South African government implemented national and regional programmes, such as the Wild Coast Spatial Development Initiative (SDI), to provoke economic growth and to ...decrease inequities. CIET measured development in the Wild Coast region across four linked cross-sectional surveys (1997-2007). The 2007 survey was an opportunity to look at inequities since the original 1997 baseline, and how such inequities affect access to health care.
The 2000, 2004 and 2007 follow-up surveys revisited the communities of the 1997 baseline. Household-level multivariate analysis looked at development indicators and access to health in the context of inequities such as household crowding, access to protected sources of water, house roof construction, main food item purchased, and perception of community empowerment. Individual multivariate models accounted for age, sex, education and income earning opportunities.
Overall access to protected sources of water increased since the baseline (from 20% in 1997 to 50% in 2007), yet households made of mud and grass, and households who bought basics as their main food item were still less likely to have protected sources of water. The most vulnerable, such as those with less education and less water and food security, were also less likely to have worked for wages leaving them with little chance of improving their standard of living (less education OR 0.59, 95%CI 0.37-0.94; less water security OR 0.67, 95%CI 0.48-0.93; less food security OR 0.43, 95%CI 0.29-0.64). People with less income were more likely to visit government services (among men OR 0.28, 95%CI 0.13-0.59; among women OR 0.33, 95%CI 0.20-0.54), reporting decision factors of cost and distance; users of private clinics sought out better service and medication. Lower food security and poorer house construction was also associated with women visiting government rather than private health services. Women with some formal education were nearly eight times more likely than women with no education to access health services for prevention rather than curative reasons (OR 7.65, 95%CI 4.10-14.25).
While there have been some improvements, the Wild Coast region still falls well below provincial and national standards in key areas such as access to clean water and employment despite years of government-led investment. Inequities remain prominent, particularly around access to health services.
In Northern Nigeria, short birth interval is common. The word kunika in the Hausa language describes a woman becoming pregnant before weaning her last child. A sizeable literature confirms an ...association between short birth interval and adverse perinatal and maternal health outcomes. Yet there are few reported studies about how people view short birth interval and its consequences. In support of culturally safe child spacing in Bauchi State, in North East Nigeria, we explored local perspectives about kunika and its consequences.
A qualitative descriptive study included 12 gender-segregated focus groups facilitated by local men and women in six communities from the Toro Local Government Area in Bauchi State. Facilitators conducted the groups in the Hausa language and translated the reports of the discussions into English. After an inductive thematic analysis, the local research team reviewed and agreed the themes in a member-checking exercise.
Some 49 women and 48 men participated in the 12 focus groups, with an average of eight people in each group. All participants were married with ages ranging from 15 to 45 years. They explained their understanding of kunika, often in terms of pregnancy while breastfeeding. They described many disadvantages of kunika, including health complications for the mother and children, economic consequences, and adverse impact on men's health and family dynamics. The groups concluded that some people still practise kunika, either intentionally (for example, in order to increase family size or because of competition between co-wives) or unintentionally (for example, because of frequent unprotected sex), and explained the roles of men and women in this.
Men and women in our study had a clear understanding of the concept of kunika. They recognized many adverse consequences of kunika beyond the narrow health concerns reported in quantitative studies. Their highlighted impacts of kunika on men's wellbeing can inform initiatives promoting the role of men in addressing kunika.
Universal home visits to pregnant women and their spouses in Bauchi State, northern Nigeria, discussed local evidence about maternal and child health risks actionable by households. The expected ...results chain for improved health behaviours resulting from the visits was based on the CASCADA model, which includes Conscious knowledge, Attitudes, Subjective norms, intention to Change, Agency to change, Discussion of options, and Action to change. Previous quantitative analysis confirmed the impact of the visits on maternal and child outcomes. To explore the mechanisms of the quantitative improvements, we analysed participants' narratives of changes in their lives they attributed to the visits.
Local researchers collected stories of change from 23 women and 21 men in households who had received home visits, from eight male and eight female home visitors, and from four government officers attached to the home visits program. We used a deductive thematic analysis based on the CASCADA results chain to analyze stories from women and men in households, and an inductive thematic approach to analyze stories from home visitors and government officials.
The stories from the visited women and men illustrated all steps in the CASCADA results chain. Almost all stories described increases in knowledge. Stories also described marked changes in attitudes and positive deviations from harmful subjective norms. Most stories recounted a change in behaviour attributed to the home visits, and many went on to mention a beneficial outcome of the behaviour change. Men, as well as women, described significant changes. The home visitors' stories described increases in knowledge, increased self-confidence and status in the community, and, among women, financial empowerment.
The narratives of change gave insights into likely mechanisms of impact of the home visits, at least in the Bauchi setting. The compatibility of our findings with the CASCADA results chain supports the use of this model in designing and analysing similar interventions in other settings. The indication that the home visits changed male engagement has broader relevance and contributes to the ongoing debate about how to increase male involvement in reproductive health.
PDF
