“significant” p-value ≠ “significant” finding: The significance of statistical evidence for the true X (i.e., statistical significance of the p-value for the estimate of the true X) says absolutely nothing about the practical/scientific significance of the true X. That is, significance of evidence is not evidence of significance. Increasing your sample size in no way increases the practical/scientific significance of your practical/scientific hypothesis. “significant” p-value = “discernible” finding: The significance of statistical evidence for the true X does tell us how well the estimate can discern the true X. That is, significance of evidence is evidence of discernibility. Increasing your sample size does increase how well your finding can discern your practical/scientific hypothesis.

Social and behavioral science research proliferated during the COVID-19 pandemic, reflecting the substantial increase in influence of behavioral science in public health and public policy more broadly. This review presents a comprehensive assessment of 742 scientific articles on human behavior during COVID-19. Two independent teams evaluated 19 substantive policy recommendations (“claims”) on potentially critical aspects of behaviors during the pandemic drawn from the most widely cited behavioral science papers on COVID-19. Teams were made up of original authors and an independent team, all of whom were blinded to other team member reviews throughout. Both teams found evidence in support of 16 of the claims; for two claims, teams found only null evidence; and for no claims did the teams find evidence of effects in the opposite direction. One claim had no evidence available to assess. Seemingly due to the risks of the pandemic, most studies were limited to surveys, highlighting a need for more investment in field research and behavioral validation studies. The strongest findings indicate interventions that combat misinformation and polarization, and to utilize effective forms of messaging that engage trusted leaders and emphasize positive social norms.

Research consistently shows evidence-based social and behavior change (SBC) programs can increase knowledge, shift attitudes and norms and produce changes in a wide variety of behaviors. SBC has proven effective in several health areas, such as increasing the uptake of family planning methods, condom use for HIV prevention, and care-seeking for malaria. Between 2017 and 2019, a series of comprehensive literature reviews were conducted to consolidate evidence that shows the positive impact of SBC interventions on behavioral outcomes related to family planning, HIV, malaria, reproductive empowerment, and the reproductive health of urban youth in low- and middle-income countries. The result is five health area-specific databases that support evidence-based SBC. The databases are searchable by keyword, country, study design, intervention and behavior. The databases extract intervention details, research methodologies and results to facilitate searching. For each of the five health areas, a “Featured Evidence” section highlights a list of key articles demonstrating impact.

The behavioural change enterprise disproportionately focuses on promoting successes at the expense of examining the failures of behavioural change interventions. We review the literature across different fields through a causal explanatory approach to identify structural relations that impede (or promote) the success of interventions. Based on this analysis we present a taxonomy of failures of behavioural change that catalogues different types of failures and backfiring effects. Our analyses and classification offer guidance for practitioners and researchers alike, and provide critical insights for establishing a more robust foundation for evidence-based policy. Behavioural change techniques are currently used by many global organisations and public institutions. The amassing evidence base is used to answer practical and scientific questions regarding what cognitive, affective, and environment factors lead to successful behavioural change in the laboratory and in the field. In this piece we show that there is also value to examining interventions that inadvertently fail in achieving their desired behavioural change (e.g., backfiring effects). We identify the underlying causal pathways that characterise different types of failure, and show how a taxonomy of causal interactions that result in failure exposes new insights that can advance theory and practice.

research on health comm messaging effects

The 2012 review found 6 studies (combined N = 23 048). In a meta-analysis, the pooled odds ratio for condom use was 2.01 (95% confidence interval [CI]: 1.42-2.84) for the most recent sexual encounter and 2.10 (95% CI: 1.51-2.91) for a composite of all condom use outcomes. Studies had significant methodological limitations. Of 518 possible new citations identified in the update, no new articles met our inclusion criteria.

When people make decisions with a pre-selected choice option – a ‘default’ – they are more likely to select that option. Because defaults are easy to implement, they constitute one of the most widely employed tools in the choice architecture toolbox. However, to decide when defaults should be used instead of other choice architecture tools, policy-makers must know how effective defaults are and when and why their effectiveness varies. To answer these questions, we conduct a literature search and meta-analysis of the 58 default studies (pooled n = 73,675) that fit our criteria. While our analysis reveals a considerable influence of defaults (d = 0.68, 95% confidence interval = 0.53–0.83), we also discover substantial variation: the majority of default studies find positive effects, but several do not find a significant effect, and two even demonstrate negative effects. To explain this variability, we draw on existing theoretical frameworks to examine the drivers of disparity in effectiveness. Our analysis reveals two factors that partially account for the variability in defaults’ effectiveness. First, we find that defaults in consumer domains are more effective and in environmental domains are less effective. Second, we find that defaults are more effective when they operate through endorsement (defaults that are seen as conveying what the choice architect thinks the decision-maker should do) or endowment (defaults that are seen as reflecting the status quo). We end with a discussion of possible directions for a future research program on defaults, including potential additional moderators, and implications for policy-makers interested in the implementation and evaluation of defaults.

Based on benefit-cost analysis, increased productivity and employment may have substantial economic benefits over several decades: $1,251 to the state as a whole for each $1 invested in the SDR social marketing campaign. $36 in benefits to the state government for each $1 invested.

In a meta-analysis of real-life experiments drawn from food science, nutrition, health economics, marketing and psychology, the authors find that behavioural nudges - facilitating action rather than providing knowledge or inducing feelings - can reduce daily energy intake by up to 209 kcal, the same number of calories as in 21 cubes of sugar.

We applied a Hidden Markov Model* (see Figure 1) to examine how and why behaviours did or did not change. The longitudinal repeated measure design meant we knew about food waste behaviour at two points (the amount of food wasted before and after the program), changes in the amount of food wasted reported over time for each household (more or less food wasted) and other factors (e.g. self-efficacy). By using a new method we could extend our understanding beyond the overall effect (households in the Waste Not Want Not program group wasted less food after participating when compared to the control group).

The results suggest that there was no significant difference in compliance rates between treatment and control schools six months post-treatment. To our knowledge, it is the first randomized controlled trial evaluating the use of descriptive social norms in increasing immunization compliance rates in a school-based setting. In addition, it serves as an example of embedding a behaviorally-informed experiment in a government program utilizing high-quality administrative data.

This report is a summary of the work of the Behavioural Insights Team and its partners from September 2017 to November 2018. It includes highlights from our six offices around the world – in London, Manchester, New York, Singapore, Sydney and Wellington. We also cover our growing portfolio of BI Ventures, products that draw on behavioural insights to make positive social impact.

tories, and their ability to transport their audience, constitute a central part of human life and consumption experience. Integrating previous literature derived from fields as diverse as anthropology, marketing, psychology, communication, consumer, and literary studies, this article offers a review of two decades’ worth of research on narrative transportation, the phenomenon in which consumers mentally enter a world that a story evokes. Despite the relevance of narrative transportation for storytelling and narrative persuasion, extant contributions seem to lack systematization. The authors conceive the extended transportation-imagery model (ETIM), which provides not only a comprehensive model that includes the antecedents and consequences of narrative transportation but also a multidisciplinary framework in which cognitive psychology and consumer culture theory cross-fertilize this field of inquiry. The authors test the model using a quantitative meta-analysis of 132 effect sizes of narrative transportation from 76 published and unpublished articles and identify fruitful directions for further research.

The objective of this review was to summarize the literature supporting narrative interventions that target health-promoting behaviours. Eligible articles were English-language peer-reviewed studies that quantitatively reported the results of a narrative intervention targeting health-promoting behaviours or theoretical determinants of behaviour. Five public health and psychology databases were searched. A total of 52 studies met inclusion criteria. In all, 14 studies found positive changes in health-promoting behaviours after exposure to a narrative intervention. The results for the changes in theoretical determinants were mixed. While narrative appears to be a promising intervention strategy, more research is needed to determine how and when to use these interventions.

Three of the best-known health messages are eating five portions a day of fruit and vegetables, getting 150 minutes of exercise a week and quitting smoking. But what evidence is there that these have worked?

Our work published this week analyses all 111 cases studies of behavioral techniques used by governments compiled by the OECD (Organisation for Economic Co-operation and Development). Our analysis demonstrates that none of the techniques used have scientific proven effectiveness.

To provide practitioners with useful information about how to promote proenvironmental behavior (PEB), a meta-analysis was performed on 87 published reports containing 253 experimental treatments that measured an observed, not self-reported, behavioral outcome. Most studies combined multiple treatments, and this confounding precluded definitive conclusions about which individual treatments are most effective. Treatments that included cognitive dissonance, goal setting, social modeling, and prompts provided the overall largest effect sizes (Hedge’s g > 0.60).

Through June 2004, the campaign is unlikely to have had favorable effects on youths and may have had delayed unfavorable effects.

ELH research

Lifestyle Gamification Case Stats and Figures OPower: reduced measurable energy consumption by over $100M Aetna: increased daily healthy activities by 50% with an average engagement of 14 minutes on the site ClinicalAdvisor.com: embedded a social platform that improved user submission by 300%, comments by 400%, and Slideshow Visualizations by 53% Bottle Bank Arcade: gamified bottle bank was used 50 times more than conventional bottle bank. The World’s Deepest Bin: 132% more trash collected compared to conventional bin Piano Stairs: 66% more of people use the stairs, if they can produce music with it Speed Camera Lottery: a lottery system that causes a 22% reduction of driving speed Toilette Seat: 44% of increase in lifting the toilet seat when urinating Nike: used gamified feedback to drive over 5,000,000 users to beat their personal fitness goals every day of the year Recycle Bank grew a community of 4 million members by providing a gamified recycling platform. Chevrolet Volt: uses a green/amber indicator to give drivers visual feedback of their driving style and reduced the number of people exceeding the speed limit by 53%

Increases in condom use were larger for longer campaigns and in nations that scored lower on the human development index. Increases in transmission knowledge were larger to the extent that respondents reported greater campaign exposure, for more recent campaigns, and for nations that scored lower on the human development index.

in Hebrew