Phase 2 Monitoring and Evaluation Tools
The Tipping Point Phase 2 evaluation is using a three-arm cluster randomized controlled trial to assess individual-, relational- and social norms change outcomes linked to CEFM. Baseline and endline data are collected in each arm through household enumeration, surveys with girls (and boys in Nepal) and adult community members, focus group discussion (FGDs) and in-depth interviews (IDIs) with adolescent girls and boys, and adult women and men.
Phase 2 Quantitative Evaluation tools
- Bangladesh Girls’ Survey
- Nepal Girls’ Survey
- Nepal Boys’ Survey
- Bangladesh Community Survey
- Nepal Community Survey
Phase 2 Qualitative Evaluation tools
- Norm by Norm guide – for Adolescent Girls and Adolescent Boys and in Bangladesh and Parents in Nepal and Bangladesh
- FGD tool – Social Norms Vignette for Adolescent Girls and Adolescent Boys in Nepal
- IDI tool – for Adolescent Girls and Adolescent Boys in Nepal
- KII tool – for key community members, government officials, and school personnel in Nepal
Phase 2 Qualitative Monitoring Tools
The Rolling Profile is a monitoring tool for collecting longitudinal data every 4-6 months to assess changes in participants’ attitudes, perceptions and reported behavior over the course of the intervention. This monitoring tool is a semi-structured interview developed to assess progress towards Tipping Point’s outcomes, with specific focus on relational-level change, i.e. adolescents’ connectedness with their parents and parents’ understanding of the life, concerns and aspirations of their children. The interviews also monitor changes in gendered expectations, based on perceived gender roles.
The Facilitator Observation tool is used to record observations on facilitation skills during a session with either girls, boys, mothers and fathers. This tool is used to monitor both the progression of individual facilitators’ skills as well as the average skill level of facilitators across an area. Around 10% of sessions are observed every month to ensure implementation fidelity to the standards set by Tipping Point.
This tool monitors the number and type of public events organized by the girls, to challenge gendered social norms or to demand their rights in the community. This qualitative monitoring tool is filled by the Field Facilitator, by interviewing girl leaders, to understand exclusively from their perspective, which sections of the population provides support in organizing these events, from which sections, most resistance and backlash is received and how girl groups plan to mitigate these challenges int eh future. Data from this tool also becomes a way of assessing the sensitivity of other participant groups towards gendered social norms and girls’ rights.
A Home Visit report is filled by a Field Facilitator when a TP participant is identified at risk of dropping out of the program. These tools monitor the fidelity of the program, by assessing the reasons for dropping out and encouraging the participants to rejoin, by explaining the purpose and importance of the Tipping Point sessions.
Phase 2 Quantitative Monitoring Tools (Attendance Tools)
- Girls’ and Boys’ groups
- Parents’ groups
- Other participant groups
- Inter-group Dialogues
- Community Events
Phase 1 Evaluation Tools
Tipping Point Phase 1 was unique in that it moved beyond standard discourse and approaches that aim to address child marriage and adopted a specific focus on gendered social norms as a key contributing factor to processes of change. A 2017 qualitative evaluation of Tipping Point in Bangladesh and Nepal incorporated multiple approaches to measuring the status of social norms using different methods. CARE’s Social Norms Analysis Plot (SNAP) framework tool informed the development of tools and the sequencing of different phases of data collection allowed for refining the tools as needed between phases. This brief provides an overview of the various tools used in the evaluation and how they contributed to assessing social norm change within Tipping point communities.