Quantitative Data Collection for the Data Must Speak (DMS) Positive Deviance Research in Zambia

The Data Must Speak (DMS) Positive Deviance Research Project, led by UNICEF and the Zambian Ministry of Education (MoE), aimed to uncover why certain schools outperform others despite facing similar challenges and resource constraints. M31 Research played a key role in the quantitative data collection phase, gathering insights from 120 schools across Zambia, split evenly between Positive Deviant Schools and Comparison Schools, categorized into three regional development strata.

Scope of Work and Methodology

M31 Research was responsible for recruiting and training enumerators, developing SurveyCTO-based digital tools, translating and piloting survey instruments, and ensuring daily data quality checks. Data was collected using five tools: Headteacher Surveys, Teacher Surveys, PTA Representative Surveys, DEBS Surveys, and Classroom Observations recorded via digital video. Enumerators used tablets to streamline data collection and validation in real-time.

Ethical Standards and Challenges

Ethical approval was secured from the ERES Converge IRB, and informed consent was obtained from all participants. Field teams navigated challenges such as remote access issues, inconsistent school-level data, and scheduling difficulties with key stakeholders. Adaptability and daily monitoring ensured data integrity despite these obstacles.

Key Results and Outcomes

The survey achieved high completion rates, including 99.4% for Teacher Surveys and 97.5% for Classroom Observations. Data validation was conducted daily, and video recordings of classroom observations were systematically coded. These efforts resulted in a robust dataset critical for analyzing effective school-level practices.

Conclusion

M31 Research’s contribution provided actionable insights into leadership, teaching practices, and community involvement, forming the foundation for evidence-based policymaking. The findings will guide interventions aimed at replicating successful strategies across Zambia’s education system. M31 Research demonstrated excellence in managing large-scale data collection, ensuring ethical compliance, and navigating logistical challenges. Our efforts produced reliable data that will drive meaningful improvements in Zambia’s education sector