Data Analysis for M&E
M&E data analysis is the process of turning collected data into evidence that informs program decisions. In development programs, this typically means calculating indicator values, comparing results against targets and baselines, identifying patterns and outliers, and drawing conclusions about what is and is not working.
What is data analysis in M&E?
The most common failure in M&E data analysis is not technical; it is structural. Programs analyze data without a prior decision about what questions the analysis needs to answer. The result is dashboards full of numbers and reports that nobody acts on. Analysis should always start with the decisions your program needs to make, not with the data you happen to have.
The data-to-decision gap
Donor program officers often describe the same pattern: program teams submit detailed data tables and narrative reports, but when asked "what did you change based on this data?", the answer is vague. The data existed. The analysis happened. But the link to a program decision was missing. Closing this gap is the purpose of a learning agenda and a structured data-to-decision process.
Adaptive management and learning systems
Adaptive management is the practice of using ongoing evidence to adjust program strategies, activities, and resource allocation in real time, rather than waiting for end-of-project evaluations. USAID's CLA (Collaborating, Learning, and Adapting) framework and FCDO's delivery-focused approach both require programs to demonstrate adaptive management. A structured learning agenda is the primary mechanism for doing this systematically rather than reactively.
Assess Data Quality
Before analyzing anything, verify that your data is trustworthy. A data quality assessment run after analysis wastes every hour spent analyzing unreliable data.
- All datasets checked for completeness and missing values
- Outliers identified and decision made (keep, correct, or flag)
- Data entry accuracy verified through spot checks
- Consistency checks run across related variables
- DQA findings documented and action plan created
Tools included
- DQA Scorecard (xlsx) — Structured scorecard covering all five quality dimensions.
- How to Conduct a DQA (docx) — Step-by-step guide to running a data quality assessment.
- Data Quality Assessment Checklist (docx) — Quick verification checklist for data quality standards.
- Data Quality Quick Reference (docx) — One-page reference for quality dimensions and standards.
- AI-Assisted Data Quality Guide (docx) — How to use AI tools to support quality assessment.
- Data Quality Assessment Worksheet (docx) — Structured worksheet for documenting DQA findings.
Clean and Prepare Data
Document every cleaning decision with a clear audit trail. Transparency in data cleaning is the foundation of credible findings.
- Raw data files preserved and never edited directly
- All cleaning actions logged with justification
- Variable definitions confirmed against MEL plan
- Cleaned dataset reviewed by a second person
- Analysis-ready dataset clearly labeled and version-controlled
Tools included
- Data Cleaning Log (xlsx) — Log every cleaning action: variable, issue, records affected, rule applied.
- Data Quality Issue Tracker (xlsx) — Track issues from identification through resolution.
- Data Quality Issue Tracker Guide (docx) — Monitor data quality issues: severity, action plans, follow-up.
Build Your Learning Agenda
Define what your program needs to learn, how it will learn, and how learning translates into adaptive decisions. A learning agenda without a decision calendar is a wish list.
- Learning questions linked to actual program decisions
- Evidence sources identified for each question
- Review schedule established (quarterly or more frequent)
- Decision-makers engaged in the learning process
- Adaptations documented with evidence rationale
Tools included
- Learning Agenda Tracker (xlsx) — Track learning questions, evidence collected, and decisions influenced.
- Learning Questions Template (docx) — Template for developing and prioritizing learning questions.
- Learning Agenda Checklist (docx) — Verify your learning agenda covers all essential elements.
- Adaptive Learning Mini Guide (docx) — Concise guide to adaptive management and learning systems.
- Adaptive Learning Quick Reference (docx) — One-page reference for adaptive learning concepts.
- Learning Agenda Tracker Guide (docx) — Detailed guidance on using and maintaining the tracker.
Decide and Adapt
Close the loop: use data and learning to make informed program decisions through structured data-to-decision sprints. The best adaptive programs build this into their quarterly rhythm.
- Latest data analyzed and key findings summarized
- Decision-makers identified and available
- Options for adaptation clearly articulated
- Evidence gaps acknowledged transparently
- Follow-up actions assigned with deadlines
Tools included
- Data-to-Decision Sprint Guide (docx) — Structured process for turning data into actionable program decisions.