Data Collection for M&E
M&E data collection is the systematic process of gathering evidence about program activities, outputs, and outcomes using defined methods and instruments. The goal is not to collect as much data as possible; it is to collect exactly the data your program needs to answer the questions in your MEL plan.
What is data collection in M&E?
Primary vs. secondary data
Primary data is collected directly from respondents or observations for your program's specific purpose: household surveys, focus groups, site visit observations. Secondary data uses existing records: health facility registers, school attendance data, government statistics. Most M&E systems use both. Primary data provides program-specific evidence; secondary data provides context and avoids duplicating what others have already collected.
Quantitative vs. qualitative methods
Quantitative methods, such as structured surveys, administrative records, and count data, tell you how many and how much. They are essential for measuring indicators and tracking progress against targets. Qualitative methods, such as focus group discussions, key informant interviews, and observations, tell you why and how. They explain patterns in quantitative data, surface implementation barriers, and capture changes that numbers miss.
The most rigorous M&E systems use both. A household survey can tell you that water access improved by 30 percentage points. A focus group can tell you which households were excluded and why, and whether the improvement will last when the project ends.
The most common data collection mistake
Most programs collect too much data, not too little. A 90-question household survey administered to 400 households produces 36,000 data points, most of which never inform a decision. A focused 20-question survey covering only the indicators in your MEL plan produces 8,000 points, takes half the time in the field, and costs significantly less to clean and analyze. Start with your indicator list, not with your curiosity.
Which Method Do You Need?
Three primary collection methods, each suited to different evidence needs. Most programs use a combination; start with your indicator list to determine which methods are required.
Household Surveys
Structured questionnaires administered to households or individuals. Produces quantitative data at scale.
Best for:
- Outcome measurement across large populations
- Sector-specific indicators (health, WASH, food security, livelihoods)
- Baseline and endline comparisons
Available instruments: Household Health Survey, WASH Household Survey, Food Consumption Score Survey, Livelihoods Coping Strategy Survey
Focus Group Discussions
Facilitated group discussions (6-12 participants) exploring shared experiences, perceptions, and attitudes.
Best for:
- Understanding community priorities and barriers
- Exploring service quality from beneficiary perspectives
- Nuanced gender and social dynamics
Available instruments: FGD: Community Needs, FGD: Service Satisfaction, FGD: Women's Empowerment
Key Informant Interviews
In-depth interviews with individuals who have specialized knowledge: program staff, officials, community leaders.
Best for:
- Understanding implementation challenges and lessons learned
- Policy alignment, coordination, and sustainability
- Triangulating quantitative findings with expert insight
Available instruments: KII: Beneficiary, KII: Community Leader, KII: Government Stakeholder, KII: Program Staff
Free Instrument Library
Ready-to-use data collection instruments for development programs. Each is designed for field use and should be adapted to your program context before deployment.
Household Surveys
- Household Health Survey. Health outcomes, service access, morbidity, and treatment-seeking behavior.QuantitativeHousehold
- WASH Household Survey. Water access, sanitation facilities, hygiene practices, and water treatment.QuantitativeHousehold
- Food Consumption Score Survey. Dietary diversity, food consumption frequency, and food group coverage.QuantitativeHousehold
- Livelihoods Coping Strategy Survey. Asset sales, debt, migration patterns, and reduced consumption as stress indicators.QuantitativeHousehold
FGD Protocols
- FGD: Community Needs. Community priorities, barriers to services, available resources, and gaps.QualitativeGroup
- FGD: Service Satisfaction. Service quality, access, relevance to needs, and ideas for improvement.QualitativeGroup
- FGD: Women's Empowerment. Gender dynamics, decision-making power, and economic participation.QualitativeGroup
KII Guides
- KII: Beneficiary. Participation experience, changes observed since program start, and key challenges.QualitativeIndividual
- KII: Community Leader. Program relevance, community coordination, sustainability, and ownership.QualitativeIndividual
- KII: Government Stakeholder. Policy alignment, government capacity, coordination mechanisms, and sustainability.QualitativeIndividual
- KII: Program Staff. Implementation challenges, lessons learned, and adaptive management practices.QualitativeIndividual
Pre-Fieldwork Readiness Checklist
Before any data collection begins, confirm these items. Missing any one costs more time in the field than the preparation would have taken.
- Site access confirmed for all locations
- Teams assigned with clear daily targets
- Buffer days scheduled (minimum 20% contingency)
- Instruments printed, devices charged, supplies packed
- IRB or ethics approval obtained (if required)
- Consent forms ready and translated into local language(s)
- Enumerators trained and piloted on all instruments