AI-native vs AI-skinned
Applying AI within collection or analysis can change what a team can do. Adding an AI summary to an unchanged process is mostly a coat of paint. Ask which one a proposed use actually is.
Guides for M&E teams using AI, from finding where it fits to doing a task and governing use across your organization. Everything here is free.
AI is a different decision at each stage. Suitability describes how much it can safely take on; a person remains accountable for every decision.
Applying AI within collection or analysis can change what a team can do. Adding an AI summary to an unchanged process is mostly a coat of paint. Ask which one a proposed use actually is.
AI can assist, automate a first pass with human review of every item, or run at scale with human spot-checking. The appropriate point depends on risk and how reliably output can be checked. Decisions still require a person in the loop.
Quality-assurance guideTheory of change, indicators, evaluation questions, instruments
Draft items, menus, and variants; check coverage gaps against a framework you supply.
Context and political sensitivity, and the soundness of the underlying theory.
Fieldwork, instruments, consent
Translation, transcription, formatting instruments.
Consent, sampling integrity, field ethics. AI does not make these decisions.
Cleaning and harmonization
De-duplication, categorization, record linkage, normalizing inconsistent entries.
Silent error propagation. Every transformation needs validation before you trust it.
Patterns, summaries, analysis code
Pattern detection, descriptive summaries, drafting analysis code.
Causal inference and interpreting significance stay with you.
Thematic analysis, open-ended responses
Coding open-ends against a codebook at scale, surfacing candidate themes.
Codebook validity and intercoder reliability. This is both the most-cited win and the most-cited disappointment.
Literature review, text-mining across reports
Text-mining across hundreds of reports, surfacing and highlighting relevant passages.
Bias toward written, English-language evidence. What is not in the documents stays invisible.
Drafting, gap-checks, visualization
Drafting from structured evidence, gap-checks, first-pass visualization.
Strategic recommendations, framing, and accountability are yours. Always disclose and cite.
Adaptive management
Near-real-time insight in place of periodic reporting.
Insight without sense-making is not learning. A faster dashboard is not a decision.
Theory of change, indicators, evaluation questions, instruments
What AI does well: Draft items, menus, and variants; check coverage gaps against a framework you supply.
Where a human is mandatory: Context and political sensitivity, and the soundness of the underlying theory.
Fieldwork, instruments, consent
What AI does well: Translation, transcription, formatting instruments.
Where a human is mandatory: Consent, sampling integrity, field ethics. AI does not make these decisions.
Cleaning and harmonization
What AI does well: De-duplication, categorization, record linkage, normalizing inconsistent entries.
Where a human is mandatory: Silent error propagation. Every transformation needs validation before you trust it.
Patterns, summaries, analysis code
What AI does well: Pattern detection, descriptive summaries, drafting analysis code.
Where a human is mandatory: Causal inference and interpreting significance stay with you.
Thematic analysis, open-ended responses
What AI does well: Coding open-ends against a codebook at scale, surfacing candidate themes.
Where a human is mandatory: Codebook validity and intercoder reliability. This is both the most-cited win and the most-cited disappointment.
Literature review, text-mining across reports
What AI does well: Text-mining across hundreds of reports, surfacing and highlighting relevant passages.
Where a human is mandatory: Bias toward written, English-language evidence. What is not in the documents stays invisible.
No how-to guide yet.
Drafting, gap-checks, visualization
What AI does well: Drafting from structured evidence, gap-checks, first-pass visualization.
Where a human is mandatory: Strategic recommendations, framing, and accountability are yours. Always disclose and cite.
Adaptive management
What AI does well: Near-real-time insight in place of periodic reporting.
Where a human is mandatory: Insight without sense-making is not learning. A faster dashboard is not a decision.
No how-to guide yet.
Service delivery and beneficiary-facing uses call for even more caution because real people are directly affected.
Chatbots, triage, translation in the field
AI suitability: Use with care
Does well: Translation, drafting information materials, routing and triage support behind a human.
Human mandatory: Anything that gives advice, makes an eligibility call, or touches a vulnerable person directly. Consent, data protection, and a clear human fallback are not optional.
Operational data, internal updates
AI suitability: Medium
Does well: Summarizing operational data, drafting internal updates, flagging anomalies for review.
Human mandatory: The same silent-error and oversight cautions as the M&E stages. Keep a person between the output and any decision.
Choose a short guide or a longer playbook. Each result says which format you are opening.
The skills and safeguards that apply to every AI-for-M&E task.