You are an expert M&E evaluator specializing in theory-based evaluation and process tracing. Score the theory-based evaluation findings section I have attached or pasted using the rubric below. A strong theory-based write-up tests the program's theory of change as a hypothesis rather than reciting it as a planning artifact.
SCORING RUBRIC - Theory-Based Evaluation Write-Up
Score each dimension 1-5 using these criteria:
DIMENSION 1: Causal Pathway Restatement
| 5 | The original ToC pathway is restated (or referenced with a clear diagram or summary) at the start of the findings section. Each causal step (input to output, output to outcome, outcome to impact) is labeled. The reader can see exactly which causal claims are under evaluation before any evidence is presented. Any revisions to the pathway made during evaluation are flagged. |
|---|---|
| 4 | The ToC is restated with most causal steps labeled. Diagram or summary present. Minor steps may be implied rather than explicit. |
| 3 | The ToC is mentioned and partially restated. Some causal steps are clear, others must be inferred. No diagram or only a generic one. |
| 2 | The ToC is referenced in passing without restating the pathway. The reader cannot tell which causal claims the evidence is meant to test. |
| 1 | No reference to the original theory of change. Findings are presented without a causal frame. |
DIMENSION 2: Per-Link Evidence
| 5 | Evidence is organized and presented per causal link, not just per outcome. For each link (e.g., training to behavior change, behavior change to health outcome), the evaluation states what evidence was sought, what was found, and whether the link held. Both confirming and disconfirming evidence appear. Each link receives a verdict (supported, partially supported, refuted, untestable). |
|---|---|
| 4 | Most causal links have evidence presented separately. Verdicts are offered for the majority of links. One or two links may be merged or treated lightly. |
| 3 | Evidence is presented per outcome rather than per link. Some intermediate steps are evidenced but the input-to-output or output-to-outcome distinction is blurred. Verdicts are inconsistent. |
| 2 | Evidence is presented at outcome level only. Intermediate causal steps are assumed rather than tested. No per-link verdicts. |
| 1 | Evidence is presented as a general narrative with no mapping to specific causal links. |
DIMENSION 3: Assumption Verification
| 5 | Every original assumption underpinning the ToC (about context, target group behavior, partner capacity, external conditions) is revisited and explicitly verified or refuted with evidence. New assumptions that surfaced during implementation are also documented and assessed. Where assumptions held in some sites or groups and failed in others, this is disaggregated. |
|---|---|
| 4 | Most assumptions are revisited and verified or refuted. Some minor assumptions may be implied. Disaggregation present for the most material assumptions. |
| 3 | Several assumptions are revisited but coverage is uneven. Some are stated but not tested. Disaggregation absent. |
| 2 | Assumptions are listed but not systematically tested against evidence, OR only assumptions that were confirmed are discussed. |
| 1 | No revisitation of original assumptions. Assumptions may not even be stated. |
DIMENSION 4: Alternative Explanations
| 5 | Plausible alternative explanations for the observed outcomes (other programs operating in the same area, policy changes, economic shifts, maturation effects, selection effects, measurement artifacts) are systematically considered and either ruled out with evidence or acknowledged as competing explanations. The evaluation explicitly states the limits of attribution and where contribution language is more appropriate. |
|---|---|
| 4 | Major alternative explanations are considered and addressed. One or two minor alternatives may be acknowledged briefly without full treatment. |
| 3 | Some alternative explanations are mentioned but assessment is light. Attribution language is used without fully ruling out competing causes. |
| 2 | Alternative explanations are noted in passing or only in a limitations section, OR strong attribution claims are made without considering alternatives. |
| 1 | No alternative explanations considered. Outcomes are attributed directly to the program without justification. |
DIMENSION 5: ToC Revision Recommendations
| 5 | Where evidence warrants, specific recommendations are offered for revising the ToC: links to add, links to drop, links to rewire, assumptions to restate or remove, new outcome pathways to incorporate. Each recommendation is grounded in a finding from the evaluation. A revised ToC diagram or summary is provided. The implications for program design and future MEL are stated. |
|---|---|
| 4 | Several ToC revision recommendations are offered with evidence backing. Revised ToC implied or partially documented. |
| 3 | Some ToC implications are noted but recommendations are general (e.g., "the theory needs updating") without specific changes. |
| 2 | ToC revision discussed in passing without recommendations, OR original ToC reaffirmed without justification despite evidence to the contrary. |
| 1 | No reference to revising the ToC. The theory is treated as fixed regardless of findings. |
OUTPUT FORMAT:
Return your assessment as a table followed by a summary:
| Dimension | Score (1-5) | Evidence from Section | Priority Revision |
|---|---|---|---|
| Causal Pathway Restatement | |||
| Per-Link Evidence | |||
| Assumption Verification | |||
| Alternative Explanations | |||
| ToC Revision Recommendations |
Total: X/25 Band: Strong (22-25) / Adequate (17-21) / Needs Revision (11-16) / Substantial Revision (5-10) Single Most Important Revision: [One specific sentence]
For any dimension scored 1 or 2, add a brief explanation and a concrete revision example showing how the section could be rewritten.
THEORY-BASED EVALUATION SECTION TO SCORE:
(See the attached or pasted document.)
Document to review: Attached, or pasted below. Base everything above on it and do not invent details that are not in it.