You are an expert M&E evaluator specializing in contribution analysis (in the Mayne tradition) and theory-based methods. Score the contribution analysis section I have attached or pasted using the rubric below. A strong contribution analysis builds a defensible story about how the program contributed to observed change, alongside other causes.
SCORING RUBRIC - Contribution Analysis Section
Score each dimension 1-5 using these criteria:
DIMENSION 1: Contribution Story Construction
| 5 | A coherent contribution story is constructed. The story integrates three elements: what the program did, what the context provided, and what co-factors (other actors, conditions, events) contributed. The story is told as a chain from inputs through to outcomes, with each step grounded in evidence. The story is internally consistent and is told as the integrated account, not as separate parallel narratives. |
|---|---|
| 4 | A contribution story is constructed with most elements integrated. Context and co-factors discussed but integration with program activities partial in places. |
| 3 | A narrative is offered but it largely describes the program in isolation, with context and co-factors treated as side notes. The reader gets a program story but not a contribution story. |
| 2 | No coherent story is constructed. Activities and outcomes are listed but not woven into a causal account that includes external factors. |
| 1 | No contribution story. Outcomes are stated without any inferential bridge from program activities. |
DIMENSION 2: Counterfactual Reasoning
| 5 | The analysis explicitly considers what might have happened without the program. Counterfactual reasoning draws on at least one of: comparison group data, pre-program trend data, plausible scenario analysis, or expert judgment with documented basis. The counterfactual is realistic (not a strawman of "nothing would have happened") and the magnitude of the difference is estimated where possible. Limitations of the counterfactual are acknowledged. |
|---|---|
| 4 | Counterfactual reasoning present and grounded in at least one source (trend data, comparison, or scenario). Magnitude discussed but estimation is approximate. Limitations noted. |
| 3 | Some counterfactual thinking is offered (e.g., "without the program, fewer people would have been reached") but it is not grounded in trend or comparison data. Magnitude not estimated. |
| 2 | Counterfactual reasoning is implicit or rhetorical ("without us, nothing would have changed") without evidence basis. |
| 1 | No counterfactual reasoning. The program is treated as if the outcomes would not have occurred at all without it. |
DIMENSION 3: Co-Factor Acknowledgment
| 5 | External co-factors are named and bounded. Other programs operating in the same area, policy changes, market shifts, broader social movements, and exogenous events are listed with evidence of their relevance. Each co-factor is assessed for the magnitude and direction of its likely contribution. Where co-factors and the program reinforced or counteracted each other, this is stated. Where co-factors might fully account for the outcome, this is acknowledged. |
|---|---|
| 4 | Major co-factors named and bounded. Magnitude and direction discussed for most. Reinforcing or counteracting effects noted for the most material. |
| 3 | Some co-factors named but not bounded. Their contribution discussed in general terms without magnitude or direction. Reinforcing effects not explored. |
| 2 | Co-factors mentioned in passing or only in limitations. Their contribution to outcomes not assessed. |
| 1 | No co-factors acknowledged. The program is presented as the sole driver of observed change. |
DIMENSION 4: Strength of Evidence Calibration
| 5 | Contribution language is consistently calibrated to evidence strength. Strong evidence supports language like "the program contributed substantially" or "definitive contribution." Moderate evidence supports "the program plausibly contributed" or "probable contribution." Weaker evidence supports "the program may have contributed" or "suggestive contribution." Every contribution claim carries a qualifier matched to its evidence base. Where evidence is too weak to support any claim, this is stated. |
|---|---|
| 4 | Most contribution claims are calibrated. Qualifiers used for the majority. A few claims may be uniformly strong without clear basis. |
| 3 | Some calibration present but qualifiers are inconsistent. Strong language sometimes used without strong evidence; cautious language sometimes used where evidence is actually robust. |
| 2 | Contribution language is uniform regardless of evidence strength, OR qualifiers are absent throughout. |
| 1 | All contribution claims are made with the same level of certainty regardless of evidence base. |
DIMENSION 5: Reader Verifiability
| 5 | A reader can retrace the reasoning from evidence to contribution claim without further translation. Each step in the inferential chain is made explicit. Sources are cited for each evidentiary input. Logical leaps are flagged and justified. The analysis would survive a skeptical reviewer who asked "how do you know?" at every step. |
|---|---|
| 4 | Most reasoning is verifiable. Sources cited for most evidentiary inputs. One or two inferential leaps may be implicit but the chain is largely visible. |
| 3 | Some steps in the reasoning are visible but others require the reader to fill in. Sources cited inconsistently. A skeptical reviewer would have to ask multiple "how do you know?" questions. |
| 2 | Reasoning is presented as conclusions without showing the inferential chain. Sources mostly absent or generic. |
| 1 | No traceability. Contribution claims appear without any visible reasoning or sources. |
OUTPUT FORMAT:
Return your assessment as a table followed by a summary:
| Dimension | Score (1-5) | Evidence from Section | Priority Revision |
|---|---|---|---|
| Contribution Story Construction | |||
| Counterfactual Reasoning | |||
| Co-Factor Acknowledgment | |||
| Strength of Evidence Calibration | |||
| Reader Verifiability |
Total: X/25 Band: Strong (22-25) / Adequate (17-21) / Needs Revision (11-16) / Substantial Revision (5-10) Single Most Important Revision: [One specific sentence]
For any dimension scored 1 or 2, add a brief explanation and a concrete revision example.
CONTRIBUTION ANALYSIS SECTION TO SCORE:
(See the attached or pasted document.)
Document to review: Attached, or pasted below. Base everything above on it and do not invent details that are not in it.