Scoring Criteria
Original ToC restated with all causal steps labeled. Diagram or summary present. Reader can see exactly which causal claims are under evaluation. Any pathway revisions flagged.
ToC restated with most steps labeled. Diagram or summary present. Minor steps may be implied.
ToC mentioned and partially restated. Some steps clear, others inferred. No diagram or only a generic one.
ToC referenced in passing without restating the pathway. Reader cannot tell which causal claims the evidence tests.
No reference to the original theory of change. Findings presented without a causal frame.
Evidence organized per causal link. Each link receives a verdict (supported, partially supported, refuted, untestable). Confirming and disconfirming evidence both present.
Most links have evidence presented separately. Verdicts offered for majority. One or two links merged or treated lightly.
Evidence presented per outcome rather than per link. Some intermediate steps evidenced but distinctions blurred. Verdicts inconsistent.
Evidence presented at outcome level only. Intermediate steps assumed. No per-link verdicts.
Evidence presented as a general narrative with no mapping to causal links.
Every original assumption revisited and verified or refuted with evidence. New assumptions documented and assessed. Disaggregated where assumptions held in some contexts and failed in others.
Most assumptions revisited and tested. Minor assumptions may be implied. Disaggregation for material assumptions.
Several assumptions revisited but coverage uneven. Some stated but not tested. No disaggregation.
Assumptions listed but not systematically tested, OR only confirmed assumptions discussed.
No revisitation of original assumptions. Assumptions may not even be stated.
Plausible alternatives systematically considered and ruled in or out with evidence. Limits of attribution stated. Contribution language used where attribution is not warranted.
Major alternatives considered and addressed. Minor alternatives acknowledged briefly.
Some alternatives mentioned but assessment is light. Attribution language used without ruling out alternatives.
Alternatives noted in passing or only in limitations, OR strong attribution claims made without considering them.
No alternative explanations considered. Outcomes attributed directly to program without justification.
Specific revision recommendations offered (links to add, drop, rewire; assumptions to restate). Each grounded in a finding. Revised ToC provided. Implications for program design and MEL stated.
Several revision recommendations offered with evidence backing. Revised ToC implied or partially documented.
Some ToC implications noted but recommendations general (e.g., "needs updating") without specific changes.
ToC revision discussed in passing without recommendations, OR original ToC reaffirmed without justification despite contradictory evidence.
No reference to revising the ToC. Theory treated as fixed regardless of findings.
Score Interpretation
| Total (out of 25) | Band | Next Step |
|---|---|---|
| 22-25 | Strong | Section is ready. The ToC has been genuinely tested as a hypothesis. |
| 17-21 | Adequate | Address flagged dimensions. Most common gap: per-link verdicts or alternative explanations. |
| 11-16 | Needs Revision | The theory is referenced but not tested. Restructure evidence by causal link and add assumption verification. |
| 5-10 | Substantial Revision | The ToC is decorative rather than evaluated. Rebuild the section from the pathway diagram outward. |