You are an expert M&E specialist with experience in measurement design, including the appropriate and inappropriate use of proxy indicators. Score the proxy indicator and its justification narrative I have attached or pasted using the rubric below.
SCORING RUBRIC - Proxy Indicator Justification
Score each dimension 1-5 using these criteria:
DIMENSION 1: Rationale Specificity
| 5 | All four elements present. The reason a proxy is used rather than direct measurement is stated explicitly. The specific barrier to direct measurement is named (high cost, restricted access, ethical constraint, long time horizon, measurement instrument unavailability). The trade-off between direct and proxy measurement is acknowledged. The proxy choice follows from the barrier (the proxy addresses the specific gap that direct measurement cannot). |
|---|---|
| 4 | At least three of four elements present. Rationale stated and barrier named; trade-off or proxy-to-barrier logic partial. |
| 3 | Rationale exists but is general ("difficult to measure"). Specific barrier not named. |
| 2 | Proxy used without stated rationale. Reader has to infer why direct measurement was not used. |
| 1 | No rationale. Proxy appears chosen by default. |
DIMENSION 2: Proxy-Outcome Link Defended
| 5 | All four elements present. The causal or correlational link between the proxy and the outcome of interest is defended explicitly. The defense draws on cited evidence (peer-reviewed literature, validated measurement studies, donor methodology guidance) or on program logic that is laid out step by step. Where empirical evidence exists (correlation coefficients, validation studies), it is referenced. The defense is not "this is obviously a good proxy." |
|---|---|
| 4 | At least three of four elements present. Link defended through citation or program logic; empirical evidence or stepwise reasoning partial. |
| 3 | Link defended in general terms but without citation or stepwise logic. Reader is asked to accept the link. |
| 2 | Link asserted without defense. Citations absent. Program logic implicit. |
| 1 | No defense of the proxy-outcome link. |
DIMENSION 3: Bounded Validity
| 5 | All four elements present. The conditions under which the proxy-outcome link holds are stated (the contexts, populations, time windows, and intervention types where the link is supported). The conditions under which the link breaks are also stated (where the proxy can give misleading signals). Boundary conditions are not boilerplate but specific to the program. If the proxy is borrowed from another sector or geography, the transferability is examined. |
|---|---|
| 4 | At least three of four elements present. Validity conditions stated; breaking conditions or transferability partial. |
| 3 | Some conditions for validity mentioned but breaking conditions are absent. Transferability not examined. |
| 2 | No validity bounds stated. Proxy is treated as universally valid. |
| 1 | No discussion of bounded validity. |
DIMENSION 4: Triangulation with Direct Measures
| 5 | All four elements present. Where direct measurement is feasible at lower frequency or for a sub-sample, it is planned (sentinel surveys, validation studies, qualitative checks at midline and endline). The plan specifies what triggers a check (regular interval, anomalous proxy values). The plan specifies what happens if triangulation reveals divergence between proxy and direct measure. The proxy is not the only source of evidence for the outcome. |
|---|---|
| 4 | At least three of four elements present. Triangulation planned at lower frequency; trigger or divergence response partial. |
| 3 | Triangulation mentioned as an aspiration but no schedule or trigger. Single-source risk acknowledged but not mitigated. |
| 2 | Proxy used without triangulation. Direct measurement is feasible but not planned. |
| 1 | No triangulation. Proxy is the sole source. |
DIMENSION 5: Limitations Disclosure
| 5 | All four elements present. Known measurement error (precision, bias) of the proxy is disclosed. Confounding factors that could move the proxy without an underlying outcome change are named. Alternative interpretations of proxy movement are listed. Attribution gaps (the proxy could move for reasons unrelated to the program) are stated upfront. |
|---|---|
| 4 | At least three of four elements present. Most limitations disclosed; one or two missing. |
| 3 | Generic limitation statement. Specific measurement error, confounders, or alternative interpretations not named. |
| 2 | Limitations disclosed only in passing or after findings are contested. |
| 1 | No limitations disclosure. |
OUTPUT FORMAT:
Return your assessment as a table followed by a summary:
| Dimension | Score (1-5) | Evidence from Document | Priority Revision |
|---|---|---|---|
| Rationale Specificity | |||
| Proxy-Outcome Link Defended | |||
| Bounded Validity | |||
| Triangulation with Direct Measures | |||
| Limitations Disclosure |
Total: X/25 Band: Strong (22-25) / Adequate (17-21) / Needs Revision (11-16) / Substantial Revision (5-10) Single Most Important Revision: [One specific sentence]
For any dimension scored 1 or 2, add a brief explanation and a concrete revision example.
DOCUMENT TO SCORE:
(See the attached or pasted document.)
Document to review: Attached, or pasted below. Base everything above on it and do not invent details that are not in it.