Scoring Criteria
All elements present. Sample supports overall analysis, planned disaggregation (sex, age, region, treatment status) with adequate cell sizes, and any planned subgroup comparisons. Rationale links sample size to each planned analysis.
At least three of four elements present. Overall and most disaggregation supported; one or two subgroups thin.
At least two of four elements present. Overall justified but disaggregation thin or comparisons underpowered.
Sample supports overall analysis but cannot support stated disaggregation or comparison.
Absent or inadequate. Sample cannot support the intended analyses.
All elements present where quant inference is intended. Confidence level, effect size or margin of error, expected variability, design effect, and non-response buffer all stated. Where no quant inference is intended, this is stated explicitly.
At least three of four elements present. Confidence and one of effect size or variability stated; design effect or buffer partial.
At least two of four elements present. Confidence and one assumption stated. Design effect and buffer missing.
Sample size stated for quant analysis but assumptions absent. Cannot be tied to power.
Absent or inadequate. No statistical justification offered.
All elements present where qual inference is intended. Target number stated as a planning estimate. Saturation or information-power criteria defined. Assessment point specified. Extension procedure named. Where no qual inference is intended, this is stated explicitly.
At least three of four elements present. Target and saturation criteria stated; assessment or extension partial.
At least two of four elements present. Target stated but saturation criteria weak.
Target stated without saturation logic.
Absent or inadequate. No saturation logic.
All elements present. Approach matches population. Approach matches inference goal (generalization, depth, comparison). Selection criteria operationalized. Approach appropriate for access conditions.
At least three of four elements present. Match and inference goal clear; operationalization or access fit partial.
At least two of four elements present. Approach named and broadly fits; operationalization implicit.
Approach mismatched to inference goal.
Absent or inadequate. No approach or approach wrong for the question.
All elements present. Sample achievable in access, time, budget, and team capacity. Feasibility risks (seasonality, security, mobility) acknowledged and mitigated.
At least three of four elements present. Achievable on most dimensions; one risk partial.
At least two of four elements present. Plausibly achievable but risks not addressed.
Sample implausible given access, time, or budget.
Absent or inadequate. Sample cannot be delivered as proposed.
Score Interpretation
| Total (out of 25) | Band | Next Step |
|---|---|---|
| 22-25 | Strong | Sample justification is defensible. Minor refinements only. |
| 17-21 | Adequate | Address flagged dimensions before fielding begins. |
| 11-16 | Needs Revision | Substantial revision required. Use the Revise prompt as a revision brief. |
| 5-10 | Substantial Revision | Sample will not support the intended analyses. Redesign before fielding. |