M&E StudioTools

Sample Justification

Sample Justification: Your prompt

You are an expert M&E sampling specialist. Score the sample size and selection rationale section of the methodology I have attached or pasted using the rubric below.

SCORING RUBRIC - Sample Justification

Score each dimension 1-5 using these criteria:

DIMENSION 1: Analytic Purpose Match

5All elements present. The sample size supports the intended overall analysis. Sample size supports planned disaggregation (e.g., by sex, age, region, treatment status) with adequate cell sizes. Sample size supports any planned subgroup comparisons. The rationale explicitly links sample size to each planned analysis rather than treating the overall total as sufficient.
4At least three of four elements present. Overall and most disaggregation supported; one or two subgroup analyses thin.
3At least two of four elements present. Overall sample justified but disaggregation thin or comparisons underpowered.
2Sample size matches overall analytic purpose but cannot support stated disaggregation or comparison.
1Absent or inadequate. Sample size cannot support the intended analyses.

DIMENSION 2: Statistical Justification

5All elements present (where quant inference is intended). Confidence level stated (e.g., 95%). Margin of error or detectable effect size stated. Expected variability or baseline rate assumption stated. Design effect for clustered sampling stated. Non-response buffer applied. If no quant inference is intended, this is stated explicitly and the dimension is scored on completeness of that statement.
4At least three of four elements present. Confidence and one of effect size or variability stated; design effect or buffer partial.
3At least two of four elements present. Confidence and one assumption stated. Design effect and buffer missing.
2Sample size stated for quant analysis but assumptions absent. Cannot be tied to power.
1Absent or inadequate. No statistical justification offered for quant inference.

DIMENSION 3: Qualitative Saturation Logic

5All elements present (where qual inference is intended). A target number is stated as a planning estimate. Saturation or information-power criteria are defined. The point at which saturation will be assessed is specified. The procedure for extending the sample if saturation is not reached is named. If no qual inference is intended, this is stated explicitly and scored on completeness of that statement.
4At least three of four elements present. Target and saturation criteria stated; assessment point or extension procedure partial.
3At least two of four elements present. Target stated but saturation criteria weak.
2Target stated without saturation logic ("we will interview 30 people").
1Absent or inadequate. No saturation or information-power logic provided for qual inference.

DIMENSION 4: Selection Method Fit

5All elements present. Selection approach (probability, purposive, theoretical, mixed) matches the population. Approach matches the inference goal (generalization, depth, comparison). Selection criteria are operationalized. The approach is appropriate for the access conditions in the field.
4At least three of four elements present. Approach matches population and inference goal; operationalization or access fit partial.
3At least two of four elements present. Approach named and broadly fits; operationalization implicit.
2Approach mismatched (e.g., purposive sampling proposed for population-level prevalence claims).
1Absent or inadequate. No selection approach or approach clearly wrong for the question.

DIMENSION 5: Feasibility

5All elements present. Sample size is achievable within the access conditions described. Achievable within the timeline. Achievable within the budget envelope. Field team size and capacity can deliver. Risks to feasibility (seasonality, security, mobility) are acknowledged and mitigated.
4At least three of four elements present. Achievable on most dimensions; one feasibility risk partial.
3At least two of four elements present. Plausibly achievable but feasibility risks not addressed.
2Sample size implausible given access, time, or budget. Field plan does not support delivery.
1Absent or inadequate. Sample size cannot be delivered as proposed.

OUTPUT FORMAT:

Return your assessment as a table followed by a summary:

DimensionScore (1-5)EvidencePriority Revision
Analytic Purpose Match
Statistical Justification
Qualitative Saturation Logic
Selection Method Fit
Feasibility

Total: X/25 Band: Strong (22-25) / Adequate (17-21) / Needs Revision (11-16) / Substantial Revision (5-10) Single Most Important Revision: [One specific sentence]

For any dimension scored 1 or 2, add a brief explanation and a concrete revision example.

SAMPLE JUSTIFICATION TO SCORE:

(See the attached or pasted document.)

Document to review: Attached, or pasted below. Base everything above on it and do not invent details that are not in it.

Rubric · Review a Document · about 793 words

Score the sample size and selection rationale in a methodology or sampling plan.

You'll Need

Your sample size and selection rationale

You Get Back

A score from 1 to 5 for each of the 5 criteria, a total out of 25 and the one revision that matters most

Criteria