Sampling Design Quality

Paste a document and get a scored quality assessment with evidence and revision priorities.

You are an expert M&E sampling specialist. Score the sampling design I will provide using the rubric below.

SCORING RUBRIC - Sampling Design Quality
Score each dimension 1-5 using these criteria:

DIMENSION 1: Sampling Strategy and Justification
- Score 5: All four elements present and well-reasoned. Sampling approach (probability, purposive, mixed) is named, rationale articulates why it was chosen over alternatives, rationale connects explicitly to evaluation questions, and the choice is appropriate for the stated inference goals (generalization, depth, comparison).
- Score 4: At least three of four elements present. Approach named with rationale. Rationale may be brief or weakly connected to evaluation questions.
- Score 3: At least two of four elements present. Approach named but rationale generic. Connection to evaluation questions implicit.
- Score 2: One element present (typically just naming the approach). No rationale or evaluation-question connection.
- Score 1: No sampling strategy stated, OR strategy clearly mismatched to inference goals.

DIMENSION 2: Sample Size and Power
- Score 5: All four elements present. Sample size stated, calculation method shown (statistical power calculation for quant, saturation or information-power criteria for qual), assumptions documented (effect size, design effect, response rate, expected variability), non-response buffer included.
- Score 4: At least three of four elements present. Size and calculation method present; assumptions or buffer partially documented.
- Score 3: Size stated and calculation method named, but assumptions or buffer not documented. For qualitative: size stated but saturation criteria weakly defined.
- Score 2: Size stated but no calculation or rationale. Quantitative size cannot be tied to power; qualitative size cannot be tied to saturation.
- Score 1: No sample size stated, OR size grossly inadequate for stated aims.

DIMENSION 3: Selection Method
- Score 5: All four elements present. Sampling frame named and its quality assessed, selection mechanism specified (random, systematic, stratified, purposive criteria), stratification or clustering rationale given where used, replacement and non-response rules stated.
- Score 4: At least three of four elements present. Sampling frame and mechanism named; stratification logic or replacement rules incomplete.
- Score 3: At least two of four elements present. Sampling frame and selection mechanism named, but stratification logic or replacement rules missing.
- Score 2: Selection mechanism named but sampling frame absent or unsuitable, OR mechanism is undefined ("sample 100 households" without specifying how).
- Score 1: No selection method described.

DIMENSION 4: Representativeness and Coverage
- Score 5: All four elements present. Target population precisely defined (inclusion and exclusion criteria), exclusions justified, geographic and demographic coverage mapped, GESI representation deliberate (sex, age, disability, other relevant identities).
- Score 4: At least three of four elements present. Target population defined and coverage mapped; GESI representation or exclusion rationale partial.
- Score 3: Target population defined, but coverage or GESI representation generic. Exclusions not justified.
- Score 2: Target population vague or contradicts the inference goals. Coverage gaps significant.
- Score 1: No defined target population, OR sample obviously biased away from the population of interest.

DIMENSION 5: Documentation and Replicability
- Score 5: All four elements present. Written sampling plan exists (separate document or clear methodology section), log of selected/rejected/replaced units maintained, weights or post-stratification specified for probability samples with unequal selection probabilities, audit trail of decisions made during fielding.
- Score 4: At least three of four elements present. Sampling plan and log exist; weights or audit trail incomplete.
- Score 3: At least two of four elements present. Sampling plan exists. Log informal or partial. Weights not specified or not applicable. No audit trail.
- Score 2: Sampling plan minimal or scattered. No log. Replicability would require substantial reconstruction.
- Score 1: No documentation. Sampling cannot be replicated by another researcher.

OUTPUT FORMAT:
Return your assessment as a table followed by a summary:

| Dimension | Score (1-5) | Evidence from Sampling Design | Priority Revision |
|-----------|-------------|------------------------------|-------------------|
| Sampling Strategy and Justification | | | |
| Sample Size and Power | | | |
| Selection Method | | | |
| Representativeness and Coverage | | | |
| Documentation and Replicability | | | |

**Total: X/25**
**Band:** Strong (22-25) / Adequate (17-21) / Needs Revision (11-16) / Substantial Revision (5-10)
**Single Most Important Revision:** [One specific sentence]

For any dimension scored 1 or 2, add a brief explanation and a concrete revision example.

SAMPLING DESIGN TO SCORE:
[Paste your sampling design here]