M&E StudioTools

Sampling Design Quality

Sampling Design Quality: Your prompt

You are an expert M&E sampling specialist. Score the sampling design I have attached or pasted using the rubric below.

SCORING RUBRIC - Sampling Design Quality

Score each dimension 1-5 using these criteria:

DIMENSION 1: Sampling Strategy and Justification

5All four elements present and well-reasoned. Sampling approach (probability, purposive, mixed) is named, rationale articulates why it was chosen over alternatives, rationale connects explicitly to evaluation questions, and the choice is appropriate for the stated inference goals (generalization, depth, comparison).
4At least three of four elements present. Approach named with rationale. Rationale may be brief or weakly connected to evaluation questions.
3At least two of four elements present. Approach named but rationale generic. Connection to evaluation questions implicit.
2One element present (typically just naming the approach). No rationale or evaluation-question connection.
1No sampling strategy stated, OR strategy clearly mismatched to inference goals.

DIMENSION 2: Sample Size and Power

5All four elements present. Sample size stated, calculation method shown (statistical power calculation for quant, saturation or information-power criteria for qual), assumptions documented (effect size, design effect, response rate, expected variability), non-response buffer included.
4At least three of four elements present. Size and calculation method present; assumptions or buffer partially documented.
3Size stated and calculation method named, but assumptions or buffer not documented. For qualitative: size stated but saturation criteria weakly defined.
2Size stated but no calculation or rationale. Quantitative size cannot be tied to power; qualitative size cannot be tied to saturation.
1No sample size stated, OR size grossly inadequate for stated aims.

DIMENSION 3: Selection Method

5All four elements present. Sampling frame named and its quality assessed, selection mechanism specified (random, systematic, stratified, purposive criteria), stratification or clustering rationale given where used, replacement and non-response rules stated.
4At least three of four elements present. Sampling frame and mechanism named; stratification logic or replacement rules incomplete.
3At least two of four elements present. Sampling frame and selection mechanism named, but stratification logic or replacement rules missing.
2Selection mechanism named but sampling frame absent or unsuitable, OR mechanism is undefined ("sample 100 households" without specifying how).
1No selection method described.

DIMENSION 4: Representativeness and Coverage

5All four elements present. Target population precisely defined (inclusion and exclusion criteria), exclusions justified, geographic and demographic coverage mapped, GESI representation deliberate (sex, age, disability, other relevant identities).
4At least three of four elements present. Target population defined and coverage mapped; GESI representation or exclusion rationale partial.
3Target population defined, but coverage or GESI representation generic. Exclusions not justified.
2Target population vague or contradicts the inference goals. Coverage gaps significant.
1No defined target population, OR sample obviously biased away from the population of interest.

DIMENSION 5: Documentation and Replicability

5All four elements present. Written sampling plan exists (separate document or clear methodology section), log of selected/rejected/replaced units maintained, weights or post-stratification specified for probability samples with unequal selection probabilities, audit trail of decisions made during fielding.
4At least three of four elements present. Sampling plan and log exist; weights or audit trail incomplete.
3At least two of four elements present. Sampling plan exists. Log informal or partial. Weights not specified or not applicable. No audit trail.
2Sampling plan minimal or scattered. No log. Replicability would require substantial reconstruction.
1No documentation. Sampling cannot be replicated by another researcher.

OUTPUT FORMAT:

Return your assessment as a table followed by a summary:

DimensionScore (1-5)Evidence from Sampling DesignPriority Revision
Sampling Strategy and Justification
Sample Size and Power
Selection Method
Representativeness and Coverage
Documentation and Replicability

Total: X/25 Band: Strong (22-25) / Adequate (17-21) / Needs Revision (11-16) / Substantial Revision (5-10) Single Most Important Revision: [One specific sentence]

For any dimension scored 1 or 2, add a brief explanation and a concrete revision example.

SAMPLING DESIGN TO SCORE:

(See the attached or pasted document.)

Document to review: Attached, or pasted below. Base everything above on it and do not invent details that are not in it.

Rubric · Review a Document · about 753 words

Score a sampling design across five dimensions using AI.

You'll Need

Your sampling design

You Get Back

A score from 1 to 5 for each of the 5 criteria, a total out of 25 and the one revision that matters most

Criteria