M&E StudioTools

Survey Question Wording

Survey Question Wording: Your prompt

You are an expert M&E survey methodologist. Score the set of survey questions I have attached or pasted using the rubric below. Diagnose each question individually and then aggregate into dimension scores.

SCORING RUBRIC - Survey Question Wording

Score each dimension 1-5 using these criteria:

DIMENSION 1: Clarity

5All elements present. Every question is phrased in a single readable sentence. No nested clauses that require rereading. No undefined acronyms or technical jargon. A respondent could answer on first read without paraphrasing.
4All questions readable on first pass. No more than two questions contain mild structural complexity (one nested clause or one term that might require a brief gloss).
3Half or more questions are clearly worded; the remainder have isolated clarity issues (one ambiguous phrase, one nested clause, or one undefined term). Issues are not systematic.
2More than 20 percent of questions require rereading or contain undefined jargon, nested clauses, or syntactic ambiguity.
1Absent or inadequate. Questions are systematically unclear, with widespread jargon, convoluted phrasing, or sentences a typical respondent would need to parse multiple times.

DIMENSION 2: Neutrality

5All elements present. No question uses leading framing ("Don't you agree that..."), loaded terms ("wasteful", "essential"), or social-desirability cues ("As a responsible citizen, how often..."). Closed options do not signal a preferred response.
4All questions broadly neutral. No more than two questions contain mild leading framing or a single loaded modifier unlikely to materially shift responses.
3Half or more questions are neutral; the remainder contain isolated leading wording, value-laden adjectives, or response options weighted toward one end. Issues are not systematic.
2More than 20 percent of questions contain leading framing, loaded terms, or social-desirability cues that would predictably bias responses.
1Absent or inadequate. Leading or loaded wording is systematic across the set, including in core measurement items.

DIMENSION 3: Single Concept

5All elements present. Every question asks about one concept. No "and" or "or" linking two attributes ("Are services timely AND respectful?"). No bundling of distinct time periods or subjects.
4All questions single-concept. No more than two items combine closely related elements (e.g., "satisfied with quality and timeliness") where respondents would plausibly answer consistently.
3Half or more questions are single-concept; the remainder bundle two related ideas. Issues are not systematic and could be split with minor rewording.
2More than 20 percent of questions are double-barreled, asking about two or more concepts that respondents could plausibly answer differently.
1Absent or inadequate. Double-barreled questions are widespread, including in core measurement items.

DIMENSION 4: Specificity

5All elements present. Every question with a temporal component states a reference period ("in the last 30 days"). Every numeric question states units ("kilograms", "USD per month"). The subject (self, household, child under 5) is explicit.
4All questions specify reference periods, units, and subjects with no more than two items where one of these is implied rather than stated.
3Half or more questions are fully specific; the remainder leave one element (reference period, unit, or subject) implicit. Issues are not systematic.
2More than 20 percent of questions are missing a reference period, unit, or explicit subject, creating predictable response variance.
1Absent or inadequate. Specificity gaps are systematic; respondents are routinely left to guess the time frame, unit, or subject.

DIMENSION 5: Reading Level and Cultural Fit

5All elements present. Vocabulary matches the literacy level documented for the target population. No idioms or metaphors that do not translate to the local context. No assumptions about household structure, occupation, or technology access that do not hold for this population.
4Vocabulary appropriate. No more than two items use a term or idiom that might be unfamiliar to a minority of the target population.
3Half or more questions fit the target population; the remainder include isolated terms, idioms, or assumptions that would not land for some respondents. Issues are not systematic.
2More than 20 percent of questions use vocabulary above the documented reading level, untranslatable idioms, or assumptions inconsistent with the target population.
1Absent or inadequate. Vocabulary and cultural assumptions are systematically misaligned with the target population.

OUTPUT FORMAT:

Return your assessment as a table followed by a summary.

DimensionScore (1-5)EvidencePriority Revision
Clarity
Neutrality
Single Concept
Specificity
Reading Level and Cultural Fit

Total: X/25 Band: Strong (22-25) / Adequate (17-21) / Needs Revision (11-16) / Substantial Revision (5-10) Single Most Important Revision: [One specific sentence]

Then list every flagged question. For each: state the question number, the failing dimension, the problem type, and a corrected version.

SURVEY QUESTIONS TO SCORE:

(See the attached or pasted document.)

Document to review: Attached, or pasted below. Base everything above on it and do not invent details that are not in it.

Rubric · Review a Document · about 873 words

Score the wording of survey questions for clarity, neutrality, and freedom from common biases (leading, double-barreled, ambiguous).

You'll Need

Your survey questions

You Get Back

A score from 1 to 5 for each of the 5 criteria, a total out of 25 and the one revision that matters most

Criteria