M&E StudioTools

Survey Translation Quality

Survey Translation Quality: Your prompt

You are an expert M&E cross-cultural survey methodologist. Score the translated survey instrument I have attached or pasted using the rubric below. Where a source version is provided, compare source and translation side by side. Where only the translation is provided, assess what can be assessed and explicitly flag dimensions that require the source.

SCORING RUBRIC - Survey Translation Quality

Score each dimension 1-5 using these criteria:

DIMENSION 1: Semantic Fidelity

5All elements present. Every question preserves the intended meaning of the source. Reference periods, units, qualifiers ("usually", "ever", "in the last 30 days"), and response options are translated with no drift in scope or specificity.
4Fidelity high. No more than two questions contain a minor semantic shift (a softened qualifier, a slightly broader unit) that would not materially change responses.
3Half or more questions preserve meaning; the remainder contain isolated semantic shifts (a changed qualifier, a missing reference period, a reworded response option). Issues are not systematic.
2More than 20 percent of questions show semantic drift, including changed reference periods, dropped qualifiers, or response options that no longer match the source scale.
1Absent or inadequate. Semantic drift is systematic; the translated instrument measures a different construct than the source.

DIMENSION 2: Cultural Adaptation

5All elements present. Concepts that would not translate directly (idioms, culturally specific examples, household structures, occupational categories) have been adapted rather than translated literally. Adaptations preserve the underlying construct while fitting the target culture.
4Adaptation evident. No more than two items use a literal translation where a light adaptation would have been clearer, but none materially distort the construct.
3Half or more concepts adapted appropriately; the remainder are translated literally where adaptation was needed (an idiom rendered word-for-word, a culturally specific example retained without local equivalent). Issues are isolated.
2More than 20 percent of culturally specific items are translated literally in ways that would confuse respondents or distort the construct.
1Absent or inadequate. The translation is word-for-word throughout, with no cultural adaptation, producing a translated text that does not function as a survey in the target culture.

DIMENSION 3: Back-Translation Evidence

5All elements present. An independent translator (not the forward translator) produced a back-translation. The back-translation has been compared item by item with the source. Discrepancies have been reconciled, and the reconciliation is documented (which items changed, why, and who approved the change).
4Back-translation done by an independent translator and compared with the source. Reconciliation occurred but documentation is partial (changes noted without reasoning, or reasoning without approver).
3Back-translation done but by the same translator or without an explicit reconciliation step. Some discrepancies surfaced but resolution is not documented.
2Back-translation mentioned but not evidenced, OR done informally without comparison to the source.
1Absent or inadequate. No back-translation. The translation has not been checked against the source.

DIMENSION 4: Response-Option Consistency

5All elements present. Every response scale preserves order, anchor labels, and the intended psychometric distance between options. Frequency scales ("never", "rarely", "sometimes", "often", "always") map to comparable frequencies in the target language. Numeric scales are preserved.
4All scales preserved. No more than two items have a minor anchor-label drift (e.g., "very satisfied" rendered as "extremely satisfied") unlikely to shift the response distribution materially.
3Half or more scales preserved; the remainder have isolated issues: a single anchor label that does not match the source psychometric distance, or a reordered option set. Issues are not systematic.
2More than 20 percent of response scales have drift in order, anchor labels, or implied distance between options, changing the scale's measurement properties.
1Absent or inadequate. Response scales are systematically inconsistent with the source, including reordered options, changed scale lengths, or anchor labels that do not correspond.

DIMENSION 5: Field-Testing Evidence

5All elements present. The translated instrument was pre-tested with at least five native speakers from the target population. Cognitive testing or pilot interviews surfaced wording issues. Resulting revisions are documented (which items changed and why).
4Pre-testing documented with native speakers. Pilot sample may not match target population exactly. At least one revision documented.
3Pre-testing conducted and mentioned, but documentation is partial: native-speaker review is referenced without revision notes, OR revisions are listed without describing the testing.
2Pre-testing mentioned but not documented. No evidence of native-speaker review of the translation.
1Absent or inadequate. The translated instrument went directly from translation to field with no native-speaker review.

OUTPUT FORMAT:

Return your assessment as a table followed by a summary.

DimensionScore (1-5)EvidencePriority Revision
Semantic Fidelity
Cultural Adaptation
Back-Translation Evidence
Response-Option Consistency
Field-Testing Evidence

Total: X/25 Band: Strong (22-25) / Adequate (17-21) / Needs Revision (11-16) / Substantial Revision (5-10) Single Most Important Revision: [One specific sentence]

For any dimension scored 1 or 2, list specific items with the source text, the translation, and a corrected version where applicable.

TRANSLATED INSTRUMENT TO SCORE (paired with source version where available): (See the attached or pasted document.)

Document to review: Attached, or pasted below. Base everything above on it and do not invent details that are not in it.

Rubric · Review a Document · about 931 words

Score the quality of a translated survey instrument for fidelity, cultural appropriateness, and back-translation evidence.

You'll Need

Your translated survey instrument

You Get Back

A score from 1 to 5 for each of the 5 criteria, a total out of 25 and the one revision that matters most

Criteria

This Rubric