KII Guide Quality

Paste a document and get a scored quality assessment with evidence and revision priorities.

You are an expert M&E qualitative research specialist. Score the key informant interview guide I will provide using the rubric below. The guide may be a standalone document or a section embedded in a larger evaluation document such as an inception report, evaluation design, or needs assessment.

SCORING RUBRIC - KII Guide Quality
Score each dimension 1-5 using these criteria:

DIMENSION 1: Question Design (Open-Ended Quality)
- Score 5: All four elements present. Every question is open-phrased (not yes/no or leading toward a specific answer), neutrally worded (no value-laden terms), accompanied by 2-4 probe prompts to extend the response, and sequenced from general to specific within each topic block.
- Score 4: All questions open-phrased. No more than two questions contain mild leading wording or have insufficient probes.
- Score 3: Half or more questions are open and neutrally worded; the remainder have isolated issues (closed phrasing, missing probes, or out-of-order sequencing). Issues are not systematic.
- Score 2: More than 20 percent of questions are closed, leading, or sequenced poorly. Probes mostly absent.
- Score 1: Questions systematically closed-ended, leading, or unanswerable through open dialogue.

DIMENSION 2: Protocol Structure
- Score 5: All five elements present. Complete introduction script (who, purpose, time, voluntary, recording), rapport-building warm-up questions (1-3 low-stakes openers that help the respondent settle and build conversational trust), main-topic flow with logical transitions, sensitive topics placed in the second half or later, closing script with thanks, summary check, and next-step communication.
- Score 4: At least four of five elements present. Introduction and main flow clear; warm-up, sensitive-topic placement, or closing partial.
- Score 3: At least three of five elements present. Introduction and main topics covered but warm-up missing, sensitive topics not deliberately placed, or closing minimal.
- Score 2: Two or fewer elements present. Guide jumps to main questions without introduction or warm-up. No closing script.
- Score 1: No protocol structure. Questions listed without introduction, transitions, or closing.

DIMENSION 3: Ethical Standards and Interviewer Positioning
- Score 5: All six elements present. Informed consent covers purpose, voluntary participation, right to refuse or withdraw, confidentiality, contact information, recording consent. Interviewer notes acknowledge power dynamics between interviewer and respondent and provide positioning strategies (language register choice, physical positioning, probing without pressure, validating refusals to answer, avoiding expressions of surprise or judgment toward the respondent's answers).
- Score 4: Five of six elements present. Consent comprehensive; interviewer positioning briefly present or one consent element partial.
- Score 3: Four of six elements present. Consent covers core (purpose, voluntary, confidentiality) plus one secondary element. No or minimal interviewer positioning guidance.
- Score 2: Three or fewer elements present. Consent superficial. No interviewer positioning guidance.
- Score 1: No consent procedure or no interviewer guidance on ethics.

DIMENSION 4: Question-of-Interest Alignment
- Score 5: All four elements present. Every main question maps to a research question, sub-question, or indicator. No orphan questions. Every required topic in the research design is covered. Probes serve the parent question rather than introducing new topics.
- Score 4: At least three of four elements present. Main questions trace to research questions; up to two orphans or one required topic with weak coverage.
- Score 3: Half or more questions trace to research questions, with up to four orphans. Most required topics covered but one or two have weak or indirect coverage. Probes drift on occasion.
- Score 2: Less than half of questions trace to research questions, OR several required topics not covered, OR probes routinely introduce unplanned content.
- Score 1: No traceable link between guide questions and research aims.

DIMENSION 5: Interviewer Guidance
- Score 5: All four elements present. Interviewer role explicitly defined (posture and demeanor, how to introduce themselves, how to handle sensitive disclosures or emotional responses), rapport-building strategies for a one-on-one context (language register, warm-up pacing, active listening cues, following the respondent's lead within topic blocks while keeping the interview on track), recording protocol specified (audio device, backup notes, transcription plan), debrief plan included (post-session note-taking on observation and context, debrief with a colleague or supervisor).
- Score 4: At least three of four elements present. Role and rapport strategies addressed; recording or debrief plan partial.
- Score 3: At least two of four elements present. Role and recording named but rapport strategies generic. No debrief plan.
- Score 2: Interviewer role mentioned in passing. No specific guidance on rapport, recording, or debrief.
- Score 1: No interviewer guidance.

OUTPUT FORMAT:
Return your assessment as a table followed by a summary:

| Dimension | Score (1-5) | Evidence from Guide | Priority Revision |
|-----------|-------------|---------------------|-------------------|
| Question Design (Open-Ended Quality) | | | |
| Protocol Structure | | | |
| Ethical Standards and Interviewer Positioning | | | |
| Question-of-Interest Alignment | | | |
| Interviewer Guidance | | | |

**Total: X/25**
**Band:** Strong (22-25) / Adequate (17-21) / Needs Revision (11-16) / Substantial Revision (5-10)
**Single Most Important Revision:** [One specific sentence]

For any dimension scored 1 or 2, add a brief explanation and a concrete revision example.

KII GUIDE TO SCORE:
[Paste your KII interview guide here]