You are an expert M&E qualitative research specialist. Score the FGD or KII protocol I have attached or pasted using the rubric below.
SCORING RUBRIC - FGD/KII Protocol Quality
Score each dimension 1-5 using these criteria:
DIMENSION 1: Question Design (Open-Ended Quality)
| 5 | All four elements present. Every question is open-phrased (not yes/no or leading toward a specific answer), neutrally worded (no value-laden terms), accompanied by 2-4 probe prompts to extend the response, and sequenced from general to specific within each topic block. |
|---|---|
| 4 | All questions open-phrased. No more than two questions contain mild leading wording or have insufficient probes. |
| 3 | Half or more questions are open and neutrally worded; the remainder have isolated issues (closed phrasing, missing probes, or out-of-order sequencing). Issues are not systematic. |
| 2 | More than 20 percent of questions are closed, leading, or sequenced poorly. Probes mostly absent. |
| 1 | Questions systematically closed-ended, leading, or unanswerable through open dialogue. |
DIMENSION 2: Protocol Structure
| 5 | All five elements present. Complete introduction script (who, purpose, time, voluntary, recording), warm-up questions (1-3 low-stakes openers), main-topic flow with logical transitions, sensitive topics placed in the second half or later, closing script with thanks, summary check, and next-step communication. |
|---|---|
| 4 | At least four of five elements present. Introduction and main flow clear; warm-up, sensitive-topic placement, or closing partial. |
| 3 | At least three of five elements present. Introduction and main topics covered but warm-up missing, sensitive topics not deliberately placed, or closing minimal. |
| 2 | Two or fewer elements present. Protocol jumps to main questions without introduction or warm-up. No closing script. |
| 1 | No protocol structure. Questions listed without introduction, transitions, or closing. |
DIMENSION 3: Ethical Standards and Power Dynamics
| 5 | All six elements present. Informed consent covers purpose, voluntary participation, right to refuse or withdraw, confidentiality, contact information, recording consent. The facilitator/interviewer guide acknowledges power dynamics between facilitator and participants and offers strategies (language choice, seating, probing without pressure, validating refusals to answer). |
|---|---|
| 4 | Five of six elements present. Consent comprehensive; power-dynamic acknowledgment briefly present or one consent element partial. |
| 3 | Four of six elements present. Consent covers core (purpose, voluntary, confidentiality) plus one secondary element. No or minimal power-dynamic acknowledgment. |
| 2 | Three or fewer elements present. Consent superficial. No power-dynamic acknowledgment. |
| 1 | No consent procedure or no facilitator guidance on ethics. |
DIMENSION 4: Question-of-Interest Alignment
| 5 | All four elements present. Every main question maps to a research question, sub-question, or indicator. No orphan questions. Every required topic in the research design is covered. Probes serve the parent question rather than introducing new topics. |
|---|---|
| 4 | At least three of four elements present. Main questions trace to research questions; up to two orphans or one required topic with weak coverage. |
| 3 | Half or more questions trace to research questions, with up to four orphans. Most required topics covered but one or two have weak or indirect coverage. Probes drift on occasion. |
| 2 | Less than half of questions trace to research questions, OR several required topics not covered, OR probes routinely introduce unplanned content. |
| 1 | No traceable link between protocol questions and research aims. |
DIMENSION 5: Facilitator/Interviewer Guidance
| 5 | All four elements present. Facilitator/interviewer role explicitly defined (stance, how to introduce themselves, what to do if topics drift), group dynamics handling for FGD (managing dominant voices, drawing out quiet participants) or rapport-building for KII (warm-up, language register), recording protocol specified (audio device, backup notes, transcription plan), debrief plan included (post-session note-taking, observations, contextual reflections). |
|---|---|
| 4 | At least three of four elements present. Role and dynamics/rapport addressed; recording or debrief plan partial. |
| 3 | At least two of four elements present. Role and recording named but dynamics/rapport guidance generic. No debrief plan. |
| 2 | Facilitator role mentioned in passing. No specific guidance on dynamics, recording, or debrief. |
| 1 | No facilitator/interviewer guidance. |
OUTPUT FORMAT:
Return your assessment as a table followed by a summary:
| Dimension | Score (1-5) | Evidence from Protocol | Priority Revision |
|---|---|---|---|
| Question Design (Open-Ended Quality) | |||
| Protocol Structure | |||
| Ethical Standards and Power Dynamics | |||
| Question-of-Interest Alignment | |||
| Facilitator/Interviewer Guidance |
Total: X/25 Band: Strong (22-25) / Adequate (17-21) / Needs Revision (11-16) / Substantial Revision (5-10) Single Most Important Revision: [One specific sentence]
For any dimension scored 1 or 2, add a brief explanation and a concrete revision example.
PROTOCOL TO SCORE:
(See the attached or pasted document.)
Document to review: Attached, or pasted below. Base everything above on it and do not invent details that are not in it.