You are an expert M&E qualitative research specialist. Score the focus group discussion guide I have attached or pasted using the rubric below. The guide may be a standalone document or a section embedded in a larger evaluation document such as an inception report, evaluation design, or needs assessment.
SCORING RUBRIC - FGD Guide Quality
Score each dimension 1-5 using these criteria:
DIMENSION 1: Question Design (Open-Ended Quality)
| 5 | All four elements present. Every question is open-phrased (not yes/no or leading toward a specific answer), neutrally worded (no value-laden terms), accompanied by 2-4 probe prompts to extend the response, and sequenced from general to specific within each topic block. |
|---|---|
| 4 | All questions open-phrased. No more than two questions contain mild leading wording or have insufficient probes. |
| 3 | Half or more questions are open and neutrally worded; the remainder have isolated issues (closed phrasing, missing probes, or out-of-order sequencing). Issues are not systematic. |
| 2 | More than 20 percent of questions are closed, leading, or sequenced poorly. Probes mostly absent. |
| 1 | Questions systematically closed-ended, leading, or unanswerable through open dialogue. |
DIMENSION 2: Protocol Structure
| 5 | All five elements present. Complete introduction script (who, purpose, time, voluntary, recording), group warm-up questions (1-3 low-stakes openers that help participants settle, introduce themselves, and engage with each other before substantive discussion), main-topic flow with logical transitions, sensitive topics placed in the second half or later, closing script with thanks, a round of final comments, and next-step communication. |
|---|---|
| 4 | At least four of five elements present. Introduction and main flow clear; warm-up, sensitive-topic placement, or closing partial. |
| 3 | At least three of five elements present. Introduction and main topics covered but warm-up missing, sensitive topics not deliberately placed, or closing minimal. |
| 2 | Two or fewer elements present. Guide jumps to main questions without introduction or warm-up. No closing script. |
| 1 | No protocol structure. Questions listed without introduction, transitions, or closing. |
DIMENSION 3: Ethical Standards and Group Dynamics Framing
| 5 | All six elements present. Informed consent covers purpose, voluntary participation, right to refuse or withdraw, confidentiality (including an explicit acknowledgment that other participants will hear responses and that the facilitator cannot guarantee their confidentiality), contact information, recording consent. Facilitator notes acknowledge power dynamics both between facilitator and participants AND within the group itself, and provide strategies (seating arrangement, equal solicitation of voices, naming groupthink risk, procedures for handling disagreements or distress). |
|---|---|
| 4 | Five of six elements present. Consent comprehensive including group confidentiality framing; power-dynamic acknowledgment briefly present or one consent element partial. |
| 3 | Four of six elements present. Consent covers core (purpose, voluntary, confidentiality) but does not address group confidentiality limitations. No or minimal group dynamics framing. |
| 2 | Three or fewer elements present. Consent superficial. No group dynamics or power framing. |
| 1 | No consent procedure or no facilitator guidance on ethics. |
DIMENSION 4: Question-of-Interest Alignment
| 5 | All four elements present. Every main question maps to a research question, sub-question, or indicator. No orphan questions. Every required topic in the research design is covered. Probes serve the parent question rather than introducing new topics. |
|---|---|
| 4 | At least three of four elements present. Main questions trace to research questions; up to two orphans or one required topic with weak coverage. |
| 3 | Half or more questions trace to research questions, with up to four orphans. Most required topics covered but one or two have weak or indirect coverage. Probes drift on occasion. |
| 2 | Less than half of questions trace to research questions, OR several required topics not covered, OR probes routinely introduce unplanned content. |
| 1 | No traceable link between guide questions and research aims. |
DIMENSION 5: Facilitator Guidance
| 5 | All four elements present. Facilitator role explicitly defined (posture, self-introduction, how to maintain neutrality and manage topic drift), group dynamics management strategies (managing dominant voices, drawing out quiet participants, preventing groupthink by soliciting minority views, handling disagreements or sensitive moments), recording and note-taking protocol specified (audio device, dedicated note-taker role if applicable, backup notes on group dynamics, transcription plan), debrief plan included (post-session note-taking on group process observations, relationship dynamics observed, contextual factors that may have affected responses). |
|---|---|
| 4 | At least three of four elements present. Role and group dynamics management addressed; recording/note-taking or debrief plan partial. |
| 3 | At least two of four elements present. Role and recording named but group dynamics guidance generic. No debrief plan. |
| 2 | Facilitator role mentioned in passing. No specific guidance on group dynamics, recording, or debrief. |
| 1 | No facilitator guidance. |
OUTPUT FORMAT:
Return your assessment as a table followed by a summary:
| Dimension | Score (1-5) | Evidence from Guide | Priority Revision |
|---|---|---|---|
| Question Design (Open-Ended Quality) | |||
| Protocol Structure | |||
| Ethical Standards and Group Dynamics Framing | |||
| Question-of-Interest Alignment | |||
| Facilitator Guidance |
Total: X/25 Band: Strong (22-25) / Adequate (17-21) / Needs Revision (11-16) / Substantial Revision (5-10) Single Most Important Revision: [One specific sentence]
For any dimension scored 1 or 2, add a brief explanation and a concrete revision example.
FGD GUIDE TO SCORE:
(See the attached or pasted document.)
Document to review: Attached, or pasted below. Base everything above on it and do not invent details that are not in it.