You are an expert M&E qualitative research specialist. Score the probe questions in the FGD discussion guide I have attached or pasted using the rubric below. Focus on the probes (sub-questions under each main question), not on the main questions themselves.
SCORING RUBRIC - FGD Probes Quality
Score each dimension 1-5 using these criteria:
DIMENSION 1: Depth
| 5 | All elements present. Every main question is paired with probes that go beyond surface answers. Probes ask for reasons ("Why do you think that is?"), mechanisms ("How does that happen?"), examples ("Can you give a specific example?"), or contrasting experiences ("Has anyone had a different experience?"). No probe simply restates the main question. |
|---|---|
| 4 | Most probes deepen the conversation. No more than two main questions are paired with shallow probes (a restated main question or a yes/no follow-up). |
| 3 | Half or more main questions have depth-building probes; the remainder have isolated issues (a restated probe, a missing example prompt). Issues are not systematic. |
| 2 | More than 20 percent of main questions have only shallow probes. Reasons, mechanisms, and examples are rarely solicited. |
| 1 | Absent or inadequate. Probes are systematically shallow, restate the main question, or are not present. |
DIMENSION 2: Neutrality
| 5 | All elements present. No probe uses leading framing ("Don't you think...", "Wouldn't it be better if..."). No probe contains judgment-laden terms ("problematic", "concerning", "obviously"). Probes invite agreement, disagreement, and minority views with equal openness. |
|---|---|
| 4 | Probes broadly neutral. No more than two probes contain mild leading framing or a single value-laden term unlikely to shift the discussion materially. |
| 3 | Half or more probes neutral; the remainder contain isolated leading wording or judgment-laden terms. Issues are not systematic. |
| 2 | More than 20 percent of probes lead toward a preferred answer, contain value-laden framing, or signal the facilitator's expected response. |
| 1 | Absent or inadequate. Leading or judgment-laden probes are systematic, including on the core research questions. |
DIMENSION 3: Sequencing
| 5 | All elements present. Probe order within each main question runs from concrete to abstract (specific example first, then interpretation). Probe order across the guide runs from warm-up to sensitive (lower-stakes probes early, higher-stakes probes after rapport is established). Sensitive probes are placed in the second half. |
|---|---|
| 4 | Sequencing logical. No more than two probes are placed earlier than rapport would warrant, or move from abstract to concrete in a way that may unsettle respondents. |
| 3 | Sequencing partially logical. Concrete-to-abstract or warm-up-to-sensitive is followed in half the guide; the remainder shows isolated ordering issues. |
| 2 | More than 20 percent of probes are sequenced poorly: sensitive probes placed early, abstract questions before concrete grounding, or warm-up probes placed late. |
| 1 | Absent or inadequate. No discernible sequencing logic. Sensitive probes and abstract questions appear early without rapport-building. |
DIMENSION 4: Coverage
| 5 | All elements present. The probe set, taken across all main questions, covers every research question the FGD is designed to answer. Each research question is addressed by at least two probes across the guide. No major coverage gaps. |
|---|---|
| 4 | At least 80 percent of research questions are addressed by two or more probes. Remaining research questions are covered by at least one probe. |
| 3 | All research questions covered by at least one probe, but two or more have only a single probe and no follow-up depth, leaving thin coverage in those areas. |
| 2 | Less than 80 percent of research questions have any probe coverage. One or more research questions are not addressed by any probe in the guide. |
| 1 | Absent or inadequate. Most research questions have no probe coverage. The probe set does not cover the FGD's stated research aims. |
DIMENSION 5: Facilitation Guidance
| 5 | All elements present. Each probe is paired with a facilitator note indicating when to use it (if the group has not already volunteered the information), when to skip it (if the group has covered the point), and how to handle resistance, silence, or sensitive responses. Notes are specific to the probe, not generic. |
|---|---|
| 4 | Most probes paired with facilitator notes. No more than two probes lack notes or have only generic notes. |
| 3 | Half or more probes have facilitator notes; the remainder are listed without guidance on when to use, skip, or escalate. Issues are not systematic. |
| 2 | More than 20 percent of probes have no facilitator notes. Where notes exist, they are generic and do not address resistance, silence, or sensitivity. |
| 1 | Absent or inadequate. No facilitator notes accompany the probes. |
OUTPUT FORMAT:
Return your assessment as a table followed by a summary.
| Dimension | Score (1-5) | Evidence | Priority Revision |
|---|---|---|---|
| Depth | |||
| Neutrality | |||
| Sequencing | |||
| Coverage | |||
| Facilitation Guidance |
Total: X/25 Band: Strong (22-25) / Adequate (17-21) / Needs Revision (11-16) / Substantial Revision (5-10) Single Most Important Revision: [One specific sentence]
For any dimension scored 1 or 2, list the specific probes that fail, state the problem, and provide a corrected version.
FGD GUIDE TO SCORE (focus on probes): (See the attached or pasted document.)
Document to review: Attached, or pasted below. Base everything above on it and do not invent details that are not in it.