Scoring Criteria
All elements present. Every main question is paired with probes that go beyond surface answers, asking for reasons, mechanisms, examples, or contrasting experiences. No probe simply restates the main question.
Most probes deepen the conversation. No more than two main questions are paired with shallow probes (a restated main question or a yes/no follow-up).
Half or more main questions have depth-building probes; the remainder have isolated issues (a restated probe, a missing example prompt). Issues are not systematic.
More than 20 percent of main questions have only shallow probes. Reasons, mechanisms, and examples are rarely solicited.
Absent or inadequate. Probes are systematically shallow, restate the main question, or are not present.
All elements present. No probe uses leading framing or judgment-laden terms. Probes invite agreement, disagreement, and minority views with equal openness.
Probes broadly neutral. No more than two probes contain mild leading framing or a single value-laden term unlikely to shift the discussion materially.
Half or more probes neutral; the remainder contain isolated leading wording or judgment-laden terms. Issues are not systematic.
More than 20 percent of probes lead toward a preferred answer, contain value-laden framing, or signal the facilitator's expected response.
Absent or inadequate. Leading or judgment-laden probes are systematic, including on the core research questions.
All elements present. Probe order within each main question runs concrete to abstract. Probe order across the guide runs warm-up to sensitive. Sensitive probes are placed in the second half.
Sequencing logical. No more than two probes are placed earlier than rapport would warrant, or move abstract to concrete in a way that may unsettle respondents.
Sequencing partially logical. Concrete-to-abstract or warm-up-to-sensitive is followed in half the guide; the remainder shows isolated ordering issues.
More than 20 percent of probes are sequenced poorly: sensitive probes placed early, abstract questions before concrete grounding, or warm-up probes placed late.
Absent or inadequate. No discernible sequencing logic. Sensitive probes and abstract questions appear early without rapport-building.
All elements present. The probe set covers every research question the FGD is designed to answer. Each research question is addressed by at least two probes across the guide. No major coverage gaps.
At least 80 percent of research questions are addressed by two or more probes. Remaining research questions are covered by at least one probe.
All research questions covered by at least one probe, but two or more have only a single probe and no follow-up depth, leaving thin coverage in those areas.
Less than 80 percent of research questions have any probe coverage. One or more research questions are not addressed by any probe in the guide.
Absent or inadequate. Most research questions have no probe coverage. The probe set does not cover the FGD's stated research aims.
All elements present. Each probe is paired with a facilitator note indicating when to use it, when to skip it, and how to handle resistance, silence, or sensitive responses. Notes are specific to the probe.
Most probes paired with facilitator notes. No more than two probes lack notes or have only generic notes.
Half or more probes have facilitator notes; the remainder are listed without guidance on when to use, skip, or escalate. Issues are not systematic.
More than 20 percent of probes have no facilitator notes. Where notes exist, they are generic and do not address resistance, silence, or sensitivity.
Absent or inadequate. No facilitator notes accompany the probes.
Score Interpretation
| Total (out of 25) | Band | Next Step |
|---|---|---|
| 22-25 | Strong | Probes are ready for facilitator briefing and field use. |
| 17-21 | Adequate | Address flagged dimensions before fielding. Walk through probes with the facilitator team. |
| 11-16 | Needs Revision | Substantial probe revision required. Use the Revise prompt and treat its output as your revision brief. |
| 5-10 | Substantial Revision | Rebuild probes from the research questions. Map every probe to a research question before drafting facilitator notes. |