M&E StudioTools

Qualitative Coding Frame Quality

Qualitative Coding Frame Quality: Your prompt

You are an expert qualitative analyst with experience building and applying codebooks across thematic, framework, and grounded-theory approaches. Score the qualitative coding frame I have attached or pasted using the rubric below.

SCORING RUBRIC - Qualitative Coding Frame Quality

Score each dimension 1-5 using these criteria:

DIMENSION 1: Code Definition Clarity

5Each code is defined precisely enough that two independent coders applying it to the same passage would agree. Definitions include inclusion rules (what the code covers) and exclusion rules (what the code does not cover, especially against near-miss codes). Definitions are written in operational language, not theoretical jargon alone.
4Most codes precisely defined. A small number rely on theoretical language without operational specification.
3Codes have definitions but inclusion and exclusion rules are implicit. Two coders may diverge on borderline passages.
2Codes have labels but minimal definitions. Coders will apply codes inconsistently because the rules are unstated.
1Codes are labels only, with no definitions. Coding will be unreliable from the start.

DIMENSION 2: Hierarchy Structure

5Where parent-child structures exist, the hierarchy is logical and reflects meaningful distinctions in the data. Codes at the same level of the hierarchy do not overlap in meaning (mutually exclusive at each level). Depth is appropriate to data volume (not so shallow that themes are lumped, not so deep that the codebook collapses under its own weight).
4Hierarchy logical for most branches. One or two overlaps at the same level, or one branch over-decomposed.
3Hierarchy present but with multiple overlaps at the same level. Some branches over-decomposed and others under-decomposed.
2Hierarchy is flat where structure would help, or deep where flat would suffice. Overlaps at the same level are common.
1No hierarchy where the data clearly requires one, or hierarchy that obscures rather than reveals structure.

DIMENSION 3: Exemplar Coverage

5Each code carries at least one anchor example from the data that the code applies to (positive exemplar) and at least one near-miss example that it does not apply to (negative exemplar against an adjacent code). Exemplars are short, specific, and traceable to source.
4Most codes have positive exemplars. Near-miss exemplars partial or absent for some codes.
3Some codes have exemplars. Many codes carry only the definition. Near-miss exemplars rare.
2A few codes carry exemplars. Most rely on the definition alone. No near-miss anchors.
1No exemplars at all. Codebook is definitions only.

DIMENSION 4: Inductive-Deductive Balance

5Codebook combines pre-specified codes (from evaluation questions, theoretical framework, or prior research) with emergent codes (added during the coding process from the data). The provenance of each code is noted (deductive, inductive, or hybrid). Adjustments to the codebook during coding are documented with version control.
4Both code sources present. Provenance not always tagged. Version control of codebook updates partial.
3Mostly deductive (driven by the EQ list) with limited emergent codes, or mostly inductive with no clear link to the evaluation questions. No version control of updates.
2Either fully deductive with no room for emergence, or fully inductive with no link to questions. Codebook described as "final" before coding starts, or never finalized.
1Codebook source is opaque. Cannot tell what came from the questions and what from the data.

DIMENSION 5: Reliability Plan

5Inter-coder reliability checking is built into the analytic plan. A specific approach is named: percentage of transcripts double-coded (typically 10-20 percent), agreement metric (Cohen's kappa, Krippendorff's alpha, or percent agreement) with a target threshold, and a reconciliation process for disagreements. Solo coders document their decision audit trail as a substitute when team coding is not feasible.
4Approach named. One element (sample size, metric, or reconciliation) thin.
3Reliability mentioned generically. No metric or threshold. Reconciliation absent.
2No reliability plan. Coding is assumed to be reliable without check.
1No mention of reliability. No audit trail. No reconciliation.

OUTPUT FORMAT:

Return your assessment as a table followed by a summary:

DimensionScore (1-5)EvidencePriority Revision
Code Definition Clarity
Hierarchy Structure
Exemplar Coverage
Inductive-Deductive Balance
Reliability Plan

Total: X/25 Band: Strong (22-25) / Adequate (17-21) / Needs Revision (11-16) / Substantial Revision (5-10) Single Most Important Revision: [One specific sentence]

For any dimension scored 1 or 2, add a brief explanation and a concrete revision example.

CODING FRAME TO SCORE:

(See the attached or pasted document.)

Document to review: Attached, or pasted below. Base everything above on it and do not invent details that are not in it.

Rubric · Review a Document · about 824 words

Score a qualitative coding frame (codebook) for structure, mutual exclusivity, and grounded-theory hygiene.

You'll Need

Your qualitative codebook

You Get Back

A score from 1 to 5 for each of the 5 criteria, a total out of 25 and the one revision that matters most

Criteria