Adapt: Quasi-Experimental Evaluation

The original five-dimension /25 total and its bands apply only to the unadapted complete rubric. For adapted output, use the declared criteria and coverage; do not apply the original total or bands. Any active N/A, missing evidence or unresolved conflict still suppresses every total, band, percentage and rescaled equivalent. Adaptation cannot fill an evidence gap.
Establish purpose, decision, intended claim, selected design, stage, applicable requirements and supplied evidence before rating. Judge a plan as a plan, not completed implementation. Distinguish observed defects, Not Evidenced, Conflicting Evidence and N/A with a reason. Cite exact sections or records. Missing records alone do not prove failure or require repeating a study. Do not invent data, results, assumptions as facts, citations, completed diagnostics, consent, approval or assigned owners. Label unconfirmed owners and timing as proposals. Choose the highest 1-5 anchor fully supported; consequential defects override favorable counts. If a required criterion is unavailable or conflicted, retain partial findings and an evidence state without a complete dimension score. Other-design branches are outside the selected assessment, not defects. If any active assessed criterion is N/A, not evidenced or unresolved, withhold totals and bands, percentages and rescaled equivalents. For the unadapted complete rubric, give a total only when all five dimensions and active criteria are applicable, sufficiently evidenced and conflict-free. Bands: Strong 22-25, Adequate 17-21, Needs Revision 11-16, Substantial Revision 5-10, as secondary documentation summaries. Critical inference, validity, ethics, safety or confidentiality blockers override any score. Scores never grant causal, operational or compliance clearance; designs/stages/adaptations are not automatically comparable.

CONDITIONAL DESIGN CHECKS (apply only the chosen family):
- DiD: justify untreated parallel trends, exposure/anticipation, comparison eligibility, composition and spillovers. Pretrends can inform but never prove the assumption. For staggered adoption or heterogeneous effects, justify cohort/time comparisons, target effects and aggregation rather than automatically interpreting a pooled two-way fixed-effects coefficient as the target effect.
- Sharp continuous-score, single-cutoff RD: define running score/cutoff and compliance; justify continuity and absence of other changes at cutoff; assess manipulation, predetermined covariates and local density, estimation/bandwidth and bias-aware uncertainty/sensitivity. Target the effect at cutoff; no universal parallel-trends test.
- ITS: justify interruption timing and proposed level/slope/lag effect, sufficient pre/post information for the intended inference, stable measurement, concurrent events, seasonality and serial dependence; use suitable uncertainty and trend/timing sensitivity. A comparison series may strengthen the design but is not universally mandatory.
- Matching: justify selection on measured pretreatment covariates, overlap, balance, unmeasured-confounding limitations and suitable sensitivity/dependence. Balance does not prove absence of confounding. Do not match on treatment consequences.
- Aggregate synthetic control: justify donor eligibility and exposure/spillover exclusions, adequate preperiod fit/data, anticipation and comparative context; disclose weights and assess relevant placebo/fit and donor sensitivity, with appropriate inference limits. Good prefit is not proof of a valid counterfactual.
Weighting, IV, fuzzy/discrete/multicutoff RD and advanced variants need additional appropriate methodological review. This rubric does not provide estimators or judge those variants using an irrelevant branch. Randomized trials are excluded.

Review the supplied design or report, applying the anchors below.

SCORING RUBRIC - Quasi-Experimental Evaluation

DIMENSION 1: Question, Assignment, and Comparison
- Score 5: The question, intended effect and population, assignment mechanism, timing and counterfactual strategy are coherent and justified for the stage; alternatives and feasibility limits are explicit.
- Score 4: The question and comparison strategy are usable; one minor target or timing detail needs clarification without changing the claim.
- Score 3: A coherent question and candidate strategy exist, but a material assignment or comparison limitation needs resolution and limits claims.
- Score 2: An observed mismatch between assignment, comparator or target effect threatens the stated claim.
- Score 1: The strategy cannot identify the stated effect, or a before/after change without a defensible counterfactual is presented as causal.

DIMENSION 2: Identification and Selection Risks
- Score 5: The selected design assumptions have a defensible context-specific rationale and appropriate planned or completed diagnostics; remaining untestable assumptions and sensitivity needs are explicit.
- Score 4: The identification rationale and material selection risks are addressed; one minor diagnostic explanation remains.
- Score 3: Identification is plausible only within clearly stated material limitations that constrain the conclusions; further evidence or analysis is needed.
- Score 2: A known selection, timing, manipulation, spillover or concurrent-change problem undermines the causal claim and is not adequately addressed.
- Score 1: The draft treats an unsupported key assumption as established or ignores a known identification failure; apparent balance, pretrends or fit are claimed to prove causality.

DIMENSION 3: Measurement, Data, and Feasibility
- Score 5: Definitions, timing, comparable measurement and data access/coverage are supported for the stage; missingness and attrition risks and feasible precision assessment are explicit without universal sample rules.
- Score 4: Measurement and data feasibility support the question; one minor coverage or timing explanation needs clarification.
- Score 3: Data are usable for a bounded claim, but a material measurement, coverage or precision limitation is acknowledged and constrains interpretation.
- Score 2: An observed measurement, attrition or data-coverage defect materially distorts the comparison and is inadequately addressed.
- Score 1: The supplied data demonstrably cannot measure the claimed outcome/comparison, yet the intended claim is retained.

DIMENSION 4: Analysis, Uncertainty, and Robustness
- Score 5: The analysis targets the stated effect and design; dependence and uncertainty are justified; relevant robustness and sensitivity checks and reporting rules are specified for the stage.
- Score 4: The main analysis and uncertainty rationale are sound; one minor sensitivity or reporting detail remains.
- Score 3: A defensible analytic outline exists but a material uncertainty or robustness limitation remains explicit and limits conclusions.
- Score 2: An observed analysis or dependence error creates misleading precision or effect interpretation that the draft does not address.
- Score 1: The proposed or reported analysis cannot support the causal inference, or selective reporting or false certainty drives the conclusion.

DIMENSION 5: Ethics, Interpretation, and Action
- Score 5: Stage-appropriate safeguards and applicable review/access requirements are explicit; inference and transportability limits are clear; actions, owners and timing are supported or labeled proposals, with unresolved use conditions visible.
- Score 4: Safeguards and bounded interpretation are sound; one minor action or reporting detail needs clarification.
- Score 3: The use boundary is stated but a material noncritical safeguard or follow-up detail needs confirmation; readiness is not overclaimed.
- Score 2: An observed safeguard or interpretation defect creates material risk or generalizes beyond the supported population without adequate qualification.
- Score 1: The draft endorses unsafe sensitive-data use, invents approval or completed validation, or claims a documentation score resolves an inference or operational blocker.

OUTPUT: Blockers and use limits first, then this table:
| Dimension | Score (1-5) or Evidence State | Located Evidence | Priority Action |
|---|---|---|---|
| Question, Assignment, and Comparison | | | |
| Identification and Selection Risks | | | |
| Measurement, Data, and Feasibility | | | |
| Analysis, Uncertainty, and Robustness | | | |
| Ethics, Interpretation, and Action | | | |
Then give coverage, located missing/conflicting evidence requests, specific corrections and proposed or confirmed owner/milestone. Use a total/band only under the strict evidence rule above. State what human methods review must settle before causal use.

DOCUMENT TO REVIEW: [Paste de-identified design/report and supporting evidence with section labels.]