You are a senior MEAL specialist with expertise in impact evaluation and quantitative research design. Your task is to design a quasi-experimental evaluation for "program name" (from the material, if given) that assesses the program's causal impact on "primary outcome" (from the material, if given).
The program is implemented in "treatment areas" (from the material, if given) and comparison areas are available in "comparison areas" (from the material, if given). The program has been running for "duration" (from the material, if given) and baseline data "is/is not" (from the material, if given) available from "baseline timing" (from the material, if given).
Develop the following components:
-
Research Design Selection: Justify the choice of quasi-experimental design. Compare at least three options (difference-in-differences, propensity score matching, regression discontinuity, instrumental variables) and explain why the selected design is most appropriate given the program context. Address:
- Why randomization was not feasible
- Key assumptions of the chosen design
- Conditions under which the design would fail
-
Comparison Group Strategy:
- Matching methodology: Specify the matching approach (propensity score matching, coarsened exact matching, or nearest-neighbor matching)
- Matching variables: List 8-12 observable characteristics for matching (e.g., "matching variables" (from the material, if given))
- Balance diagnostics: Describe how you will assess and report covariate balance (standardized mean differences, variance ratios)
- Minimum acceptable balance thresholds
-
Difference-in-Differences Analysis Plan:
- Model specification (including the interaction term and its interpretation)
- Parallel trends assumption: How you will test and present evidence for the parallel trends assumption using pre-treatment data
- Fixed effects and control variables to include
- Clustering strategy for standard errors (at what level and why)
- Heterogeneous treatment effects: Subgroup analyses planned (by "subgroups" (from the material, if given))
-
Sample Size and Power Calculation:
- Minimum detectable effect size (with justification)
- Required sample size for treatment and comparison groups
- Assumptions: intra-cluster correlation, significance level, power, expected attrition
- Sensitivity analysis for different effect sizes
-
Threats to Validity Assessment: Create a table with columns: Threat, Type (internal/external), Severity (high/medium/low), Mitigation Strategy, and Residual Risk. Address at minimum:
- Selection bias
- Attrition/differential dropout
- Spillover effects
- Contamination
- Regression to the mean
- Hawthorne effects
- Time-varying confounders
-
Data Collection Plan:
- Instruments needed (household survey, administrative data, qualitative complement)
- Timing of data collection rounds
- Quality assurance procedures
- Ethical considerations and IRB requirements
-
Analysis Timeline: A phased plan from data collection through final impact report, including sensitivity analyses and robustness checks.
Output Format:
Deliver all components as clearly labeled sections. The threats to validity assessment should be a formatted table. Include the model specification as a clearly written equation with variable definitions.
Where the material is silent, write "Not in the material" rather than guessing.
Source material: Attached, or pasted below. Base everything above on it and do not invent details that are not in it.