You are an expert M&E procurement specialist. Score the evaluator selection criteria section of the Terms of Reference I have attached or pasted using the rubric below.
SCORING RUBRIC - Evaluator Selection Criteria
Score each dimension 1-5 using these criteria:
DIMENSION 1: Required Expertise Specificity
| 5 | All four elements present. Required technical skills named specifically (e.g., "quasi-experimental impact evaluation design," "contribution analysis," "qualitative coding with NVivo"), sector knowledge specified (sub-sector, not just "health" or "education"), methods knowledge specified (qualitative, quantitative, or mixed with named techniques), and tools or software proficiency listed where relevant. |
|---|---|
| 4 | At least three of four elements present. Skills and sector named; methods or tools partial. |
| 3 | At least two of four elements present. Generic skills with one specific element. Sector named but broadly. |
| 2 | Skills stated as "M&E experience" or "evaluation expertise" without specificity. No methods or tools named. |
| 1 | No required expertise stated, OR expertise requirements unrelated to the evaluation scope. |
DIMENSION 2: Experience Breadth and Depth
| 5 | All four elements present. Minimum years of experience stated and calibrated to scope (e.g., 8+ years for lead, 4+ for team members), sector experience specified with minimum number of similar engagements, geographic experience specified (region, country type, or specific countries), and methods experience specified (e.g., "minimum two mixed-methods evaluations in the past five years"). |
|---|---|
| 4 | At least three of four elements present. Years and sector calibrated; geographic or methods experience partial. |
| 3 | At least two of four elements present. Years stated but sector or geography generic. |
| 2 | Years stated without scope calibration. No prior-engagement requirements. |
| 1 | No experience requirements stated, OR experience requirements clearly inappropriate to the scope (too low or unrealistically high). |
DIMENSION 3: Scoring Matrix Clarity
| 5 | All four elements present. Scoring matrix included with named criteria, weights stated per criterion (totaling 100% or a stated total), point scale defined per criterion (e.g., 0-10), and scoring guidance describes what evidence yields what score so two reviewers would converge. |
|---|---|
| 4 | At least three of four elements present. Matrix with weights and scale; reviewer guidance partial. |
| 3 | At least two of four elements present. Matrix included but weights or scale incomplete. |
| 2 | Criteria listed but no matrix, weights, or scoring scale. |
| 1 | No scoring approach described, OR scoring left to undocumented reviewer judgment. |
DIMENSION 4: Diversity and GESI Considerations
| 5 | All four elements present. Local or in-country expertise requirement specified, gender balance addressed (team composition expectations or explicit consideration), language requirements specified (working languages plus any local languages needed for fieldwork), and lived experience or representation relevant to the program named where appropriate (e.g., disability-led inquiry, youth participation). |
|---|---|
| 4 | At least three of four elements present. Local expertise and language addressed; gender or lived experience partial. |
| 3 | At least two of four elements present. Local or language addressed but gender and lived experience absent. |
| 2 | One element present. Diversity referenced as a checkbox without substance. |
| 1 | No diversity or GESI considerations. |
DIMENSION 5: Procurement Fairness
| 5 | All four elements present. Criteria are objective (verifiable against CV or proposal evidence), criteria are non-discriminatory (no requirements that exclude qualified candidates without programmatic justification), evaluation process is documented (who reviews, how scores combine, how ties are broken), and feedback to unsuccessful bidders is offered or referenced. |
|---|---|
| 4 | At least three of four elements present. Criteria objective and process documented; non-discrimination or feedback partial. |
| 3 | At least two of four elements present. Criteria objective but process or feedback unstated. |
| 2 | Subjective criteria (e.g., "fits with organization culture") without operational definition. No process. |
| 1 | No process documented, OR criteria contain discriminatory elements with no justification. |
OUTPUT FORMAT:
Return your assessment as a table followed by a summary:
| Dimension | Score (1-5) | Evidence from Selection Criteria | Priority Revision |
|---|---|---|---|
| Required Expertise Specificity | |||
| Experience Breadth and Depth | |||
| Scoring Matrix Clarity | |||
| Diversity and GESI Considerations | |||
| Procurement Fairness |
Total: X/25 Band: Strong (22-25) / Adequate (17-21) / Needs Revision (11-16) / Substantial Revision (5-10) Single Most Important Revision: [One specific sentence]
For any dimension scored 1 or 2, add a brief explanation and a concrete revision example.
EVALUATOR SELECTION CRITERIA TO SCORE:
(See the attached or pasted document.)
Document to review: Attached, or pasted below. Base everything above on it and do not invent details that are not in it.