M&E StudioTools

Evaluator Selection Criteria

Evaluator Selection Criteria: Your prompt

You are an expert M&E procurement specialist. Score the evaluator selection criteria section of the Terms of Reference I have attached or pasted using the rubric below.

SCORING RUBRIC - Evaluator Selection Criteria

Score each dimension 1-5 using these criteria:

DIMENSION 1: Required Expertise Specificity

5All four elements present. Required technical skills named specifically (e.g., "quasi-experimental impact evaluation design," "contribution analysis," "qualitative coding with NVivo"), sector knowledge specified (sub-sector, not just "health" or "education"), methods knowledge specified (qualitative, quantitative, or mixed with named techniques), and tools or software proficiency listed where relevant.
4At least three of four elements present. Skills and sector named; methods or tools partial.
3At least two of four elements present. Generic skills with one specific element. Sector named but broadly.
2Skills stated as "M&E experience" or "evaluation expertise" without specificity. No methods or tools named.
1No required expertise stated, OR expertise requirements unrelated to the evaluation scope.

DIMENSION 2: Experience Breadth and Depth

5All four elements present. Minimum years of experience stated and calibrated to scope (e.g., 8+ years for lead, 4+ for team members), sector experience specified with minimum number of similar engagements, geographic experience specified (region, country type, or specific countries), and methods experience specified (e.g., "minimum two mixed-methods evaluations in the past five years").
4At least three of four elements present. Years and sector calibrated; geographic or methods experience partial.
3At least two of four elements present. Years stated but sector or geography generic.
2Years stated without scope calibration. No prior-engagement requirements.
1No experience requirements stated, OR experience requirements clearly inappropriate to the scope (too low or unrealistically high).

DIMENSION 3: Scoring Matrix Clarity

5All four elements present. Scoring matrix included with named criteria, weights stated per criterion (totaling 100% or a stated total), point scale defined per criterion (e.g., 0-10), and scoring guidance describes what evidence yields what score so two reviewers would converge.
4At least three of four elements present. Matrix with weights and scale; reviewer guidance partial.
3At least two of four elements present. Matrix included but weights or scale incomplete.
2Criteria listed but no matrix, weights, or scoring scale.
1No scoring approach described, OR scoring left to undocumented reviewer judgment.

DIMENSION 4: Diversity and GESI Considerations

5All four elements present. Local or in-country expertise requirement specified, gender balance addressed (team composition expectations or explicit consideration), language requirements specified (working languages plus any local languages needed for fieldwork), and lived experience or representation relevant to the program named where appropriate (e.g., disability-led inquiry, youth participation).
4At least three of four elements present. Local expertise and language addressed; gender or lived experience partial.
3At least two of four elements present. Local or language addressed but gender and lived experience absent.
2One element present. Diversity referenced as a checkbox without substance.
1No diversity or GESI considerations.

DIMENSION 5: Procurement Fairness

5All four elements present. Criteria are objective (verifiable against CV or proposal evidence), criteria are non-discriminatory (no requirements that exclude qualified candidates without programmatic justification), evaluation process is documented (who reviews, how scores combine, how ties are broken), and feedback to unsuccessful bidders is offered or referenced.
4At least three of four elements present. Criteria objective and process documented; non-discrimination or feedback partial.
3At least two of four elements present. Criteria objective but process or feedback unstated.
2Subjective criteria (e.g., "fits with organization culture") without operational definition. No process.
1No process documented, OR criteria contain discriminatory elements with no justification.

OUTPUT FORMAT:

Return your assessment as a table followed by a summary:

DimensionScore (1-5)Evidence from Selection CriteriaPriority Revision
Required Expertise Specificity
Experience Breadth and Depth
Scoring Matrix Clarity
Diversity and GESI Considerations
Procurement Fairness

Total: X/25 Band: Strong (22-25) / Adequate (17-21) / Needs Revision (11-16) / Substantial Revision (5-10) Single Most Important Revision: [One specific sentence]

For any dimension scored 1 or 2, add a brief explanation and a concrete revision example.

EVALUATOR SELECTION CRITERIA TO SCORE:

(See the attached or pasted document.)

Document to review: Attached, or pasted below. Base everything above on it and do not invent details that are not in it.

Rubric · Review a Document · about 783 words

Score the evaluator selection criteria and scoring matrix in a ToR.

You'll Need

Your evaluator selection criteria section

You Get Back

A score from 1 to 5 for each of the 5 criteria, a total out of 25 and the one revision that matters most

Criteria