Scoring Criteria
Every stage from raw data source to decision-maker shown. Covers collection, entry, storage, cleaning, analysis, reporting, and use. No step is implied. Both routine and one-off data products represented.
All major stages from source to use shown. No more than one transition implied. Routine flows covered; one-off products referenced.
Source-to-use path recognizable but at least two transitions implied or missing. Only routine flows shown.
Half or more transitions missing or jumpy. Flow stops at storage or reporting, OR analysis and use absent.
No end-to-end flow. Diagram shows a list of tools without connections, or covers only one segment.
Named position at every transition point. Every box and arrow has a clear owner. Handovers between positions explicit. Supervision and approval roles named.
Named positions at no fewer than 80 percent of transition points. The remainder show a unit rather than a position. Major handovers explicit.
Named positions at half or more transition points. The remainder show unit-level ownership or no owner. Handovers implied.
Named positions at fewer than half of transition points, OR all ownership at unit level ("the team").
No roles assigned. Diagram shows tools and arrows but no one owns any step.
Every storage and transfer point names a specific tool or platform. No generic placeholders. File formats and transfer methods named.
Specific tools named at no fewer than 80 percent of storage and transfer points. The remainder use slightly generic but recognizable labels.
Specific tools named at half or more storage and transfer points. The remainder use generic labels with no further specification.
Tools labeled generically for half or more points, OR multiple distinct systems collapsed into one box.
No specific tools named. Diagram shows abstract stages only.
Validation, cleaning, and review steps drawn as explicit nodes with named owners and triggers. At least one verification step before use. Error-handling path shown.
Validation and cleaning explicit with named owners. Verification step shown, though one element (frequency, sample size, or error path) unspecified.
At least one quality gate shown but referenced as a step rather than detailed. No error-handling path.
Quality gates implied through general statements. No named owner or trigger for any check.
No quality gates shown. Data moves from collection to reporting with no verification.
Flow realistic given staffing, geography, connectivity, and reporting cycles. Field steps account for connectivity. Frequencies align with reporting calendar. Workload at each position plausible.
Flow realistic overall. One feasibility concern unaddressed, but the rest of the flow accounts for context.
Flow conceptually sound but two or more steps assume conditions (connectivity, staff time, device access) not justified by the broader plan.
Flow unrealistic at multiple points (e.g., real-time dashboards in a paper-based operation, or daily workload exceeding staff capacity).
Flow detached from operational reality. Idealized system with no relationship to documented staffing or context.
Score Interpretation
| Total Score | Band | Next Step |
|---|---|---|
| 22-25 | Strong | Minor refinements only |
| 17-21 | Adequate | Address flagged dimensions before submission |
| 11-16 | Needs Revision | Return to MEL team with AI output as revision brief |
| 5-10 | Substantial Revision | Redesign the data flow before proceeding |