Rapid Evaluation
An evaluation that focuses questions, populations and methods around a short decision deadline, iterating collection and analysis to produce actionable findings. State the limitations accompanying speed. [1]
- Difficulty
- Intermediate
- Cost
- Low
- Duration
- Planning example, not a universal standard duration: a few days–4 weeks in a short cycle with a focused scope
How it works at a glance
Rapid evaluation combines existing documents, short interviews, observations and other methods according to the purpose, analyzing information during collection to inform subsequent collection. Relevant expertise and stakeholder collaboration support delivery. [1]
A short duration does not guarantee evidence quality. Distinguish scope, verified findings and remaining uncertainty, and propose feasible improvements within the deadline and subsequent verification. [1]
- Focus on questions needed for the decision
- Define sufficient evidence
- Collect data through light mixed methods
- Update hypotheses daily or weekly
- Interpret with service users and field staff
- State the strength of conclusions in proposals
When to use it and when it is unsuitable
When to use it
- When an improvement decision is needed within a few weeks
- When understanding field conditions and key hypotheses before a large evaluation
- When identifying what to change next in the early stages of a new program or pilot
- When collecting minimally credible service user and field perspectives on a limited budget
When it is unsuitable
- When rigorous causal estimation or statistical generalization is expected from the short exploratory approach described here alone. Rapid evaluations with those aims require additional design, including appropriate comparisons and sampling.
- When politically or legally consequential decisions require accountability beyond short exploratory evidence
Participants, roles, and deliverables
Participants and roles
1–2 evaluators, a field manager and several service users or stakeholders. Involvement of decision-makers able to act quickly is important.
Main deliverables
- Rapid evaluation brief
- Key findings and confidence levels
- Next improvement actions
Implementation steps
- Focus on questions needed for the decisionSpecify what is to be decided and by when, and focus on questions that can be supported within the deadline. Do not prescribe a fixed mandatory question count.
- Define sufficient evidenceDecide in advance how many interviews and which documents and indicators would allow an initial decision. Judge sufficiency for practical decisions rather than completeness.
- Collect data through light mixed methodsCombine document review, short interviews, observation and brief surveys, and check whether multiple sources support the same findings.
- Update hypotheses daily or weeklyRecord findings during collection and update hypotheses to check next. Do not postpone analysis until the end in a short evaluation.
- Interpret with service users and field staffReturn provisional findings to stakeholders to check interpretations and omissions. Weaken conclusions if contradictory evidence emerges.
- State the strength of conclusions in proposalsDistinguish higher-confidence findings, hypotheses and issues requiring further verification, and briefly state the next improvement actions.
Strengths and limitations
Strengths
- Provides evidence for improvement decisions quickly.
- Well suited to early course corrections and identifying field issues.
- Triangulating several sources can improve validity even with limited budgets.
- Lowers psychological barriers to evaluation and facilitates ongoing learning cycles.
Limitations
- With limited samples, the short exploratory approach described here is unsuitable for statistical generalization. Speed itself does not rule out rigorous causal comparisons or generalization.
- Prone to confirmation bias through collecting only information consistent with the evaluator's hypothesis.
- Shorter periods make long-term outcomes and unintended effects harder to capture.
Common pitfalls
- Treating rapid evaluation as careless evaluation without defining questions, evidence requirements or limitations
- Hearing only favorable views without seeking contrary views from service users or field staff
- Presenting exploratory findings as conclusions from rigorous effect evaluation
Conditions of use and evidence
- Use multiple sources and iterative analysis even within a short deadline, and report evidence limitations. [1]
Assess reception congestion at next week's management meeting
A fictional illustrative 2-week evaluation plan with observations created for explanation.
Scroll horizontally to view the table
| Source | Fictional finding | Remaining unknowns |
|---|---|---|
| Reception records | Long waiting times on Monday mornings | Whether this also occurs outside busy periods |
| Field observation | Data entry concentrates in the same time slot. | Conditions beyond the 2 observed days |
| Staff interviews | Unclear division of data entry roles | Burden perceived by service users |
Common errors in judgment
Drawing definitive conclusions even from a short study
How to revise
Separate provisional conclusions from additional checks.
ReasonFindings may be specific to a narrow period or population.
Trying to answer every evaluation question
How to revise
Focus on questions needed for the immediate decision.
ReasonAn overly broad scope prevents supporting evidence being assembled by the deadline.
References and checked sections
- Rapid evaluationEleanor Williams/BetterEvaluation
- Section consulted
- Other common features across rapid models include
- How it relates to the text
- Use multiple sources and iterative analysis even within a short deadline, and report evidence limitations.
Editorial and checking information
How to cite this page
Change history
- — Corrected statements and procedures identified through content checks (U11). Preserved field order, counts, labels and section structure.
- — Checked sources for definitions and applicability conditions, and added fictional examples, reasons for judgments and examples for every worksheet field. Revised unverified claims about history and adoption. Also reviewed existing procedures and cautions, and adjusted fixed participant counts and thresholds and generalizations about institutions. Preserved field positions, types and counts while revising fixed conditions and thresholds in the forms.


