Evaluability Assessment
Before evaluation begins, examine the program description, available information and intended uses to determine what kind of evaluation would be credible and useful. [1]
- Difficulty
- Intermediate
- Cost
- Medium
- Duration
- Illustrative estimate (adjust for scale and staffing): 1–4 weeks (including document review and interviews)
How it works at a glance
An evaluability assessment examines hypotheses about program change, data availability and access, the intentions of stakeholders who will use the evaluation, and implementation conditions. It considers readiness for evaluation and its value, rather than program performance. [1]
Findings inform not only whether to proceed but also how to focus questions, improve data and adjust timing. Distinguish major barriers from remediable gaps, and do not rely solely on a checklist total. [1]
- Document review
- Key informant interviews
- Assess clarity of objectives and indicators
- Check data availability and access feasibility
- Confirm intended use
- Prepare the EA report and recommendations
When to use it and when it is unsuitable
When to use it
- Prioritizing programs for evaluation when budgets and staffing are limited
- Quickly assessing objectives, indicators and data readiness when accepting a new evaluation assignment
- Examining the feasibility and usefulness of reevaluation when an earlier evaluation was not used
- When the evaluation commissioner cannot yet clearly state what should be evaluated
When it is unsuitable
- When objectives and indicators are ready and the need for evaluation is clear; evaluation design can begin immediately
- Urgent, short-term process or formative evaluations with no time for an EA
- Small programs where conducting the evaluation costs less than assessing evaluability
Participants, roles, and deliverables
Participants and roles
Evaluation officers (evaluators or an internal evaluation team), program managers and key stakeholder representatives. A small team of 2–4 can conduct the assessment.
Main deliverables
- Evaluability assessment report
- Evaluability checklist
- Recommended preparatory actions before evaluation
Implementation steps
- Document reviewCollect and analyze plans, logic models, existing evaluation reports, monitoring data and other materials to assess objective clarity and existing data.
- Key informant interviewsInterview program staff, managers and key stakeholders to examine shared understanding of objectives and expectations, interests and intended uses of evaluation.
- Assess clarity of objectives and indicatorsAssess whether objectives meet SMART criteria and measurable indicators are defined. Recommend redefining unclear objectives.
- Check data availability and access feasibilityCheck whether needed materials exist, are accessible and are of sufficient quality to answer the questions. If starting-point information is unavailable, consider later sources and the range of answerable questions in the design.
- Confirm intended useIdentify who will use findings and how. Evaluation investment is difficult to justify without a prospect of use. Secure decision-maker involvement in advance.
- Prepare the EA report and recommendationsSummarize theory, materials, conditions for use and major barriers. Propose questions answerable now, questions requiring further preparation and alternative designs. Even when scoring is used, do not let total scores offset major unresolved issues.
Strengths and limitations
Strengths
- Prevents wasted evaluation resources and focuses effort on feasible evaluations that will be used
- Identifies unclear objectives and indicators early, with the additional benefit of encouraging improvement
- Aligns commissioners’ and evaluation teams’ expectations early
Limitations
- EA itself takes time and money and may not be worthwhile for programs with small evaluation budgets
- A finding that evaluation is not feasible may be used as an excuse to avoid evaluation
- Assessors’ subjective judgments can influence conclusions, and criteria are difficult to standardize
Common pitfalls
- Using EA as a procedure for refusing evaluation and documenting an escape from accountability
- Relying solely on document review without consulting frontline staff and beneficiaries
- Completing an EA report without incorporating recommendations into evaluation design
Conditions of use and evidence
- Checklist items are not necessarily equally important; major barriers to proceeding are considered separately. [1]
Defining evaluation scope without follow-up data
The following fictional example concerns a counseling program scheduled for a final evaluation, but without follow-up on people’s circumstances after support.
Scroll horizontally to view the table
| Assessment item | Rating (◎○△×) | Evidence and comments | Recommendations for improvement |
|---|---|---|---|
| Clarity of objectives | ○ | The plan states the aim of connecting people to applications | Standardize the definition of connection |
| Follow-up data | × | No records after initial counseling | Collect prospectively from consenting participants |
| Timing of use | ◎ | Use at the December budget meeting for the following year | Present an implementation evaluation by November |
Common errors in judgment
Assuming every type of evaluation is feasible because more than half the items are rated ○
How to revise
Check needed materials and major barriers for each evaluation question
ReasonOther ○ ratings cannot compensate for missing critical data.
Concluding that a program has no value because its effects are difficult to estimate
How to revise
Judge evaluation feasibility separately from program value
ReasonThis assessment does not judge program performance.
References and checked sections
- Evaluability assessmentBetterEvaluation
- Section consulted
- 3. What do Evaluability Assessments examine?; 4. How do you do an Evaluability Assessment?
- How it relates to the text
- Checklist items are not necessarily equally important; major barriers to proceeding are considered separately.
Editorial and checking information
How to cite this page
Change history
- — Updated explanations to correspond to the sources and added method-specific fictional completed examples, judgment examples and a change log.


