OECD-DAC Evaluation Criteria
Examine program value through 6 perspectives: relevance, coherence, effectiveness, efficiency, impact and sustainability. Define questions and priorities according to the evaluation’s purpose. [1]
- Difficulty
- Intermediate
- Cost
- Medium
- Duration
- Illustrative estimate (adjust for scale and staffing): applying the criteria takes 1–2 days during evaluation design; the full evaluation depends on program scale
How it works at a glance
The 6 OECD-DAC criteria provide complementary perspectives for judging program value. Relevance concerns fit with needs; coherence concerns relationships with other interventions; effectiveness concerns objective achievement; efficiency concerns resource use; impact concerns significant changes; sustainability concerns continued benefits. [1]
The criteria are not research methods themselves. Develop specific questions and choose methods according to intended use, the program and stakeholder needs. There is no need to mechanically weight all criteria equally. [1]
When to use it and when it is unsuitable
When to use it
- Conducting final or midterm evaluations of ODA and international cooperation projects
- Comparing multiple projects or programs using common dimensions
- Preparing evaluation reports for accountability to funders or donors
- Systematically developing evaluation questions under the 6 criteria
When it is unsuitable
- Treating the 6 criteria as fixed research methods. They provide perspectives for questions; the actual research design is determined separately.
- Allocating equal coverage to all criteria prevents investigation of questions important to intended use.
Participants, roles, and deliverables
Participants and roles
Evaluation team (1–3 evaluation specialists) and program officers. Midterm and final evaluations often include external evaluators.
Main deliverables
- Evaluation matrix
- Findings and ratings by criterion
- Lessons and recommendations
- Evaluation report
Implementation steps
- Confirm purpose and scopeClarify whom the evaluation serves (donors, implementing agencies or beneficiaries) and agree with stakeholders which of the 6 criteria to prioritize. Equal treatment of all criteria is unnecessary.
- Develop evaluation questionsSelect criteria fitting the purpose and turn them into questions suited to the program and intended use. A fixed number of questions per criterion is unnecessary.
- Prepare the evaluation matrixCreate a matrix listing criteria, questions, indicators, information sources and collection methods. This prevents duplicate collection and identifies unanswerable questions early.
- Data collectionCombine methods such as literature and report review, interviews, site visits and questionnaires to gather information needed for each criterion.
- Analyze and judge each criterionOrganize data by criterion and answer evaluation questions with evidence. Define any rating scale, such as a 4-point scale, in advance.
- Identify lessons and recommendationsIntegrate analysis across the 6 criteria and specify lessons and recommendations for future project design or policy. Prioritize learning specific to this program over generalities.
Strengths and limitations
Strengths
- Provides an international shared vocabulary so evaluators across agencies and countries can discuss the same criteria
- Combining the 6 criteria supports comprehensive assessment of diverse program dimensions
- Supports comparability, accumulating lessons and learning across evaluations
- Adding coherence in 2019 strengthened the perspective of policy coherence for development (PCD)
Limitations
- Mechanically applying the 6 criteria may miss fundamental questions about the program
- Unspecified weights across criteria can leave overall judgments dependent on evaluator discretion
- Information on impact and sustainability is often insufficient at evaluation time, making adequate answers difficult
Common pitfalls
- Allocating equal research time to all 6 criteria results in shallow answers to key questions; select priorities in advance
- Judging effectiveness only by target achievement and ignoring the appropriateness of objectives (relevance) or external factors
- Reports become lists by criterion without explaining overall reasons or possible responses
Conditions of use and evidence
- Choose the scope and emphasis of criteria according to evaluation purpose and context. [1]
Prioritizing counseling service reach and coordination
The following fictional example prioritizes fit with residents’ needs and coordination with other agencies ahead of next year’s service redesign.
Scroll horizontally to view the table
| Criterion (priority ★) | Evaluation question | Measurement indicators | Information source | Collection method |
|---|---|---|---|---|
| Relevance ★ | Can people seek counseling when they need it? | Preferred hours and reasons for non-use | Users and non-users | Voluntary interview |
| Coherence ★ | Are there duplications or gaps involving referral destinations? | Examples of interrupted or duplicated referrals | Coordination records between services | Record comparison |
Common errors in judgment
Assuming that averaging all criterion scores produces an objective conclusion
How to revise
Explain priorities and judgment criteria and label unevaluated areas as such
ReasonAveraging different value judgments does not resolve missing evidence.
Judging impact through participant satisfaction
How to revise
Define significant changes and the information needed to examine them
ReasonReactions and broader changes are different perspectives.
References and checked sections
- Evaluation CriteriaOECD
- Section consulted
- Principles for using evaluation criteria; Six lenses to analyse an intervention and its results
- How it relates to the text
- Choose the scope and emphasis of criteria according to evaluation purpose and context.
Editorial and checking information
How to cite this page
Change history
- — Corrected statements and procedures identified during content checks (U05). Preserved the order, number and labels of input fields and the section structure.
- — Updated explanations to correspond to the sources and added method-specific fictional completed examples, judgment examples and a change log.


