Reporting, use & meta-evaluationOrganizational developmentEvaluation cultureStaff developmentSystem developmentLearning organization
Evaluation Capacity Building
Evaluation Capacity Building
Also known as: ECB、Developing evaluation capacity、Developing an evaluation culture
Develops people's skills, organizational arrangements and an environment supporting learning so evaluation informs everyday decisions. Provides time and responsibilities for practical use alongside training. [1]
- Difficulty
- Advanced
- Cost
- High
- Duration
- Illustrative estimate (adjust for scale and team): several years (involving changes to organizational culture and systems)
Content updated: 2026-09-13Source checked: 2026-09-13 (includes AI cross-checking)No documented human reviewIncludes fictional examples
How it works at a glance
Evaluation capacity building develops an organization's ability to conduct evaluations and keep using their results. It addresses staff skills as well as leadership involvement, information systems, job responsibilities and time for evaluation. [1]
Embedding evaluation in real work and accumulating experience of conducting and using it matters. Review the capacity-building plan itself, checking not only training attendance but whether staff can formulate questions and use evidence in practice. [1]
- Assess current capacity (ECB assessment)
- Develop an ECB strategy and roadmap
- Implement individual skills development
- Institutionalize organizational systems
- Develop an evaluation culture
- Monitor and adapt ECB progress
When to use it and when it is unsuitable
When to use it
- When reducing excessive dependence on external experts due to limited internal evaluation expertise
- When evaluation remains a formal reporting obligation rather than supporting learning and improvement
- When developing or strengthening institutional infrastructure such as evaluation policies and SOPs
- When designing systematic support to strengthen evaluation capacity in aid or support recipient organizations
When it is unsuitable
- When training attendance is the sole objective, without considering opportunities or arrangements for practical use.
- If needed support is unavailable, clarify these conditions and consider the scope for a small trial.
Participants, roles, and deliverables
Participants and roles
Executives demonstrate commitment, evaluation departments lead implementation, and all managers support cultural change. External ECB facilitators often support initial stages.
Main deliverables
- ECB assessment report
- ECB roadmap and strategic plan
- Training program package
- Evaluation policy and SOPs
Implementation steps
- Assess current capacity (ECB assessment)Assess individual skills, organizational systems and evaluation culture through surveys and interviews. Identify existing capabilities, barriers, attitudes and incentives, then prioritize challenges.
- Develop an ECB strategy and roadmapBased on assessment, plan for individuals, organizational systems and the environment for evaluation use. Adapt the timeframe to organizational conditions, linking near-term action to a long-term vision.
- Implement individual skills developmentDesign and deliver staged training in evaluation design, data collection, analysis, report writing and use, alongside mentoring and practical apprenticeships. Develop internal facilitators to reduce reliance on external trainers.
- Institutionalize organizational systemsEstablish evaluation policies, annual plans, committees and SOPs. Locate the evaluation function within the organizational chart and secure staffing and budgets for evaluation posts.
- Develop an evaluation cultureContinuously communicate leadership's support for evaluation, hold regular learning sessions on findings, ensure psychological safety to learn from failure, and recognize and share successful evaluation use.
- Monitor and adapt ECB progressMonitor ECB outcome indicators, such as evaluation counts, quality scores, recommendation implementation rates and evaluation staff training hours, and review the roadmap annually. Conduct periodic meta-evaluation of ECB itself too.
Strengths and limitations
Strengths
- Unlike one-off training, has lasting effects by embedding self-sustaining evaluation capacity
- Reduces dependence on external experts and improves evaluation autonomy, credibility and cost efficiency
- Developing an evaluation culture improves organizational learning and adaptability
- In aid and support contexts, directly strengthens ownership
Limitations
- Requires ongoing checks that capabilities are used in practice and embedded in the organization. Understanding immediately after training does not establish sustained adoption.
- Leadership changes or restructuring may waste the investment
- External ECB consultants may provide superficial training without understanding organizational context
Common pitfalls
- Assuming training alone completes capacity building. Also examine roles, time, information and decision-making arrangements for actual use.
- Assigning responsibility solely to the evaluation department without organization-wide commitment
- Copying a model organization's practices wholesale without diagnosis. Differences in culture, scale and resources require examination of fit.
Conditions of use and evidence
- Provide organizational structures, roles, time, records and information-sharing arrangements alongside training. [1]
Develop the ability to connect reflection with the next operational decision
The following is a fictional example for illustration. A support organization examines why records are collected but not used in meetings.
Scroll horizontally to view the table
| Priority challenge | Level (individual/system/culture) | Specific action | Person responsible | Deadline |
|---|---|---|---|---|
| Shared understanding of denominators | Individuals | Exercises reading percentages and missing data using actual anonymized records | Records staff member A | October 2026 |
| Secure reflection time | System | Allocate a 20-minute discussion slot in monthly meetings and staff time | Manager B | October 2026 |
| Turn missed targets into learning | Culture | Bring one difficult result and record improvement options and needed support | Frontline representative C | November 2026 |
Common errors in judgment
Common mistake
Treat training attendance as evidence of improved capability
How to revise
Check whether staff can use practical questions and records
ReasonParticipation volume and workplace capability differ.
Common mistake
Centralize all analysis in one evaluation officer
How to revise
Provide roles and time for frontline staff and managers too
ReasonThis prevents the evaluation function from disappearing when one person transfers.
Organize your thinking by writing
Evaluation capacity assessment worksheet
A practical template is available to fill in and print on A4 paper.
Open worksheetRelated methods
References and checked sections
- A Checklist for Building Organizational Evaluation CapacityBoris B. Volkov and Jean A. King · 2007
- Section consulted
- Organizational Context, p. 1; ECB Structures, pp. 2–3
- How it relates to the text
- Provide organizational structures, roles, time, records and information-sharing arrangements alongside training.
Editorial and checking information
How to cite this page
EvalCompass Editorial Team. “Evaluation Capacity Building”. EvalCompass, updated 2026-09-13. https://evalcompass.jun-nakatani.com/en/methods/evaluation-capacity-building/
Add the date you accessed the page. Text created by this site is available under CC BY 4.0. Quotations, external materials, and bundled fonts have their own terms of use. When reusing content, credit the source, link to the license, and indicate any changes.
Change history
- — Updated explanations to correspond with sources, and added method-specific fictional worksheet examples, judgment examples and revision history.