Outcome Harvesting
Works backward from changes that actually occurred to examine program contribution. Includes unexpected changes and emphasizes substantiation by independent sources. [1]
- Difficulty
- Advanced
- Cost
- Medium
- Duration
- Illustrative estimate, adjusted to scale and staffing: 2–6 months for design, collection, substantiation and analysis, depending on scale
How it works at a glance
Outcome Harvesting describes whose behavior, relationships or practices changed, when and how, then examines links to the program. Distinguish activities or materials produced from changes in actors outside the program. [1]
Develop descriptions from records and stakeholder information, then check them with people independent of the intervention who know about the changes and contribution. Analyze verified information and disagreements to inform primary users' decisions. [1]
- Design: define collection scope and sources
- Collect and describe outcomes
- Substantiate outcomes
- Analyze contribution
- Analyze patterns and interpret
- Answer evaluation questions and report
When to use it and when it is unsuitable
When to use it
- Evaluating interventions with unpredictable outcomes, such as advocacy, policy change or network building
- When identifying whose activities contributed to which changes in complex multi-partner programs
- When retrospectively organizing what actually changed after a program ended
- When building reasonable evidence of program contribution rather than rigorous causal proof
When it is unsuitable
- Programs mainly targeting individual knowledge, skills or attitudes, outside this method's outcome definition
- Short, simple interventions where direct input-to-output measurement is sufficient
Participants, roles, and deliverables
Participants and roles
1–2 evaluators or facilitators, program staff providing information and descriptions, external substantiators interviewed, and stakeholders in interpretation sessions
Main deliverables
- Outcome register: descriptions, substantiation and contribution
- Pattern analysis report
- Change map, an optional visualization
Implementation steps
- Design: define collection scope and sourcesDefine changes to collect, including social actors, geographical coverage and period. Identify sources such as implementer records, local partner reports and external observers. Agree standards for outcome statements.
- Collect and describe outcomesGather evidence of behavior change from records, reports, emails, interviews and other sources. Describe each outcome in a structured statement: who changed their behavior, how, when and where.
- Substantiate outcomesSelect knowledgeable substantiators independent of the describing organization's claims. Record which parts were supported, disagreements and unverified issues. Specify substantiators' positions and information coverage.
- Analyze contributionDescribe the extent and nature of program involvement in each outcome. Remember this concerns contribution, not sole causation. Also examine competing hypotheses and other factors.
- Analyze patterns and interpretAnalyze collected and substantiated outcomes across cases, organizing change patterns, unexpected outcomes and unrealized changes. Interpret findings in stakeholder review sessions.
- Answer evaluation questions and reportUse analysis to answer evaluation questions and recommend improvements. Retain the outcome register, harvest data, as a learning resource for the next cycle.
Strengths and limitations
Strengths
- Systematically records unforeseen outcomes and complex change processes.
- Substantiation emphasizing evidence rather than testimony improves reporting credibility.
- Useful for interventions such as advocacy or policy change where standard indicators are difficult to define.
- Implementer involvement advances evaluation and learning together.
Limitations
- The distinctive, narrow definition of outcomes as behavior change requires care when integrating with other frameworks.
- Substantiation requires time and skills; checking changes involving hard-to-reach actors can be difficult.
- Unclear criteria for outcome significance or value bias what is collected.
Common pitfalls
- Omitting substantiation and treating collection and description as completion produces merely a self-reported list.
- Confusing outcomes with outputs. Conducting training or submitting a report is not an outcome.
- Overclaiming contribution as attribution damages credibility. Consistently use appropriate wording such as “The program was one factor contributing to the change.”
Conditions of use and evidence
- During substantiation, check with people independent of the intervention who know about the change and contribution. [1]
Check how a partner changed referral procedures
A fictional illustrative example verifying a report that referral procedures changed after a support organization's study session.
Scroll horizontally to view the table
| Social actor: individual, organization or group | Specific behavior change | Time and place of change | Overview of the process leading to change |
|---|---|---|---|
| Partner consultation desk B | Introduced advance contact with referral destinations after obtaining the person's consent | August 2026, desk B | B revised internal procedures after a study session examining interrupted referrals. |
Common errors in judgment
Treating creation of training materials as an outcome
How to revise
Record how recipients' behavior changed.
ReasonDistinguish outputs from social change.
Treating program staff approval as completed substantiation
How to revise
Also check with independent sources knowledgeable about the change.
ReasonA process addressing self-report bias is necessary.
References and checked sections
- Outcome harvestingRicardo Wilson-Grau et al. / BetterEvaluation
- Section consulted
- Steps in the process; 4. Substantiate; Principles
- How it relates to the text
- During substantiation, check with people independent of the intervention who know about the change and contribution.
Editorial and checking information
How to cite this page
Change history
- — Updated explanations to correspond with sources, and added method-specific fictional worksheet examples, judgment examples and revision history.
- — Made minimal corrections to assertions, fixed conditions or inconsistencies between worksheets and examples based on content check FW-03. Preserved field counts, order, labels and section structure. Did not change verification status of unchecked material.


