Participatory & qualitative approachesAdvocacy evaluationComplex systemsEvidence collectionBehavior changeContribution analysis

Outcome Harvesting

Outcome Harvesting
Also known as: Outcome harvesting method、OH

Works backward from changes that actually occurred to examine program contribution. Includes unexpected changes and emphasizes substantiation by independent sources. [1]

Difficulty
Advanced
Cost
Medium
Duration
Illustrative estimate, adjusted to scale and staffing: 2–6 months for design, collection, substantiation and analysis, depending on scale
Content updated: 2026-10-07Source checked: 2026-09-13 (includes AI cross-checking)No documented human reviewIncludes fictional examples

How it works at a glance

Outcome Harvesting describes whose behavior, relationships or practices changed, when and how, then examines links to the program. Distinguish activities or materials produced from changes in actors outside the program. [1]

Develop descriptions from records and stakeholder information, then check them with people independent of the intervention who know about the changes and contribution. Analyze verified information and disagreements to inform primary users' decisions. [1]

  1. Design: define collection scope and sources
  2. Collect and describe outcomes
  3. Substantiate outcomes
  4. Analyze contribution
  5. Analyze patterns and interpret
  6. Answer evaluation questions and report
Sequence of implementation steps. See “Implementation steps” for details of each stage.

When to use it and when it is unsuitable

When to use it

  • Evaluating interventions with unpredictable outcomes, such as advocacy, policy change or network building
  • When identifying whose activities contributed to which changes in complex multi-partner programs
  • When retrospectively organizing what actually changed after a program ended
  • When building reasonable evidence of program contribution rather than rigorous causal proof

When it is unsuitable

  • Programs mainly targeting individual knowledge, skills or attitudes, outside this method's outcome definition
  • Short, simple interventions where direct input-to-output measurement is sufficient

Participants, roles, and deliverables

Participants and roles

1–2 evaluators or facilitators, program staff providing information and descriptions, external substantiators interviewed, and stakeholders in interpretation sessions

Main deliverables

  • Outcome register: descriptions, substantiation and contribution
  • Pattern analysis report
  • Change map, an optional visualization

Implementation steps

  1. Design: define collection scope and sources
    Define changes to collect, including social actors, geographical coverage and period. Identify sources such as implementer records, local partner reports and external observers. Agree standards for outcome statements.
  2. Collect and describe outcomes
    Gather evidence of behavior change from records, reports, emails, interviews and other sources. Describe each outcome in a structured statement: who changed their behavior, how, when and where.
  3. Substantiate outcomes
    Select knowledgeable substantiators independent of the describing organization's claims. Record which parts were supported, disagreements and unverified issues. Specify substantiators' positions and information coverage.
  4. Analyze contribution
    Describe the extent and nature of program involvement in each outcome. Remember this concerns contribution, not sole causation. Also examine competing hypotheses and other factors.
  5. Analyze patterns and interpret
    Analyze collected and substantiated outcomes across cases, organizing change patterns, unexpected outcomes and unrealized changes. Interpret findings in stakeholder review sessions.
  6. Answer evaluation questions and report
    Use analysis to answer evaluation questions and recommend improvements. Retain the outcome register, harvest data, as a learning resource for the next cycle.

Strengths and limitations

Strengths

  • Systematically records unforeseen outcomes and complex change processes.
  • Substantiation emphasizing evidence rather than testimony improves reporting credibility.
  • Useful for interventions such as advocacy or policy change where standard indicators are difficult to define.
  • Implementer involvement advances evaluation and learning together.

Limitations

  • The distinctive, narrow definition of outcomes as behavior change requires care when integrating with other frameworks.
  • Substantiation requires time and skills; checking changes involving hard-to-reach actors can be difficult.
  • Unclear criteria for outcome significance or value bias what is collected.

Common pitfalls

  • Omitting substantiation and treating collection and description as completion produces merely a self-reported list.
  • Confusing outcomes with outputs. Conducting training or submitting a report is not an outcome.
  • Overclaiming contribution as attribution damages credibility. Consistently use appropriate wording such as “The program was one factor contributing to the change.”

Conditions of use and evidence

  • During substantiation, check with people independent of the intervention who know about the change and contribution. [1]
Fictional example; not actual results

Check how a partner changed referral procedures

A fictional illustrative example verifying a report that referral procedures changed after a support organization's study session.

Social actor: individual, organization or groupSpecific behavior changeTime and place of changeOverview of the process leading to change
Partner consultation desk BIntroduced advance contact with referral destinations after obtaining the person's consentAugust 2026, desk BB revised internal procedures after a study session examining interrupted referrals.

Common errors in judgment

Common mistake

Treating creation of training materials as an outcome

How to revise

Record how recipients' behavior changed.

ReasonDistinguish outputs from social change.

Common mistake

Treating program staff approval as completed substantiation

How to revise

Also check with independent sources knowledgeable about the change.

ReasonA process addressing self-report bias is necessary.

References and checked sections

  1. Outcome harvesting
    Ricardo Wilson-Grau et al. / BetterEvaluation
    Section consulted
    Steps in the process; 4. Substantiate; Principles
    How it relates to the text
    During substantiation, check with people independent of the intervention who know about the change and contribution.
    Source checked: (includes AI cross-checking)

Editorial and checking information

Content updated: Source checked: (includes AI cross-checking)No documented human reviewIncludes fictional examplesEditorial policy and scope of checkingCite this pageReport a correction

How to cite this page

EvalCompass Editorial Team. “Outcome Harvesting”. EvalCompass, updated 2026-10-07. https://evalcompass.jun-nakatani.com/en/methods/outcome-harvesting/
Add the date you accessed the page. Text created by this site is available under CC BY 4.0. Quotations, external materials, and bundled fonts have their own terms of use. When reusing content, credit the source, link to the license, and indicate any changes.

Suggest a correction or improvement to this page

Change history
  • — Updated explanations to correspond with sources, and added method-specific fictional worksheet examples, judgment examples and revision history.
  • — Made minimal corrections to assertions, fixed conditions or inconsistencies between worksheets and examples based on content check FW-03. Preserved field counts, order, labels and section structure. Did not change verification status of unchecked material.