EvalCompassEvalCompass
Causal inference & experimentsCausal inferenceTheory-basedContribution storyComplex contextsTheory-based evaluation

Contribution Analysis

Contribution Analysis
Also known as: Contribution analysis、Contribution assessment

Examines how programs contribute to outcomes through theory of change, multiple sources and alternative explanations. Explains pathways and remaining uncertainty. [1]

Contribution story worksheet — openReferences and checked sections
Difficulty
Intermediate
Cost
Medium
Duration
Illustrative planning durations, not common standards: initial design 1–2 weeks, evidence collection/analysis 1–3 months
Content updated: 2026-09-13Source checked: 2026-09-13 (includes AI cross-checking)No documented human reviewIncludes fictional examples

How it works at a glance

Clarify expected pathways and assumptions and collect supporting and contrary evidence for each stage. Investigate other activities and external conditions too. [1]

Revise explanations from evidence and investigate weak links. This does not assign percentages to contribution without evidence. [1]

① TheoryExplain the contribution logic② EvidenceGather evidence for each link③ Rival explanationsExamine and rule out other factors④ Contribution claimAssess credibilityBuild a theory-based case that the program contributed to changeIterate: add evidence where the contribution story is weak
When a rigorous counterfactual cannot be constructed, compare the theory with evidence and examine rival explanations to strengthen the credibility of the contribution story.

When to use it and when it is unsuitable

When to use it

  • Answer causal contribution questions where RCTs/econometric methods are unsuitable
  • Explain mechanisms and context in complex social, development or multi-year policies
  • A theory of change exists/can be developed with evidence for each step
  • Accountability to donors, funders or policymakers about what worked and how

When it is unsuitable

  • Theory is unclear or impossible and contribution logic cannot be identified
  • Precise effect-size or percentage estimates needed: argues contribution but does not statistically estimate effect sizes
  • Very sparse evidence with no means to check major steps

Participants, roles, and deliverables

Participants and roles

Led by 1–2 evaluators, collecting evidence/interviews from staff, beneficiaries and experts. Independent external evaluation strengthens credibility.

Main deliverables

  • Theory of change diagram and narrative
  • Contribution story report with step evidence and alternatives
  • Evidence matrix: change steps × evidence types/strength
  • Remaining uncertainty and recommendations for further evidence

Implementation steps

  1. Step 1: formulate attribution questions
    Specify whether/how far the program contributed to an outcome. Share that the goal is a contribution argument, not proof of complete attribution.
  2. Step 2: state and agree theory of change
    Document activities → outcomes → impact pathways with assumptions/external factors after stakeholder, implementer and expert agreement.
  3. Step 3: collect and test step evidence
    Systematically collect supporting/refuting existing data, studies, interviews and administrative records; combine quantitative and qualitative evidence.
  4. Step 4: develop the contribution story
    Integrate evidence to explain how the program worked and contributed. State support strength at each step.
  5. Step 5: examine and challenge alternatives
    Systematically examine other policies, social/economic changes and evidence for/against them. Revise contribution claims if alternatives are strong.
  6. Step 6: conclude with uncertainty
    Honestly show missing evidence/untested assumptions and report conclusions with evidence levels. Recommend additional evidence to strengthen the story.

Strengths and limitations

Strengths

  • Systematic logical causal evaluation in complex contexts beyond RCTs or quantitative methods
  • Explicit theory incorporates learning about what worked or failed
  • Fits mixed methods and systematic diverse evidence
  • Transparent participatory processes support use and organizational learning

Limitations

  • Credibility depends heavily on theory quality and thorough evidence; weak stories lack persuasiveness
  • Contribution judgments lack clear objective criteria and rely substantially on evaluators
  • The framework alone yields no contribution percentage or average effect; separately state methods/assumptions for quantitative estimates
  • Exhaustive alternatives are difficult; overlooked explanations cannot be excluded

Common pitfalls

  • Avoid tailoring theory to conclusions. State theory early with staff, include independent perspectives/refutation and retain changes.
  • Selective supportive evidence biases stories. Collect and present alternative evidence fairly too.
  • Hidden uncertainty undermines honesty and trust. State strong support versus weak evidence clearly.
  • Do not list alternatives to meet counts. Examine important external factors or interventions from evidence and report remaining explanations.

Conditions of use and evidence

  • Revise explanations using other contributing factors/alternatives, not only theory-consistent evidence. [1]
Fictional example; not actual results

Examine whether training supported evaluation-plan adoption

A fictional illustration examining an organization's pathway into plan use.

Pathway/explanationFictional evidenceProvisional interpretation
Plan created in trainingTraining draft and meeting version share itemsConsistent with contribution to preparation
Supervisor interventionMeeting invitation includes improvement instructionsAnother factor supporting workplace adoption
Funder form changesChange notice arrived before trainingMay have increased adoption need

Common errors in judgment

Common mistake

Treat the entire theory as correct because outcomes occurred

How to revise

Check each stage and alternative pathways

ReasonOther factors may produce outcomes despite failed intermediate hypotheses.

Common mistake

Assign 70% contribution from impressions alone

How to revise

Describe which evidence supports which change

ReasonPathway explanation and proportion estimation require different testing.

Organize your thinking by writing

Contribution story worksheet

A practical template is available to fill in and print on A4 paper.

Open worksheet

Related practical guides

Theory of changeEvaluation methods for EBPMWhat is impact evaluation?

Related methods

Theory of ChangeProcess TracingQualitative Comparative AnalysisRealist EvaluationLogic Model

References and checked sections

  1. Contribution analysis
    BetterEvaluation
    Section consulted
    Steps in the process
    How it relates to the text
    Revise explanations using other contributing factors/alternatives, not only theory-consistent evidence.
    Source checked: (includes AI cross-checking)

Editorial and checking information

Content updated: Source checked: (includes AI cross-checking)No documented human reviewIncludes fictional examplesEditorial policy and scope of checkingCite this pageReport a correction

How to cite this page

EvalCompass Editorial Team. “Contribution Analysis”. EvalCompass, updated 2026-09-13. https://evalcompass.jun-nakatani.com/en/methods/contribution-analysis/
Add the date you accessed the page. Text created by this site is available under CC BY 4.0. Quotations, external materials, and bundled fonts have their own terms of use. When reusing content, credit the source, link to the license, and indicate any changes.

Suggest a correction or improvement to this page

Change history
  • — Checked sources for definitions and conditions and added fictional examples, judgment rationales and completed entries for every field. Revised unsupported historical or uptake claims. Reviewed procedures and cautions, adjusting fixed counts, thresholds and institutional generalizations. Preserved field positions, types and counts while revising fixed conditions and thresholds.