Reporting, use & meta-evaluationInformed consentConflicts of interestConfidentiality obligationsParticipant protectionIndependence

Evaluation Ethics

Evaluation Ethics
Also known as: Evaluator ethics、Ethical evaluation practice

Examines dignity, voluntary participation, information handling, conflicts of interest and honest reporting in concrete terms. Reviews these according to circumstances from design through publication. [1]

Difficulty
Intermediate
Cost
Low
Duration
Illustrative estimate (adjust for scale and team): applied continuously throughout evaluation (0.5–1 day for initial risk identification)
Content updated: 2026-10-07Source checked: 2026-09-13 (includes AI cross-checking)No documented human reviewIncludes fictional examples

How it works at a glance

Evaluation ethics respects participants' rights, culture and context while reducing harm and disadvantage and collecting and communicating information honestly. AEA's Guiding Principles were updated in 2025 and set out systematic inquiry, competence, integrity, respect for people, and common good and equity. [1]

Translate principles into procedures for explanations that allow free refusal, confidentiality protection, disclosure and management of conflicts, and responses to pressure. Professional ethics guidance alone does not determine legal compliance or approval of an individual study; checks must reflect actual conditions. [1]

  1. Identify ethical risks in advance
  2. Design informed consent
  3. Plan data protection, anonymization and confidentiality
  4. Disclose and manage conflicts of interest
  5. Implement consideration for people in vulnerable circumstances
  6. Ensure cultural responsiveness
  7. Ensure honest reporting
Sequence of implementation steps. See “Implementation steps” for details of each stage.

When to use it and when it is unsuitable

When to use it

  • When identifying ethical risks and designing responses during evaluation planning
  • In every evaluation involving research with people, including interviews or observation
  • When participants include people in vulnerable circumstances, such as children, refugees or people with disabilities
  • When commissioners require independence and fairness in an external evaluation
  • When deciding whose interests to protect and how when reporting or disclosing findings

When it is unsuitable

  • Using an ethics checklist alone to determine approval or legal compliance for an individual study.
  • Secondary data and document analysis also require checks of use conditions, reidentification, confidentiality and honest reporting.

Participants, roles, and deliverables

Participants and roles

All team members are responsible for ethical compliance. IRB review is desirable for large evaluations or those involving vulnerable groups.

Main deliverables

  • Ethical risk assessment record
  • Signed informed consent forms
  • Conflict of interest disclosure
  • Completed evaluation ethics checklist

Implementation steps

  1. Identify ethical risks in advance
    Early in planning, identify participants, informants, potential conflicts of interest and groups requiring cultural consideration. Ask who could be harmed by the evaluation and which interests could threaten fairness, and assess the nature and severity of risks.
  2. Design informed consent
    Explain the purpose, commissioner, data use and publication, storage, voluntary participation, scope for refusal and withdrawal, and recording in accessible ways. Check understanding and willingness, and design necessary support or additional consent procedures according to individual conditions and applicable rules.
  3. Plan data protection, anonymization and confidentiality
    Determine storage locations, access restrictions, anonymization procedures and disposal dates in advance and document them in the evaluation plan. Check relevant privacy laws and use data only within participants' consent. Interview transcripts and recordings require particularly strict management.
  4. Disclose and manage conflicts of interest
    Disclose relationships that could influence judgments, including employment, contracts, funding and personal interests, from before the evaluation begins. Discuss responses and remaining constraints, considering changed roles or withdrawal if fair implementation is impossible.
  5. Implement consideration for people in vulnerable circumstances
    Where participants include children, older people, people with disabilities, refugees, ethnic minorities or others with less power, give utmost attention to voluntary consent, culturally and linguistically suitable explanations, privacy and reduced psychological burden. If evaluation affects selection for a social intervention, explain the possibility of not receiving benefits and the right to withdraw.
  6. Ensure cultural responsiveness
    Consider participants' cultural backgrounds, gender, religion, ethnicity and values throughout design, implementation and interpretation. Recognize interpretive bias from external perspectives and reflect participants' views in findings. Actively gather the voices of vulnerable people, especially where stakeholders with unequal power participate.
  7. Ensure honest reporting
    Do not distort findings for convenience; explain positive and negative findings, funding relationships and limitations. Keep reasons and histories for revisions, and handle disagreements and disclosure scope according to prior conditions and participant protection.

Strengths and limitations

Strengths

  • Protecting participants' rights and safety strengthens trust and the quality of information provided
  • Disclosing and managing conflicts enables explanation of evaluators' relationships and conditions affecting judgments.
  • Identifying ethical dilemmas in advance can prevent confusion and disputes during implementation
  • Cultural responsiveness enables fair evaluation practice across diverse groups

Limitations

  • Thorough ethical consideration increases design and implementation costs and time
  • Commissioners' accountability requirements and confidentiality obligations to participants can fundamentally conflict, often without complete resolution
  • Highly culturally responsive practice requires deep cultural and community understanding, which external evaluators may lack
  • Guidelines provide standards for ethical conduct, but application in specific situations relies on evaluators' continuing ethical reflection

Common pitfalls

  • Treating informed consent as paperwork without checking actual understanding and agreement
  • Checking conflicts only after completion, discovering them after fairness has been compromised. Disclosure before accepting the assignment is the principle.
  • Responding ambiguously to commissioner pressure to remove or change inconvenient findings. Specify agreed change procedures in the contract in advance.
  • Writing consideration for vulnerable participants into the design but forgetting it during implementation. Stage-by-stage checklist reviews help.

Conditions of use and evidence

  • Continuously examine evaluators' conflicts of interest and power relationships alongside respect for participants and avoidance of harm. [1]
Fictional example; not actual results

Prepare interviews that service users can decline

The following is a fictional example for illustration. Interviews with life consultation service users are planned, separating support from study participation.

Participant groupExplanation content (purpose, uses, right to decline, etc.)Consent method (written/oral)Special considerations for vulnerable groupsImplemented (〇/×)
Adult service usersPurpose, voluntary participation, no effect on support if declining, scope of use and withdrawalWritten consent after an accessible information sheet and oral confirmationExplain without support staff present. Check needs for a preferred support person or interpreter.×
Consultation office staffScope of use for work evaluation, confidentiality and publication of statementsWritten consent after explanationAvoid supervisors' presence and confirm that individual statements will not be passed to personnel appraisals×

Common errors in judgment

Common mistake

Assume a signed consent form permits any publication

How to revise

Check the explained purpose and scope and the possibility of reidentification

ReasonThis aligns consent with actual publication content.

Common mistake

Quietly delete findings inconvenient to the commissioner

How to revise

Retain reasons for revisions and differing views, responding according to reporting conditions

ReasonThis preserves evaluation integrity and accountability.

References and checked sections

  1. Guiding Principles
    American Evaluation Association · Updated in 2025
    Section consulted
    Introduction; Integrity; Respect for People; Common Good and Equity
    How it relates to the text
    Continuously examine evaluators' conflicts of interest and power relationships alongside respect for participants and avoidance of harm.
    Source checked: (includes AI cross-checking)

Editorial and checking information

Content updated: Source checked: (includes AI cross-checking)No documented human reviewIncludes fictional examplesEditorial policy and scope of checkingCite this pageReport a correction

How to cite this page

EvalCompass Editorial Team. “Evaluation Ethics”. EvalCompass, updated 2026-10-07. https://evalcompass.jun-nakatani.com/en/methods/evaluation-ethics/
Add the date you accessed the page. Text created by this site is available under CC BY 4.0. Quotations, external materials, and bundled fonts have their own terms of use. When reusing content, credit the source, link to the license, and indicate any changes.

Suggest a correction or improvement to this page

Change history
  • — Corrected descriptions and procedures identified through content checks (U01). Preserved input field order, counts, labels and section structure.
  • — Updated explanations to correspond with sources, and added method-specific fictional worksheet examples, judgment examples and revision history.