EvalCompassEvalCompass
Data collectionQualitative researchBehavioral observationFieldworkHawthorne effectParticipant observation

Observation

Observation
Also known as: Field observation、Structured observation、Participant observation

Directly records behavior and events in practice. Define situations and items and retain observed facts separately from interpretations. [1]

Observation design and recording worksheet — openReferences and checked sections
Difficulty
Intermediate
Cost
Medium
Duration
Illustrative planning durations, not common standards: 1–4 hours per observation, repeated as needed over days to months
Content updated: 2026-09-13Source checked: 2026-09-13 (includes AI cross-checking)No documented human reviewIncludes fictional examples

How it works at a glance

Observation may explore the whole setting or focus on specific behavior or procedures. Set times, locations and observer involvement according to questions. [1]

Omissions and reactions to observers occur. Record rather than relying on memory, and report unobserved scope and alternative interpretations. [1]

  1. Set observation purpose and focus
  2. Design format and tools
  3. Train observers and check reliability
  4. Enter the field and establish relationships
  5. Observe and record
  6. Assess and address Hawthorne effects
  7. Organize and analyze records
Sequence of implementation steps. See “Implementation steps” for details of each stage.

When to use it and when it is unsuitable

When to use it

  • Check whether implementation follows plans: fidelity
  • Record participant behavior, dialogue and environments directly rather than by self-report
  • Reveal behavior or tacit processes difficult to describe in interviews or surveys
  • Evaluate indicators needing site checks, such as service quality or environmental safety

When it is unsuitable

  • Observer presence substantially changes behavior: strong Hawthorne effects; repeated longer observation may promote familiarity
  • Large dispersed activities need rapid assessment: observation is limited by time and geography
  • Internal attitudes or past experiences: combine interviews or questionnaires

Participants, roles, and deliverables

Participants and roles

Observers suited to purpose and site scale. When multiple people record, share targets and criteria and examine interpretive differences.

Main deliverables

  • Observation checklist records by visit or situation
  • Field notes
  • Observation aggregation and analysis report

Implementation steps

  1. Set observation purpose and focus
    Decide what to observe and why against questions. List specific behaviors, events and environmental elements and state exclusions.
  2. Design format and tools
    Choose structured or unstructured observation. For structured work, design checklists and rating scales using specific observable behavior, such as hand-raising counts instead of enthusiasm.
  3. Train observers and check reliability
    Practice observing the same situation with multiple observers and examine disagreements and reasons. Revise definitions and recording, practicing again as needed. State appropriate agreement statistics and judgment rationale for the format and scale when used.
  4. Enter the field and establish relationships
    Explain purpose, methods and records to teachers, staff or other targets beforehand and obtain consent. Use preliminary observation if needed and record reactivity. Do not assume natural behavior returns after a fixed number of visits.
  5. Observe and record
    Alongside checklists, record context, atmosphere and unexpected events in field notes. Separate facts such as what was said from interpretations such as apparent enthusiasm.
  6. Assess and address Hawthorne effects
    Compare behavior and conditions across repeated observations. Do not explain changes solely by familiarity; record differences in participants, activities and times and incorporate them into interpretation.
  7. Organize and analyze records
    Summarize checklist data descriptively and analyze field notes thematically. Compare visits by sequence and situation for consistent patterns and exceptions.

Strengths and limitations

Strengths

  • Directly records actual behavior and environments without self-report
  • Reveals tacit practice and cultural context not expressed verbally
  • Directly examines implementation fidelity
  • Can identify unexpected events and secondary effects

Limitations

  • Observer presence may cause atypical behavior through Hawthorne effects
  • Observable situations, times and places are physically limited
  • Prone to observer interpretation and selective-attention bias
  • Ethical or privacy constraints make some settings unobservable

Common pitfalls

  • Vague items such as active participation yield inconsistent interpretations. Operationalize behavior and give examples.
  • Do not start without checking familiarity with observers and recording. Use preliminary observation as needed to examine reactivity and recording problems.
  • Observation alone does not establish causal change from the program; other evidence is needed.

Conditions of use and evidence

  • State scope and recording conditions because time, fatigue and context affect observation. [1]
Fictional example; not actual results

Observe reception waiting and information

A fictional illustration: records from a 2-hour consultation reception observation.

TimeObserved factInterpretation and further checks
9:10A visitor paused before a sign for 2 minutesInformation may be unclear; not checked with the person
9:12A staff member approached and guided them to receptionAn observed approach; necessity needs confirmation with the person or other evidence

Common errors in judgment

Common mistake

Report satisfaction because someone was silent

How to revise

Record silence as fact and ask about feelings if needed

ReasonBehavior does not uniquely establish inner experience.

Common mistake

Treat one visit as ordinary implementation

How to revise

Vary weekdays and times and record observer reactions

ReasonBehavior may depend on that setting's conditions.

Organize your thinking by writing

Observation design and recording worksheet

A practical template is available to fill in and print on A4 paper.

Open worksheet

Related practical guides

How to design an evaluation questionnaireHow to conduct evaluation interviewsWhat is process evaluation?

Related methods

InterviewCase StudyDocument ReviewParticipatory Rural Appraisal / Participatory Learning and ActionThematic Analysis

References and checked sections

  1. Observation in evaluation
    Richard A. Krueger · 2017
    Section consulted
    Key features of Observation in evaluation
    How it relates to the text
    State scope and recording conditions because time, fatigue and context affect observation.
    Source checked: (includes AI cross-checking)

Editorial and checking information

Content updated: Source checked: (includes AI cross-checking)No documented human reviewIncludes fictional examplesEditorial policy and scope of checkingCite this pageReport a correction

How to cite this page

EvalCompass Editorial Team. “Observation”. EvalCompass, updated 2026-09-13. https://evalcompass.jun-nakatani.com/en/methods/observation/
Add the date you accessed the page. Text created by this site is available under CC BY 4.0. Quotations, external materials, and bundled fonts have their own terms of use. When reusing content, credit the source, link to the license, and indicate any changes.

Suggest a correction or improvement to this page

Change history
  • — Checked definition and condition sources and added fictional examples, judgment rationales and completed fields. Revised unsupported history or uptake claims. Reviewed procedures, fixed counts, thresholds and institutional generalizations while preserving field positions, types and counts. Removed unsupported uniform numerical guidance for observer agreement. Rechecked completed examples against completion checks and conditional procedures.