EvalCompassEvalCompass
Design & theoryJudgment criteriaPerformance level descriptionsQualitative evaluationEvaluation criteriaDavidson

Rubric-Based Evaluation

Rubric-Based Evaluation
Also known as: Evaluation rubric、Evaluation criteria table、Scoring guidance

An assessment table linking what is evaluated to concrete conditions at each performance level. It communicates the reasoning that connects evidence to judgments. [1]

Evaluation rubric worksheet — openReferences and checked sections
Difficulty
Intermediate
Cost
Low
Duration
Illustrative estimate (adjust for scale and staffing): half a day to 2 days (rubric development workshop)
Content updated: 2026-09-13Source checked: 2026-09-13 (includes AI cross-checking)No documented human reviewIncludes fictional examples

How it works at a glance

A rubric sets several performance levels for each evaluation dimension and describes them using observable characteristics. It explains which evidence supports a judgment, rather than merely assigning a score. [1]

During development, check with stakeholders for missing important dimensions and test the rubric on actual records and cases to examine differences between levels. If scores are aggregated, specify integration methods, including weights and minimum requirements. [1]

Criterion / levelExcellentGoodMinimumInsufficientEffectivenessEfficiencySustainabilityDescribe in advance what each performance level means in every cell
Describe each cell in a matrix of evaluation criteria and performance levels. This makes judgments more transparent.

When to use it and when it is unsuitable

When to use it

  • Making transparent the criteria underlying an overall judgment, such as whether a program succeeded
  • Sharing consistent judgment criteria among multiple evaluators or experts
  • Evaluating a program across dimensions using DAC or other criteria and rating each dimension
  • Enabling communities and beneficiaries to define success themselves in participatory evaluation

When it is unsuitable

  • When a single quantitative indicator, such as return on investment or beneficiary numbers, is sufficient; a descriptive rubric is excessive
  • Where making criteria explicit in advance is politically difficult, although that is itself a problem

Participants, roles, and deliverables

Participants and roles

Lead evaluator and stakeholder representatives for development; the entire evaluation team for application. 3–8 people is a guide.

Main deliverables

  • Evaluation rubric (criteria × levels × descriptors)
  • Dimension rating sheet
  • Overall judgment report with rubric-based rationale

Implementation steps

  1. Define evaluation dimensions and criteria
    Decide what to evaluate. Refer to the 6 DAC criteria and program-specific perspectives to select criteria needed for the intended use.
  2. Define performance levels
    Choose levels for each criterion: 3 (excellent / good / needs improvement) or 4–5. Name levels so their evaluative direction is clear.
  3. Develop descriptors
    In each criterion × level cell, describe the concrete condition or evidence matching that level in 1–3 sentences. Avoid vague wording such as “largely achieved” or “generally good”; describe observable characteristics.
  4. Consider weights
    If criteria have different importance, agree with stakeholders on the rationale for weighting. An unweighted rubric is also a common starting point.
  5. Pilot and adjust
    Apply the rubric to actual data and cases, check whether descriptors fit reality and differences among evaluators are acceptable, and adjust it.
  6. Design the overall judgment process
    State how dimension ratings are integrated into an overall judgment, for example whether the lowest-rated criterion determines the overall judgment or a weighted average is used.

Strengths and limitations

Strengths

  • Makes criteria for success transparent, reducing arbitrary and subjective judgments
  • Documents the grounds for an overall judgment integrating several evaluation dimensions
  • Stakeholder participation in rubric development creates shared understanding of criteria
  • Concrete level descriptions support recommendations for improvement after evaluation

Limitations

  • Rubric development takes time and can be costly for a one-off evaluation
  • Describing levels is difficult and requires skilled, experienced evaluators
  • Dynamic and emergent changes are difficult to standardize, so a rubric may not fully capture reality

Common pitfalls

  • Descriptors such as “good implementation” are too vague to resolve differences among evaluators
  • Evaluators alone choose criteria without reflecting stakeholders’ and beneficiaries’ views of what matters
  • Reporting only dimension scores without integration rules prevents an overall conclusion
  • Treating a rubric as a mechanical scoring formula and omitting evidence-based judgment

Conditions of use and evidence

  • Pilot level descriptions and check consistency when multiple evaluators use them. [1]
Fictional example; not actual results

Assessing whether a draft evaluation plan is usable

The following fictional example uses 4 levels to assess correspondence between questions and indicators in plans prepared during an NPO staff workshop.

CriterionLevel 4 (excellent)Level 3 (sufficient)Level 2 (partly achieved)Level 1 (needs improvement)
Correspondence between questions and indicatorsEach question has indicators and judgment criteria, and limitations can be explainedEach question has corresponding indicators and judgment criteriaIndicators exist but their correspondence to some questions is unclearOnly indicators are listed, without questions
Feasibility of collectionSources, timing and responsibility are confirmed and pilotedSources, timing and responsibility are specifiedAt least one of the 3 elements remains undecidedNo collection plan

Common errors in judgment

Common mistake

Describing level 3 only as “generally good”

How to revise

Describe a state in which questions, indicators and judgment criteria correspond

ReasonDifferent evaluators can then examine the same evidence.

Common mistake

Passing a plan without needed sources because other items score highly

How to revise

Assess collection feasibility separately as an essential requirement

ReasonAverages can conceal serious deficiencies.

Organize your thinking by writing

Evaluation rubric worksheet

A practical template is available to fill in and print on A4 paper.

Open worksheet

Related methods

Key Evaluation QuestionsIndicator DesignOECD-DAC Evaluation CriteriaUtilization-Focused Evaluation

References and checked sections

  1. Rubrics
    BetterEvaluation
    Section consulted
    Main text; Advice for choosing this method; Advice for using this method
    How it relates to the text
    Pilot level descriptions and check consistency when multiple evaluators use them.
    Source checked: (includes AI cross-checking)

Editorial and checking information

Content updated: Source checked: (includes AI cross-checking)No documented human reviewIncludes fictional examplesEditorial policy and scope of checkingCite this pageReport a correction

How to cite this page

EvalCompass Editorial Team. “Rubric-Based Evaluation”. EvalCompass, updated 2026-09-13. https://evalcompass.jun-nakatani.com/en/methods/rubric/
Add the date you accessed the page. Text created by this site is available under CC BY 4.0. Quotations, external materials, and bundled fonts have their own terms of use. When reusing content, credit the source, link to the license, and indicate any changes.

Suggest a correction or improvement to this page

Change history
  • — Updated explanations to correspond to the sources and added method-specific fictional completed examples, judgment examples and a change log.