Meta-evaluation checklist (aligned with Joint Committee standards)

Keep the evaluation report at hand and score each standard with supporting evidence. After scoring, enter overall observations and recommendations for improvement.

When to use this worksheet and what completion involves Fictional completed example

EvalCompass Worksheet

Meta-evaluation checklist (aligned with Joint Committee standards)

Method: Meta-Evaluation

Keep the evaluation report at hand and score each standard with supporting evidence. After scoring, enter overall observations and recommendations for improvement.

Basic information

Enter the evaluation being reviewed and the reviewers

Completed example for this section (fictional)

This fictional example is for explanation. Adapt it to your own program. Your entries will not change.

Name of evaluation being reviewed: End-of-program evaluation of learning support (fictional)
Implementing organization and year of evaluation: Fictional support organization / FY2026
Meta-evaluator: External reviewer D
Meta-evaluation date: September 13, 2026
Standards framework used (e.g., Joint Committee standards, third edition): Simplified review using the five attributes in JCSEE's third edition (2010)

Reason for this entry: Clarify the relationship between the reviewer and the evaluation being reviewed.

Name of evaluation being reviewed

Implementing organization and year of evaluation

Meta-evaluator

Meta-evaluation date

Standards framework used (e.g., Joint Committee standards, third edition)

Writing tips and explanation for this section

About this section

Enter the evaluation being reviewed and the reviewers

Clarify the relationship between the reviewer and the evaluation being reviewed.

View the method explanation

Writing tips

Follow each field’s heading to record the program name, focus, period, and other details. Leave undecided matters clearly marked as unresolved.

Read the full fictional example

Utility ratings

Rate whether the evaluation meets intended users' information needs (4 = strongly meets / 3 = mostly meets / 2 = partly meets / 1 = does not meet)

Completed example for this section (fictional)

This fictional example is for explanation. Adapt it to your own program. Your entries will not change.

Scroll horizontally to view the table

Standard	Score (1–4)	Evidence and comments
U3: Clarity of purpose	3	States that findings will inform target participant selection next year
U5: Relevant information	2	No materials on the experiences of absent children

Reason for this entry: Select a limited set of standards and present the evidence.

Scroll horizontally to view the table

Standard	Score (1–4)	Evidence and comments

Writing tips and explanation for this section

About this section

Rate whether the evaluation meets intended users' information needs (4 = strongly meets / 3 = mostly meets / 2 = partly meets / 1 = does not meet)

Select a limited set of standards and present the evidence.

View the method explanation

Writing tips

Keep the information in each row aligned. Scroll wide tables horizontally to see every column.

Read the full fictional example

Feasibility, propriety, accuracy and accountability ratings

Enter scores and evidence similarly for the main standards under each attribute

Completed example for this section (fictional)

This fictional example is for explanation. Adapt it to your own program. Your entries will not change.

Scroll horizontally to view the table

Attribute	Standard	Score (1–4)	Evidence and comments
Feasibility	F2: Practical procedures	3	Used existing records to reduce data collection burden
Propriety	P3: Human rights and dignity	Undetermined	Requested additional records of consent explanations
Accuracy	A5: Information management	2	Insufficient records of how missing data were excluded
Accountability	E1: Evaluation documentation	2	Cannot identify the version of analysis procedures used

Reason for this entry: Distinguish insufficient documentation by entering “undetermined” in the scoring field too.

Scroll horizontally to view the table

Attribute	Standard	Score (1–4)	Evidence and comments

Writing tips and explanation for this section

About this section

Enter scores and evidence similarly for the main standards under each attribute

Distinguish insufficient documentation by entering “undetermined” in the scoring field too.

View the method explanation

Writing tips

Keep the information in each row aligned. Scroll wide tables horizontally to see every column.

Read the full fictional example

Overall observations

Describe overall strengths, major weaknesses and serious problems, if any

Completed example for this section (fictional)

This fictional example is for explanation. Adapt it to your own program. Your entries will not change.

The intended use is clear, but information about absentees and records needed to reproduce analysis are insufficient. Judgment on the appropriateness of consent procedures is deferred until additional materials arrive.

Reason for this entry: Limit overall observations to what can be established.

Writing tips and explanation for this section

About this section

Describe overall strengths, major weaknesses and serious problems, if any

Limit overall observations to what can be established.

View the method explanation

Writing tips

Use the example as a reference and record what you have established about your own program. Distinguish assumptions and unchecked matters from confirmed facts.

Read the full fictional example

Improvement recommendation

Enter specific improvements for the next evaluation cycle in priority order

Completed example for this section (fictional)

This fictional example is for explanation. Adapt it to your own program. Your entries will not change.

Scroll horizontally to view the table

Recommendation number	Improvement	Intended recipient	Priority
M1	Add missing-data treatment and analysis procedure versions	Analyst for the evaluation being reviewed	High
M2	Identify where consent explanation materials are stored	Research lead for the evaluation being reviewed	High

Reason for this entry: Address recommendations to those responsible for improving the evaluation, rather than program staff.

Scroll horizontally to view the table

Recommendation number	Improvement	Intended recipient	Priority

Writing tips and explanation for this section

About this section

Enter specific improvements for the next evaluation cycle in priority order

Address recommendations to those responsible for improving the evaluation, rather than program staff.

View the method explanation

Writing tips

Keep the information in each row aligned. Scroll wide tables horizontally to see every column.

Read the full fictional example

Before writing, check when to use the worksheet and what completion involves

Meta-evaluation checklist (aligned with Joint Committee standards) is a worksheet for applying Meta-Evaluation in meetings or individual work. For the overall duration of the method, use “Illustrative estimate (adjust for scale and team): 1–4 weeks (review of a single evaluation) / several months (system-level meta-evaluation)” as a reference, adjusting for scale and resources. Fill in what you know provisionally and leave unresolved matters as questions to check next.

When this worksheet is useful

When checking the credibility and quality of a received evaluation report
When a third party examines the quality of an organization's or ministry's evaluation system as a whole
When learning materials on good evaluation practice are needed as part of evaluation capacity building

Participants and preparation

Meta-evaluation team (1–3 independent evaluation experts) and a commissioner-side coordinator. For a single evaluation, obtain documents from its evaluation team as well.

Bring the materials used for decisions, existing data, and differing stakeholder views to help complete the worksheet.

Suggested order

1. Basic informationEnter the evaluation being reviewed and the reviewers
2. Utility ratingsRate whether the evaluation meets intended users' information needs (4 = strongly meets / 3 = mostly meets / 2 = partly meets / 1 = does not meet)
3. Feasibility, propriety, accuracy and accountability ratingsEnter scores and evidence similarly for the main standards under each attribute
4. Overall observationsDescribe overall strengths, major weaknesses and serious problems, if any
5. Improvement recommendationEnter specific improvements for the next evaluation cycle in priority order

Signs the worksheet is ready for review

Meta-evaluation report
Evaluation quality scoring sheet (by standard)
Recommendations for improvement

Cautions for review

Completing checklists mechanically becomes pass/fail labeling. Design the process as an opportunity for improvement and learning.
Focusing only on methodological standards overlooks utility, including whether evaluation actually informed decisions
Neglecting to check meta-evaluator independence from the evaluation and conflicts of interest

Guides to read before starting

Read a completed fictional example (your entries will not change)

Fictional example; not actual results

The following is a fictional example for illustration. An external reviewer checks a learning support evaluation report against supporting materials.

Basic information

Name of evaluation being reviewed: End-of-program evaluation of learning support (fictional)
Implementing organization and year of evaluation: Fictional support organization / FY2026
Meta-evaluator: External reviewer D
Meta-evaluation date: September 13, 2026
Standards framework used (e.g., Joint Committee standards, third edition): Simplified review using the five attributes in JCSEE's third edition (2010)

Reason for this entry: Clarify the relationship between the reviewer and the evaluation being reviewed.

Utility ratings

Scroll horizontally to view the table

Standard	Score (1–4)	Evidence and comments
U3: Clarity of purpose	3	States that findings will inform target participant selection next year
U5: Relevant information	2	No materials on the experiences of absent children

Reason for this entry: Select a limited set of standards and present the evidence.

Feasibility, propriety, accuracy and accountability ratings

Scroll horizontally to view the table

Attribute	Standard	Score (1–4)	Evidence and comments
Feasibility	F2: Practical procedures	3	Used existing records to reduce data collection burden
Propriety	P3: Human rights and dignity	Undetermined	Requested additional records of consent explanations
Accuracy	A5: Information management	2	Insufficient records of how missing data were excluded
Accountability	E1: Evaluation documentation	2	Cannot identify the version of analysis procedures used

Reason for this entry: Distinguish insufficient documentation by entering “undetermined” in the scoring field too.

Overall observations

Reason for this entry: Limit overall observations to what can be established.

Improvement recommendation

Scroll horizontally to view the table

Recommendation number	Improvement	Intended recipient	Priority
M1	Add missing-data treatment and analysis procedure versions	Analyst for the evaluation being reviewed	High
M2	Identify where consent explanation materials are stored	Research lead for the evaluation being reviewed	High

Reason for this entry: Address recommendations to those responsible for improving the evaluation, rather than program staff.

Common errors in judgment

Rate evaluation quality poorly because its conclusion differs from expectations

How to revise: Check the materials and procedures leading to conclusions against standards

Reason: This separates evaluation quality from preferences about its findings.

Conclude that consent was not obtained because consent records cannot be found

How to revise: Request supporting materials and treat the judgment as undetermined

Reason: Insufficient evidence differs from a confirmed violation.

Editorial and checking information

Content updated: 2026-09-13Source checked: 2026-09-13 (includes AI cross-checking)No documented human reviewIncludes fictional examplesEditorial policy and scope of checking Cite this page Report a correction

References and checked sections

Program Evaluation Standards
Joint Committee on Standards for Educational Evaluation · 2010 (third edition)
Section consulted
Standards Statements; Evaluation Accountability Standards (E1–E3)
How it relates to the text
In addition to evaluation documentation, JCSEE distinguishes internal and external meta-evaluation.
Source checked: 2026-09-13 (includes AI cross-checking)

How to cite this page

EvalCompass Editorial Team. “Meta-evaluation checklist (aligned with Joint Committee standards)”. EvalCompass, updated 2026-09-13. https://evalcompass.jun-nakatani.com/en/worksheets/meta-evaluation/

Add the date you accessed the page. Text created by this site is available under CC BY 4.0. Quotations, external materials, and bundled fonts have their own terms of use. When reusing content, credit the source, link to the license, and indicate any changes.

Suggest a correction or improvement to this page

Change history

2026-09-13 — Updated explanations to correspond with sources, and added method-specific fictional worksheet examples, judgment examples and revision history.