Start with the decision
A score used to guide revision has a different role from a score used to place a student or certify a qualification. Ask what action will follow from the result. The stakes help determine what evidence, explanation and review arrangements are needed.
Look for the writing task and criteria
A number is difficult to interpret without knowing the task it describes. Find the prompt, the expected audience, the conditions and the criteria. A score from a brief timed task should not be treated as an account of everything a person can write in every setting.
Ask how the judgment was made
Look for information about who or what assessed the work, what the system was designed to measure and how results were checked. Agreement between two scores is one question. Whether those scores support a particular use is another question that needs its own evidence.
Keep feedback distinct from ranking
A useful revision comment identifies something a writer can inspect and change. A rank or total may not explain that next step. Ask for the reasoning, the relevant passage and the criterion behind an important judgment, rather than assuming the number is an explanation.
Consider the student’s own process
An assessment should have a clear purpose and a fair way to question an important judgment. Our petition asks institutions to protect students’ independent authorship, consider drafts and reasoning, and give students an opportunity to respond to concerns about their work.
AN ORIGINAL WORKED EXAMPLE
A useful question
What does this score allow someone to conclude about this piece of writing?
A second question
What would require another writing sample, another kind of evidence or a human explanation?
ONE THING TO TRY
Before acting on a writing score, ask for its task, criteria, intended use and a way to question the result.
Build a revision planFurther reading
Project credit: Human Readers. No named human or expert review is claimed for this launch guide.
Report a factual or editorial issue ↗