Peer review

Lesson 12 34 minProducing

In this lesson

By the end, you’ll be able to

  • Write a structured review that opens with a fair summary and separates major concerns from minor points
  • Make every comment specific and actionable, and critique the work rather than the author
  • Read reviews of your own work without despair, and act on the substance behind the tone

Sign in to save your progress

You can keep reading without an account, but completed lessons won’t be saved.

Sign in

Peer review is the last stage of how research becomes trusted, and the one where you finally sit on the other side of the desk. It is not gatekeeping for its own sake; at its best it is a careful reader helping an author make the work as strong as it can be. Learning to review well also makes you a better writer, because you start to see your own drafts the way a reviewer will. This lesson is about giving a review that helps, and taking one without falling apart.

Summaryshow you understood the studyMajor concernswhat threatens the conclusionsMinor pointsfixable detailsconstructive tone throughoutcritique the work, not the author
A useful review has a shape: a fair summary that shows you understood the study, then the major concerns that decide whether the conclusions hold, then the minor points. A constructive tone runs through all of it, and it critiques the work, never the author.

Start by summarizing the study in a sentence or two, so the authors can see you actually read it and understood what they were trying to do. Then separate your comments into major concerns and minor points. A major concern is anything that bears on whether the conclusions are supported: a design that cannot answer the question, a measure that does not capture the construct, a claim that overreaches the evidence. A minor point is a fixable detail that does not threaten the findings: a missing axis label, an unclear sentence, a statistic worth adding. Sorting them this way is not politeness; it tells the author and the editor what has to change versus what would merely help.

Categorize

Sort each draft review comment by how a good reviewer would triage it.

Does it threaten the conclusion (major), is it a fixable detail (minor), or is it just an opinion or an attack (not useful)?

The treatment and control groups differ in age at baseline, and this is not adjusted for, so the effect may be confounded.
With only 12 participants, the study is underpowered for the causal claim in the conclusion.
Figure 2 is missing units on the y-axis.
There is a typo in the third paragraph of the introduction.
I just didn't find this paper interesting.
The authors are clearly not real experts in this area.
How sure?

Every comment should be specific and actionable. 'This paper is weak' helps no one; 'the conclusion claims causation, but the design is cross-sectional, so either soften the claim to association or justify why causation is warranted' tells the author exactly what and how to fix. Critique the work, not the person: 'the authors clearly do not understand statistics' is both an attack and useless, while naming the specific statistical problem is fair and fixable. Two more duties round it out: stay within your competence, telling the editor honestly what you can and cannot assess, and keep the manuscript confidential, never sharing it without the editor's consent.

Exercise

Which review comment is most useful to the authors?

Which comment names the issue, its location, and a fix?

Answer options
How sure?

Signature interactive

Reviewer Seat

The study

A company tested whether its meditation app reduces stress. Twenty-five employees who volunteered used the app for two weeks and reported lower stress afterward than before. The paper concludes the app reduces workplace stress.

A co-reviewer drafted six comments. You are the reviewer of record: triage each as a major concern, a minor point, or something to drop.

There is no control group, so the before-to-after drop could be regression to the mean or expectation, not the app.

Stress is measured only by self-report; a validated scale or a physiological measure would strengthen it.

With 25 volunteers over two weeks, the paper cannot support 'reduces workplace stress' as a general claim.

Please report the exact stress scale used and its range.

There is a grammatical error in the last sentence of the abstract.

Honestly, I'm tired of meditation studies; the topic feels overdone.

Constructed example. The point is the reasoning, not this specific paper.

One day the reviews will be about your work, and some will be blunt. The skill is to separate the tone from the substance. A harsh review is often a specific, correct review wrapped in a bad mood, and the useful part is still in there. Read past the sharp edges, address each concrete point, revise where the critique is right, and explain politely where you disagree. Rejection and criticism are not verdicts on you; they are part of how the work gets stronger. The researchers who improve fastest are the ones who can hear a hard review without either collapsing or getting defensive.

Written response

Lab. You are reviewing this study. Abstract: 'We surveyed 60 students at one high school who use a study app. App users reported studying more and had higher self-reported grades than non-users. We conclude the app improves academic performance and recommend schools adopt it.' Write a short, structured review: one sentence summarizing the study, then your major concerns, then any minor points, keeping your tone constructive.

Summary sentence, then major (design, self-selection, self-report, overreaching recommendation), then minor (response rate, measures), constructive throughout.

0/80 words

How sure?

Checkpoint · item 1 of 5

What should a good peer review usually open with?

How do you show the authors you actually read and understood it?

How sure?

Reflection