Skoči na glavni sadržaj

Peer review by patients and the public

Comment on our reviews in progress based on your lived experience

This content is available only in English

You can enrich our evidence by becoming a peer reviewer.

What is peer review?

Peer review means giving feedback on Cochrane protocols and reviews before they are published. Researchers peer review medical research before it is published to check its quality. At Cochrane, we believe that patients and the public also have a valuable role to play in reviewing our evidence in progress. As a patient or member of the public, you can give feedback on Cochrane protocols and reviews before they are published.

  • A Cochrane protocol is a short document explaining how the review authors plan to carry out a systematic review.
  • A Cochrane review looks at the results of studies for a treatment or intervention. The authors analyse the data and present the evidence for the effectiveness of the treatment. Watch a video to find out more about systematic reviews.

Cochrane reviews all contain a short introduction that summarises the key question the review set out to answer and the review findings, written in a way that everyone can understand. This is called the plain language summary. Read plain language summaries of our reviews.

Why is peer review by patients and the public important?

Feedback from patients and the public is important to make sure that Cochrane reviews are:

  • easy to understand
  • written in plain language
  • relevant and sensitive to patients' needs
  • helpful to patients and members of the public who need to make decisions about health care.

Cochrane is committed to involving patients and the public in producing health evidence. We want to make sure our reviews address questions that are important to patients. This makes Cochrane reviews both more relevant and trustworthy. 

Many of Cochrane's funders and partners also expect and require us to involve patients and the public in our work. Like us, they recognise that patient and public involvement can improve health outcomes for all: patients and the public help to produce Cochrane evidence; our evidence informs healthcare policy and guidelines; policy and guidelines improve practice; and better practice means better outcomes for patients.

What will I be asked to do as a peer reviewer?

You will be asked to read a draft of a Cochrane protocol or review. Then you will be asked to complete a feedback form with questions that guide you through the different sections of the protocol or review. You will have the chance to think carefully about the protocol or review and raise issues that you think are important.

We ask you to explain any changes you would like the authors to make. For instance, you could suggest specific changes to wording to make the review easier to understand. Your comments should be respectful and objective.

You may not want to comment on all the sections of the review, but your views on the following sections will be particularly helpful: the plain language summary (for example, whether the language can be understood by patients and the public), background, outcomes, implications for practice, implications for research, abstract and synopsis.

Cochrane has different feedback forms for protocols and reviews, and for different types of review. All forms include sections on conflicts of interest and acknowledgements. You can see example forms below.

Example feedback form - Protocol: Intervention review (Patient and Public reviewer)
Conflicts of Interest
  • Are you an employee (full-time or part-time) of an organization with a financial interest in the topic of the article?
  • Do you own a commercial organization with a financial interest in the topic of the article?
  • Do you have any other direct financial interests relevant to the topic of the article?
  • Do you personally own a patent (or pending application for a patent) for an intervention, diagnostic test or prognostic marker that is relevant to the topic of the article?
  • Do you have a relationship with any of the authors of the article?
  • Are you an author of a study that might be included in the review?
Acknowledgement

You have the option throughout the peer review process to remain anonymous to the authors, if you choose. The authors will be encouraged to acknowledge your contribution but can do so only with your written permission.

  • Do you give permission to be acknowledged as a peer reviewer in the published article?
  • If so, do you choose to be named, or to be anonymous? If named, please provide your name and any affiliations as you wish them to appear.
  • Do you give permission to be acknowledged as a peer reviewer in a list of peer reviewers on a Cochrane website?
  • If so, do you choose to be named, or to be anonymous? If named, please provide your name and any affiliations as you wish them to appear.
Feedback questions
  1. Background: Does the background explain the topic clearly (i.e. are the healthcare need and intervention clear)? If not, which words or phrases are not clear, or how would you describe them? Does the background address the hopes and concerns of people considering the treatment? Is it clear “why it is important to do the review”
  2. Objectives: Are the objectives of the Cochrane protocol clearly described? If not, which words or phrases are not clear, or can you suggest any improvements? Are the objectives relevant, and do you think they would help patients, carers and the public in making a healthcare decision? If not, please provide your reasons.
  3. Types of studies: Is it clear what types of studies (e.g. randomised controlled trials, observational studies) are to be used? Are the study designs appropriate? If not, please suggest the addition or deletion of any study designs.
  4. Types of participants: Do the proposed participants cover all relevant groups of people who might want to use this treatment? If not, who else would it be helpful to include or exclude?
  5. Types of interventions:  Are the study interventions and comparisons/controls clearly described? Are the included interventions appropriate? If not, please explain.
  6. Types of outcome measures: Are the outcome measures (benefits and harms/side effects) the ones that are important to consumers, patients and the public? Can you highlight any other outcomes that are important to users of this review?
  7. Search methods for identification of studies: Do you have any comments on this section?
  8. Data collection and analysis: Do you have any comments on this section?
  9. Declarations of interest: Does the Cochrane protocol acknowledge possible interests of the authors (e.g. personal or financial) that could have influenced them?
  10. Language and style of writing: Is the Cochrane protocol reasonably easy to understand? Is the technical language used appropriately, and where possible, explained? If not, which sections need to be clearer and can you suggest any improvements? Is any language insensitive to consumers? Please suggest alternative phrases if possible.
  11. Words requiring further definition: Please list below any words that you think need further definition.
  12. Additional comments: Please add any other comments that you may have.
Example feedback form - Review: Intervention (Patient and Public reviewer)
Conflicts of Interest
  • Are you an employee (full-time or part-time) of an organization with a financial interest in the topic of the article
  • Do you own a commercial organization with a financial interest in the topic of the article?
  • Do you have any other direct financial interests relevant to the topic of the article?
  • Do you personally own a patent (or pending application for a patent) for an intervention, diagnostic test or prognostic marker that is relevant to the topic of the article?
  • Do you have a relationship with any of the authors of the article?
  • Are you an author of a study that might be included in the review?
Acknowledgement
  • Do you agree to being acknowledged as a peer reviewer in the published article?
  • Do you agree to being acknowledged as a peer reviewer in a list of peer reviewers on a Cochrane website?
  • If yes, please include your name and any affiliation as you wish it to appear.
Feedback questions
  1. Title: Please note that the title has already been peer reviewed and agreed to in the published Cochrane protocol (available on the Cochrane Library). We therefore we do not expect you to comment on the title. If you can suggest an improvement, however, please do so here and the editors will consider it.
  2. Abstract: Is there anything mentioned in the Cochrane review that may be important, but is missing from the Abstract? Do you think that the Abstract overstates or understates what was found in the Cochrane review?
  3. Plain language summary title: Does the Plain language summary title reflect the title of the Cochrane review, and is it easy to understand? If not, can you identify which words or phrases are difficult to understand, or could you suggest any improvements to the wording?
  4. Plain language summary population: Is the health problem or issue being addressed stated clearly?
  5. Plain language summary interventions: Are the interventions and comparisons/controls examined in the Cochrane review stated clearly and succinctly in this section?
  6. Plain language summary findings: Does the Plain language summary report the main findings from the Cochrane review clearly and accurately? Does it report on adverse effects or harms?
  7. Plain language summary quality of evidence: Does the Plain language summary describe the overall quality of the evidence, and comment on any issues that could affect the findings of the review?
  8. Plain language summary consistency: Do you think the findings in the Plain Language Summary are consistent with the Abstract and the rest of the Cochrane review? Is there anything mentioned in the review that may be important, but is missing from the plain language summary? Do you think that the plain language summary overstates or understates what was found in the review?
  9. Plain language summary usefulness: Do you think the Plain language summary would help patients, carers and the public in making a healthcare decision? If not, is there anything missing from the Plain language summary that you think should be included?  Do you have any other suggestions for improvement?
  10. Writing style of the Plain language summary: Is the Plain language summary written in plain language and easy to understand? Are sentences too long or wordy? Are there any parts that you think should be rewritten?
  11. Terminology in the Plain language summary: Are abbreviations, research terms and technical terms avoided or explained? If any terms require clarification, please include them here.
  12. Background/Objectives/Criteria for considering studies for this review/Search methods for identification of studies/Data collection and analysis: Please note that these sections were published in the Cochrane protocol (available in the Cochrane Library) and have therefore been peer reviewed. If you would like to provide any comments, please do so here and the editors will consider them. Major suggestions for change are more likely to be considered for future updates of the Cochrane review than this version.
  13. Results: Can you understand the format of the results? Is it clear whether the intervention was effective or not?
  14. Quality of the evidence and risk of bias: Do the results include information about the overall quality of the evidence, and risk of bias?
  15. Study funding: Does the section ‘Included studies’ and the ‘Characteristics of included studies’ table include details about the funding sources for the studies?
  16. Discussion: Do the authors discuss harms as well as benefits? Are the effects of the treatments over- or understated?
  17. Author’s conclusions, implications for practice: Is this section clear and reasonably easy to understand?
  18. Author’s conclusions, implications for research: Do you think the authors have identified the important areas for future research? Are there any missing? Are there any benefits or harms important for healthcare users that are not addressed in the studies that you would like to see highlighted here?
  19. Declarations of interest: Does the Cochrane review acknowledge possible interests of the authors (e.g. personal or financial) that could have influenced them? If you don’t have any comments on declarations of interest, please leave blank.
  20. Summary of findings table: Do you think the outcomes included in the Summary of findings table are the most important outcomes to people with experience of the health condition? If not, please list them here.
  21. Language and style of writing: Is the Cochrane review reasonably easy to understand? Is the technical language used appropriately, and where possible, explained? If not, which sections need to be clearer and can you suggest any improvements? Is any language insensitive to patients or the public? Please suggest alternative phrases if possible.
  22. Words requiring further definition: Please list below any words that you think need further definition.
  23. Additional comments: Please add any other comments that you may have.

What are the benefits of being a peer reviewer?

When you give feedback on a Cochrane review, you are making a difference. Feedback from patients and the public improves the quality of Cochrane evidence. Your comments help us make sure our reviews are useful to patients, carers and the public.

At Cochrane, we believe it is important to reward everyone who contributes to our work. Your contributions will earn points that count towards earning Cochrane Membership. You can track your contributions as a peer reviewer in your Cochrane account. It is free and simple to sign up for a Cochrane account.

Cochrane has no policy on payment for involvement and in general peer review is not rewarded financially.

Training and resources 

  • Evidence Essentials : Take this free course if you are new to peer review and Cochrane evidence. The four modules introduce evidence-based medicine, clinical trials, and how to understand Cochrane evidence as a member of the public.
  • Conducting an Intervention Review: Take this course to find out more about the methods and research used in Cochrane reviews. As a peer reviewer, you can access this course for free.

Your experience

You may have become involved in Cochrane's work because of your lived experience of healthcare conditions. This is often underpinned by complex emotions. While this is often positive, you may need support if a review topic is directly relevant to your health status or condition. There is support available for you.

How can I volunteer for peer review?

You can volunteer to peer review as a patient or member of the public through Cochrane Engage. Cochrane Engage is our online volunteer hub. It connects Cochrane review authors and editors with people who have the time and expertise to get involved in our work. Once you have a Cochrane account, you can quickly set up a profile on Cochrane Engage. Then you can search for tasks that match your interests and skills. 

How do I provide my feedback on reviews and protocols?

Cochrane uses a system called Editorial Manager to collect online feedback on draft protocols and reviews. The instructions below explain the full process, from accepting an invitation to peer review to submitting your feedback.

Agree to an invitation to provide written feedback

You will receive an email from the Cochrane Review Group editing the draft review, inviting you to provide feedback. The email will include details of the draft review, and a suggested deadline for your comments. The email will also include a link to accept the invitation to review. 

Please accept your invitation within 7 days or you will be automatically uninvited. When you click on the Agree to Review link in your invitation email, you will be taken to the Cochrane account login screen. 

 

Enter your Cochrane account username (your email address) and password. We recommend using Chrome or Firefox as your browser. 

If you do not wish to provide written feedback, or the deadline is not convenient, you can click the Decline to Review link in the email.

When you have logged into Editorial Manager you will see a message thanking you for agreeing to review. Click on Pending Assignments.

What if I have already agreed to provide feedback?

If you have already been in contact with a Cochrane Review Group – for instance, if you have agreed to review on Cochrane Engage – the email you receive will take you straight to the online form. Click on the Pending Assignments link in the email and log in on the Cochrane account login screen.  When you log into Editorial Manager, you can go straight to the step below to open a copy of the review.

Open a copy of the draft protocol or review

Open your Pending Assignments folder. Click View Submission in the left-hand menu to open a PDF of the draft review.

If you are offered a choice of PDFs, always click the link at the top of the list. You can open the PDF to read online, or download and save it.

Provide feedback using an online form

When you have read through the plain language summary and any other sections of the review you are interested in, click Submit Recommendation in the left-hand menu to open the online comments form.

 

At the top of the form the dropdown Recommendation menu asks you for your overall opinion on the draft review. Please choose your recommendation based on the extent of changes you think the authors need to make before the review can be published.

  • Accept – no further changes needed
  • Minor Revision – some small changes needed
  • Major Revision – substantial changes needed
  • Reject – draft review is not suitable for publication

You may wish to complete the rest of the questions on the form before returning to give your overall recommendation.

 

Complete the form answering each question in turn. When giving your feedback, please focus on how useful the review will be to patients, carers and the public. You can write as much or as little as you like. At the bottom of the form, there is space for you to add any general comments to the editors of the Cochrane Review Group who asked you for feedback.

If you need to save your answers before you have finished, click Save & Submit Later at the bottom of the form. When you have completed all the questions, click Proceed. If you see a warning that not all questions are complete, please go to the top of the page and make sure you have chosen your overall recommendation.

You will see a summary of all your answers to check over. You can click Back to make changes. If you are happy with your answers, click Submit Review to Editorial Office and then OK. You will see a message thanking you for providing feedback.

If you would like to receive a copy of all the feedback on this review from other reviewers, or the authors’ responses to your comments, please contact the Cochrane Review Group publishing the review. You can do this by replying to your invitation email, or you can contact the Cochrane Support team.

Help and support 

We provide help and support to patients and the public who peer review for us.