Skip to main content
It looks like you're using Internet Explorer 11 or older. This website works best with modern browsers such as the latest versions of Chrome, Firefox, Safari, and Edge. If you continue with this browser, you may see unexpected results.

Systematic Reviews

This is a guide to conducting systematic reviews, a structured, comprehensive approach to reviewing the literature on a selected topic.

Critically Appraising the Literature

Much like the question formulation, search, and selection processes, the process of evaluating the quality of the literature in a systematic review should be structured. In the critical appraisal stage, the researchers analyze the design of each included study, the validity of the results in light of the design, potential for bias, and the relevance of each study to the larger literature and the research question. There are tools that researchers can use to help them approach this process systematically and objectively. 

Tools

More Resources

These are key issues to consider when appraising various types of medical studies. 

Key Issues in Appraising Therapy Studies:

  • Randomization and concealed allocation
  • Follow-up of all patients (ideally 80% or better)
  • Blinding (concealment) of patients, clinicians and study personnel to the treatment being provided
  • Intention to Treat analysis
  • Baseline similarities between groups (established at the start of the trial)

Key Issues in Appraising Diagnostic Studies:

  • Independent blind comparison with a gold standard
  • Appropriate spectrum of patients
  • All patients receive both tests
  • Key Issues in Appraising Prognosis Studies:
  • Well-defined sample of patients
  • Similar prognostic factors
  • Follow-up
  • Objective outcome criteria

Key Issues for Etiology/Harm Studies:

  • Similarity of comparison groups
  • Outcomes and exposure measured the same for both groups
  • Follow-up of sufficient length
 
“EMB and the Medical Librarian”. University of North Carolina School of Information and Library Science. Unpublished course material, 2008. Instructors Connie Schardt and Angela Myatt. Retrieved from https://guides.hsict.library.utoronto.ca/c.php?g=699108&p=4964046