PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation
By Andrea C. Tricco, E. Lillie, Wasifa Zarin, K. O’Brien, Heather Colquhoun, D. Levac, David Moher, M. Peters, T. Horsley, L. Weeks and 18 more. Annals of Internal Medicine, 2018
31,635 citations recorded by the source corpus.
Scoping reviews can be conducted to meet various objectives. They may examine the extent (that is, size), range (variety), and nature (characteristics) of the evidence on a topic or question; determine the value of undertaking a systematic review; summarize findings from a body of knowledge that is heterogeneous in methods or discipline; or identify gaps in the literature to aid the planning and commissioning of future research (1, 2). A recent scoping review by members of our team suggested that although the number of scoping reviews in the literature is increasing steadily, methodological and reporting quality needs to improve in order to facilitate complete and transparent reporting (1). Results from a survey on scoping review terminology, definitions, and methods showed a lack of consensus on how to conduct and report scoping reviews (3). The Joanna Briggs Institute (JBI) published a guidance document for the conduct of scoping reviews (4) (updated in 2017 [5]) based on earlier work by Arksey and O'Malley (6) and Levac and colleagues (7). However, a reporting guideline for scoping reviews currently does not exist. Reporting guidelines outline a minimum set of items to include in research reports and have been shown to increase methodological transparency and uptake of research findings (8, 9). Although a reporting guideline exists for systematic reviewsthe PRISMA (Preferred Reporting Items for Systematic reviews and Meta-Analyses) statement (10)scoping reviews serve a different purpose (11). Systematic reviews are useful for answering clearly defined questions (for example, Does this intervention improve specified outcomes when compared with a given comparator in this population?), whereas scoping reviews are useful for answering much broader questions (such as What is the nature of the evidence for this intervention? or What is known about this concept?). Given the difference in objectives, and therefore in the methodological approach (such as presence vs. absence of a risk-of-bias assessment or meta-analysis), scoping reviews should have different essential reporting items from systematic reviews. Consequently, some PRISMA items may not be appropriate, whereas other important considerations may be missing (1214). It was decided that a PRISMA extension for scoping reviews was needed to provide reporting guidance for this specific type of knowledge synthesis. This extension is also intended to apply to evidence maps (15, 16), which share similarities with scoping reviews and involve a systematic search of a body of literature to identify knowledge gaps, with a visual representation of results (such as a figure or graph). Methods The PRISMA-ScR (PRISMA extension for Scoping Reviews) was developed according to published guidance by the EQUATOR (Enhancing the QUAlity and Transparency Of health Research) Network for the development of reporting guidelines (9). The St. Michael's Hospital Research Ethics Board granted research ethics approval for this study on 15 August 2016. Protocol, Advisory Board, and Expert Panel Our protocol was drafted by the research team and revised as necessary by the advisory board before being listed as a reporting guideline on the EQUATOR (17) and PRISMA (18) Web sites. The research team included 2 leads (A.C.T. and S.E.S.) and 2 research coordinators (E.L. and W.Z.), none of whom participated in the scoring exercises, and a 4-member advisory board (K.K.O., H.C., D.L., and D.M.) with extensive experience doing scoping reviews or developing reporting guidelines. We aimed to form an expert panel of approximately 30 members that would be representative of different geography and stakeholder types and research experiences, including persons with experience in the conduct, dissemination, or uptake of scoping reviews. Survey Development and Round 1 of Delphi The initial step in developing the Delphi survey via Qualtrics (an online survey platform) (19) involved identifying potential modifications to the original 27-item PRISMA checklist. The modifications were based on a research program carried out by members of the advisory board to better understand scoping review practices (1, 3, 20) and included a broader research question and literature search strategy, optional risk-of-bias assessment and consultation exercise (whereby relevant stakeholders contribute to the work, as described by Arksey and O'Malley [6]), and a qualitative analysis. For round 1 of scoring, we prepared a draft of the PRISMA-ScR (Supplement) and asked expert panel members to rate their agreement with each of the proposed reporting items using a 7-point Likert scale (1 = entirely disagree, 2 = mostly disagree, 3 = somewhat disagree, 4 = neutral, 5 = somewhat agree, 6 = mostly agree, and 7 = entirely agree). Each survey item included an optional text box where respondents could provide comments. The research team calibrated the survey for content and clarity before administering it and sent biweekly reminders to optimize participation. Supplement. PRISMA-ScR Round 1 Survey (With Information Sheet) Survey Analysis To be conservative, a threshold for 85% agreement was established a priori for each of the reporting items to indicate consensus among the expert panel. This rule required that at least 85% of the panel mostly or entirely agreed (values of 6 or 7 on the Likert scale) with the inclusion of the item in the PRISMA-ScR. If agreement was less than 85%, it was considered to be discrepant. This standard was used for all 3 rounds of scoring to inform the final checklist. For ease and consistency with how the survey questions were worded, we did not include a provision for agreement on exclusion (that is, 85% of answers corresponding to values of 1 or 2 on the Likert scale). All comments were summarized to help explain the scorings and identify any issues. For the analysis, the results were stratified by group (in-person meeting vs. online, hereafter e-Delphi) because discrepant items could differ between groups. In-Person Group (Round 2 of Delphi) The Chatham House rule (21) was established at the beginning of the meeting, whereby participants were free to use information that is shared but were not permitted to reveal the identity or affiliation of the speaker. Expert panel members were given their individual results; the overall group distribution, median, and interquartile range; a summary of the JBI methodological guidance (4); and preliminary feedback from the e-Delphi group. These data were used to generate and inform the discussion about each discrepant item from round 1. Two researchers (A.C.T. and S.E.S.) facilitated the discussion using a modified nominal group technique (22) to reach consensus. Panel members were subsequently asked to rescore the discrepant items using sli.do (23), a live audience-response system in a format that resembled the round 1 survey. For items that failed to meet the threshold for consensus, working groups were assembled. The meeting was audio-recorded and transcribed using TranscribeMe (24), and 3 note-takers independently documented the main discussion points. The transcript was annotated to complement a master summary of the discussion points, which was compiled using the 3 note-takers' files. E-Delphi Group (Round 2 of Delphi) Those who could not attend the in-person meeting participated via an online discussion exercise using Conceptboard (25), a visual collaboration platform that allows users to provide feedback on whiteboards in real time. The discrepant items from round 1 were presented as a single whiteboard, and questions (for example, After reviewing your survey results with respect to this item, please share why you rated this item the way you did) were assigned to participants as tasks to facilitate the discussion. E-Delphi panel members received the same materials as in-person participants and were encouraged to respond to others' comments and interact through a chat feature. The second round of scoring was done in Qualtrics using a similar format as in round 1. A summary of the Conceptboard discussion, as well as the annotated meeting transcript and master summary document, were shared so that participants could learn about the perspectives of the in-person group before rescoring. Working Groups and Round 3 of Delphi To enable panel-wide dialogue and refine the checklist items before the final round of scoring, working groups were created and collaborated by teleconference and e-mail. Their task was to discuss the discrepant items in terms of the key issues and considerations (relating to both concepts and wording) that had been raised in earlier stages across both groups. To harmonize the data from the 2 groups, a third round of scoring exercise was administered using Qualtrics (19). In this step, suggested modifications (in terms of both concepts and wording) from all previous stages were incorporated into the items that had failed to reach consensus in the first 2 rounds across both groups, and the full panel scored this updated list. Interactive Workshop (Testing) A workshop led by the lead investigator (A.C.T.) and facilitated by members of the advisory board and expert panel (S.E.S., C.M.G., C.G., T.H., M.T.M., and M.D.J.P.) was held as part of the Global Evidence Summit in Cape Town, South Africa, in September 2017. Participants (researchers, scientists, policymakers, managers, and students) tested the checklist by applying the PRISMA-ScR to a scoping review on a health-related topic (26). Role of the Funding Source This work was supported by a grant from the Canadian Institutes of Health Research. The funding source had no role in designing the study; collecting, analyzing, or interpreting the data; writing the manuscript; or deciding to submit it for publication. Results Expert Panel A total of 37 persons were invited to participate, of whom 31 completed round 1 and 24 completed all 3 rounds of scoring. The Figure presents results of the modified Delphi, in
Subfields: Economics and Econometrics, Sociology and Political Science, Statistics and Probability
View Paper: https://www.semanticscholar.org/paper/450106c6c960424b365249f2a301ce0abe24e346
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Economics and Econometrics
- Christopher B. Barrett
- David Moher
- I. Boutron
- John Hoddinott
- Matthew J. Page
- Larissa Shamseer
- Patrick M. M. Bossuyt
- J. Tetzlaff
In Sociology and Political Science
- Christopher B. Barrett
- Matthew J. Page
- David Moher
- John Hoddinott
- Bertie Vidgen
- J. Upton
- Kate Ghezzi-Kopel
- Tong Wu
In Statistics and Probability
- David Moher
- Matthew J. Page
- Larissa Shamseer
- I. Boutron
- J. Yepes‐Nuñez
- G. Úrrutia
- Marta Romero-García
- S. Alonso-Fernández
Citations in the corpus
- Machine Learning-Based Heart Disease Diagnosis: A Systematic Literature Review (2021, positive): “Even though PRISMA is not a quality assessment approach, it is acceptable in the research domain due to its 27-evidence based checklist and four-phase analysis, ultimately providing the opportunity of clarity and transparency of any systematic literature reviews (SLR) [23].”
- Inequities in Health Care Services Caused by the Adoption of Digital Health Technologies: Scoping Review (2021, methodology): “The reporting of the scoping review was guided by the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) checklist; for details of items included in the checklist, please see Multimedia Appendix 1 [29].”
- Scoping reviews: the PAGER framework for improving the quality of reporting (2021, methodology): “It is certainly the case that the main methodological advances in scoping reviews has been generated from within the health research community (Tricco et al., 2018; Levac et al., 2010; Davis et al., 2009).”
- A scoping review of artificial intelligence in medical education: BEME Guide No. 84 (2024, methodology): “We also conformed to the PRISMA-ScR reporting standards (Tricco et al. 2018), drawing on support from Peters et al. (2020, 2022) to offset the absence of specialized reporting standards for scoping reviews in health professions education.”
- Using Media for Coping: A Scoping Review (2020, methodology): “…drawing on existing recommended steps (e.g., Munn et al., 2018; Peters et al., 2015) and guidelines for reporting (i.e., Preferred Reporting Items for Systematic reviews and Meta-Analyses [PRISMA]; Moher et al., 2009; Tricco et al., 2018), we conducted a scoping review of coping using media.”
- A scoping review of the development resilience literature: Theory, methods and evidence (2021, methodology): “The PRISMA-ScR guidelines state that risk of bias and methodological quality of included studies are generally not appraised (Tricco et al., 2018).”
- Risk and protective factors for mental health in elite athletes: a scoping review (2019, methodology): “Such appraisals are not a necessary feature of scoping reviews (Grant & Booth, 2009; Tricco et al., 2018), and such practices can distract readers from the purpose of a scoping review.”
- Understanding Eco-anxiety: A Systematic Scoping Review of Current Literature and Identified Knowledge Gaps (2021, methodology): “The present scoping review was reported as per the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines for scoping reviews (PRISMA-ScR) [1].”
- Stadium Attendance Demand Research: A Scoping Review (2021, methodology): “In emerging research fields such as the economics of sports, conducting a scoping review is helpful in identifying, locating, and, then, synthesizing the existing knowledge (e.g., McKinstry et al., 2014; Tricco et al., 2016, 2018).”
- Directions in abusive language training data, a systematic review: Garbage in, garbage out (2020, methodology): “This study’s selection criteria, protocol, and methodology follow the PRISMA framework [29, 30], based on the guidance provided by [31].”