Applying systematic review search methods to the grey literature: a case study examining guidelines for school-based breakfast programs in Canada

By Katelyn M. Godin, J. Stapleton, S. Kirkpatrick, R. Hanning, S. Leatherdale. Systematic Reviews, 2015

798 citations recorded by the source corpus.

BackgroundGrey literature is an important source of information for large-scale review syntheses. However, there are many characteristics of grey literature that make it difficult to search systematically. Further, there is no ‘gold standard’ for rigorous systematic grey literature search methods and few resources on how to conduct this type of search. This paper describes systematic review search methods that were developed and applied to complete a case study systematic review of grey literature that examined guidelines for school-based breakfast programs in Canada.MethodsA grey literature search plan was developed to incorporate four different searching strategies: (1) grey literature databases, (2) customized Google search engines, (3) targeted websites, and (4) consultation with contact experts. These complementary strategies were used to minimize the risk of omitting relevant sources. Since abstracts are often unavailable in grey literature documents, items’ abstracts, executive summaries, or table of contents (whichever was available) were screened. Screening of publications’ full-text followed. Data were extracted on the organization, year published, who they were developed by, intended audience, goal/objectives of document, sources of evidence/resources cited, meals mentioned in the guidelines, and recommendations for program delivery.ResultsThe search strategies for identifying and screening publications for inclusion in the case study review was found to be manageable, comprehensive, and intuitive when applied in practice. The four search strategies of the grey literature search plan yielded 302 potentially relevant items for screening. Following the screening process, 15 publications that met all eligibility criteria remained and were included in the case study systematic review. The high-level findings of the case study systematic review are briefly described.ConclusionsThis article demonstrated a feasible and seemingly robust method for applying systematic search strategies to identify web-based resources in the grey literature. The search strategy we developed and tested is amenable to adaptation to identify other types of grey literature from other disciplines and answering a wide range of research questions. This method should be further adapted and tested in future research syntheses.

Subfields: Public Health, Environmental and Occupational Health

View Paper: https://www.semanticscholar.org/paper/e024764c6441148f8e8bf4be04727618eba17f90

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

1. Jamie Hosking
2. K. Witten
3. A. Macmillan
4. A. Woodward
5. Melody Smith
6. H. Mackie
7. P. Baas
8. A. Field

Citations in the corpus

• Systematic literature review of built environment effects on physical activity and active transport – an update and new findings on health equity (2017, methodology): “We sought the most robust evidence available, ensuring our methods were as robust and replicable as possible [45], and reducing the risk of bias in outcome reporting that may occur in the grey literature, for instance in settings where funding for infrastructural work is at stake.”