Lessons from applying the systematic literature review process within the software engineering domain
By Pearl Brereton, Barbara A. Kitchenham, David Budgen, Mark Turner, Mohamed Khalil. Journal of Systems and Software, 2007
2,361 citations recorded by the source corpus.
A consequence of the growing number of empirical studies in software engineering is the need to adopt systematic approaches to assessing and aggregating research outcomes in order to provide a balanced and objective summary of research evidence for a particular topic. The paper reports experiences with applying one such approach, the practice of systematic literature review, to the published studies relevant to topics within the software engineering domain. The systematic literature review process is summarised, a number of reviews being undertaken by the authors and others are described and some lessons about the applicability of this practice to software engineering are extracted.The basic systematic literature review process seems appropriate to software engineering and the preparation and validation of a review protocol in advance of a review activity is especially valuable. The paper highlights areas where some adaptation of the process to accommodate the domain-specific characteristics of software engineering is needed as well as areas where improvements to current software engineering infrastructure and practices would enhance its applicability. In particular, infrastructure support provided by software engineering indexing databases is inadequate. Also, the quality of abstracts is poor; it is usually not possible to judge the relevance of a study from a review of the abstract alone.
Subfields: Computer Science Applications, Information Systems
View Paper: https://www.semanticscholar.org/paper/1c32125cc9fb052b881a6dec812b62ed998915d7
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Computer Science Applications
- Claes Wohlin
- Costas Boletsis
- Samireh Jalali
- Pearl Brereton
- Barbara A. Kitchenham
- Emelie Engström
- Mats Skoglund
- Per Runeson
In Information Systems
- Claes Wohlin
- Kai Petersen
- Sairam Vakkalanka
- Ludwik Kuzniarz
- Pearl Brereton
- Pooyan Jamshidi
- Barbara A. Kitchenham
- Samireh Jalali
Citations in the corpus
- A Survey on Blockchain Interoperability: Past, Present, and Future Trends (2020, background): “Google Scholar’s coverage is arguably the biggest across other academic search engines for Computer Science [61], and it meets the criteria recommended in guidelines for conducting systematic literature reviews [33, 61].”
- Servant Leadership: A systematic literature review—toward a model of antecedents and outcomes (2019, methodology): “We tried to reduce bias to a minimum by clearly defining the steps of the review process prior to the review (Brereton et al., 2007).”
- Systematic literature reviews in software engineering - A systematic literature review (2009, methodology): “The procedure of having one extractor and one checker is not consistent with the medical standards summarized in Kitchenham’s guidelines [22], but is a procedure we had found useful in practice [2].”
- Software clone detection: A systematic review (2013, background): “[25] and Budgen and Brereton [30] define a systematic literature review as a means of identifying, evaluating and interpreting all available research relevant to a particular research question, or topic area, or phenomenon of interest.”
- Cloud Migration Research: A Systematic Review (2013, background): “To-date, there has not been a systematic literature review (SLR) of research on cloud migration, making it difficult to assess the maturity in general and identifying trends, research gaps, and future dimensions of cloud migration in particular.”
- Guidance on Conducting a Systematic Literature Review (2017, methodology): “Similar to the inclusion screening process, it is recommended that two or more researchers perform a parallel independent quality assessment (Breretona et al. 2007; Noordzij et al. 2009).”
- Sustainable vehicles-based alternatives in last mile distribution of urban freight transport: A Systematic literature review (2017, background): “It requires the use of systematic procedures for higher data reliability [13,14], which must follow well-defined protocols to locate existing studies, select and evaluate the contributions, then analyze and synthesize the data, and finally present the main findings.”
- Standing on the Shoulders of Giants: Challenges and Recommendations of Literature Search in Information Systems Research (2015, background): “…and developing guidelines are grounded in several other IS research publications (e.g., Bandara et al., 2011; Boell & Cecez-Kecmanovic, 2014; Brereton et al., 2007; Kitchenham, 2004; Levy & Ellis, 2006; Okoli & Schabram, 2010; Turner et al., 2008; Webster & Watson, 2002; Wolfswinkel et al.,…”
- Does the technology acceptance model predict actual use? A systematic literature review (2010, methodology): “The completeness of the search is dependent upon the search criteria used and the scope of the search, and is also influenced by the limitations of the search engines used [4].”
- A systematic review of systematic review process research in software engineering (2013, background): “[1] wrote one of the first papers that commented on issues connected with performing SRs and many such papers have followed since, for example:”
- Circular economy performance assessment methods: A systematic literature review (2019, background): “In order to sum up the results obtained so far and gather interesting details on current findings, a systematic literature review (Brereton et al., 2007; Smart et al., 2017; Software Engineering Group, 2007) on scientific articles published up to the second quarter of 2018 and provided by the most p”
- Review of recent systems for automatic assessment of programming assignments (2010, methodology): “This means that an explicit procedure in selecting the systems and papers was applied (see [7] for details): to be included, a paper must have presented an AA system providing summative, numerical feedback from programming assignments or described results from using such system.”
- The New Era of Virtual Reality Locomotion: A Systematic Literature Review of Techniques and a Proposed Typology (2017, methodology): “This study has been undertaken as a systematic literature review based on the original guidelines, as proposed by Kitchenham [26] and Brereton et al. [27] and implemented by Beecham et al. [28].”
- Guidelines for conducting systematic mapping studies in software engineering: An update (2015, background): “[16] B.A. Kitchenham, D. Budgen, O. Pearl Brereton, Using mapping studies as the basis for further research–a participant-observer case study, Inf.”