On the Reliability of Mapping Studies in Software Engineering

Claes Wohlin, Per Runeson, Paulo Anselmo da Mota Silveira Neto, Emelie Engström, Ivan do Carmo Machado, Eduardo Santana de Almeida

Research output: Contribution to journalArticlepeer-review

363 Downloads (Pure)

Abstract

Background: Systematic literature reviews and systematic mapping studies are becoming increasingly common in software engineering, and hence it becomes even more important to better understand the reliability of such studies.
Objective: This paper presents a study of two systematic mapping studies to evaluate the reliability of mapping studies and point out some challenges related to this type of study in software engineering.
Method: The research is based on an in-depth case study of two published mapping studies on software product line testing.
Results: We found that despite the fact that the two studies are addressing the same topic, there are quite a number of differences when it comes to papers included and in terms of classification of the papers included in the two mapping studies.
Conclusions: From this we conclude that although mapping studies are important, their reliability cannot simply be taken for granted. Based on the findings we also provide four conjectures that further research has to address to make secondary studies (systematic mapping studies and systematic literature reviews) even more valuable to both researchers and practitioners.
Original languageEnglish
Pages (from-to)2594-2610
JournalJournal of Systems and Software
Volume86
Issue number10
DOIs
Publication statusPublished - 2013

Subject classification (UKÄ)

  • Computer Science

Free keywords

  • Systematic mapping study
  • systematic map
  • software product lines
  • systematic reviews
  • systematic literature review
  • review of reviews
  • meta-study
  • software testing

Fingerprint

Dive into the research topics of 'On the Reliability of Mapping Studies in Software Engineering'. Together they form a unique fingerprint.

Cite this