Supporting Change Impact Analysis Using a Recommendation System: An Industrial Case Study in a Safety-Critical Context

Research output: Contribution to journalArticle

Abstract

Change Impact Analysis (CIA) during software evolution of safety-critical systems is a labor-intensive task. Several authors have proposed tool support for CIA, but very few tools were evaluated in industry. We present a case study on ImpRec, a recommendation System for Software Engineering (RSSE), tailored for CIA at a process automation company. ImpRec builds on assisted tracing, using information retrieval solutions and mining software repositories to recommend development artifacts, potentially impacted when resolving incoming issue reports. In contrast to the majority of tools for automated CIA, ImpRec explicitly targets development artifacts that are not source code. We evaluate ImpRec in a two-phase study. First, we measure the correctness of ImpRec’s recommendations by a simulation based on 12 years’ worth of issue reports in the company. Second, we assess the utility of working with ImpRec by deploying the RSSE in two development teams on different continents. The results suggest that ImpRec presents about 40% of the true impact among the top-10 recommendations. Furthermore, user log analysis indicates that ImpRec can support CIA in industry, and developers acknowledge the value of ImpRec in interviews. In conclusion, our findings show the potential of reusing traceability associated with developers’ past activities in an RSSE.

Details

Authors
Organisations
External organisations
  • Blekinge Institute of Technology
  • RISE, Swedish Institute of Computer Science (SICS)
Research areas and keywords

Subject classification (UKÄ) – MANDATORY

  • Software Engineering
Original languageEnglish
Pages (from-to) 675 - 700
JournalIEEE Transactions on Software Engineering
Publication statusPublished - 2016 Oct 24
Publication categoryResearch
Peer-reviewedYes

Related projects

Johan Åkesson, Boris Magnusson, David Svensson Fors, Eva Magnusson, Görel Hedin, Krzysztof Kuchcinski, Per Andersson, Pierre Nugues, Sven Robertz, Torbjörn Ekman, Annabella Loconsole, Alma Orucevic-Alagic, Björn A Johnsson, Dietmar Pfahl, Elizabeth Bjarnason, Emma Söderberg, Giedré Sabaliauskaité, Håkan Jonsson, Jörn Janneck, Krzysztof Wnuk, Markus Borg, Mats Skoglund, Sardar Muhammad Sulaman, Sten Minör, Thomas Sandholm, Günter Alce, Mattias Wallergård, Chenxin Zhang, Sebastian Barney, Jan Kasper Martinsen, Håkan Grahn, Samireh Jalali, Anders Ardö, Emelie Engström, Richard Berntsson Svensson, Björn Regnell, Per Runeson, Claes Wohlin, Martin Höst & Jonas Wisbrant

2008/09/302018/12/31

Project: ResearchNational collaboration

View all (1)