Efficient Regression Testing Based on Test History: An Industrial Evaluation

Edward Dunn Ekelund, Emelie Engström

Forskningsoutput: Kapitel i bok/rapport/Conference proceedingKonferenspaper i proceedingPeer review

811 Nedladdningar (Pure)


Due to changes in the development practices at Axis Communications, towards continuous integration, faster regression testing feedback is needed. The current automated regression test suite takes approximately seven hours to run which prevents developers from integrating code changes several times a day as preferred. Therefore we want to implement a highly selective yet accurate regression testing strategy. Traditional code coverage based techniques are not applicable due to the size and complexity of the software under test. Instead we decided to select tests based on regression test history. We developed a tool, the Difference Engine, which parses and analyzes results from previous test runs and outputs regression test recommendations. The Difference Engine correlates code and test cases at package level and recommends test cases that are strongly correlated to recently changed packages. We evaluated the technique with respect to correctness, precision, recall and efficiency. Our results are promising. On average the tool manages to identify 80% of the relevant tests while recommending only 4% of the test cases in the full regression test suite.
Titel på värdpublikation2015 IEEE International Conference on Software Maintenance and Evolution (ICSME)
FörlagIEEE - Institute of Electrical and Electronics Engineers Inc.
Antal sidor9
ISBN (elektroniskt)978-1-4673-7532-0
StatusPublished - 2015
EvenemangInternational Conference on Software Maintenance and Evolution - Bremen, Tyskland
Varaktighet: 2015 sep. 29 → …


KonferensInternational Conference on Software Maintenance and Evolution
Period2015/09/29 → …

Ämnesklassifikation (UKÄ)

  • Annan teknik


Utforska forskningsämnen för ”Efficient Regression Testing Based on Test History: An Industrial Evaluation”. Tillsammans bildar de ett unikt fingeravtryck.

Citera det här