On the search for industry-relevant regression testing researchShow others and affiliations
2019 (English)In: Empirical Software Engineering, ISSN 1382-3256, E-ISSN 1573-7616, Vol. 24, no 4, p. 2020-2055Article in journal (Refereed) Published
Abstract [en]
Regression testing is a means to assure that a change in the software, or its execution environment, does not introduce new defects. It involves the expensive undertaking of rerunning test cases. Several techniques have been proposed to reduce the number of test cases to execute in regression testing, however, there is no research on how to assess industrial relevance and applicability of such techniques. We conducted a systematic literature review with the following two goals: firstly, to enable researchers to design and present regression testing research with a focus on industrial relevance and applicability and secondly, to facilitate the industrial adoption of such research by addressing the attributes of concern from the practitioners' perspective. Using a reference-based search approach, we identified 1068 papers on regression testing. We then reduced the scope to only include papers with explicit discussions about relevance and applicability (i.e. mainly studies involving industrial stakeholders). Uniquely in this literature review, practitioners were consulted at several steps to increase the likelihood of achieving our aim of identifying factors important for relevance and applicability. We have summarised the results of these consultations and an analysis of the literature in three taxonomies, which capture aspects of industrial-relevance regarding the regression testing techniques. Based on these taxonomies, we mapped 38 papers reporting the evaluation of 26 regression testing techniques in industrial settings. © The Author(s) 2019
Place, publisher, year, edition, pages
New York, NY: Springer, 2019. Vol. 24, no 4, p. 2020-2055
Keywords [en]
Regression testing, Industrial relevance, Systematic literature review, Taxonomy, Recommendations
National Category
Software Engineering
Identifiers
URN: urn:nbn:se:hh:diva-41451DOI: 10.1007/s10664-018-9670-1ISI: 000477582700010Scopus ID: 2-s2.0-85061506841OAI: oai:DiVA.org:hh-41451DiVA, id: diva2:1390233
Funder
ELLIIT - The Linköping‐Lund Initiative on IT and Mobile CommunicationsSwedish Research Council, 621-2014-5057Knowledge Foundation, 20140312
Note
Other funder: EASE, the Industrial Excellence Centre for Embedded Applications Software Engineering.
2020-01-312020-01-312022-09-15Bibliographically approved