hh.sePublications
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Automatic generation of configurable test-suites for software product lines
Halmstad University, School of Information Technology, Halmstad Embedded and Intelligent Systems Research (EIS), Centre for Research on Embedded Systems (CERES).
2018 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Software Product Line Engineering (SPLE) is an approach used in the development of similar products, which aims at systematic reuse of software artifacts. The SPLE process has several activities executed to assure software quality. Quality assurance is of vital importance for achieving and maintaining a high quality for various artifacts, such as products and processes. Testing activities are widely used in industry for quality assurance. However, the effort for applying testing is usually high, and increasing the testing efficiency is a major concern. A common means of increasing efficiency is automation of test design. Several techniques, processes, and strategies were developed for SPLE testing, but still many problems are open in this area of research. The challenge in focus is the reduction of the overall test effort required to test SPLE products. Test effort can be reduced by maximizing test reuse using models that take advantage of the similarity between products. The thesis goal is to automate the generation of small test-suites with high fault detection and low test redundancy between products. To achieve the goal, equivalent tests are identified for a set of products using complete and configurable test-suites. Two research directions are explored, one is product-based centered, and the other is product line-centered. For test design, test-suites that have full fault coverage were generated from state machines with and without feature constraints. A prototype tool was implemented for test design automation. In addition, the proposed approach was evaluated using examples, experimental studies, and an industrial case study for the automotive domain. The results of the product-based centered approach indicate a reduction of 36% on the number of test cases that need to be concretized. The results of the product line-centered approach indicate a reduction of 50% on the number of test cases generated for groups of product configurations.

Place, publisher, year, edition, pages
Halmstad: Halmstad University Press, 2018. , p. 154
Series
Halmstad University Dissertations ; 48
National Category
Computer and Information Sciences Software Engineering
Identifiers
URN: urn:nbn:se:hh:diva-37779ISBN: 978-91-88749-00-0 (print)ISBN: 978-91-88749-01-7 (electronic)OAI: oai:DiVA.org:hh-37779DiVA, id: diva2:1241847
Public defence
2018-08-24, Halda, Visionen, Kristian IV:s väg 3, Halmstad, 13:00 (English)
Opponent
Supervisors
Funder
ELLIIT - The Linköping‐Lund Initiative on IT and Mobile Communications
Note

Paper III & IV not in DiVA.

Available from: 2019-02-08 Created: 2018-08-24 Last updated: 2019-02-08Bibliographically approved
List of papers
1. Reducing the Concretization Effort in FSM-Based Testing of Software Product Lines
Open this publication in new window or tab >>Reducing the Concretization Effort in FSM-Based Testing of Software Product Lines
2017 (English)In: 10th IEEE International Conference on Software Testing, Verification and Validation Workshops - ICSTW 2017 / [ed] Randall Bilof, Los Alamitos, CA: IEEE , 2017, p. 329-336Conference paper, Published paper (Refereed)
Abstract [en]

To test a Software Product Line (SPL), the test artifacts and the techniques must be extended to support variability. In general, when new SPL products are developed, more tests are generated to cover new or modified features. A dominant source of extra effort for such tests is the concretization of newly generated tests. Thus, minimizing the amount of new non-concretized tests required to perform conformance testing on new products reduces the overall test effort. In this paper, we propose a test reuse strategy for conformance testing of SPL products that aims at reducing test effort. We use incremental test generation methods based on finite state machines (FSMs) to maximize test reuse. We combine these methods with a selection algorithm used to identify non-redundant concretized tests. We illustrate our strategy using examples and a case study with an embedded mobile SPL. The results indicate that our strategy can save up to 36% of test effort in comparison to current test reuse strategies for the same fault detection capability. © 2017 IEEE.

Place, publisher, year, edition, pages
Los Alamitos, CA: IEEE, 2017
Series
IEEE International Conference on Software Testing Verification and Validation Workshops, ISSN 2159-4848
Keywords
Conformance Testing, Test Case Reuse, Model-Based Testing, Finite State Machine, Software Product Lines
National Category
Software Engineering
Identifiers
urn:nbn:se:hh:diva-35617 (URN)10.1109/ICSTW.2017.61 (DOI)000403392800051 ()2-s2.0-85018410007 (Scopus ID)978-1-5090-6676-6 (ISBN)978-1-5090-6677-3 (ISBN)
Conference
10th IEEE International Conference on Software Testing, Verification and Validation (ICSTW), Tokyo, Japan, March 13-17, 2017
Funder
Knowledge FoundationSwedish Research CouncilELLIIT - The Linköping‐Lund Initiative on IT and Mobile Communications
Note

Funding: The work of V. Hafemann has been partially supported by the Science Without Borders project number 201694/2015-8. The work of M.R. Mousavi has been supported by grants from the Swedish Knowledge Foundation (KKS), Swedish Research Council (VR), and the ELLIIT Strategic Research Environment.

Available from: 2017-12-01 Created: 2017-12-01 Last updated: 2018-12-20Bibliographically approved
2. Validated Test Models for Software Product Lines: Featured Finite State Machines
Open this publication in new window or tab >>Validated Test Models for Software Product Lines: Featured Finite State Machines
2016 (English)In: Formal Aspects of Component Software: 13th International Conference, FACS 2016, Besançon, France, October 19-21, 2016, Revised Selected Papers / [ed] Kouchnarenko, Olga & Khosravi, Ramtin, Cham: Springer, 2016, Vol. 10231, p. 210-227Conference paper, Published paper (Refereed)
Abstract [en]

Variants of the finite state machine (FSM) model have been extensively used to describe the behaviour of reactive systems. In particular, several model-based testing techniques have been developed to support test case generation and test case executions from FSMs. Most such techniques require several validation properties to hold for the underlying test models. In this paper, we propose an extension of the FSM test model for software product lines (SPLs), named featured finite state machine (FFSM). As the first step towards using FFSMs as test models, we define feature-oriented variants of basic test model validation criteria. We show how the high-level validation properties coincide with the necessary properties on the product FSMs. Moreover, we provide a mechanised tool prototype for checking the feature-oriented properties using satisfiability modulo theory (SMT) solver tools. We investigate the applicability of our approach by applying it to both randomly generated FFSMs as well as those from a realistic case study (the Body Comfort System). The results of our study show that for random FFSMs over 16 independent non-mandatory features, our technique provides substantial efficiency gains for the set of proposed validity checks. © Springer International Publishing AG 2017

Place, publisher, year, edition, pages
Cham: Springer, 2016
Series
Lecture Notes in Computer Science, ISSN 0302-9743 ; 10231
Keywords
Formal Modelling, Model Validation, Software Product Line, Finite State Machine
National Category
Computer and Information Sciences
Identifiers
urn:nbn:se:hh:diva-33213 (URN)10.1007/978-3-319-57666-4_13 (DOI)2-s2.0-85018251728 (Scopus ID)978-3-319-57665-7 (ISBN)978-3-319-57666-4 (ISBN)
Conference
The 13th International Conference on Formal Aspects of Component Software (FACS 2016), Besançon, France, 19-21 October, 2016
Projects
VR Project - EFFEMBACKKS Project - AUTO-CAAS
Funder
ELLIIT - The Linköping‐Lund Initiative on IT and Mobile CommunicationsSwedish Research Council, 621-2014-5057Knowledge Foundation, 20140312
Available from: 2017-02-06 Created: 2017-02-06 Last updated: 2018-12-20Bibliographically approved

Open Access in DiVA

fulltext(3507 kB)27 downloads
File information
File name FULLTEXT02.pdfFile size 3507 kBChecksum SHA-512
b218b80f68928f96f1422b8e60ecfc3f29849f0c63005db803622e4bda54f7349e6657fa697af88f599b8f77da03f42ba7602af524c79b69bfafc6f4e9da0bdf
Type fulltextMimetype application/pdf

Authority records BETA

Hafemann Fragal, Vanderson

Search in DiVA

By author/editor
Hafemann Fragal, Vanderson
By organisation
Centre for Research on Embedded Systems (CERES)
Computer and Information SciencesSoftware Engineering

Search outside of DiVA

GoogleGoogle Scholar
Total: 27 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 28 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf