Testing effectiveness and effort in software product lines

Download
2013
Çöteli, Mert Burkay
Software product lines (SPL) aim to decrease the total software development cost by the help of reusability and variability. However, the increasing number of variations for the delivery types of products would result in increasing cost of the verification and validation process. Total testing cost of development can also be decreased by reusing test cases and scripts. The main objective of this study is to increase testing effectiveness while minimizing testing effort. Four different cases consisting of Aselsan’s SPL projects have been studied. Firstly, FIG Basis path method was applied at the functional testing phase, and an increase on the testing effectiveness value has been observed. FIG basis path method is a test case sequence generation technique using the feature tree of the software component. This method would be preferable to improve testing effectiveness on the functional verification phase. The second study was on testing effort estimation. There are two testing approaches for SPL projects, namely infrastructure based and product focused testing. These two techniques have been compared in terms of testing effort. It was a study that gives an idea to test managers about the selection of the proper testing technique. Thirdly, reusability techniques were evaluated. Reusability of testing artifacts can be used to decrease the total testing effort. Two reusability techniques for testing artifacts were compared in terms of the number of test cases. Proper technique would be chosen to decrease testing effort. Finally, selection of a reference application on platform tests was proposed and software products were grouped according to the redundancy values. Then, testing effectiveness values were evaluated for each test grouping.

Suggestions

An Ontology based approach to requirements reuse problem in software product lines
Karataş, Elif Kamer; Birtürk, Ayşenur; Department of Computer Engineering (2012)
With new paradigms in software engineering such as Software Product Lines, scope of reuse is enlarged from implementation upto design, requirements, test-cases, etc. In this thesis an ontology-based approach is proposed as a solution to systematic requirement reuse problem in software product lines, and the approach is supported with a reuse automation tool. A case study is performed on the projects of an industrial software product line using hereby proposed solution and then based on the evaluated metrics...
Hierachical variability management in software product lines
Atasoy, Mehmet Erdem; Doğru, Ali Hikmet; Department of Computer Engineering (2013)
Software product lines (SPL) aim is to analyze commonality and variability of product family although SPLE describes much kind of processes in different abstraction levels. In this respect, numbers of variations are increasing for the types of products so that may result in increasing cost of the managing variability process. So that variability models is used to manage variabilities in software product lines. Representing solution space variability in an understandable way in software product line engineer...
GSPA: a generic software process assessment tool
Yürüm, Ozan Raşit; Demirörs, Onur; Department of Information Systems (2014)
Performing process improvement to deliver the qualified products with expected cost on time has been a requirement for organization targeting to be successful in software market. Software organizations usually perform process improvement based on well-known process assessment frameworks such as CMMI and ISO 15504. As improvement needs diverge, a number of process assessment models such as Automotive SPICE, Enterprise SPICE, Brazilian Software Improvement, and Agile Maturity Model are derived. In addition, s...
An Action research of achievements in a software product line implementation
Ergül, Muhittin Erdem; Bilgen, Semih; Department of Electrical and Electronics Engineering (2014)
Software product lines emphasize, with an innovative approach, the idea of predictive re-use. In this way, significant improvements are provided in cost, time-to-market and quality and market dominance is enabled in the target area. The majority of the academic studies in this area are case studies. In this study it is also intended to provide scientific data to the literature about the achievements brought about by software product lines. First, the challenges in the software development activities perform...
Improvement proposal for a software requirements management process
Yamaç, Pınar Işıl; Bilgen, Semih; Department of Information Systems (2006)
This thesis focuses on measurement based software process improvement, especially improvement of requirements change management process. The literature on software measurement is investigated, software process improvement methodologies are studied and requirements change management metrics are examined. Requirements change management process at a private company working in the defense industry is observed and metrics obtained from various tools have been aggregated. Moreover, an improvement proposal, which ...
Citation Formats
M. B. Çöteli, “Testing effectiveness and effort in software product lines,” M.S. - Master of Science, Middle East Technical University, 2013.