Investigating the effect of variations in the test development process: a case from a safety-critical system

Date

2011-12-01

Author

TARHAN, AYÇA
Demirörs, Onur

Metadata

Show full item record

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Item Usage Stats

127
views

0
downloads

Variation is inherent to a process, and process management demands understanding the nature of variation in quantitative terms, for evaluation and prediction purposes. This understanding requires the identification of process indicators that build the system of variation. To utilize quantitative techniques to understand and improve a software process, more indicators are needed than in a manufacturing process. The need to identify the indicators of a software process and the lack of a generic approach to assess the ability of a software process for quantitative management encouraged us to carry out a sequence of studies that resulted in the development of an Assessment Approach for Quantitative Process Management (A(2)QPM). This paper explains an application of the A(2)QPM to the test development process of an avionics software project and presents the results. The study aimed at understanding the effect of the test design stage and the effect of internal reviews as verification activities in test development, with respect to process productivity and product quality measures. The measurement data collected during the execution of the processes were analyzed by control charts to observe the evidence of process stability. The mean values of measurement data were utilized to make performance comparisons between the various executions of the test development process. The results showed that process productivity was unaffected, but the test procedure quality was positively influenced by the application of test design and internal reviews. The utilization of the A(2)QPM as a guide for the quantitative implementation enabled the systematic evaluation of the test development process and measures prior to analysis. This resulted in the identification of process clusters having stable variation.

Subject Keywords

Software, Safety, Risk, Reliability and Quality

URI

https://hdl.handle.net/11511/56532

Journal

SOFTWARE QUALITY JOURNAL

DOI

https://doi.org/10.1007/s11219-011-9129-8

Collections

Graduate School of Informatics, Article

Suggestions

OpenMETU
Core

Failure modes and criticality analysis of the preliminary design phase of the Mars Desert Research Station considering human factors Oğuz, Elif; Clelland, David (Elsevier BV, 2018-10-01) This work presents an extension to the traditional FMECA (Failure Modes, Effects and Criticality Analysis) method to include the effects of human factors concerning accessibility/repairability, probability of contact and degree of contact. The authors refer to this extension to the traditional FMECA as the Human Design Approach (HDA). All data used in this study was collected during the stay of two of the authors at the Mars Desert Research Station (MDRS) in the Utah desert, USA. The MDRS is a laboratory fo...
Apply Quantitative Management Now TARHAN, AYÇA; Demirörs, Onur (Institute of Electrical and Electronics Engineers (IEEE), 2012-05-01) The Assessment Approach for Quantitative Process Management (A2QPM) helps identify software process measures for quantitative analysis even when organizations lack formal systems for process measurement. A2QPM is the first approach to quantitative management that offers software organizations a well-defined, detailed guideline for assessing their software processes and applying beneficial quantitative techniques to improve them. All the A2QPM applications we've described resulted in quantitative analysis im...
Utilization of statistical process control (SPC) in emergent software organizations: Pitfalls and suggestions Sargut, K. U.; Demirörs, Onur (Springer Science and Business Media LLC, 2006-06-01) Common wisdom in the domain of software engineering tells us that companies should be mature enough to apply Statistical Process Control (SPC) techniques. Since reaching high maturity levels (in CMM or similar models such as ISO 15504) usually takes 5-10 years, should software companies wait years to utilize Statistical Process Control techniques? To answer this question, we performed a case study of the application of SPC techniques using existing measurement data in an emergent software organization. Spec...
Nonconvex optimization of desirability functions Akteke-Ozturk, Basak; Köksal, Gülser; Weber, Gerhard Wilhelm (Informa UK Limited, 2018-01-01) Desirability functions (DFs) are commonly used in optimization of design parameters with multiple quality characteristic to obtain a good compromise among predicted response models obtained from experimental designs. Besides discussing multi-objective approaches for optimization of DFs, we present a brief review of literature about most commonly used Derringer and Suich type of DFs and others as well as their capabilities and limitations. Optimization of DFs of Derringer and Suich is a challenging problem. ...
Assessment of software process and metrics to support quantitative understanding TARHAN, AYÇA; Demirörs, Onur (2007-11-07) The use of process metrics and data for quantitative understanding is not very straightforward. If we have an identification of process components and follow a measurement process, we are likely to use process metrics and data effectively. But if we don't have these practices, we can hardly trust oil process metrics and data for quantitative understanding. In this paper, we summarize eight case studies that we performed in different industrial contexts. The case studies rely on an assessment approach that i...

Citation Formats

A. TARHAN and O. Demirörs, “Investigating the effect of variations in the test development process: a case from a safety-critical system,” SOFTWARE QUALITY JOURNAL, pp. 615–642, 2011, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/56532.