ELA: an automated statistical fault localization technique

Download
2015
Bayraktar, Özkan
Software debugging consists of locating software faults, finding their causes, and fixing them. Among all these activities, the fault localization is the most difficult one and requires manual effort. Although there are several studies on automating this process, their effectiveness has not yet reached at a desired level. In this dissertation, we propose a fault localization framework that introduces a new fault localization metric called Ela, three test suite reduction strategies to improve the effectiveness of fault localization, and an effective ranking strategy to improve the ranking of statements. Several experiments are performed on the Siemens suite to evaluate the proposed metric. Besides the expense metric used in fault localization literature, we also adapt the mean reciprocal rank to measure the overall ranking quality of the four techniques. Ela has better ranking than the other techniques in 4 of 118 versions while it is one of the best performing techniques for the remaining 114 versions of the subject programs. We apply an equivalent test elimination strategy to neutralize the bias caused by the existence of the equivalent tests. This strategy achieves on average 99.5% test size reduction. Ela has better ranking than the other techniques in 31 of 118 versions while it is one of the best performing techniques for the remaining 87 versions of the subject programs. We propose three test suite reduction strategies to reduce the effort for the fault localization. The best of these strategies achieves on average 34.1% test size reduction while resulting an improvement up to 1.7 in Jaccard, up to 2.46% in Tarantula, up to 1.01% in Ochiai, and up to 0.38% in Ela in terms of average expense. We propose an effective ranking strategy, called Local Maxima, to improve the ranking of statements. This strategy achieves an improvement 10.54% in Jaccard, 10.47% in Tarantula, 10.74% in Ochiai, and 10.88% in Ela in terms of average expense.

Suggestions

QEVM: quality integrated earned value management
Efe, Pınar; Demirörs, Onur; Department of Information Systems (2015)
Software project management discipline is in need of valuable tools and techniques to complete projects in agreed scope, on time and within budget according to customer needs. Earned Value Management (EVM) is a simple and powerful performance management and feedback tool, which is widely used in project management with an increasing interest particularly in last decade. EVM clearly displays the project progress in terms of scope, cost and schedule and enables predicting future of the project based on the tr...
Measurement based software process improvement
Ener, Aysun; Bilgen, Semih; Department of Electrical and Electronics Engineering (2007)
This thesis is a study on improving the software requirements management processes of embedded software department of a company. The literature on software process improvement and requirements engineering is reviewed. After determining the problems related to the current requirements management processes of the department, an improved process is proposed addressing these problems. The static process descriptions and the models of the current and improved requirements management processes are formed. A recen...
E-CDGM: An Evolutionary Call-Dependency Graph Modularization Approach for Software Systems
Izadkhah, Habib; Elgedawy, Islam; Isazadeh, Ayaz (Walter de Gruyter GmbH, 2016-9-1)
Lack of up-to-date software documentation hinders the software evolution and maintenance processes, as simply the outdated software structure and code could be easily misunderstood. One approach to overcoming such problems is using software modularization, in which the software architecture is extracted from the available source code; such that developers can assess the reconstructed architecture against the required changes. Unfortunately, existing software modularization approaches are not accurate, as th...
Investigation of the effects of structural characteristics of object-oriented software on fault-proneness
Gölcük, Halit; Bilgen, Semih; Department of Electrical and Electronics Engineering (2014)
This study investigates the effects of structural characteristics of object-oriented software, which are observable at the model level of the software developed by means of Unified Modeling Language (UML), on software quality, assessing quality in terms of fault-proneness. In the scope of this thesis study, real-time embedded software components developed by Aselsan, a leading defense industry company in Turkey, were analyzed. The correlation between software metrics measured from the UML models of the soft...
Architectural design of an access control system for enterprise networks
Kirimer, Burak; Özgit, Attila (2007-11-09)
Client computers in enterprise networks have the potential to be the source of serious security problems, especially when their hardware and software components are out of physical administrative control. Besides, services in the network may have client configuration requirements. We propose a system composed of a policy management and enforcement server and client agents, which authenticates the client users and checks their computer configurations before allowing their access to services. The information ...
Citation Formats
Ö. Bayraktar, “ELA: an automated statistical fault localization technique,” Ph.D. - Doctoral Program, Middle East Technical University, 2015.