ELA: an automated statistical fault localization technique

Download

index.pdf

Date

2015

Author

Bayraktar, Özkan

Metadata

Show full item record

Item Usage Stats

90
views

22
downloads

Software debugging consists of locating software faults, finding their causes, and fixing them. Among all these activities, the fault localization is the most difficult one and requires manual effort. Although there are several studies on automating this process, their effectiveness has not yet reached at a desired level. In this dissertation, we propose a fault localization framework that introduces a new fault localization metric called Ela, three test suite reduction strategies to improve the effectiveness of fault localization, and an effective ranking strategy to improve the ranking of statements. Several experiments are performed on the Siemens suite to evaluate the proposed metric. Besides the expense metric used in fault localization literature, we also adapt the mean reciprocal rank to measure the overall ranking quality of the four techniques. Ela has better ranking than the other techniques in 4 of 118 versions while it is one of the best performing techniques for the remaining 114 versions of the subject programs. We apply an equivalent test elimination strategy to neutralize the bias caused by the existence of the equivalent tests. This strategy achieves on average 99.5% test size reduction. Ela has better ranking than the other techniques in 31 of 118 versions while it is one of the best performing techniques for the remaining 87 versions of the subject programs. We propose three test suite reduction strategies to reduce the effort for the fault localization. The best of these strategies achieves on average 34.1% test size reduction while resulting an improvement up to 1.7 in Jaccard, up to 2.46% in Tarantula, up to 1.01% in Ochiai, and up to 0.38% in Ela in terms of average expense. We propose an effective ranking strategy, called Local Maxima, to improve the ranking of statements. This strategy achieves an improvement 10.54% in Jaccard, 10.47% in Tarantula, 10.74% in Ochiai, and 10.88% in Ela in terms of average expense.

Subject Keywords

Debugging in computer science., Computer programs, Computer programs, Computer software, Computer software, Software failures

URI

http://etd.lib.metu.edu.tr/upload/12618870/index.pdf
https://hdl.handle.net/11511/24730

Collections

Graduate School of Informatics, Thesis

Suggestions

OpenMETU
Core

QEVM: quality integrated earned value management Efe, Pınar; Demirörs, Onur; Department of Information Systems (2015) Software project management discipline is in need of valuable tools and techniques to complete projects in agreed scope, on time and within budget according to customer needs. Earned Value Management (EVM) is a simple and powerful performance management and feedback tool, which is widely used in project management with an increasing interest particularly in last decade. EVM clearly displays the project progress in terms of scope, cost and schedule and enables predicting future of the project based on the tr...
Measurement based software process improvement Ener, Aysun; Bilgen, Semih; Department of Electrical and Electronics Engineering (2007) This thesis is a study on improving the software requirements management processes of embedded software department of a company. The literature on software process improvement and requirements engineering is reviewed. After determining the problems related to the current requirements management processes of the department, an improved process is proposed addressing these problems. The static process descriptions and the models of the current and improved requirements management processes are formed. A recen...
Investigation of the effects of structural characteristics of object-oriented software on fault-proneness Gölcük, Halit; Bilgen, Semih; Department of Electrical and Electronics Engineering (2014) This study investigates the effects of structural characteristics of object-oriented software, which are observable at the model level of the software developed by means of Unified Modeling Language (UML), on software quality, assessing quality in terms of fault-proneness. In the scope of this thesis study, real-time embedded software components developed by Aselsan, a leading defense industry company in Turkey, were analyzed. The correlation between software metrics measured from the UML models of the soft...
Architectural design of an access control system for enterprise networks Kirimer, Burak; Özgit, Attila (2007-11-09) Client computers in enterprise networks have the potential to be the source of serious security problems, especially when their hardware and software components are out of physical administrative control. Besides, services in the network may have client configuration requirements. We propose a system composed of a policy management and enforcement server and client agents, which authenticates the client users and checks their computer configurations before allowing their access to services. The information ...
Design and implementation of a monitoring framework Kuz, Kadir; Doğru, Ali Hikmet; Department of Computer Engineering (2009) In this thesis work, the symptoms in Windows XP operating system for fault monitoring are investigated and a fault monitoring library is developed. A test GUI is implemented to examine this library. Performance tests including memory and CPU usage are done to see its overhead to the system and platform tests on the current version of Windows operating system series (Windows Vista) are done to see for compatibility. In this thesis, fault monitor-fault detector interface is also defined and implemented. To mo...

Citation Formats

Ö. Bayraktar, “ELA: an automated statistical fault localization technique,” Ph.D. - Doctoral Program, Middle East Technical University, 2015.