Automatically Identifying Code Features for Software Defect Prediction : Using AST N-grams

Shippey, Thomas and Bowes, David and Hall, Tracy (2019) Automatically Identifying Code Features for Software Defect Prediction : Using AST N-grams. Information and Software Technology, 106. pp. 142-160. ISSN 0950-5849

[thumbnail of automatically-identifying-code]
PDF (automatically-identifying-code)
automatically_identifying_code.pdf - Accepted Version
Available under License Creative Commons Attribution-NonCommercial-NoDerivs.

Download (673kB)


Context: Identifying defects in code early is important. A wide range of static code metrics have been evaluated as potential defect indicators. Most of these metrics offer only high level insights and focus on particular pre-selected features of the code. None of the currently used metrics clearly performs best in defect prediction. Objective: We use Abstract Syntax Tree (AST) n-grams to identify features of defective Java code that improve defect prediction performance. Method: Our approach is bottom-up and does not rely on pre-selecting any specific features of code. We use non-parametric testing to determine relationships between AST n-grams and faults in both open source and commercial systems. We build defect prediction models using three machine learning techniques. Results: We show that AST n-grams are very significantly related to faults in some systems, with very large effect sizes. The occurrence of some frequently occurring AST n-grams in a method can mean that the method is up to three times more likely to contain a fault. AST n-grams can have a large effect on the performance of defect prediction models. Conclusions: We suggest that AST n-grams offer developers a promising approach to identifying potentially defective code.

Item Type:
Journal Article
Journal or Publication Title:
Information and Software Technology
Additional Information:
This is the author’s version of a work that was accepted for publication in Information and Software Technology. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in Information and Software Technology, 106, 2019 DOI: 10.1016/j.infsof.2018.10.001
Uncontrolled Keywords:
?? softwareinformation systemscomputer science applications ??
ID Code:
Deposited By:
Deposited On:
03 Oct 2018 12:50
Last Modified:
19 Apr 2024 01:52