Further thoughts on precision

Gray, D. and Bowes, D. and Davey, N. and Sun, Y. and Christianson, B. (2011) Further thoughts on precision. In: 15th Annual Conference on Evaluation & Assessment in Software Engineering (EASE 2011). IEEE, pp. 129-133. ISBN 9781849195096

Full text not available from this repository.

Abstract

Background: There has been much discussion amongst automated software defect prediction researchers regarding use of the precision and false positive rate classifier performance metrics. Aim: To demonstrate and explain why failing to report precision when using data with highly imbalanced class distributions may provide an overly optimistic view of classifier performance. Method: Well documented examples of how dependent class distribution affects the suitability of performance measures. Conclusions: When using data where the minority class represents less than around 5 to 10 percent of data points in total, failing to report precision may be a critical mistake. Furthermore, deriving the precision values omitted from studies can reveal valuable insight into true classifier performance.

Item Type:
Contribution in Book/Report/Proceedings
ID Code:
132046
Deposited By:
Deposited On:
18 Mar 2019 11:00
Refereed?:
Yes
Published?:
Published
Last Modified:
15 Jan 2020 07:01