Blogs (1) >>
ICSE 2019
Sat 25 - Fri 31 May 2019 Montreal, QC, Canada
Fri 31 May 2019 11:50 - 12:00 at Laurier - Defect Prediction Chair(s): Burak Turhan

Defect models that are trained on class imbalanced datasets (i.e., the proportion of defective and clean modules is not equally represented) are highly susceptible to produce inaccurate prediction models. Prior research compares the impact of class rebalancing techniques on the performance of defect models but arrives at contradictory conclusions due to the use of different choice of datasets, classification techniques, and performance measures. Such contradictory conclusions make it hard to derive practical guidelines for whether class rebalancing techniques should be applied in the context of defect models. In this paper, we investigate the impact of class rebalancing techniques on performance measures and the interpretation of defect models. We also investigate the experimental settings in which class rebalancing techniques are beneficial for defect models. Through a case study of 101 datasets that span across proprietary and open-source systems, we conclude that the impact of class rebalancing techniques on the performance of defect prediction models depends on the used performance measure and the used classification techniques. We observe that the optimized SMOTE technique and the under-sampling technique are beneficial when quality assurance teams wish to increase AUC and Recall, respectively, but they should be avoided when deriving knowledge and understandings from defect models.

Fri 31 May
Times are displayed in time zone: (GMT-04:00) Eastern Time (US & Canada) change

11:00 - 12:30: Papers - Defect Prediction at Laurier
Chair(s): Burak TurhanMonash University
icse-2019-Journal-First-Paper11:00 - 11:10
Zhiyuan WanZhejiang University, Xin XiaMonash University, Ahmed E. HassanQueen's University, David LoSingapore Management University, Jianwei Yin, Xiaohu Yang
icse-2019-Technical-Papers11:10 - 11:30
Suraj YatishThe University of Adelaide, Jirayus JiarpakdeeMonash University, Patanamon ThongtanunamThe University of Melbourne, Chakkrit (Kla) TantithamthavornMonash University, Australia
icse-2019-Technical-Papers11:30 - 11:50
George CabralUniversity of Birmingham, Leandro Minku , Emad ShihabConcordia University, Suhaib MujahidConcordia University
icse-2019-Journal-First-Paper11:50 - 12:00
Chakkrit (Kla) TantithamthavornMonash University, Australia, Ahmed E. HassanQueen's University, Kenichi MatsumotoNara Institute of Science and Technology
icse-2019-Journal-First-Paper12:00 - 12:10
Kwabena E. BenninBlekinge Institute of Technology, SERL Sweden, Jacky Keung, Akito Monden
Authorizer link
icse-2019-New-Ideas-and-Emerging-Reults12:10 - 12:20
Cristina MonniUniversità della Svizzera Italiana, Mauro PezzeUniversità della Svizzera italiana (USI) (Switzerland) and Università degli Studi di Milano Bicocca (Italy)
icse-2019-Paper-Presentations12:20 - 12:30