Blogs (1) >>
ICSE 2019
Sat 25 - Fri 31 May 2019 Montreal, QC, Canada
Fri 31 May 2019 11:50 - 12:00 at Laurier - Defect Prediction Chair(s): Burak Turhan

Defect models that are trained on class imbalanced datasets (i.e., the proportion of defective and clean modules is not equally represented) are highly susceptible to produce inaccurate prediction models. Prior research compares the impact of class rebalancing techniques on the performance of defect models but arrives at contradictory conclusions due to the use of different choice of datasets, classification techniques, and performance measures. Such contradictory conclusions make it hard to derive practical guidelines for whether class rebalancing techniques should be applied in the context of defect models. In this paper, we investigate the impact of class rebalancing techniques on performance measures and the interpretation of defect models. We also investigate the experimental settings in which class rebalancing techniques are beneficial for defect models. Through a case study of 101 datasets that span across proprietary and open-source systems, we conclude that the impact of class rebalancing techniques on the performance of defect prediction models depends on the used performance measure and the used classification techniques. We observe that the optimized SMOTE technique and the under-sampling technique are beneficial when quality assurance teams wish to increase AUC and Recall, respectively, but they should be avoided when deriving knowledge and understandings from defect models.

Fri 31 May

icse-2019-Paper-Presentations
11:00 - 12:30: Papers - Defect Prediction at Laurier
Chair(s): Burak TurhanMonash University
icse-2019-Journal-First-Paper11:00 - 11:10
Talk
Zhiyuan WanZhejiang University, Xin XiaMonash University, Ahmed E. HassanQueen's University, David LoSingapore Management University, Jianwei Yin, Xiaohu Yang
icse-2019-Technical-Papers11:10 - 11:30
Talk
Suraj YatishThe University of Adelaide, Jirayus JiarpakdeeMonash University, Patanamon ThongtanunamThe University of Melbourne, Chakkrit TantithamthavornMonash University, Australia
icse-2019-Technical-Papers11:30 - 11:50
Talk
George CabralUniversity of Birmingham, Leandro Minku , Emad ShihabConcordia University, Suhaib Mujahid
icse-2019-Journal-First-Paper11:50 - 12:00
Talk
Chakkrit TantithamthavornMonash University, Australia, Ahmed E. HassanQueen's University, Kenichi MatsumotoNara Institute of Science and Technology
Pre-print
icse-2019-Journal-First-Paper12:00 - 12:10
Talk
Kwabena E. BenninBlekinge Institute of Technology, SERL Sweden, Jacky Keung, Akito Monden
Authorizer link
icse-2019-New-Ideas-and-Emerging-Reults12:10 - 12:20
Talk
Cristina MonniUniversità della Svizzera Italiana, Mauro PezzeUniversità della Svizzera italiana (USI) (Switzerland) and Università degli Studi di Milano Bicocca (Italy)
Pre-print
icse-2019-Paper-Presentations12:20 - 12:30
Talk