Blogs (1) >>
ICSE 2019
Sat 25 - Fri 31 May 2019 Montreal, QC, Canada
Wed 29 May 2019 16:00 - 16:20 at Duluth - Test Selection and Prioritization Chair(s): Robert Feldt

The cost of software testing has become a burden for software companies in the era of rapid release and continuous integration. Our industrial collaborator Ericsson also faces the challenges of expensive testing processes which are typically part of a complex and specialized testing environment. In order to assist Ericsson with improving the test effectiveness of one of its large subsystems, we adopt test selection and prioritization approaches based on test execution history from prior research. By adopting and simulating those approaches on six months of testing data from our subject system, we confirm the existence of valuable information in the test execution history. In particular, the association between test failures provide the most value to the test selection and prioritization processes. More importantly, during this exercise, we encountered various challenges that are unseen or undiscussed in prior research. We document the challenges, our solutions and the lessons learned as an experience report. Our experiences can be valuable for other software testing practitioners and researchers who would like to adopt existing test effectiveness improvement approaches into their work environment.

Wed 29 May

Displayed time zone: Eastern Time (US & Canada) change

16:00 - 18:00
Test Selection and PrioritizationSoftware Engineering in Practice / Technical Track / Papers / Journal-First Papers at Duluth
Chair(s): Robert Feldt Chalmers University of Technology
16:00
20m
Talk
Improving Test Effectiveness Using Test Executions History: An Industrial Experience ReportSEIPIndustry Program
Software Engineering in Practice
Armin Najafi Concordia University, Weiyi Shang Concordia University, Canada, Peter Rigby Concordia University, Montreal, Canada
16:20
20m
Talk
FastLane: Test Minimization for Rapidly Deployed Large-scale Online ServicesTechnical TrackIndustry Program
Technical Track
Adithya Abraham Philip , Ranjita Bhagwan Microsoft Research India, Rahul Kumar Microsoft, Chandra Maddila Microsoft, Nachiappan Nagappan Microsoft Research
16:40
20m
Talk
Scalable Approaches for Test Suite ReductionArtifacts AvailableArtifacts Evaluated ReusableACM SIGSOFT Distinguished Paper AwardTechnical TrackIndustry Program
Technical Track
Emilio Cruciani Gran Sasso Science Institute, L'Aquila, Italy, Breno Miranda Federal University of Pernambuco, Roberto Verdecchia Gran Sasso Science Institute, Vrije Universiteit Amsterdam, Antonia Bertolino CNR-ISTI
Pre-print
17:00
20m
Talk
Using Machine Learning to Recommend Correctness Checks for Geographic Map DataSEIPIndustry Program
Software Engineering in Practice
Abhaya Parthy Apple Inc., Leopold Silberstein Apple Inc., Emily Kowalczyk Apple Inc., John Paul High Apple Inc., Adithya Nagarajan Apple Inc., Atif Memon Apple Inc.
17:20
20m
Talk
A Framework for Checking Regression Test Selection ToolsArtifacts Evaluated ReusableTechnical Track
Technical Track
Chenguang Zhu University of Texas, Austin, Owolabi Legunsen University of Illinois at Urbana-Champaign, August Shi University of Illinois at Urbana-Champaign, Milos Gligoric University of Texas at Austin
17:40
10m
Talk
ConTesa: Directed Test Suite Augmentation for Concurrent SoftwareJournal-First
Journal-First Papers
Tingting Yu University of Kentucky, Zunchen Huang , Chao Wang USC
17:50
10m
Talk
Discussion Period
Papers