Blogs (1) >>
ICSE 2019
Sat 25 - Fri 31 May 2019 Montreal, QC, Canada
Wed 29 May 2019 11:00 - 11:20 at Duluth - Testing Effectiveness Chair(s): Diomidis Spinellis

Software testing is an integral part of software development process. Unfortunately, for many projects, bugs are prevalent despite testing effort, and testing continues to cost significant amount of time and resources. This brings forward the issue of test case quality and prompts us to investigate what make good test cases. To answer this important question, we interview 21 and survey 261 practitioners, who come from many small to large companies and open source projects distributed in 27 countries, to create and validate 29 hypotheses that describe characteristics of good test cases and testing practices. These characteristics span multiple dimensions including test case contents, size and complexity, coverage, maintainability, and bug detection. We present highly rated characteristics and rationales why practitioners agree or disagree with them, which in turn highlight best practices and trade-offs that need to be considered in the creation of test cases. Our findings also highlight open problems and opportunities for software engineering researchers to improve practitioner activities and address their pain points.

Wed 29 May

Displayed time zone: Eastern Time (US & Canada) change

11:00 - 12:30
Testing EffectivenessJournal-First Papers / Software Engineering in Practice / Papers / New Ideas and Emerging Results at Duluth
Chair(s): Diomidis Spinellis Athens University of Economics and Business
11:00
20m
Talk
Practitioners' Views on Good Software Testing PracticesSEIPIndustry Program
Software Engineering in Practice
Pavneet Singh Kochhar Microsoft, Xin Xia Monash University, David Lo Singapore Management University
11:20
20m
Talk
Perception and Practices of Differential TestingSEIPIndustry Program
Software Engineering in Practice
Muhammad Ali Gulzar University of California, Los Angeles, Yongkang Zhu Google, Xiaofeng Han Google
11:40
10m
Talk
An interleaving approach to combinatorial testing and failure-inducing interaction identificationIndustry ProgramJournal-First
Journal-First Papers
Xintao Niu , Changhai Nie , Hareton Leung , Yu Lei , Xiaoyin Wang University of Texas at San Antonio, USA, Jiaxi Xu School of Information Engineering, Nanjing Xiaozhuang University, Yan Wang
11:50
10m
Talk
An Empirical Comparison of Combinatorial Testing, Random Testing and Adaptive Random TestingIndustry ProgramJournal-First
Journal-First Papers
Huayao Wu Nanjing University, Changhai Nie , Justyna Petke University College London, Yue Jia University College London, Mark Harman Facebook and University College London
12:00
10m
Talk
Assurances in Software Testing: A RoadmapIndustry ProgramNIER
New Ideas and Emerging Results
Marcel Böhme Monash University
Pre-print
12:10
10m
Talk
Automatic Test Improvement with DSpot: a Study with Ten Mature Open-Source ProjectsIndustry ProgramJournal-First
Journal-First Papers
Benjamin Danglot University Lille 1 and INRIA, Oscar Luis Vera Pérez INRIA, Benoit Baudry KTH Royal Institute of Technology, Sweden, Martin Monperrus KTH Royal Institute of Technology
12:20
10m
Talk
Discussion Period
Papers