Blogs (1) >>
ICSE 2019
Sat 25 - Fri 31 May 2019 Montreal, QC, Canada
Wed 29 May 2019 12:00 - 12:10 at Duluth - Testing Effectiveness Chair(s): Diomidis Spinellis

As software engineering researchers we already understand how to make testing more effective and efficient at finding bugs. However, as fuzzing (here, short for automated software testing) becomes more widely adopted in practice, practitioners are asking: Which assurances does a fuzzing campaign provide that exposes no bugs? When is it safe to stop the fuzzer with a reasonable residual risk? How much longer should the fuzzer be run to achieve sufficient coverage?

It is time for us to move beyond the innovation of increasingly sophisticated testing techniques, to build a body of knowledge around the explication and quantification of the testing process, and to develop sound methodologies to estimate and extrapolate these quantities with measurable accuracy. In our vision of the future practitioners leverage a rich statistical toolset to assess residual risk, to obtain statistical guarantees, and to analyze the cost-benefit trade-off for ongoing fuzzing campaigns. We propose a general framework as a first starting point to tackle this fundamental challenge and discuss a large number of concrete opportunities for future research.

Wed 29 May
Times are displayed in time zone: (GMT-04:00) Eastern Time (US & Canada) change

11:00 - 12:30: Papers - Testing Effectiveness at Duluth
Chair(s): Diomidis SpinellisAthens University of Economics and Business
icse-2019-Software-Engineering-in-Practice11:00 - 11:20
Pavneet Singh KochharMicrosoft, Xin XiaMonash University, David LoSingapore Management University
icse-2019-Software-Engineering-in-Practice11:20 - 11:40
Muhammad Ali GulzarUniversity of California, Los Angeles, Yongkang ZhuGoogle, Xiaofeng HanGoogle
icse-2019-Journal-First-Paper11:40 - 11:50
Xintao Niu, Changhai Nie, Hareton Leung, Yu Lei, Xiaoyin WangUniversity of Texas at San Antonio, USA, Jiaxi XuSchool of Information Engineering, Nanjing Xiaozhuang University, Yan Wang
icse-2019-Journal-First-Paper11:50 - 12:00
Huayao WuNanjing University, Changhai Nie, Justyna PetkeUniversity College London, Yue JiaUniversity College London, Mark HarmanFacebook and University College London
icse-2019-New-Ideas-and-Emerging-Reults12:00 - 12:10
Marcel BöhmeMonash University
icse-2019-Journal-First-Paper12:10 - 12:20
Benjamin DanglotUniversity Lille 1 and INRIA, Oscar Luis Vera PérezINRIA, Benoit BaudryKTH Royal Institute of Technology, Sweden, Martin MonperrusKTH Royal Institute of Technology
icse-2019-Paper-Presentations12:20 - 12:30