Blogs (1) >>
ICSE 2019
Sat 25 - Fri 31 May 2019 Montreal, QC, Canada
Fri 31 May 2019 15:10 - 15:20 at Place du Canada - Testing of AI Systems Chair(s): Marija Mikic

There is a dramatically increasing interest in the quality assurance for DNN-based systems in the software engineering community. An emerging hot topic in this direction is structural coverage criteria for testing neural networks, which are inspired by coverage metrics used in conventional software testing. In this short paper, we argue that these criteria could be misleading because of the fundamental differences between neural networks and human written programs. Our preliminary exploration shows that (1) adversarial examples are pervasively distributed in the finely divided space defined by such coverage criteria, while available natural samples are very sparse, and as a consequence, (2) previously reported fault-detection “capabilities” conjectured from high coverage testing are more likely due to the adversary-oriented search but not the real “high” coverage.

Fri 31 May

icse-2019-Paper-Presentations
14:00 - 15:30: Papers - Testing of AI Systems at Place du Canada
Chair(s): Marija MikicGoogle
icse-2019-Technical-Papers14:00 - 14:20
Talk
Viet Hung PhamUniversity of Waterloo, Thibaud Lutellier, Weizhen QiUniversity of Science and Technology of China, Lin TanPurdue University
Pre-print
icse-2019-Technical-Papers14:20 - 14:40
Talk
Jinhan KimKAIST, Robert FeldtChalmers University of Technology, Shin YooKorea Advanced Institute of Science and Technology
Pre-print
icse-2019-Demonstrations14:40 - 15:00
Talk
Youcheng SunUniversity of Oxford, Xiaowei HuangUniversity of Liverpool, Daniel KroeningUniversity of Oxford, James SharpDefence Science and Technology Laboratory (Dstl), Matthew HillDefence Science and Technology Laboratory (Dstl), Rob AshmoreDefence Science and Technology Laboratory (Dstl)
icse-2019-New-Ideas-and-Emerging-Reults15:00 - 15:10
Talk
Jasmine SekhonUniversity of Virginia, Cody FlemingUniversity of Virginia
Pre-print
icse-2019-New-Ideas-and-Emerging-Reults15:10 - 15:20
Talk
Zenan LiNanjing University, Xiaoxing MaNanjing University, Chang XuNanjing University, Chun CaoNanjing University
Pre-print
icse-2019-New-Ideas-and-Emerging-Reults15:20 - 15:30
Talk
Ravi MangalGeorgia Institute of Technology, Aditya Nori, Alessandro OrsoGeorgia Tech