Blogs (1) >>
ICSE 2019
Sat 25 - Fri 31 May 2019 Montreal, QC, Canada
Fri 31 May 2019 15:20 - 15:30 at Place du Canada - Testing of AI Systems Chair(s): Marija Mikic

Neural networks are becoming increasingly prevalent in software, and it is therefore important to be able to verify their behavior. Because verifying the correctness of neural networks is extremely challenging, it is common to focus on the verification of other properties of these systems. One important property, in particular, is robustness. Most existing definitions of robustness, however, are at one of two extremes:practical definitions, whose notion of robustness is too weak to be useful, or (too) strong definitions that are unlikely to be satisfied by—and verifiable for—practical neural networks. To strike a balance between these two extremes, we propose a novel notion of robustness: probabilistic robustness. Given a probability distribution over the inputs to a neural network, probabilistic robustness requires the neural network to be robust with at least (1 − \epsilon) probability, This probabilistic approach is practical and provides a principled way of estimating the robustness of a neural network. We also present an algorithm, based on abstract interpretation and importance sampling, for checking whether a neural network is probabilistically robust. Our algorithm uses abstract interpretation to approximate the behavior of a neural network and compute an overapproximation of the input regions that violate robustness. It then uses importance sampling to counter the effect of such overapproximation and compute an accurate estimate of the probability that the neural network violates the robustness property.

Fri 31 May

icse-2019-Paper-Presentations
14:00 - 15:30: Papers - Testing of AI Systems at Place du Canada
Chair(s): Marija MikicGoogle
icse-2019-Technical-Papers14:00 - 14:20
Talk
Viet Hung PhamUniversity of Waterloo, Thibaud Lutellier, Weizhen QiUniversity of Science and Technology of China, Lin TanPurdue University
Pre-print
icse-2019-Technical-Papers14:20 - 14:40
Talk
Jinhan KimKAIST, Robert FeldtChalmers University of Technology, Shin YooKorea Advanced Institute of Science and Technology
Authorizer link Pre-print
icse-2019-Demonstrations14:40 - 15:00
Talk
Youcheng SunUniversity of Oxford, Xiaowei HuangUniversity of Liverpool, Daniel KroeningUniversity of Oxford, James SharpDefence Science and Technology Laboratory (Dstl), Matthew HillDefence Science and Technology Laboratory (Dstl), Rob AshmoreDefence Science and Technology Laboratory (Dstl)
icse-2019-New-Ideas-and-Emerging-Reults15:00 - 15:10
Talk
Jasmine SekhonUniversity of Virginia, Cody FlemingUniversity of Virginia
Pre-print
icse-2019-New-Ideas-and-Emerging-Reults15:10 - 15:20
Talk
Zenan LiNanjing University, Xiaoxing MaNanjing University, Chang XuNanjing University, Chun CaoNanjing University
Pre-print
icse-2019-New-Ideas-and-Emerging-Reults15:20 - 15:30
Talk
Ravi MangalGeorgia Institute of Technology, Aditya Nori, Alessandro OrsoGeorgia Tech