ISSTA 2021 – Proceedings

Frontmatter

Invited Presentation

Automated Debugging: Past, Present, and Future (ISSTA Impact Paper Award)
Chris Parnin and Alessandro Orso
(North Carolina State University, USA; Georgia Institute of Technology, USA)

Publisher's Version Article: issta21invited-inv1-p doi:10.1145/3460319.3472397

Technical Papers

Web Applications

Identifying Privacy Weaknesses from Multi-party Trigger-Action Integration Platforms
Kulani Mahadewa, Yanjun Zhang, Guangdong Bai, Lei Bu, Zhiqiang Zuo, Dileepa Fernando, Zhenkai Liang, and Jin Song Dong
(National University of Singapore, Singapore; University of Queensland, Australia; Nanjing University, China; Sri Lanka Technological Campus, Sri Lanka)

Publisher's Version Article: issta21main-p185-p doi:10.1145/3460319.3464838

WebEvo: Taming Web Application Evolution via Detecting Semantic Structure Changes
Fei Shao, Rui Xu, Wasif Haque, Jingwei Xu, Ying Zhang, Wei Yang, Yanfang Ye, and Xusheng Xiao
(Case Western Reserve University, USA; University of Texas at Dallas, USA; Peking University, China)

Publisher's Version Published Artifact Artifacts Available Article: issta21main-p29-p doi:10.1145/3460319.3464800

Modular Call Graph Construction for Security Scanning of Node.js Applications
Benjamin Barslev Nielsen, Martin Toldam Torp, and Anders Møller
(Aarhus University, Denmark)

Publisher's Version Article: issta21main-p156-p doi:10.1145/3460319.3464836

Testing Deep Learning Systems

Attack as Defense: Characterizing Adversarial Examples using Robustness
Zhe Zhao, Guangke Chen, Jingyi Wang, Yiwei Yang, Fu Song, and Jun Sun
(ShanghaiTech University, China; Zhejiang University, China; Singapore Management University, Singapore)

Publisher's Version Article: issta21main-p260-p doi:10.1145/3460319.3464822

Exposing Previously Undetectable Faults in Deep Neural Networks
Isaac Dunn, Hadrien Pouget, Daniel Kroening, and Tom Melham
(University of Oxford, UK; Amazon, UK)

Publisher's Version Published Artifact Artifacts Available Artifacts Functional Article: issta21main-p58-p doi:10.1145/3460319.3464801

DeepCrime: Mutation Testing of Deep Learning Systems Based on Real Faults
Nargiz Humbatova, Gunel Jahangirova, and Paolo Tonella
(USI Lugano, Switzerland)

Publisher's Version Published Artifact Artifacts Available Artifacts Reusable Article: issta21main-p370-p doi:10.1145/3460319.3464825

DeepHyperion: Exploring the Feature Space of Deep Learning-Based Systems through Illumination Search
Tahereh Zohdinasab, Vincenzo Riccio, Alessio Gambi, and Paolo Tonella
(USI Lugano, Switzerland; University of Passau, Germany)

Publisher's Version Published Artifact Artifacts Available Artifacts Reusable Article: issta21main-p153-p doi:10.1145/3460319.3464811

Automatic Test Suite Generation for Key-Points Detection DNNs using Many-Objective Search (Experience Paper)
Fitash Ul Haq, Donghwan Shin, Lionel C. Briand, Thomas Stifter, and Jun Wang
(University of Luxembourg, Luxembourg; University of Ottawa, Canada; IEE, Luxembourg; Post Luxembourg, Luxembourg)

Publisher's Version Article: issta21main-p65-p doi:10.1145/3460319.3464802

Efficient White-Box Fairness Testing through Gradient Search
Lingfeng Zhang, Yueling Zhang, and Min Zhang
(East China Normal University, China; Singapore Management University, Singapore)

Publisher's Version Published Artifact Artifacts Available Article: issta21main-p216-p doi:10.1145/3460319.3464820

DialTest: Automated Testing for Recurrent-Neural-Network-Driven Dialogue Systems
Zixi Liu, Yang Feng, and Zhenyu Chen
(Nanjing University, China)

Publisher's Version Published Artifact Artifacts Available Article: issta21main-p556-p doi:10.1145/3460319.3464829

AdvDoor: Adversarial Backdoor Attack of Deep Learning System
Quan Zhang, Yifeng Ding, Yongqiang Tian, Jianmin Guo, Min Yuan, and Yu Jiang
(Tsinghua University, China; University of Waterloo, Canada; WeBank, China)

Publisher's Version Published Artifact Artifacts Available Article: issta21main-p141-p doi:10.1145/3460319.3464809

ModelDiff: Testing-Based DNN Similarity Comparison for Model Reuse Detection
Yuanchun Li, Ziqi Zhang, Bingyan Liu, Ziyue Yang, and Yunxin Liu
(Microsoft Research, China; Peking University, China; Tsinghua University, China)

Publisher's Version Published Artifact Artifacts Available Article: issta21main-p203-p doi:10.1145/3460319.3464816

Android Application Analysis and Testing

Parema: An Unpacking Framework for Demystifying VM-Based Android Packers
Lei Xue, Yuxiao Yan, Luyi Yan, Muhui Jiang, Xiapu Luo, Dinghao Wu, and Yajin Zhou
(Hong Kong Polytechnic University, China; Xi'an Jiaotong University, China; Pennsylvania State University, USA; Zhejiang University, China)

Publisher's Version Article: issta21main-p286-p doi:10.1145/3460319.3464839

An Infrastructure Approach to Improving Effectiveness of Android UI Testing Tools
Wenyu Wang, Wing Lam, and Tao Xie
(University of Illinois at Urbana-Champaign, USA; Peking University, China)

Publisher's Version Article: issta21main-p499-p doi:10.1145/3460319.3464828

Semantic Matching of GUI Events for Test Reuse: Are We There Yet?
Leonardo Mariani, Ali Mohebbi, Mauro Pezzè, and Valerio Terragni
(University of Milano-Bicocca, Italy; USI Lugano, Switzerland; Schaffhausen Institute of Technology, Switzerland; University of Auckland, New Zealand)

Publisher's Version Published Artifact Artifacts Available Article: issta21main-p469-p doi:10.1145/3460319.3464827

GUIDER: GUI Structure and Vision Co-guided Test Script Repair for Android Apps
Tongtong Xu, Minxue Pan, Yu Pei, Guiyin Li, Xia Zeng, Tian Zhang, Yuetang Deng, and Xuandong Li
(Nanjing University, China; Hong Kong Polytechnic University, China; Tencent, China)

Publisher's Version Article: issta21main-p619-p doi:10.1145/3460319.3464830

Understanding and Finding System Setting-Related Defects in Android Apps
Jingling Sun, Ting Su, Junxin Li, Zhen Dong, Geguang Pu, Tao Xie, and Zhendong Su
(East China Normal University, China; National University of Singapore, Singapore; Peking University, China; ETH Zurich, Switzerland)

Publisher's Version Published Artifact Artifacts Available Artifacts Reusable Article: issta21main-p101-p doi:10.1145/3460319.3464806

HomDroid: Detecting Android Covert Malware by Social-Network Homophily Analysis
Yueming Wu, Deqing Zou, Wei Yang, Xiang Li, and Hai Jin
(Huazhong University of Science and Technology, China; University of Texas at Dallas, USA)

Publisher's Version Article: issta21main-p85-p doi:10.1145/3460319.3464833

Fuzzing

Seed Selection for Successful Fuzzing
Adrian Herrera, Hendra Gunadi, Shane Magrath, Michael Norrish, Mathias Payer, and Antony L. Hosking
(Australian National University, Australia; DST, Australia; CSIRO’s Data61, Australia; EPFL, Switzerland)

Publisher's Version Published Artifact Artifacts Available Article: issta21main-p6-p doi:10.1145/3460319.3464795

Gramatron: Effective Grammar-Aware Fuzzing
Prashast Srivastava and Mathias Payer
(Purdue University, USA; EPFL, Switzerland)

Publisher's Version Published Artifact Artifacts Available Artifacts Reusable Article: issta21main-p184-p doi:10.1145/3460319.3464814

QFuzz: Quantitative Fuzzing for Side Channels
Yannic Noller and Saeid Tizpaz-Niari
(National University of Singapore, Singapore; University of Texas at El Paso, USA)

Publisher's Version Published Artifact Artifacts Available Artifacts Reusable Article: issta21main-p209-p doi:10.1145/3460319.3464817

Data Processing Application Analysis

SAND: A Static Analysis Approach for Detecting SQL Antipatterns
Yingjun Lyu, Sasha Volokh, William G. J. Halfond, and Omer Tripp
(Amazon, USA; University of Southern California, USA)

Publisher's Version Article: issta21main-p210-p doi:10.1145/3460319.3464818

Semantic Table Structure Identification in Spreadsheets
Yakun Zhang, Xiao Lv, Haoyu Dong, Wensheng Dou, Shi Han, Dongmei Zhang, Jun Wei, and Dan Ye
(Institute of Software at Chinese Academy of Sciences, China; University of Chinese Academy of Sciences, China; Microsoft Research, China)

Publisher's Version Article: issta21main-p161-p doi:10.1145/3460319.3464812

Dynamic Analysis

Runtime Detection of Memory Errors with Smart Status
Zhe Chen, Chong Wang, Junqi Yan, Yulei Sui, and Jingling Xue
(Nanjing University of Aeronautics and Astronautics, China; University of Technology Sydney, Australia; UNSW, Australia)

Publisher's Version Published Artifact Artifacts Available Artifacts Functional Article: issta21main-p113-p doi:10.1145/3460319.3464807

UAFSan: An Object-Identifier-Based Dynamic Approach for Detecting Use-After-Free Vulnerabilities
Binfa Gui, Wei Song, and Jeff Huang
(Nanjing University of Science and Technology, China; Texas A&M University, USA)

Publisher's Version Article: issta21main-p123-p doi:10.1145/3460319.3464835

Symbolic Execution

Fuzzing SMT Solvers via Two-Dimensional Input Space Exploration
Peisen Yao, Heqing Huang, Wensheng Tang, Qingkai Shi, Rongxin Wu, and Charles Zhang
(Hong Kong University of Science and Technology, China; Xiamen University, China)

Publisher's Version Article: issta21main-p67-p doi:10.1145/3460319.3464803

Boosting Symbolic Execution via Constraint Solving Time Prediction (Experience Paper)
Sicheng Luo, Hui Xu, Yanxiang Bi, Xin Wang, and Yangfan Zhou
(Fudan University, China)

Publisher's Version Published Artifact Artifacts Available Artifacts Reusable Article: issta21main-p166-p doi:10.1145/3460319.3464813

Synthesize Solving Strategy for Symbolic Execution
Zhenbang Chen, Zehua Chen, Ziqi Shuai, Guofeng Zhang, Weiyu Pan, Yufeng Zhang, and Ji Wang
(National University of Defense Technology, China; Hunan University, China)

Publisher's Version Article: issta21main-p200-p doi:10.1145/3460319.3464815

Type and Interval Aware Array Constraint Solving for Symbolic Execution
Ziqi Shuai, Zhenbang Chen, Yufeng Zhang, Jun Sun, and Ji Wang
(National University of Defense Technology, China; Hunan University, China; Singapore Management University, Singapore)

Publisher's Version Published Artifact Artifacts Available Artifacts Reusable Article: issta21main-p451-p doi:10.1145/3460319.3464826

Grammar-Agnostic Symbolic Execution by Token Symbolization
Weiyu Pan, Zhenbang Chen, Guofeng Zhang, Yunlai Luo, Yufeng Zhang, and Ji Wang
(National University of Defense Technology, China; Hunan University, China)

Publisher's Version Published Artifact Artifacts Available Artifacts Functional Article: issta21main-p515-p doi:10.1145/3460319.3464845

Machine Learning and Testing

Interval Constraint-Based Mutation Testing of Numerical Specifications
Clothilde Jeangoudoux, Eva Darulova, and Christoph Lauter
(MPI-SWS, Germany; University of Alaska at Anchorage, USA)

Publisher's Version Article: issta21main-p117-p doi:10.1145/3460319.3464808

Predoo: Precision Testing of Deep Learning Operators
Xufan Zhang, Ning Sun, Chunrong Fang, Jiawei Liu, Jia Liu, Dong Chai, Jiang Wang, and Zhenyu Chen
(Nanjing University, China; Huawei, China)

Publisher's Version Article: issta21main-p420-p doi:10.1145/3460319.3464843

TERA: Optimizing Stochastic Regression Tests in Machine Learning Projects
Saikat Dutta, Jeeva Selvam, Aryaman Jain, and Sasa Misailovic
(University of Illinois at Urbana-Champaign, USA)

Publisher's Version Published Artifact Artifacts Available Artifacts Reusable Article: issta21main-p468-p doi:10.1145/3460319.3464844

Deep Just-in-Time Defect Prediction: How Far Are We?
Zhengran Zeng, Yuqun Zhang, Haotian Zhang, and Lingming Zhang
(Southern University of Science and Technology, China; Kwai, China; University of Illinois at Urbana-Champaign, USA)

Publisher's Version Published Artifact Artifacts Available Artifacts Reusable Article: issta21main-p212-p doi:10.1145/3460319.3464819

Configuration and Dependency

Fixing Dependency Errors for Python Build Reproducibility
Suchita Mukherjee, Abigail Almanza, and Cindy Rubio-González
(University of California at Davis, USA)

Publisher's Version Published Artifact Artifacts Available Article: issta21main-p10-p doi:10.1145/3460319.3464797

Test-Case Prioritization for Configuration Testing
Runxiang Cheng, Lingming Zhang, Darko Marinov, and Tianyin Xu
(University of Illinois at Urbana-Champaign, USA)

Publisher's Version Published Artifact Artifacts Available Artifacts Reusable Article: issta21main-p146-p doi:10.1145/3460319.3464810

The Impact of Tool Configuration Spaces on the Evaluation of Configurable Taint Analysis for Android
Austin Mordahl and Shiyi Wei
(University of Texas at Dallas, USA)

Publisher's Version Published Artifact Artifacts Available Artifacts Functional Article: issta21main-p280-p doi:10.1145/3460319.3464823

Challenges and Opportunities: An In-Depth Empirical Study on Configuration Error Injection Testing
Wang Li, Zhouyang Jia, Shanshan Li, Yuanliang Zhang, Teng Wang, Erci Xu, Ji Wang, and Xiangke Liao
(National University of Defense Technology, China)

Publisher's Version Published Artifact Artifacts Available Article: issta21main-p28-p doi:10.1145/3460319.3464799

Testing

Empirically Evaluating Readily Available Information for Regression Test Optimization in Continuous Integration
Daniel Elsner, Florian Hauer, Alexander Pretschner, and Silke Reimer
(TU Munich, Germany; IVU Traffic Technologies, Germany)

Publisher's Version Published Artifact Artifacts Available Article: issta21main-p92-p doi:10.1145/3460319.3464834

Toward Optimal MC/DC Test Case Generation
Sangharatna Godboley, Joxan Jaffar, Rasool Maghareh, and Arpita Dutta
(National Institute of Technology Warangal, India; National University of Singapore, Singapore; Huawei, Canada)

Publisher's Version Published Artifact Artifacts Available Artifacts Reusable Article: issta21main-p322-p doi:10.1145/3460319.3464841

Log-Based Slicing for System-Level Test Cases
Salma Messaoudi, Donghwan Shin, Annibale Panichella, Domenico Bianculli, and Lionel C. Briand
(University of Luxembourg, Luxembourg; Delft University of Technology, Netherlands; University of Ottawa, Canada)

Publisher's Version Article: issta21main-p310-p doi:10.1145/3460319.3464824

Model-Based Testing of Networked Applications
Yishuai Li, Benjamin C. Pierce, and Steve Zdancewic
(University of Pennsylvania, USA)

Publisher's Version Published Artifact Artifacts Available Artifacts Reusable Article: issta21main-p15-p doi:10.1145/3460319.3464798

Validating Static Warnings via Testing Code Fragments
Ashwin Kallingal Joshy, Xueyuan Chen, Benjamin Steenhoek, and Wei Le
(Iowa State University, USA)

Publisher's Version Published Artifact Artifacts Available Article: issta21main-p77-p doi:10.1145/3460319.3464832

Continuous Test Suite Failure Prediction
Cong Pan and Michael Pradel
(Beihang University, China; University of Stuttgart, Germany)

Publisher's Version Article: issta21main-p308-p doi:10.1145/3460319.3464840

Empirical Evaluation of Smart Contract Testing: What Is the Best Choice?
Meng Ren, Zijing Yin, Fuchen Ma, Zhenyang Xu, Yu Jiang, Chengnian Sun, Huizhong Li, and Yan Cai
(Tsinghua University, China; University of Waterloo, Canada; WeBank, China; Institute of Software at Chinese Academy of Sciences, China)

Publisher's Version Published Artifact Artifacts Available Artifacts Reusable Article: issta21main-p173-p doi:10.1145/3460319.3464837

Binary Analysis

iDEV: Exploring and Exploiting Semantic Deviations in ARM Instruction Processing
Shisong Qin, Chao Zhang, Kaixiang Chen, and Zheming Li
(Tsinghua University, China)

Publisher's Version Article: issta21main-p413-p doi:10.1145/3460319.3464842

RAProducer: Efficiently Diagnose and Reproduce Data Race Bugs for Binaries via Trace Analysis
Ming Yuan, Yeseop Lee, Chao Zhang, Yun Li, Yan Cai, and Bodong Zhao
(Tsinghua University, China; Institute of Software at Chinese Academy of Sciences, China)

Publisher's Version Article: issta21main-p56-p doi:10.1145/3460319.3464831

A Lightweight Framework for Function Name Reassignment Based on Large-Scale Stripped Binaries
Han Gao, Shaoyin Cheng, Yinxing Xue, and Weiming Zhang
(University of Science and Technology of China, China)

Publisher's Version Article: issta21main-p86-p doi:10.1145/3460319.3464804

Bugs and Analysis

Finding Data Compatibility Bugs with JSON Subschema Checking
Andrew Habib, Avraham Shinnar, Martin Hirzel, and Michael Pradel
(University of Luxembourg, Luxembourg; IBM Research, USA; University of Stuttgart, Germany)

Publisher's Version Published Artifact Artifacts Available Artifacts Reusable Article: issta21main-p8-p doi:10.1145/3460319.3464796

Automated Patch Backporting in Linux (Experience Paper)
Ridwan Shariffdeen, Xiang Gao, Gregory J. Duck, Shin Hwei Tan, Julia Lawall, and Abhik Roychoudhury
(National University of Singapore, Singapore; Southern University of Science and Technology, China; Inria, France)

Publisher's Version Published Artifact Artifacts Available Artifacts Reusable Article: issta21main-p237-p doi:10.1145/3460319.3464821

Faster, Deeper, Easier: Crowdsourcing Diagnosis of Microservice Kernel Failure from User Space
Yicheng Pan, Meng Ma, Xinrui Jiang, and Ping Wang
(Peking University, China)

Publisher's Version Article: issta21main-p87-p doi:10.1145/3460319.3464805

Demo Papers

echidna-parade: A Tool for Diverse Multicore Smart Contract Fuzzing
Alex Groce and Gustavo Grieco
(Northern Arizona University, USA; Trail of Bits, USA)

Publisher's Version Article: issta21demo-p8-p doi:10.1145/3460319.3469076

ProFuzzBench: A Benchmark for Stateful Protocol Fuzzing
Roberto Natella and Van-Thuan Pham
(Federico II University of Naples, Italy; University of Melbourne, Australia)

Publisher's Version Article: issta21demo-p38-p doi:10.1145/3460319.3469077

SCStudio: A Secure and Efficient Integrated Development Environment for Smart Contracts
Meng Ren, Fuchen Ma, Zijing Yin, Huizhong Li, Ying Fu, Ting Chen, and Yu Jiang
(Tsinghua University, China; WeBank, China; Ant Financial, China; University of Electronic Science and Technology of China, China)

Publisher's Version Article: issta21demo-p48-p doi:10.1145/3460319.3469078

C4: The C Compiler Concurrency Checker
Matt Windsor, Alastair F. Donaldson, and John Wickerson
(University of York, UK; Imperial College London, UK)

Publisher's Version Article: issta21demo-p60-p doi:10.1145/3460319.3469079

TauMed: Test Augmentation of Deep Learning in Medical Diagnosis
Yunhan Hou, Jiawei Liu, Daiwei Wang, Jiawei He, Chunrong Fang, and Zhenyu Chen
(Nanjing University, China)

Publisher's Version Article: issta21demo-p87-p doi:10.1145/3460319.3469080

MoScan: A Model-Based Vulnerability Scanner for Web Single Sign-On Services
Hanlin Wei, Behnaz Hassanshahi, Guangdong Bai, Padmanabhan Krishnan, and Kostyantyn Vorobyov
(University of Queensland, Australia; Oracle, Australia)

Publisher's Version Article: issta21demo-p94-p doi:10.1145/3460319.3469081

RESTest: Automated Black-Box Testing of RESTful Web APIs
Alberto Martin-Lopez, Sergio Segura, and Antonio Ruiz-Cortés
(University of Seville, Spain)

Publisher's Version Article: issta21demo-p100-p doi:10.1145/3460319.3469082

proc time: 0.11