ISSTA 2021
30th ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2021)
Powered by
Conference Publishing Consulting

30th ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2021), July 11–17, 2021, Virtual, Denmark

ISSTA 2021 – Proceedings

Contents - Abstracts - Authors

Frontmatter

Title Page
Welcome from the Chairs
ISSTA 2021 Organization
ISSTA 2021 Sponsors and Supporters

Invited Presentation

Automated Debugging: Past, Present, and Future (ISSTA Impact Paper Award)
Chris Parnin and Alessandro Orso
(North Carolina State University, USA; Georgia Institute of Technology, USA)
Publisher's Version

Technical Papers

Web Applications

Identifying Privacy Weaknesses from Multi-party Trigger-Action Integration Platforms
Kulani Mahadewa, Yanjun Zhang, Guangdong Bai, Lei Bu, Zhiqiang Zuo, Dileepa Fernando, Zhenkai Liang, and Jin Song Dong
(National University of Singapore, Singapore; University of Queensland, Australia; Nanjing University, China; Sri Lanka Technological Campus, Sri Lanka)
Publisher's Version
WebEvo: Taming Web Application Evolution via Detecting Semantic Structure Changes
Fei Shao, Rui Xu, Wasif Haque, Jingwei Xu, Ying Zhang, Wei Yang, Yanfang Ye, and Xusheng Xiao
(Case Western Reserve University, USA; University of Texas at Dallas, USA; Peking University, China)
Publisher's Version Video Info
Modular Call Graph Construction for Security Scanning of Node.js Applications
Benjamin Barslev Nielsen, Martin Toldam Torp, and Anders Møller
(Aarhus University, Denmark)
Publisher's Version

Testing Deep Learning Systems

Attack as Defense: Characterizing Adversarial Examples using Robustness
Zhe Zhao, Guangke Chen, Jingyi Wang, Yiwei Yang, Fu Song, and Jun Sun
(ShanghaiTech University, China; Zhejiang University, China; Singapore Management University, Singapore)
Publisher's Version
Exposing Previously Undetectable Faults in Deep Neural Networks
Isaac Dunn, Hadrien Pouget, Daniel Kroening, and Tom Melham
(University of Oxford, UK; Amazon, UK)
Publisher's Version Artifacts Functional
DeepCrime: Mutation Testing of Deep Learning Systems Based on Real Faults
Nargiz Humbatova, Gunel Jahangirova, and Paolo Tonella
(USI Lugano, Switzerland)
Publisher's Version Artifacts Reusable
DeepHyperion: Exploring the Feature Space of Deep Learning-Based Systems through Illumination Search
Tahereh Zohdinasab, Vincenzo Riccio, Alessio Gambi, and Paolo Tonella
(USI Lugano, Switzerland; University of Passau, Germany)
Publisher's Version Artifacts Reusable
Automatic Test Suite Generation for Key-Points Detection DNNs using Many-Objective Search (Experience Paper)
Fitash Ul Haq, Donghwan Shin, Lionel C. Briand, Thomas Stifter, and Jun Wang
(University of Luxembourg, Luxembourg; University of Ottawa, Canada; IEE, Luxembourg; Post Luxembourg, Luxembourg)
Publisher's Version
Efficient White-Box Fairness Testing through Gradient Search
Lingfeng Zhang, Yueling Zhang, and Min Zhang
(East China Normal University, China; Singapore Management University, Singapore)
Publisher's Version
DialTest: Automated Testing for Recurrent-Neural-Network-Driven Dialogue Systems
Zixi Liu, Yang Feng, and Zhenyu Chen
(Nanjing University, China)
Publisher's Version
AdvDoor: Adversarial Backdoor Attack of Deep Learning System
Quan Zhang, Yifeng Ding, Yongqiang Tian, Jianmin Guo, Min Yuan, and Yu Jiang
(Tsinghua University, China; University of Waterloo, Canada; WeBank, China)
Publisher's Version Info
ModelDiff: Testing-Based DNN Similarity Comparison for Model Reuse Detection
Yuanchun Li, Ziqi Zhang, Bingyan Liu, Ziyue Yang, and Yunxin Liu
(Microsoft Research, China; Peking University, China; Tsinghua University, China)
Publisher's Version

Android Application Analysis and Testing

Parema: An Unpacking Framework for Demystifying VM-Based Android Packers
Lei Xue, Yuxiao Yan, Luyi Yan, Muhui Jiang, Xiapu Luo, Dinghao Wu, and Yajin Zhou
(Hong Kong Polytechnic University, China; Xi'an Jiaotong University, China; Pennsylvania State University, USA; Zhejiang University, China)
Publisher's Version
An Infrastructure Approach to Improving Effectiveness of Android UI Testing Tools
Wenyu Wang, Wing Lam, and Tao Xie
(University of Illinois at Urbana-Champaign, USA; Peking University, China)
Publisher's Version
Semantic Matching of GUI Events for Test Reuse: Are We There Yet?
Leonardo Mariani, Ali Mohebbi, Mauro Pezzè, and Valerio Terragni
(University of Milano-Bicocca, Italy; USI Lugano, Switzerland; Schaffhausen Institute of Technology, Switzerland; University of Auckland, New Zealand)
Publisher's Version
GUIDER: GUI Structure and Vision Co-guided Test Script Repair for Android Apps
Tongtong Xu, Minxue Pan, Yu Pei, Guiyin Li, Xia Zeng, Tian Zhang, Yuetang Deng, and Xuandong Li
(Nanjing University, China; Hong Kong Polytechnic University, China; Tencent, China)
Publisher's Version
Understanding and Finding System Setting-Related Defects in Android Apps
Jingling Sun, Ting Su, Junxin Li, Zhen Dong, Geguang Pu, Tao Xie, and Zhendong Su
(East China Normal University, China; National University of Singapore, Singapore; Peking University, China; ETH Zurich, Switzerland)
Publisher's Version Artifacts Reusable
HomDroid: Detecting Android Covert Malware by Social-Network Homophily Analysis
Yueming Wu, Deqing Zou, Wei Yang, Xiang Li, and Hai Jin
(Huazhong University of Science and Technology, China; University of Texas at Dallas, USA)
Publisher's Version

Fuzzing

Seed Selection for Successful Fuzzing
Adrian Herrera, Hendra Gunadi, Shane Magrath, Michael Norrish, Mathias Payer, and Antony L. Hosking
(Australian National University, Australia; DST, Australia; CSIRO’s Data61, Australia; EPFL, Switzerland)
Publisher's Version
Gramatron: Effective Grammar-Aware Fuzzing
Prashast Srivastava and Mathias Payer
(Purdue University, USA; EPFL, Switzerland)
Publisher's Version Artifacts Reusable
QFuzz: Quantitative Fuzzing for Side Channels
Yannic Noller and Saeid Tizpaz-Niari
(National University of Singapore, Singapore; University of Texas at El Paso, USA)
Publisher's Version Artifacts Reusable

Data Processing Application Analysis

SAND: A Static Analysis Approach for Detecting SQL Antipatterns
Yingjun Lyu, Sasha Volokh, William G. J. Halfond, and Omer Tripp
(Amazon, USA; University of Southern California, USA)
Publisher's Version
Semantic Table Structure Identification in Spreadsheets
Yakun Zhang, Xiao Lv, Haoyu Dong, Wensheng Dou, Shi Han, Dongmei Zhang, Jun Wei, and Dan Ye
(Institute of Software at Chinese Academy of Sciences, China; University of Chinese Academy of Sciences, China; Microsoft Research, China)
Publisher's Version

Dynamic Analysis

Runtime Detection of Memory Errors with Smart Status
Zhe Chen, Chong Wang, Junqi Yan, Yulei Sui, and Jingling Xue
(Nanjing University of Aeronautics and Astronautics, China; University of Technology Sydney, Australia; UNSW, Australia)
Publisher's Version Artifacts Functional
UAFSan: An Object-Identifier-Based Dynamic Approach for Detecting Use-After-Free Vulnerabilities
Binfa Gui, Wei Song, and Jeff Huang
(Nanjing University of Science and Technology, China; Texas A&M University, USA)
Publisher's Version

Symbolic Execution

Fuzzing SMT Solvers via Two-Dimensional Input Space Exploration
Peisen Yao, Heqing Huang, Wensheng Tang, Qingkai Shi, Rongxin Wu, and Charles Zhang
(Hong Kong University of Science and Technology, China; Xiamen University, China)
Publisher's Version
Boosting Symbolic Execution via Constraint Solving Time Prediction (Experience Paper)
Sicheng Luo, Hui Xu, Yanxiang Bi, Xin Wang, and Yangfan Zhou
(Fudan University, China)
Publisher's Version Artifacts Reusable
Synthesize Solving Strategy for Symbolic Execution
Zhenbang Chen, Zehua Chen, Ziqi Shuai, Guofeng Zhang, Weiyu Pan, Yufeng Zhang, and Ji Wang
(National University of Defense Technology, China; Hunan University, China)
Publisher's Version
Type and Interval Aware Array Constraint Solving for Symbolic Execution
Ziqi Shuai, Zhenbang Chen, Yufeng Zhang, Jun Sun, and Ji Wang
(National University of Defense Technology, China; Hunan University, China; Singapore Management University, Singapore)
Publisher's Version Artifacts Reusable
Grammar-Agnostic Symbolic Execution by Token Symbolization
Weiyu Pan, Zhenbang Chen, Guofeng Zhang, Yunlai Luo, Yufeng Zhang, and Ji Wang
(National University of Defense Technology, China; Hunan University, China)
Publisher's Version Artifacts Functional

Machine Learning and Testing

Interval Constraint-Based Mutation Testing of Numerical Specifications
Clothilde Jeangoudoux, Eva Darulova, and Christoph Lauter
(MPI-SWS, Germany; University of Alaska at Anchorage, USA)
Publisher's Version
Predoo: Precision Testing of Deep Learning Operators
Xufan Zhang, Ning Sun, Chunrong Fang, Jiawei Liu, Jia Liu, Dong Chai, Jiang Wang, and Zhenyu Chen
(Nanjing University, China; Huawei, China)
Publisher's Version
TERA: Optimizing Stochastic Regression Tests in Machine Learning Projects
Saikat Dutta, Jeeva Selvam, Aryaman Jain, and Sasa Misailovic
(University of Illinois at Urbana-Champaign, USA)
Publisher's Version Artifacts Reusable
Deep Just-in-Time Defect Prediction: How Far Are We?
Zhengran Zeng, Yuqun Zhang, Haotian Zhang, and Lingming Zhang
(Southern University of Science and Technology, China; Kwai, China; University of Illinois at Urbana-Champaign, USA)
Publisher's Version Artifacts Reusable

Configuration and Dependency

Fixing Dependency Errors for Python Build Reproducibility
Suchita Mukherjee, Abigail Almanza, and Cindy Rubio-González
(University of California at Davis, USA)
Publisher's Version
Test-Case Prioritization for Configuration Testing
Runxiang Cheng, Lingming Zhang, Darko Marinov, and Tianyin Xu
(University of Illinois at Urbana-Champaign, USA)
Publisher's Version Artifacts Reusable
The Impact of Tool Configuration Spaces on the Evaluation of Configurable Taint Analysis for Android
Austin Mordahl and Shiyi Wei
(University of Texas at Dallas, USA)
Publisher's Version Artifacts Functional
Challenges and Opportunities: An In-Depth Empirical Study on Configuration Error Injection Testing
Wang Li, Zhouyang Jia, Shanshan Li, Yuanliang Zhang, Teng Wang, Erci Xu, Ji Wang, and Xiangke Liao
(National University of Defense Technology, China)
Publisher's Version

Testing

Empirically Evaluating Readily Available Information for Regression Test Optimization in Continuous Integration
Daniel Elsner, Florian Hauer, Alexander Pretschner, and Silke Reimer
(TU Munich, Germany; IVU Traffic Technologies, Germany)
Publisher's Version
Toward Optimal MC/DC Test Case Generation
Sangharatna Godboley, Joxan Jaffar, Rasool Maghareh, and Arpita Dutta
(National Institute of Technology Warangal, India; National University of Singapore, Singapore; Huawei, Canada)
Publisher's Version Artifacts Reusable
Log-Based Slicing for System-Level Test Cases
Salma Messaoudi, Donghwan Shin, Annibale Panichella, Domenico Bianculli, and Lionel C. Briand
(University of Luxembourg, Luxembourg; Delft University of Technology, Netherlands; University of Ottawa, Canada)
Publisher's Version
Model-Based Testing of Networked Applications
Yishuai Li, Benjamin C. Pierce, and Steve Zdancewic
(University of Pennsylvania, USA)
Publisher's Version Artifacts Reusable
Validating Static Warnings via Testing Code Fragments
Ashwin Kallingal Joshy, Xueyuan Chen, Benjamin Steenhoek, and Wei Le
(Iowa State University, USA)
Publisher's Version Info
Continuous Test Suite Failure Prediction
Cong Pan and Michael Pradel
(Beihang University, China; University of Stuttgart, Germany)
Publisher's Version
Empirical Evaluation of Smart Contract Testing: What Is the Best Choice?
Meng Ren, Zijing Yin, Fuchen Ma, Zhenyang Xu, Yu Jiang, Chengnian Sun, Huizhong Li, and Yan Cai
(Tsinghua University, China; University of Waterloo, Canada; WeBank, China; Institute of Software at Chinese Academy of Sciences, China)
Publisher's Version Artifacts Reusable

Binary Analysis

iDEV: Exploring and Exploiting Semantic Deviations in ARM Instruction Processing
Shisong Qin, Chao Zhang, Kaixiang Chen, and Zheming Li
(Tsinghua University, China)
Publisher's Version
RAProducer: Efficiently Diagnose and Reproduce Data Race Bugs for Binaries via Trace Analysis
Ming Yuan, Yeseop Lee, Chao Zhang, Yun Li, Yan Cai, and Bodong Zhao
(Tsinghua University, China; Institute of Software at Chinese Academy of Sciences, China)
Publisher's Version
A Lightweight Framework for Function Name Reassignment Based on Large-Scale Stripped Binaries
Han Gao, Shaoyin Cheng, Yinxing Xue, and Weiming Zhang
(University of Science and Technology of China, China)
Publisher's Version

Bugs and Analysis

Finding Data Compatibility Bugs with JSON Subschema Checking
Andrew Habib, Avraham Shinnar, Martin Hirzel, and Michael Pradel
(University of Luxembourg, Luxembourg; IBM Research, USA; University of Stuttgart, Germany)
Publisher's Version Info Artifacts Reusable
Automated Patch Backporting in Linux (Experience Paper)
Ridwan Shariffdeen, Xiang Gao, Gregory J. Duck, Shin Hwei Tan, Julia Lawall, and Abhik Roychoudhury
(National University of Singapore, Singapore; Southern University of Science and Technology, China; Inria, France)
Publisher's Version Artifacts Reusable
Faster, Deeper, Easier: Crowdsourcing Diagnosis of Microservice Kernel Failure from User Space
Yicheng Pan, Meng Ma, Xinrui Jiang, and Ping Wang
(Peking University, China)
Publisher's Version

Demo Papers

echidna-parade: A Tool for Diverse Multicore Smart Contract Fuzzing
Alex Groce and Gustavo Grieco
(Northern Arizona University, USA; Trail of Bits, USA)
Publisher's Version Info
ProFuzzBench: A Benchmark for Stateful Protocol Fuzzing
Roberto Natella and Van-Thuan Pham
(Federico II University of Naples, Italy; University of Melbourne, Australia)
Publisher's Version Info
SCStudio: A Secure and Efficient Integrated Development Environment for Smart Contracts
Meng Ren, Fuchen Ma, Zijing Yin, Huizhong Li, Ying Fu, Ting Chen, and Yu Jiang
(Tsinghua University, China; WeBank, China; Ant Financial, China; University of Electronic Science and Technology of China, China)
Publisher's Version
C4: The C Compiler Concurrency Checker
Matt Windsor, Alastair F. Donaldson, and John Wickerson
(University of York, UK; Imperial College London, UK)
Publisher's Version Info
TauMed: Test Augmentation of Deep Learning in Medical Diagnosis
Yunhan Hou, Jiawei Liu, Daiwei Wang, Jiawei He, Chunrong Fang, and Zhenyu Chen
(Nanjing University, China)
Publisher's Version
MoScan: A Model-Based Vulnerability Scanner for Web Single Sign-On Services
Hanlin Wei, Behnaz Hassanshahi, Guangdong Bai, Padmanabhan Krishnan, and Kostyantyn Vorobyov
(University of Queensland, Australia; Oracle, Australia)
Publisher's Version Video
RESTest: Automated Black-Box Testing of RESTful Web APIs
Alberto Martin-Lopez, Sergio Segura, and Antonio Ruiz-Cortés
(University of Seville, Spain)
Publisher's Version Video

proc time: 8.82