2013 9th Joint Meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering (ESEC/FSE), August 18–26, 2013, Saint Petersburg, Russia

Desktop Layout

Empirical Studies II
Technical Research
Heraldic Hall, Chair: Harald Gall
Searching for Better Configurations: A Rigorous Approach to Clone Evaluation
Tiantian Wang, , Yue Jia, and Jens Krinke
(Harbin Institute of Technology, China; University College London, UK)
Publisher's Version
Supplementary Material
Abstract: Clone detection finds application in many software engineering activities such as comprehension and refactoring. However, the confounding configuration choice problem poses a widely-acknowledged threat to the validity of previous empirical analyses. We introduce desktop and parallelised cloud-deployed versions of a search based solution that finds suitable configurations for empirical studies. We evaluate our approach on 6 widely used clone detection tools applied to the Bellon suite of 8 subject systems. Our evaluation reports the results of 9.3 million total executions of a clone tool; the largest study yet reported. Our approach finds significantly better configurations (p < 0.05) than those currently used, providing evidence that our approach can ameliorate the confounding configuration choice problem.


Time stamp: 2019-04-23T20:10:06+02:00