FAST Approaches to Scalable Similarity-based Test Case Prioritization
Many test case prioritization criteria have been proposed for speeding up fault detection. Among them, similarity-based approaches give priority to the test cases that are the most dissimilar from those already selected. However, the proposed criteria do not scale up to handle the many thousands or even some millions test suite sizes of modern industrial systems and simple heuristics are used instead. We introduce the FAST family of test case prioritization techniques that radically changes this landscape by borrowing algorithms commonly exploited in the big data domain to find similar items. FAST techniques provide scalable similarity-based test case prioritization in both white-box and black-box fashion. The results from experimentation on real world C and Java subjects show that the fastest members of the family outperform other black-box approaches in efficiency with no significant impact on effectiveness, and also outperform white-box approaches, including greedy ones, if preparation time is not counted. A simulation study of scalability shows that one FAST technique can prioritize a million test cases in less than 20 minutes.
FAST Approaches to Scalable Similarity-based Test Case Prioritization (FAST - Presentation.pdf) | 1.42MiB |
Wed 30 May Times are displayed in time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
14:00 - 14:20 Talk | Hybrid Regression Test Selection Technical Papers Lingming ZhangUniversity of Texas at Dallas | ||
14:20 - 14:40 Talk | Fine-Grained Test Minimization Technical Papers Pre-print | ||
14:40 - 15:00 Talk | FAST Approaches to Scalable Similarity-based Test Case Prioritization Technical Papers Breno MirandaFederal University of Pernambuco, Emilio CrucianiGran Sasso Science Institute, L'Aquila, Italy, Roberto VerdecchiaGran Sasso Science Institute, Vrije Universiteit Amsterdam, Antonia BertolinoCNR-ISTI DOI Pre-print File Attached | ||
15:00 - 15:20 Talk | Towards Refactoring-Aware Regression Test Selection Technical Papers Kaiyuan Wang, Chenguang ZhuUniversity of Texas, Austin, Ahmet CelikUniversity of Texas at Austin, USA, Jongwook Kim, Don BatoryUniversity of Texas, Austin, Milos GligoricUniversity of Texas at Austin File Attached | ||
15:20 - 15:30 Talk | Q&A in groups Technical Papers |