A Systematic Literature Review on Regression Test Case Prioritization

Ani Rahmani, Sabrina Ahmad, Intan Ermahani A. Jalil, Adhitia Putra Herawan
2021 International Journal of Advanced Computer Science and Applications  
Test case prioritization (TCP) is deemed valid to improve testing efficiency, especially in regression testing, as retest all is costly. The TCP schedule the test case execution order to detect bugs faster. For such benefit, test case prioritization has been intensively studied. This paper reviews the development of TCP for regression testing with 48 papers from 2017 to 2020. In this paper, we present four critical surveys. First is the development of approaches and techniques in regression TCP
more » ... studies, second is the identification of software under test (SUT) variations used in TCP studies, third is the trend of metrics used to measure the TCP studies effectiveness, and fourth is the stateof-the-art of requirements-based TCP. Furthermore, we discuss development opportunities and potential future directions on regression TCP. Our review provides evidence that TCP has increasing interests. We also discovered that requirement-based utilization would help to prepare test cases earlier to improve TCP effectiveness. Although there have been many studies in the form of TCP surveys, literature review, or mapping, each research has a different emphasis and perspective. In this regard, we have reviewed 48 credible papers from reputable journals and proceedings. Section II explains this in more detail. 254 | P a g e www.ijacsa.thesai.org This paper is presented in stages, starting by looking at RT in general, followed by a study of TCP, and finally exploring the requirement-based TCP. Following the introduction, Section II presents the motivation and related work in RT and TCP. Section III describes the SLR method, including threats to validity and Section IV presents results and discussion. Subsequently, Section V describes the research findings, and Section VI offers future work and conclusions. II. MOTIVATION AND RELATED WORK In this section, we explain the motivation and related work of the study conducted. A. The Motivation The ideal implementation of RT is to "retest all" or execute all test cases. However, in practice, not all test cases will be retested, especially those implementing RT manually. Several RT practice personal intuition based on experience, and even randomly [12] . Complete testing is complicated, and even worst, in several cases testing needs to be stopped. This condition causes other RT implementation problems, such as an error in the execution of the test case sequencing. On top of that, the RT process may be prolonged, or it may also run out of time. Studies [12], [13] stated that these approaches are inefficient and require high costs.
doi:10.14569/ijacsa.2021.0120929 fatcat:k57ja3mrmbcmxbula4py2oqudi