Test case model for maintaining software under the concept of risk and requirement-based prioritization
Main Article Content
Abstract
Test case growth in software maintenance poses multifaceted challenges, including extended execution times, heightened costs, maintenance complexities, and increased system intricacy. Larger test cases not only introduce redundancy but also elevate the risk of overlooking defects during testing, emphasizing the need to manage test case expansion effectively while maintaining adequate testing coverage. One approach to mitigating this issue is risk-based prioritization, which focuses on testing critical and high-risk areas of the software. By emphasizing these pivotal aspects, this method aims to streamline test cases, optimizing testing efforts. However, it has limitations, as it may not comprehensively address all functional requirements, necessitating an in-depth understanding of the software system's architecture and vulnerabilities. Furthermore, requirements-based prioritization ensures thorough testing of all functional requirements, crucial for meeting industry standards and regulatory compliance. This approach utilizes clear criteria provided by requirements to evaluate whether software functions as intended. While effective in guaranteeing comprehensive coverage, it may fall short in addressing all potential risks and vulnerabilities, potentially undermining its effectiveness in identifying and prioritizing critical areas of the software. Considering these challenges, a nuanced approach that combines risk-based and requirements-based prioritization could offer a balanced solution. By leveraging the strengths of both methods, it becomes possible to address the diverse aspects of software testing, optimizing coverage, and efficiently managing test case growth. Moreover, the proposed model demonstrates promising results in tackling these challenges. With a notable test suite size reduction of 0.61-1.05% compared to traditional methods and a faultless percentage surpassing comparative studies by 0.05-0.75% across seven C-language System Under Test (SUT) programs, the model showcases its efficacy in improving testing efficiency and reliability. These findings underscore the potential of adopting advanced models to navigate the complexities associated with test case management and software testing in general.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
References
MacIver DR, Donaldson AF. Test-case reduction via test-case generation: Insights from the hypothesis reducer (tool insights paper). The 34th European Conference on Object-Oriented Programming (ECOOP 2020); 2020 Nov 15-17; Berlin, Germany. Germany: Schloss Dagstuhl; 2020. p. 1-27.
Lawanna A. An effective test case selection for software testing improvement. 2015 International Computer Science and Engineering Conference (ICSEC); 2015 Nov 23; Chiang Mai, Thailand. USA: IEEE; 2015. p. 1-6.
Srisura B, Lawanna A. False test case selection: improvement of regression testing approach. The 13th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON); 2016 Jun 28 – Jul 1; Chiang Mai, Thailand. USA: IEEE; 2016. p. 1-6.
Prado Lima JA, Vergilio SR. Test case prioritization in continuous integration environments: a systematic mapping study. Inf Softw Technol. 2020;121:106268.
Bajaj A, Sangwan OP, Abraham A. Improved novel bat algorithm for test case prioritization and minimization. Soft Comput. 2022;26(22):12393-419.
Bajaj A, Abraham A, Ratnoo S, Gabralla LA. Test case prioritization, selection, and reduction using improved quantum-behaved particle swarm optimization. Sensors. 2022;22(12):4374.
Pan R, Bagherzadeh M, Ghaleb TA, Briand L. Test case selection and prioritization using machine learning: a systematic literature review. Empir Software Eng. 2022;27(2):29.
Demir ZC, Emrah Amrahov Ş. Dominating set-based test prioritization algorithms for regression testing. Soft Comput. 2022;26(17):8203-20.
Ahmed FS, Majeed A, Khan TA, Bhatti SN. Value-based cost-cognizant test case prioritization for regression testing. PLoS One. 2022;17(5):e0264972.
Dahiya O, Solanki K, Rishi R, Dalal S, Dhankhar A, Singh J. Comparative performance evaluation of TFC-SVM approach for regression test case prioritization. In: Goyal V, Gupta M, Mirjalili S, Trivedi A, editors. Proceedings of International Conference on Communication and Artificial Intelligence. Lecture Notes in Networks and Systems, vol 435. Singapore: Springer; 2022. p. 229-38.
Chen Z, Chen J, Wang W, Zhou J, Wang M, Chen X, et al. Exploring better black-box test case prioritization via log analysis. ACM Trans Softw Eng Methodol. 2023;32(3):1-32.
Min JL, Rajabi N, Rahmani A. Comprehensive study of SIR: leading SUT repository for software testing. J Phys: Conf Ser. 2021;1869(1):012072.
do Prado Lima JA, Vergilio SR. An evaluation of ranking-to-learn approaches for test case prioritization in continuous integration. J Softw Eng Res Dev. 2023;11(1):1-20.
Thomas SW, Hemmati H, Hassan AE, Blostein D. Static test case prioritization using topic models. Empir Software Eng. 2014;19:182-212.
Fang C, Chen Z, Wu K, Zhao Z. Similarity-based test case prioritization using ordered sequences of program entities. Software Qual J. 2014;22:335-61.
Yadav DK, Dutta S. Test case prioritization based on early fault detection technique. Recent Adv Comput Sci Commun. 2021;14(1):302-16.
Saraswat P, Singhal A, Bansal A. A review of test case prioritization and optimization techniques. In: Hoda M, Chauhan N, Quadri S, Srivastava P, editors. Software Engineering. Advances in Intelligent Systems and Computing, vol. 731. Singapore: Springer; 2019. p. 507-16.
Xing Y, Wang X, Shen Q. Test case prioritization based on artificial fish school algorithm. Comput Commun. 2021;180:295-302.
Paul Friedman K, Gagne M, Loo LH, Karamertzanis P, Netzeva T, Sobanski T, et al. Utility of in vitro bioactivity as a lower bound estimate of in vivo adverse effect levels and in risk-based prioritization. Toxicol Sci. 2020;173(1):202-25.
Been F, Kruve A, Vughs D, Meekel N, Reus A, Zwartsen A, et al. Risk-based prioritization of suspects detected in riverine water using complementary chromatographic techniques. Water Res. 2021;204:117612.
Santhiapillai FP, Chandima Ratnayake RM. Risk-based prioritization method for planning and allocation of resources in public sector. TQM J. 2022;34(4):829-44.
Wan Q, Miao X, Wang C, Dinçer H, Yüksel S. A hybrid decision support system with golden cut and bipolar q-ROFSs for evaluating the risk-based strategic priorities of fintech lending for clean energy projects. Financ Innov. 2023;9(1):1-25.
Singh A, Singhrova A, Bhatia R, Rattan D. A systematic literature review on test case prioritization techniques. In: Hooda S, Sood VM, Singh Y, Dalal S, Sood M, editors. Agile Software Development: Trends, Challenges and Applications. Beverly: Scrivener Publishing; 2023. p. 101-59.
Freeda RA, Rajendran PS. An overview of efficient regression testing prioritization techniques based on genetic algorithm. In: Dutta P, Chakrabarti S, Bhattacharya A, Dutta S, Shahnaz C, editors. Emerging Technologies in Data Mining and Information Security. Lecture Notes in Networks and Systems, vol 490. Singapore: Springer; 2023. p. 383-90.
Guerra-García C, Nikiforova A, Jiménez S, Perez-Gonzalez HG, Ramírez-Torres M, Ontañon-García L. ISO/IEC 25012-based methodology for managing data quality requirements in the development of information systems: Towards Data Quality by Design. Data Knowl Eng. 2023;145:102152.
Khaleel SI, Anan R. A review paper: optimal test cases for regression testing using artificial intelligent techniques. Int J Electr Comput Eng. 2023;13(2):1803-16.
Aung NL, Lawanna A. A competence-based deletion model for the improvement of case-based maintenance in case-based reasoning. Appl Sci Eng Prog. 2021;14(1):3-12.
Lakshminarayana P, Suresh Kumar TV. Automatic generation and optimization of test case using hybrid cuckoo search and bee colony algorithm. J Intell Syst. 2021;30(1):59-72.