THE USE OF GENERATIVE ARTIFICIAL INTELLIGENCE IN SOFTWARE TESTING
DOI:
https://doi.org/10.34185/1562-9945-2-151-2024-10Keywords:
generative AI, GenAI, software testing, large language model, test automation, AI-augmented testing, AI-assistant, autonomous test creationAbstract
This article explores the potential of using generative artificial intelligence (AI) for software testing, reflecting on both the advantages and potential drawbacks of this emerging technology. Considering the vital role of rigorous testing in software production, the authors ponder whether generative AI could make the testing process more efficient and comprehen-sive, without the need to increase resources. The article delves into the current limitations of this technology, emphasizing the need for continuous exploration and adaptation. It con-cludes with a summation of potential innovative solutions and avenues for future investiga-tion. The paper encourages discussions surrounding the question of fully automated testing and the role of human specialists in the future of QA. It ultimately provides a thought-provoking reflection on the intersection of emerging technologies, and their societal impacts
References
Fan Angela, Gokkaya Beliz, Harman Mark, Lyubarskiy Mitya, Sengupta Shubho, Yoo Shin, Zhang Jie M. Large Language Models for Software Engineering: Survey and Open Problems // arXiv. 2023. DOI: https://doi.org/10.48550/arXiv.2310.03533.
Wang Junjie, Huang Yuchao, Chen Chunyang, Liu Zhe, Wang Song, Wang Qing. Software Testing with Large Language Model: Survey, Landscape, and Vision // arXiv. 2023. DOI: https://doi.org/10.48550/arXiv.2307.07221.
Nguyen-Duc Anh, Cabrero-Daniel Beatriz et al. Generative Artificial Intelligence for Software Engineering ¬– A Research Agenda // arXiv. 2023. DOI: https://doi.org/10.48550/arXiv.2310.18648.
Feldt Robert, Kang Sungmin, Yoon Juyeon, Yoo Shin. Towards Autonomous Test-ing Agents via Conversational Large Language Models // arXiv. 2023. DOI: https://doi.org/10.48550/arXiv.2306.05152.
Keen M. How Large Language Models Work // IBM Technology. 2023. URL: https://www.youtube.com/watch?v=5sLYAQS9sWQ.
Keen M. Why Large Language Models Hallucinate // IBM Technology. 2023. URL: https://www.youtube.com/watch?v=cfqtFvWOfg0.
Pythagora project Github repository // Pythagora. 2023. URL: https://github.com/Pythagora-io/pythagora.
TestCraftApp project Github repository // TestCraft. 2023. URL: https://github.com/TestCraft-App/test-craft-api-v1.
Ng Andrew. The Near Future of AI // Stanford eCorner. 2023. URL: https://www.youtube.com/watch?v=KDBq0GqKpqA.
Kirilenko Igor, Jakubiak Nathan. Pros & Cons of Generative AI in Software Test-ing // Parasoft. 2023. URL: https://www.youtube.com/watch?v=57HTehOnll0.
Kirilenko Igor, Jakubiak Nathan. Use AI to Achieve Continuous Software Quality // Parasoft. 2023. URL: https://www.youtube.com/watch?v=mUPL7qJFtKA.
Kirilenko Igor, Jakubiak Nathan. Generative AI: the future of testing? - Test Smarter, Not Harder Event // Magnifai. 2023.
URL: https://www.youtube.com/watch?v=9Hfb4nW4uSg.
Liu H., Liu L., Yue C., Wang Y., Deng B. Autotestgpt: A system for the automated generation of software test cases based on chatgpt. 2023.
URL: https://ssrn.com/abstract=4584792.
Yuan Z., Lou Y., Liu M., Ding S., Wang K., Chen Y., Peng X. No More Manual Tests? Evaluating and Improving ChatGPT for Unit Test Generation. 2023 // arXiv. DOI: https://doi.org/10.48550/arXiv.2305.04207.
Ma W., Liu S., Wang W., Hu Q., Liu Y., Zhang C., Nie L., Liu Y. The scope of chatgpt in software engineering: A thorough investigation. 2023 // arXiv preprint arXiv:2305.12138.
Haas R., Elsner D., Juergens E., Pretschner A., Apel S. How can manual testing processes be optimized? developer survey, optimization guidelines, and case studies // 29th ACM Joint Meeting on European Software Engineering Conference and Sym-posium on the Foundations of Software Engineering, ser. ESEC/FSE 2021, Athens, Greece: Association for Computing Machinery, 2021, P. 1281–1291.
Downloads
Published
Issue
Section
License
Copyright (c) 2024 System technologies
This work is licensed under a Creative Commons Attribution 4.0 International License.
