Using AI tools in requirements engineering: analysis of capabilities and chatbot for validation

Anton Striapunin, Vyacheslav Kharchenko

Abstract


This study investigates the processes and means of requirements engineering (RE) of software and complex information systems (SWS). The subject of this study is the instrumental means of SWS RE based on the methods of artificial (computational) intelligence (AI). The goal is to improve the accuracy and efficiency of CCD requirements development processes using AI tools by providing better communications between business teams and technical teams and automating complex requirements collection and documentation processes. The tasks are as follows: to analyze the principles and means of integrating AI tools into requirements engineering processes, the development and verification of which is a critical stage in the development of SWS; to determine the problems of using traditional SWS RE methods and perform their comparative analysis with AI-based methods; and to develop a chatbot architecture for requirements validation and identify characteristics of RE processes that are improved through its use. The results. The results of this study demonstrate that AI tools can significantly improve the accuracy, timeliness, and efficiency of requirements development processes and project team communication. An architecture and software solution for an intelligent chatbot for requirements validation is proposed, and the benefits and limitations of its application are discussed. Directions for further development and research regarding the end-to-end implementation of AI tools in IP processes have been developed.

Keywords


artificial intelligence; requirements engineering; team communication; chatbot

References


Mars Climate Orbiter, Mishap Investigation Board, Phase I Report, November 10, 1999. 48 p. Available at: https://llis.nasa.gov/llis_lib/pdf/1009464main1_0641-mr.pdf. (accessed 1.03.2024).

Arulmohan, S., Meurs, M. - J., & Mosser, S. Extracting Domain Models from Textual Requirements in the Era of Large Language Models. 2023 ACM/IEEE International Conference on Model Driven Engineering Languages and Systems Companion (MODELS-C), Västerås, Sweden, 2023, pp. 580-587. DOI: 10.1109/MODELS-C59198.2023.00096.

Liu, K., Reddivari, S., & Reddivari, K. Artificial Intelligence in Software Requirements Engineering: State-of-the-Art. 2022 IEEE 23rd International Conference on Information Reuse and Integration for Data Science (IRI), San Diego, CA, USA, 2022, pp. 106-111. DOI: 10.1109/IRI54793.2022.00034.

Chen, L., Ali Babar, M., & Nuseibeh, B. Characterizing Architecturally Significant Requirements. IEEE Software, 2013, vol. 30, iss. 2, pp. 38-45. DOI: 10.1109/MS.2012.174.

Zhao, L., Alhoshan, W., Ferrari, A., Letsholo, K. J., Ajagbe, M. A., Chioasca, E.-V., & Batista-Navarro, R. T. Natural language processing for requirements engineering: A systematic mapping study. ACM Computing Surveys (CSUR), 2021, vol. 54, iss. 3, atricle no. 55, pp. 1-14. DOI: 10.1145/3444689.

Brackett, J. W. Software Requirements. SEI Curriculum Module SEI-CM-19-1.2, Carnegie Mellon University, Software Engineering Institute, 1990. 27 p. Available at: https://insights.sei.cmu.edu/documents/1547/1990_007_001_15809.pdf. (accessed 1.03.2024).

Wang, Y., & Xu, J. Y. Autonomous Software Requirement Specifications towards AI Programming. 2021 IEEE 20th International Conference on Cognitive Informatics & Cognitive Computing (ICCI*CC), Banff, AB, Canada, 2021, pp. 123-130. DOI: 10.1109/ICCICC53683.2021.9811311.

Arellano, A., Carney, E., & Austin, M. A. Natural Language Processing of Textual Requirements. ICONS 2015 : The Tenth International Conference on Systems, 2015, pp. 93-97. Available at: https://user.eng.umd.edu/~austin/reports.d/ICONS2015-AA-EC-MA.pdf. (accessed 1.03.2024).

Dalpiaz, F., Ferrari, A., Franch, X., & Palomares, C. Natural Language Processing for Requirements Engineering: The Best Is Yet to Come. IEEE Software, 2018, vol. 35, no. 5, pp. 115-119. DOI: 10.1109/MS.2018.3571242.

Vahidi, P., & Sharifpour, R. Information extraction with LLMs using Amazon SageMaker JumpStart. AWS Machine Learning Blog, 2024. Available at: https://aws.amazon.com/blogs/machine-learning/information-extraction-with-llms-using-amazon-sagemaker-jumpstart. (accessed 1.03.2024).

Kharchenko, V., Fesenko, H., & Illiashenko, O. Quality Models for Artificial Intelligence Systems: Characteristic-Based Approach, Development and Application. Sensors, 2022, vol. 22, iss. 13, article no. 4865, pp. 1-36, DOI: 10.3390/s22134865.

Vasylʹyev, I., & Kharchenko, V. Freymvork dlya metrychnoho otsinyuvannya system shtuchnoho intelektu na osnovi modeli yakosti [A framework for metric evaluation of artificial intelligence systems based on quality model]. Systemy upravlinnya, navihatsiyi ta zvʺyazku. Zbirnyk naukovykh pratsʹ – Control, navigation and communication systems. academic journal, Poltava, PNTU Publ., 2022, vol. 2(68), pp. 41-45. DOI: 10.26906/SUNZ.2022.2.041.




DOI: https://doi.org/10.32620/aktt.2024.2.10