Analysis of the Problem of Testing in Software Project Development under Outsourcing Conditions for Non-Core Clients

Ігор Володимирович Шостак, Олександр Вячеславович Череватенко

Abstract


The article is devoted to the problem of improving the efficiency of the testing process in the development of software projects within an Agile environment of outsourcing IT companies. The relevance of the study is determined by the current conditions of the IT services market and the strict requirements for the competitiveness of outsourcing companies. The object of the research is quality assurance processes of software projects implemented in the Agile environment of outsourcing companies. At present, Agile methodology and flexible frameworks (Scrum, Kanban, Lean, etc.) constitute a natural environment for the development of outsourcing software projects, and issues related to organizing production processes for projects of various domains (startups, SaaS, financial technologies, telemedicine, logistics, etc.) are well studied and supported by mature tooling (Jira, Azure, and others). At the same time, practical experience and retrospective studies indicate the presence of systemic trigger factors that lead to a significant decline in team performance, which is generally interpreted as the existence of specific problems typical for projects with distributed teams and non-core customers. Therefore, ensuring the efficiency of development processes in this context remains an open issue. The subject of the study is the problems that arise during the testing process in outsourcing software projects and the methods for addressing them. The purpose of the study is, based on the analysis of practical experience, to identify and formulate specific testing problems in outsourcing projects developed for non-core customers that may cause a decrease in team efficiency, and, using established practices, to develop recommendations to eliminate or reduce the impact of these problems. To achieve this purpose, the study identified and systematized the main testing process issues, analyzed and classified the causes of their occurrence according to their significance, and proposed recommendations for their resolution. The results obtained indicate that, within a qualitative study based on the systematization of outsourcing company experience and analysis of typical scenarios, key problems faced by testing teams were identified, including insufficient tester involvement at early development stages, difficulties in communication and requirements elicitation, challenges in assessing feature readiness, test documentation maintenance, defect management, limited time and resources for testing, automation difficulties, regression testing scope, acceptance testing and reporting, shaping realistic customer expectations, knowledge transfer, and team motivation. The proposed recommendations include the active adoption of the Shift-Left approach and collaborative requirements definition, the establishment of transparent and structured stakeholder–developer communication, the development of flexible yet clear Definition of Done criteria and iterative acceptance testing processes, as well as the application of adaptive approaches to test documentation and automation. The recommendations also aim to improve defect management processes, test cycle planning efficiency, regression test automation, the development of an adaptive system of quality metrics and reporting, proactive management of customer expectations, and systematic knowledge sharing within teams.

Keywords


Agile, outsourcing, software project management, testing, quality assurance (QA), Shift-Left, Definition of Done (DoD)

References


Beck K., Beedle M., van Bennekum A., Cockburn A., Cunningham W., Fowler, M. et al. Manifesto for Agile Software Development. AgileAlliance. – 2001. Retrieved from https://agilemanifesto.org/iso/en/manifesto.html

Brooks Jr., F. P. The Mythical Man-Month: Essays on Software Engineering (Anniversary ed.). Addison-Wesley Professional. – 1995. – 212 h. Retrieved from: https://web.eecs.umich.edu/~weimerw/2018-481/readings/mythical-man-month.pdf

Cohn M. Succeeding with Agile: Software Development Using Scrum. Addison-Wesley Professional. – 2009. – 51 p. Retrieved from: https://api.pageplace.de/preview/DT0400.9780321660510_A23552372/preview-9780321660510_A23552372.pdf

Crispin L., Gregory J. Agile Testing: A Practical Guide for Testers and Agile Teams. Addison-Wesley Professional. – 2009. – 112 p. Retrieved from: https://api.pageplace.de/preview/DT0400.9780134190648_A25762397/preview-9780134190648_A25762397.pdf

Crispin L., Gregory J. More Agile Testing: Learning Journeys for the Whole Team. Addison-Wesley Professional. – 2014. – 93 p. Retrieved from: https://ptgmedia.pearsoncmg.com/images/9780321967053/samplepages/9780321967053.pdf

DeMarco T., Lister T. Peopleware: Productive Projects and Teams. Dorset House Publishing. – 1987. – 261 p. Retrieved from: https://orion2020.org/archivo/articulos/00_peopleware.pdf

Eckstein J. Agile Software Development with Distributed Teams. Dorset House Publishing. – 2004. – 53 p. Retrieved from: https://ptgmedia.pearsoncmg.com/images/9780133491982/samplepages/0133491986.pdf

Fowler M. Patterns of Enterprise Application Architecture. Addison-Wesley Professional. – 2004. – 389 p. Retrieved from: https://ptgmedia.pearsoncmg.com/images/9780321127426/samplepages/9780321127426.pdf

Graham D., Fewster M. Experiences of Test Automation: Case Studies of Software Test Automation. Addison-Wesley Professional. – 2012. – 114 p. Retrieved from: https://ptgmedia.pearsoncmg.com/images/9780321754066/samplepages/0321754069.pdf

Humble J., Farley D. Continuous Delivery: Reliable Software Releases through Build, Test, and Deployment Automation. Addison-Wesley Professional. – 2010. – 497 p. Retrieved from: https://proweb.md/ftp/carti/Continuous-Delivery-Jez%20Humble-David-Farley.pdf

HubSpot. (n.d.). The Complete Guide to Shift–Left Testing [Whitepaper]. Retrieved from https://cdn2.hubspot.net/hubfs/3937956/whitepapers/The%20Complete%20Guide%20to%20Shift%20Left%20Testing.pdf

Kaner C., Bach J., Pettichord B. Lessons Learned in Software Testing: A Survival Guide for the Real World. Wiley. – 2002. – 30 p. Retrieved from: https://content.e-bookshelf.de/media/reading/L-592829-e29d79a396.pdf

Leffingwell D. Scaling Software Agility: Best Practices for Large Enterprises. Addison-Wesley Professional. – 2007. – 79 p. Retrieved from: https://pdfs.semanticscholar.org/ae8f/7fb9801a7d73ed5499ca9f5b579df4711bc4.pdf

Martin, R. C. Clean Code: A Handbook of Agile Software Craftsmanship. Prentice Hall. – 2008. – 464 p. Retrieved from: https://ptgmedia.pearsoncmg.com/images/9780132350884/samplepages/9780132350884.pdf

McConnell S. Code Complete. Microsoft Press. – 1993. – 952 p. Retrieved from: http://aroma.vn/web/wp-content/uploads/2016/11/code-complete-2nd-edition-v413hav.pdf

McConnell S. Rapid Development: Taming Wild Software Schedules. Microsoft Press. – 1996. – 672 p. Retrieved from: https://ptgmedia.pearsoncmg.com/images/9781556159008/samplepages/9781556159008.pdf

Naik K., Tripathy P. Software Testing and Quality Assurance: Theory and Practice. Wiley. – 2015. – 648 p. Retrieved from: https://www.softwaretestinggenius.com/download/staqtpsn.pdf

Patton J. User Story Mapping: Discover the Whole Story, Build the Right Product. O'Reilly Media. – 2014. – 324 p. Retrieved from: https://www.agileleanhouse.com/lib/lib/People/JeffPatton/StoryMapping_sampler.pdf

Schwaber K., Sutherland J. The Scrum Guide. Scrum.org & ScrumInc. – 2020. Retrieved from: https://scrumguides.org/

Smart J. F. BDD in Action: Behaviour-Driven Development for the Whole Team. Manning Publications. – 2015. – 384 p. Retrieved from https://kupichitay.com.ua/product/bdd-in-action-behavior-driven-development-for-the-whole-software-lifecycle-john-ferguson-smart/

Wiegers K., Beatty J. Software Requirements (3rd ed.). Microsoft Press. – 2013. – 673 p. Retrieved from https://olivroqueaprende.com/WDK/Software_Requirements_3rd_Edition.pdf

Sheikh S. Integrating Continuous Testing and Shift Left Practices in the Software Development Life Cycle for Enhanced Code Reliability. International Journal of Advanced Research in Management (IJARM). – 2024. – 15 (3). – P. 1-10 Retrieved from https://iaeme.com/MasterAdmin/Journal_uploads/IJARM/VOLUME_15_ISSUE_3/IJARM_15_03_009.pdf

Lopes de Souza P., Lopes de Souza W., Ferreira P. ScrumOntoBDD: Agile software development based on scrum, ontologies and behaviour driven development. Journal of the Brazilian Computer Society. – 2021. – v.27. – Art. 10. Retrieved from https://doi.org/10.1186/s13173-021-00114-w

Pham, K. P., & Neumann, M. How to Measure Performance in Agile Software Development? A Mixed Method Study. 50th Euromicro Conference on Software Engineering and Advanced Applications (SEAA). IEEE. 2024. - Retrieved from DOI: 10.1109/SEAA64295.2024.00074

Government Digital Service. Exploratory testing — Service Manual. GOV.UK. – 2016. Retrieved from https://www.gov.uk/service-manual/technology/exploratory-testing

MoldStud. Best practices for test environment management in software testing. MoldStud. – 2024. Retrieved from https://moldstud.com/articles/p-best-practices-for-test-environment-management-in-software-testing

Trinkenreich, B. A Model for Understanding and Reducing Developer Burnout. SEIP. – 2023. Retrieved from https://biancatrink.github.io/files/papers/SEIP2023.pdf

Shostak I. Cherevatenko O. Metod porivnialnoho analizu poperednikh otsinok i faktychnykh zusyl komandy pry rozroblenni prohramnykh proektiv v Agile-seredovyshchi [Method of comparative analysis of previous estimates and actual efforts of the team during the development of software projects in the Agile environment] – Vidkryti informatsiini ta kompiuterni intehrovani tekhnolohii. 2025 – № 105. – С. 171-183. Retrieved from http://nti.khai.edu/ojs/index.php/oikit/article/view/oikit.2025.105.14




DOI: https://doi.org/10.32620/oikit.2026.107.11

Refbacks

  • There are currently no refbacks.