Abstract
The field of test automation is pivotal in modern software development, offering significant benefits in terms of efficiency, accuracy and repeatability of tests. The master’sthesis presents a comprehensive systematic literature review (SLR) aimed at synthesizing existing research on test automation. The SLR is guided by five research questions
that explore emerging tools and technologies, how organizations balance comprehensive
test coverage with time and resource constraints, typical organizational structures, which
KPIs are used to assess the effectiveness of test automation, how tests are developed in
agile environments.
The SLR revealed critical insights into the prevalent trends and practices in test
automation. Notably, GUI automation emerged as a predominant focus, with scriptbased methods being the most widely utilized. The review also highlighted the role of
artificial intelligence in enhancing test suite performance, although its adoption remains
limited. Organizational factor influencing the effectiveness of test automation teams
were examined, uncovering the necessity for multidisciplinary skills. Additionally, several
test automation improvement models, such as TIMMi, TAIM, TMM, and TPI, were
identified and evaluated.
Based on the insights from the literature, three actionable recommendations were
derived to help practitioners optimize their test automation organization. First, the development of a test automation strategy using improvement models is recommended.
Second, test case selection, prioritization, and minimization should be utilized to optimize the performance of test suites. Third, strategies to make test teams efficient in
agile environments are outlined. Compared to previous works that primarily focus on
theoretical frameworks and technical aspects, this thesis bridges the gap between academic research and practical implementation by providing actionable recommendations
specifically for practitioners. These recommendations are designed to address common
challenges effectively.
This thesis contributes to the understanding of test automation by providing a detailed analysis of the current state of research and formulating practical recommendations for improvement in the field of test automation. The insights gained are intended
to inform and guide practitioners and researchers in this field, thereby promoting the
advancement of methods and technologies in test automation.
| Date of Award | 2024 |
|---|---|
| Original language | English (American) |
| Supervisor | Josef Pichler (Supervisor) |