Discovered: Jan 5, 2025 07:06 Me:: tl;dr Natural Language Processing-based test automation strategy is best for web apps Leotta, Ricca, Marchetto, Olianas:: An empirical study to compare three web test automation approaches: NLP‐based, programmable, and capture&replay - 2024 - Journal of Software: Evolution and Process - Wiley Online Library<– via Greg Wilson’s summary of papers page: It will never work in theory <– QUOTE: Results show that the NLT approach appears to be the best option for small- to medium-sized test suites such as those considered in our empirical study. In fact, compared with competitors, the NLT approach minimizes the total cumulative cost (development and evolution) and does not require software testers with programming skills. NLT is also the best in terms of resiliency being more robust to the evolution of a web application. CRT is slightly faster during development but then loses when evolution is considered. In conclusion, these new NLP-based tools appear to be very promising and will probably be even more performing in the near future when the adopted NLP algorithms used to transform natural language based test cases into executable test cases improve further.

Leave a comment on github