Skip to content

Leapwork study shows that C-Suites trust AI-augmented software testing but still want human validation

Humans may do a lot less of the testing themselves in the future, but they will still have to peer review software output, say both C-Suite and technical teams

Copenhagen, October 1, 2024 - AI-augmented testing tools have come a long way in the last few years: a staggering majority (79%) of organizations have already adopted them. However, neither C-Suite executives nor senior technical leaders believe humans are going away anytime soon. A majority of total respondents (74%) across organizations believe software testing will continue to need human validation for the foreseeable future. This is according to research from Leapwork surveying 400 respondents in the U.S and UK, of which half were C-Suite and half were senior software engineering or technology leads.

The level of enthusiasm towards the need for human validation does differ depending on who is being asked. An overwhelming 80% of technical teams share this view compared to 68% of C-Suite executives. Depending on the exact role of the respondent, this disparity becomes starker: 92% of IT directors think testing will need human validation compared to just 64% of CIOs.

The need for human validation, however, is not indicative of the level of trust in AI-augmented testing tools. In fact, trust is high, with 68% of overall respondents saying they trust the results of AI-augmented testing tools – specifically, 64% of C-Suite executives compared to 72% of technical leaders. The sentiments around AI-augmented testing tools are positive enough that 74% of organizations say they will likely invest more money into the technology over the next year. This tracks with the generally strong belief that AI-augmented testing tools will improve testing efficiency and effectiveness. Over half of respondents (54%) agree, while just 10% disagree.

"I believe that the synergy between AI and human expertise represents a transformative partnership in software testing," says Robert Salesas, CTO at Leapwork. "AI tools can significantly enhance efficiency, allowing technical teams to focus on innovation and ideation rather than the repetitive details of testing in an increasingly complex software environment. However, no matter how advanced the tools become, the principle of requiring human oversight and independent review will always be essential to ensure accuracy and reliability."

Whether or not AI-augmented testing will significantly create or reduce jobs, however, is a matter that has divided C-Suites and technical teams. While nearly (45%) of overall respondents say AI-augmented testing has created new roles specifically for people with AI skills, almost just as many (43%) have seen a reduction in roles due to efficiency gains. A closer inspection reveals C-Suite executives have a much more bullish perception than technical leaders. Over half of C-Suite executives (53%) say the tools have increased the number of new roles compared to just over a third (36%) of technical leaders. These perceptions also vary based on sector: 52% of respondents in healthcare are seeing new jobs created (vs. 39% seeing reduced roles) compared to only 36% in government. About 57% of respondents in manufacturing report a reduction in jobs.

EDITOR'S NOTE

Leapwork commissioned research via Censuswide to gather responses from 401 respondents across US and UK organizations. These included 201 C-Suite executives (CTO/CIOs) and 200 technical leads (including VP of IT, Director of IT, IT Manager, software engineering leads, QA test manager/director. The respondents were surveyed across sectors that include technology/software, finance and banking, healthcare, manufacturing, retail, and government. The respondents were aged 18-55+.

About Leapwork

Leapwork is the AI-powered test automation platform helping enterprise companies deliver continuous quality across the business. Software testing teams rely on Leapwork to deliver higher-quality experiences from the moment a customer interacts with the business through the applications, APIs, and data that drive it. Providing an intuitive visual workflow and generative AI capabilities, everyone from engineers to business users can build, maintain, and scale complex data-driven tests faster and more efficiently than ever. To learn more, visit: leapwork.com.