While Quality Owners Might Change, Similar Challenges Continue
October 07, 2021

Noel Wurst

SmartBear recently released the results of its 2021 State of Software Quality | Testing survey, my personal favorite of the company's reports. While I do work for SmartBear, my interest in these non-product-promotional surveys is purely due to my fascination with the world of software quality, and the evolution we're seeing around who owns quality, the challenges that quality owners face, and what they feel will solve those challenges.

I don't feel too bad about revealing this spoiler, because I doubt you'll be surprised to hear that a "lack of time" was reported as the number one challenge to doing more testing, especially as release frequencies continue to increase. However, it was disheartening to see that a lack of time was also the number one response when we asked people to identify the biggest blocker to professional development.

We also asked respondents what testing activity is the most time-intensive task within the time they are able to dedicate to testing, and the number one answer was disheartening again.

23% of respondents reported that "writing manual test cases" is the biggest culprit.

Why is that disheartening?

I would argue that writing out test cases isn't actually testing. It's a testing-related activity, sure, and maybe even a necessary one.

But can you say that the single act of writing out test cases actually improves the quality of your software?

Would your customers say the same?

The second-place answer, coming in at only 1% less at 22% was "learning how to use test tools." Again, a necessary requirement and skill, but learning how to use a tool to test is not testing. What I find humorous, but not surprising at all, is that in this year's survey, we asked respondents for the number one quality they look for in API tooling.

What would you guess the number one answer was?

Most powerful features?

The latest AI/ML innovations?

Nope. "Ease of use."

One trend that's been interesting to observe — from within this survey and in the industry at large — is looking at who owns quality in an organization. In the past, it was largely, if not entirely, owned by manual QA teams. But today, quality owners possess any number of professional titles and backgrounds: manual or exploratory testers, automation engineers, SDETs, business analysts, DevOps teams, or probably the fastest growing group of quality owners — developers.

Even as an exploratory testing enthusiast myself, I'm thrilled to see developers share the responsibility of testing. However, one result that completely surprised me was finding out just how much time developers say they are spending on testing in an average week. Developers were one of the only roles to state that they're spending more time on testing in 2021 than they did in years' past and this percentage is increasing every year (automation engineers, manual testers, and business analysts all reported a decrease in 2021). Developers reported spending, on average, 47% of their week testing. What? Really?

Do developers want to spend nearly 50% of their week not developing new software? From all the testers I've ever spoken to, few would want to spend 50% of their week not testing. I won't be surprised at all to one day see every developer claim to also be a fellow quality owner like their tester counterparts, but at what percentage over 50% of a developer's week being taken up by testing do they simply become … a tester?

There's simply too much actual testing that needs to be done, too many accelerated release cadence goals to hit, and too many bugs to eliminate from the last release(!) to envision those who own software quality being able to continually deliver on our promises to customers. Not if we continue to struggle to spend time on what directly impacts our customers, because too much of our time is stuck doing what doesn't.

Noel Wurst is Software Quality Evangelist at SmartBear
Share this

Industry News

May 19, 2022

Jellyfish announced the launch of Jellyfish Benchmarks, a way to add context around engineering metrics and performance by introducing a method for comparison.

May 19, 2022

Solo.io announced the addition and integration of Cilium networking into its Gloo Mesh platform, providing a complete application-networking solution for companies’ cloud-native digital transformation efforts.

May 19, 2022

Aqua Security announced multiple updates to Aqua Trivy, making it a unified scanner for cloud native security.

May 18, 2022

Red Hat unveiled updates across its portfolio of developer tools designed to help organizations build and deliver applications faster and more consistently across Kubernetes-based hybrid and multicloud environments.

May 18, 2022

Armory announced public early access to their new Continuous Deployment-as-a-Service product.

May 18, 2022

DataCore Software announced DataCore Bolt, enterprise-grade container-native storage software for DevOps.

May 17, 2022

DevOps Institute, a global professional association for advancing the human elements of DevOps, announced the release of the Upskilling IT 2022 report.

May 17, 2022

Replicated announced a host of new platform features and capabilities that enable their customers to accelerate enterprise adoption of their Kubernetes applications.

May 17, 2022

Codefresh announced that its flagship continuous delivery (CD) platform will be made accessible as a fully-hosted solution for DevOps teams seeking to quickly and easily achieve frictionless, GitOps-based continuous software delivery in the cloud.

May 16, 2022

Red Hat announced new capabilities and enhancements across its portfolio of open hybrid cloud solutions aimed at accelerating enterprise adoption of edge compute architectures through the Red Hat Edge initiative.

May 16, 2022

D2iQ announced a partnership with GitLab.

May 16, 2022

Kasten by Veeam announced the new Kasten by Veeam K10 V5.0 Kubernetes data management platform.

May 12, 2022

Red Hat introduced Red Hat Enterprise Linux 9, the Linux operating system designed to drive more consistent innovation across the open hybrid cloud, from bare metal servers to cloud providers and the farthest edge of enterprise networks.

May 12, 2022

Couchbase announced version 7.1 of Couchbase Server.

May 12, 2022

Copado added Copado Robotic Testing to Copado Essentials.