While Quality Owners Might Change, Similar Challenges Continue
October 07, 2021

Noel Wurst

SmartBear recently released the results of its 2021 State of Software Quality | Testing survey, my personal favorite of the company's reports. While I do work for SmartBear, my interest in these non-product-promotional surveys is purely due to my fascination with the world of software quality, and the evolution we're seeing around who owns quality, the challenges that quality owners face, and what they feel will solve those challenges.

I don't feel too bad about revealing this spoiler, because I doubt you'll be surprised to hear that a "lack of time" was reported as the number one challenge to doing more testing, especially as release frequencies continue to increase. However, it was disheartening to see that a lack of time was also the number one response when we asked people to identify the biggest blocker to professional development.

We also asked respondents what testing activity is the most time-intensive task within the time they are able to dedicate to testing, and the number one answer was disheartening again.

23% of respondents reported that "writing manual test cases" is the biggest culprit.

Why is that disheartening?

I would argue that writing out test cases isn't actually testing. It's a testing-related activity, sure, and maybe even a necessary one.

But can you say that the single act of writing out test cases actually improves the quality of your software?

Would your customers say the same?

The second-place answer, coming in at only 1% less at 22% was "learning how to use test tools." Again, a necessary requirement and skill, but learning how to use a tool to test is not testing. What I find humorous, but not surprising at all, is that in this year's survey, we asked respondents for the number one quality they look for in API tooling.

What would you guess the number one answer was?

Most powerful features?

The latest AI/ML innovations?

Nope. "Ease of use."

One trend that's been interesting to observe — from within this survey and in the industry at large — is looking at who owns quality in an organization. In the past, it was largely, if not entirely, owned by manual QA teams. But today, quality owners possess any number of professional titles and backgrounds: manual or exploratory testers, automation engineers, SDETs, business analysts, DevOps teams, or probably the fastest growing group of quality owners — developers.

Even as an exploratory testing enthusiast myself, I'm thrilled to see developers share the responsibility of testing. However, one result that completely surprised me was finding out just how much time developers say they are spending on testing in an average week. Developers were one of the only roles to state that they're spending more time on testing in 2021 than they did in years' past and this percentage is increasing every year (automation engineers, manual testers, and business analysts all reported a decrease in 2021). Developers reported spending, on average, 47% of their week testing. What? Really?

Do developers want to spend nearly 50% of their week not developing new software? From all the testers I've ever spoken to, few would want to spend 50% of their week not testing. I won't be surprised at all to one day see every developer claim to also be a fellow quality owner like their tester counterparts, but at what percentage over 50% of a developer's week being taken up by testing do they simply become … a tester?

There's simply too much actual testing that needs to be done, too many accelerated release cadence goals to hit, and too many bugs to eliminate from the last release(!) to envision those who own software quality being able to continually deliver on our promises to customers. Not if we continue to struggle to spend time on what directly impacts our customers, because too much of our time is stuck doing what doesn't.

Noel Wurst is Software Quality Evangelist at SmartBear
Share this

Industry News

October 02, 2023

Spectro Cloud announced Palette EdgeAI to simplify how organizations deploy and manage AI workloads at scale across simple to complex edge locations, such as retail, healthcare, industrial automation, oil and gas, automotive/connected cars, and more.

September 28, 2023

Kong announced Kong Konnect Dedicated Cloud Gateways, the simplest and most cost-effective way to run Kong Gateways in the cloud fully managed as a service and on enterprise dedicated infrastructure.

September 28, 2023

Sisense unveiled the public preview of Compose SDK for Fusion.

September 28, 2023

Cloudflare announced Hyperdrive to make every local database global. Now developers can easily build globally distributed applications on Cloudflare Workers, the serverless developer platform used by over one million developers, without being constrained by their existing infrastructure.

September 27, 2023

Kong announced full support for Kong Mesh in Konnect, making Kong Konnect an API lifecycle management platform with built-in support for Kong Gateway Enterprise, Kong Ingress Controller and Kong Mesh via a SaaS control plane.

September 27, 2023

Vultr announced the launch of the Vultr GPU Stack and Container Registry to enable global enterprises and digital startups alike to build, test and operationalize artificial intelligence (AI) models at scale — across any region on the globe. \

September 27, 2023

Salt Security expanded its partnership with CrowdStrike by integrating the Salt Security API Protection Platform with the CrowdStrike Falcon® Platform.

September 26, 2023

Progress announced a partnership with Software Improvement Group (SIG), an independent technology and advisory firm for software quality, security and improvement, to help ensure the long-term maintainability and modernization of business-critical applications built on the Progress® OpenEdge® platform.

September 26, 2023

Solace announced a new version of its Solace Event Portal solution that gives organizations with Apache Kafka deployments better visibility into, and control over, their Kafka event streams, brokers and associated assets.

September 26, 2023

Reply launched a proprietary framework for generative AI-based software development, KICODE Reply.

September 26, 2023

Harness announced the industry-wide Engineering Excellence Collective™, an engineering leadership community.

September 25, 2023

Harness announced four new product modules on the Harness platform.

September 25, 2023

Sylabs announced the release of SingularityCE 4.0.

September 25, 2023

Timescale announced the launch of Timescale Vector, enabling developers to build production AI applications at scale with PostgreSQL.