While Quality Owners Might Change, Similar Challenges Continue
October 07, 2021

Noel Wurst
SmartBear

SmartBear recently released the results of its 2021 State of Software Quality | Testing survey, my personal favorite of the company's reports. While I do work for SmartBear, my interest in these non-product-promotional surveys is purely due to my fascination with the world of software quality, and the evolution we're seeing around who owns quality, the challenges that quality owners face, and what they feel will solve those challenges.


I don't feel too bad about revealing this spoiler, because I doubt you'll be surprised to hear that a "lack of time" was reported as the number one challenge to doing more testing, especially as release frequencies continue to increase. However, it was disheartening to see that a lack of time was also the number one response when we asked people to identify the biggest blocker to professional development.

We also asked respondents what testing activity is the most time-intensive task within the time they are able to dedicate to testing, and the number one answer was disheartening again.

23% of respondents reported that "writing manual test cases" is the biggest culprit.

Why is that disheartening?

I would argue that writing out test cases isn't actually testing. It's a testing-related activity, sure, and maybe even a necessary one.

But can you say that the single act of writing out test cases actually improves the quality of your software?

Would your customers say the same?

The second-place answer, coming in at only 1% less at 22% was "learning how to use test tools." Again, a necessary requirement and skill, but learning how to use a tool to test is not testing. What I find humorous, but not surprising at all, is that in this year's survey, we asked respondents for the number one quality they look for in API tooling.

What would you guess the number one answer was?

Most powerful features?

The latest AI/ML innovations?

Nope. "Ease of use."

One trend that's been interesting to observe — from within this survey and in the industry at large — is looking at who owns quality in an organization. In the past, it was largely, if not entirely, owned by manual QA teams. But today, quality owners possess any number of professional titles and backgrounds: manual or exploratory testers, automation engineers, SDETs, business analysts, DevOps teams, or probably the fastest growing group of quality owners — developers.

Even as an exploratory testing enthusiast myself, I'm thrilled to see developers share the responsibility of testing. However, one result that completely surprised me was finding out just how much time developers say they are spending on testing in an average week. Developers were one of the only roles to state that they're spending more time on testing in 2021 than they did in years' past and this percentage is increasing every year (automation engineers, manual testers, and business analysts all reported a decrease in 2021). Developers reported spending, on average, 47% of their week testing. What? Really?

Do developers want to spend nearly 50% of their week not developing new software? From all the testers I've ever spoken to, few would want to spend 50% of their week not testing. I won't be surprised at all to one day see every developer claim to also be a fellow quality owner like their tester counterparts, but at what percentage over 50% of a developer's week being taken up by testing do they simply become … a tester?

There's simply too much actual testing that needs to be done, too many accelerated release cadence goals to hit, and too many bugs to eliminate from the last release(!) to envision those who own software quality being able to continually deliver on our promises to customers. Not if we continue to struggle to spend time on what directly impacts our customers, because too much of our time is stuck doing what doesn't.

Noel Wurst is Software Testing Evangelist and Sr. Manager, Communications, at SmartBear
Share this

Industry News

October 21, 2021

Splunk announced the latest enhancements to the Splunk observability portfolio including advanced product innovations for Splunk Application Performance Monitoring (APM), Splunk Real User Monitoring (RUM), Splunk Synthetic Monitoring, Splunk Log Observer, Splunk Infrastructure Monitoring and Splunk IT Service Intelligence.

October 21, 2021

Platform9 announced a number of new enterprise features that greatly eliminate operational complexities in managing multi-cluster and multicloud Kubernetes deployments, available in the new release, Platform9 5.4 Release.

October 21, 2021

Graylog is announcing Graylog Security.

Designed to overcome legacy Security Information & Event Management (SIEM) challenges, Graylog’s scalable, flexible cybersecurity platform makes security analysts’ jobs easier and faster. With SIEM, Anomaly Detection, and User Entity Behavior Analytics (UEBA) capabilities, Graylog’s security solution will provide security teams with even greater confidence, productivity, and expertise to mitigate risks caused by Insider Threats, credential-based attacks, and other cyber threats.

October 21, 2021

Prodly announced a Series A investment of $10 million led by Leta Capital.

October 20, 2021

SonarSource added over 5,000 customers in the last 12 months, reaching the 15,000 commercial customers milestone in record time.

October 20, 2021

Actian announced the general availability of its newly released DataConnect 12 integration platform, demonstrating a continued focus on ease of use for complex data integration and data quality.

October 20, 2021

Salt Security announced new capabilities in its next-generation Salt Security API Protection Platform to secure GraphQL APIs.

October 20, 2021

vFunction announces the availability of the vFunction Application Transformation Engine and the expanded vFunction Modernization Platform, with new, advanced capabilities that enable enterprises to automatically assess, analyze, and manage the full modernization and migration process from start to finish.

October 20, 2021

Mage raised a $6.3 million seed round led by Gradient Ventures.

October 19, 2021

Couchbase announced its Couchbase Capella hosted Database-as-a-Service (DBaaS) offering on Amazon Web Services (AWS).

October 19, 2021

Checkmarx announced the launch of the Checkmarx Application Security Platform to help CISOs, AppSec teams, and developers address the growing and dynamic security challenges they face.

October 19, 2021

Tasktop announced Affinity Modeling for model-based integration in Tasktop Hub, helping Agile and DevOps software delivery teams reduce time to market and develop software faster.

October 19, 2021

Morpheus Data is continuing released version 5.3.3 targeted at enterprises trying to manage a complex mix of VMware, Kubernetes, and Public Cloud services.

October 19, 2021

Okta announced the availability of Okta Workflows as a standalone offering for all customers.

October 18, 2021

Red Hat announced a series of updates in its portfolio of developer tools and programs aimed at delivering greater productivity, security and scale for developers building applications on Red Hat OpenShift.