Less Than 20% of QA Processes in "Good" Health
April 23, 2019

Derek Choy
Rainforest QA

In 2018, software defects in the US cost about $2.85 trillion. Needless to say, there's room for improvement. If you haven't taken a look at the QA health of your organization, you should consider it. How much money could be saved by better test coverage?

It might seem odd, but one of the most important metrics to an organization's QA health is customer satisfaction. CSAT reflects on product quality, and knowing where your coverage falls short can help shape a strategy that improves QA, product, quality, and CSAT.

Rainforest QA teamed up with TechWell to diagnose the state of QA health by surveying 250 QA testers, engineers, managers, and other QA professionals to understand how they approach QA in their organizations.


Weak Pulse

As it turns out, only 17% of respondents' QA teams are in "good" health or better, with more than half merely surviving, and 32% practically on life support. Why is good QA such a struggle for some? It could be that for many companies QA operates as a separate entity.

For an organization to get the most from its QA team, QA goals should be aligned with business goals. However, that's usually not the case. Only 48% of respondents report following that best-practice alignment. 20% of respondents report not having any QA goals at all. When it comes to test coverage, we see similar numbers.

Test coverage is an integral factor in product quality, so determining test coverage is an important step toward reaching that goal. Ideally, a QA team will work with development to align test coverage with code and measure how much code is exercised when tests are run. We find that 49% of respondents are following QA best practices for determining test coverage, but the other half of those surveyed currently do nothing to determine coverage.

Taking Control of QA

Here are some other eye-opening statistics we found:

■ 46% of respondents believe their QA process does not adequately align with development cycles
■ 10% of respondents are "extremely confident" that their current test coverage will ensure a high-quality product
■ The 48% of respondents who are following smart QA measurement practices keep track of metrics such as:
- number of tests executed
- number of bugs found in test vs. production
- percent of automated tests
- resolution

At this point, the main takeaway from the 2019 QA Health Survey won't be a surprise. Many QA organizations need to take better control of their QA fitness, and soon. Development and deployment processes are not slowing down. Users demand better features, more services, and higher quality.

Derek Choy is CIO at Rainforest QA
Share this

Industry News

November 13, 2019

Testim introduced the Testim Development Kit, a new way for developers to quickly create resilient tests directly in code.

November 13, 2019

Rollbar announced an error monitoring solution for Salesforce’s Apex platform.

November 13, 2019

StackRox announced version 3.0 of the StackRox Kubernetes Security Platform.

November 12, 2019

VMware announced rapid advancement of VMware Tanzu, a new portfolio of products and services designed to transform the way enterprises build, run and manage software on Kubernetes.

November 12, 2019

SmartBear released ReadyAPI 3.0. This latest release addresses the increasing requirement for organizations to consistently deliver high-quality APIs in order to meet accelerated business demands within compressed release cycles.

November 12, 2019

Aqua Security announced its expansion into cloud security posture management (CSPM) with its acquisition of CloudSploit.

November 07, 2019

To help developers increase the speed and quality of their SQL coding, enhance efficiency, and take advantage of the latest improvements in SQL Server, Redgate has released a major upgrade for its most popular tool, SQL Prompt.

November 07, 2019

CloudBees announced a partnership with Atos and VMware surrounding a solution to help customers adopt DevOps best practices at scale on Atos’ recently announced Atos Digital Hybrid Cloud (DHC) powered by VMware Tanzu and CloudBees cloud native continuous integration/continuous delivery (CI/CD) enterprise solution.

November 07, 2019

Fugue announced the release of the Fugue Best Practices Framework to help cloud engineering and security teams identify and remediate dangerous cloud resource misconfigurations that aren’t addressed by common compliance frameworks.

November 06, 2019

Red Hat and the Quarkus community announced Quarkus 1.0.

November 06, 2019

Copado announced its Winter 20 release to provide Salesforce customers the fastest path to continuous innovation.

November 06, 2019

Applause announced its new solution for AI training and testing.

November 05, 2019

Broadcom announced an expanded collaboration with Infosys to help SAP customers mitigate risks and costs associated with the upgrade to SAP’s next-generation enterprise resource planning application, S/4HANA.

November 05, 2019

Opsani AI is now generally available for services providers running on Microsoft's Azure cloud computing platform.

November 05, 2019

Wind River announced the release of its latest version of Wind River Simics.