Less Than 20% of QA Processes in "Good" Health
April 23, 2019

Derek Choy
Rainforest QA

In 2018, software defects in the US cost about $2.85 trillion. Needless to say, there's room for improvement. If you haven't taken a look at the QA health of your organization, you should consider it. How much money could be saved by better test coverage?

It might seem odd, but one of the most important metrics to an organization's QA health is customer satisfaction. CSAT reflects on product quality, and knowing where your coverage falls short can help shape a strategy that improves QA, product, quality, and CSAT.

Rainforest QA teamed up with TechWell to diagnose the state of QA health by surveying 250 QA testers, engineers, managers, and other QA professionals to understand how they approach QA in their organizations.


Weak Pulse

As it turns out, only 17% of respondents' QA teams are in "good" health or better, with more than half merely surviving, and 32% practically on life support. Why is good QA such a struggle for some? It could be that for many companies QA operates as a separate entity.

For an organization to get the most from its QA team, QA goals should be aligned with business goals. However, that's usually not the case. Only 48% of respondents report following that best-practice alignment. 20% of respondents report not having any QA goals at all. When it comes to test coverage, we see similar numbers.

Test coverage is an integral factor in product quality, so determining test coverage is an important step toward reaching that goal. Ideally, a QA team will work with development to align test coverage with code and measure how much code is exercised when tests are run. We find that 49% of respondents are following QA best practices for determining test coverage, but the other half of those surveyed currently do nothing to determine coverage.

Taking Control of QA

Here are some other eye-opening statistics we found:

■ 46% of respondents believe their QA process does not adequately align with development cycles
■ 10% of respondents are "extremely confident" that their current test coverage will ensure a high-quality product
■ The 48% of respondents who are following smart QA measurement practices keep track of metrics such as:
- number of tests executed
- number of bugs found in test vs. production
- percent of automated tests
- resolution

At this point, the main takeaway from the 2019 QA Health Survey won't be a surprise. Many QA organizations need to take better control of their QA fitness, and soon. Development and deployment processes are not slowing down. Users demand better features, more services, and higher quality.

Derek Choy is CIO at Rainforest QA
Share this

Industry News

July 01, 2020

JFrog announced the launch of ChartCenter, a free, security-focused central repository of Helm charts for the community.

July 01, 2020

Kong announced a significant upgrade to open source Kuma, Kuma 0.6, available today.

July 01, 2020

Compuware Corporation, a BMC company, announced new capabilities that further automate and integrate test data and test case execution, empowering IT teams to achieve high-performance application development quality, velocity and efficiency.

June 30, 2020

Couchbase announced the general availability of Couchbase Cloud, a fully-managed Database-as-a-Service (DBaaS).

June 30, 2020

Split Software announced new capabilities designed to accelerate the adoption of feature flags in large-scale organizations.

June 30, 2020

WhiteHat Security announced a discounted Web + Mobile Application Security bundle to help organizations secure the digital future.

June 29, 2020

Puppet introduced the public beta availability of Relay, an event-driven automation platform.

June 29, 2020

D2iQ introduced KUDO for Kubeflow to simplify and accelerate machine learning (ML) deployments on Kubernetes.

June 29, 2020

Codefresh announced $27M in new funding led by Red Dot Capital Partners.

June 25, 2020

Micro Focus announced the general availability of Visual COBOL 6.0 and Enterprise Suite 6.0, providing versatile application, process and infrastructure modernization solutions for today’s enterprise developer.

June 25, 2020

SaltStack announced new features available in SaltStack Enterprise 6.3 that integrate best-of-breed IT monitoring and vulnerability management solutions, including Splunk, Tenable, Qualys, Rapid7, and Kenna Security.

June 25, 2020

Keysight Technologies has completed the acquisition of Eggplant from The Carlyle Group.

June 24, 2020

JFrog unveiled new capabilities to address the growing problem of software distribution bottlenecks. The newly introduced CDN-based and Peer-to-Peer software package distribution mechanisms empower companies to overcome the challenge of frequently delivering large volumes of artifacts to internal teams and external clients.

June 24, 2020

Copado announced its Summer 20 release to accelerate, optimize and measure innovation delivery on the Salesforce platform.

June 24, 2020

Bugsnag launched Stability Center, a centralized location that offers a holistic view into stability stats and trends across releases for multiple client and server-side applications.