Less Than 20% of QA Processes in "Good" Health
April 23, 2019

Derek Choy
Rainforest QA

In 2018, software defects in the US cost about $2.85 trillion. Needless to say, there's room for improvement. If you haven't taken a look at the QA health of your organization, you should consider it. How much money could be saved by better test coverage?

It might seem odd, but one of the most important metrics to an organization's QA health is customer satisfaction. CSAT reflects on product quality, and knowing where your coverage falls short can help shape a strategy that improves QA, product, quality, and CSAT.

Rainforest QA teamed up with TechWell to diagnose the state of QA health by surveying 250 QA testers, engineers, managers, and other QA professionals to understand how they approach QA in their organizations.


Weak Pulse

As it turns out, only 17% of respondents' QA teams are in "good" health or better, with more than half merely surviving, and 32% practically on life support. Why is good QA such a struggle for some? It could be that for many companies QA operates as a separate entity.

For an organization to get the most from its QA team, QA goals should be aligned with business goals. However, that's usually not the case. Only 48% of respondents report following that best-practice alignment. 20% of respondents report not having any QA goals at all. When it comes to test coverage, we see similar numbers.

Test coverage is an integral factor in product quality, so determining test coverage is an important step toward reaching that goal. Ideally, a QA team will work with development to align test coverage with code and measure how much code is exercised when tests are run. We find that 49% of respondents are following QA best practices for determining test coverage, but the other half of those surveyed currently do nothing to determine coverage.

Taking Control of QA

Here are some other eye-opening statistics we found:

■ 46% of respondents believe their QA process does not adequately align with development cycles
■ 10% of respondents are "extremely confident" that their current test coverage will ensure a high-quality product
■ The 48% of respondents who are following smart QA measurement practices keep track of metrics such as:
- number of tests executed
- number of bugs found in test vs. production
- percent of automated tests
- resolution

At this point, the main takeaway from the 2019 QA Health Survey won't be a surprise. Many QA organizations need to take better control of their QA fitness, and soon. Development and deployment processes are not slowing down. Users demand better features, more services, and higher quality.

Derek Choy is CIO at Rainforest QA
Share this

Industry News

January 23, 2020

StackRox announced that the latest version of the StackRox Kubernetes Security Platform includes support for Google Anthos, the open application platform that enables users to modernize, build and run applications across on-premise and multiple public cloud environments.

January 23, 2020

CloudVector launched API Shark, the free API discovery and observability tool.

January 23, 2020

Thundra announced $4 million in Series A funding led by global investment firm Battery Ventures.

January 22, 2020

CollabNet VersionOne and XebiaLabs have merged.

January 22, 2020

Keyfactor announced DevOps integrations with automation and containerization providers Ansible, Docker, HashiCorp, Jenkins and Kubernetes to offer security-first services and solutions designed to seamlessly integrate with existing enterprise tools and applications.

January 22, 2020

Sysdig raised $70 million in Series E funding.

January 21, 2020

Red Hat announced the general availability of Red Hat OpenShift Container Storage 4 to deliver an integrated, multicloud experience to Red Hat OpenShift Container Platform users.

January 21, 2020

Snyk has secured a $150 million investment, led by Stripes, a leading New York-based growth equity firm.

January 21, 2020

vChainannounced the close of a $7M Series A investment round.

January 16, 2020

VAST Data announced the general availability of its new Container Storage Interface (CSI).

January 16, 2020

Fugue has open sourced Regula, a tool that evaluates Terraform infrastructure-as-code for security misconfigurations and compliance violations prior to deployment.

January 16, 2020

WhiteHat Security will offer free application scanning services to federal, state and municipal agencies in North America.

January 15, 2020

Micro Focus announced the release of Micro Focus AD Bridge 2.0, offering IT administrators the ability to extend Active Directory (AD) controls from on-premises resources, including Windows and Linux devices to the cloud - a solution not previously offered in the marketplace.

January 15, 2020

SaltStack announced the availability of three new open-source innovation modules: Heist, Umbra, and Idem.

January 15, 2020

ShiftLeft announced a partnership and deep integration with CircleCI that enables organizations to insert security directly into developer pull requests from code repositories.