The Merging of Traditional QA and Monitoring is the Future of Dev
April 12, 2021

Richard Whitehead

We're all familiar with the process of QA within the software development cycle. Developers build a product and send it to QA engineers, who test and bless it before pushing it into the world. After release, a different team of SREs with their own toolset then monitor for issues and bugs. Now, a new level of customer expectations for speed and reliability have pushed businesses further toward delivering rapid product iterations and innovations to keep up with customer demands. This leaves little time to run the traditional development process. QA can no longer act as a major, individual step.

Fortunately, modern, automated infrastructure as code (IAC)-built toolchains that deliver continuous observability now let SRE teams watch the entire build pipeline from the first piece of code through release. This enables a whole new speed within the delivery cycle and merges the traditional roles of QA and monitoring.

Helping "the Human in the Middle"

Without a proper QA process, any change dev teams make to digital systems can have cascading effects on the infrastructure. This only further stresses the SRE team to find and fix issues after deployment. And changes are happening faster than ever. As a result, we meet the juxtaposition between the need for QA and the limited time to work the process into the development cycle as a standalone step.

Observability (mining deep data from distributed systems) delivers the data necessary to eliminate traditional QA, but that isn't enough. Humans still need help. When you apply AI to this observability data (intelligent observability), teams can analyze data at machine speed. This lets DevOps practitioners and SREs view the entire product lifecycle, from early development to daily performance, through the lens of quality.

The use of intelligent observability helps teams find the needle in the proverbial haystack of data — the root causes of issues within digital systems — instantly. It also helps identify actionable ways to quickly resolve a new product's impacts on the infrastructure. Without this capability, we revert to the old way of doing things where the dev team has QA find the needle instead. This new continuous learning and intelligent collaboration creates a merging of traditional QA and monitoring for a CI/CD pipeline that actually works.

Integrating observability with AI into the development cycle creates an opportunity to monitor expected outcomes much closer, enabling "the human in the middle" to spot change almost instantly. If the system starts behaving dramatically differently after a deployment, SREs and DevOps practitioners can see it and intervene immediately, without the need to wait for a QA team. If nothing changes or the system improves, they know there's no need to remediate a deployment.

In cases where a change in performance is expected, it was traditionally incumbent on the developer to modify the unit tests or to communicate the change to the QA team. Now, AI- and ML-based systems' change tolerance reduces IT teams' effort. For example, if you're monitoring a KPI with an adaptive thresholding algorithm, you can simply let the algorithm re-train and learn the new behavior instead of relying on the dev team to communicate the expected change in performance to QA.

Merged Systems Support DevOps Three Ways

A merged system of QA and monitoring throughout the development cycle also aligns with the DevOps Three Ways principles. We look at the First Way: flow/system thinking, the Second Way: amplifying feedback loops, and the Third Way: creating a culture of continual experimentation and learning, as the guiding principles behind DevOps practices.

The merging of traditional QA and monitoring supports the First Way — flow/system thinking — by building a holistic system view of the development process with the elimination of siloed workflows. This creates quality throughout development and delivery because the system is never optimized for local efficiency only or passed onto the next step with a known issue.

A merge also supports the Second Way — amplifying feedback loops — by giving IT teams clear, consistent feedback throughout the development and delivery process. As traditional QA and monitoring merge, the need to loop feedback through multiple teams with various processes and priorities evaporates.

This merge perhaps has the greatest impact on the Third Way. As DevOps practitioners focus on the holistic product cycle versus quick development that's passed off to QA, they can learn from bugs and build constant improvement into their process. This also gives them room to experiment and take risks. Infusing quality into the development process itself means they won't hand over garbage to the QA team — no matter how "out there" the forthcoming release might be.

Integrating observability with AI into the development cycle allows teams to not only see into systems as they're being built, but also identify actionable ways to resolve a new product's impacts on the overall infrastructure. As DevOps practitioners and SREs balance change, these actionable insights empower the merging of traditional QA and monitoring for a whole new speed of delivery — delivering better customer experiences and giving your business the ability to launch competitive, innovative services faster than ever.

Richard Whitehead is Chief Evangelist at Moogsoft
Share this

Industry News

August 11, 2022

Granulate, an Intel Company, announced the upcoming launch of its latest free cost-reduction solution, gMaestro, a continuous workload and pod rightsizing tool for Kubernetes cost optimization.

August 11, 2022

Rezilion announced the availability of MI-X, a newly created open-source tool developed by Rezilion's vulnerability research team.

August 11, 2022

Contrast Security announced its enhanced application programming interface (API) security capabilities within the Contrast Secure Code Platform.

August 10, 2022

Mirantis made it even easier to integrate Mirantis Container Cloud into developer workflows and provide developers and operators with easy access and visibility into the Kubernetes clusters with the Mirantis Container Cloud Lens Extension announced today.

August 10, 2022

ArmorCode announced an integration with Traceable AI which will bring its data into the ArmorCode platform and improve Application Security Posture from code to cloud.

August 10, 2022

Quali unveiled enhanced features for its Torque platform to unify infrastructure orchestration and governance.

August 09, 2022

Veracode announced the enhancement of its Continuous Software Security Platform with substantial improvements to its integrated developer experience.

August 09, 2022

Normalyze announced General Availability for its Freemium offering, a self-serve, free platform that democratizes data discovery and classification in all three public clouds, Amazon Web Services (AWS), Microsoft Azure, and Google Cloud Platform (GCP).

August 09, 2022

Traceable AI announced enhanced capabilities to address more specific types of API attacks, including API abuse and misuse, fraud and malicious API bots, all of which contribute to serious data security and compliance challenges within organizations today.

August 08, 2022

Contrast Security announced that software composition analysis (SCA) is now available for free in CodeSec.

CodeSec offers free application security testing and SCA in a single, developer-friendly interface.

The new SCA feature will enable developers to easily identify vulnerable third-party libraries quickly and accurately, getting secure code moving in minutes.

August 08, 2022

CloudBees announced Anuj Kapur as President and CEO.

August 08, 2022

ShiftLeft named Stuart McClure as CEO.

August 04, 2022

Cribl announced a new partnership with SentinelOne. The partnership enables SentinelOne customers to leverage Cribl's observability product suite to streamline cybersecurity triage, optimize data collection, and provide security teams control of their data.

August 04, 2022

Seemplicity partnered with Checkmarx. The partnership will see the Checkmarx One Platform integrated within Seemplicity's Productivity Platform, allowing joint customers to simplify the entire find-to-fix lifecycle and ultimately accelerate the time to remediation of vulnerabilities found throughout the software development lifecycle (SDLC).

August 04, 2022

Rafay Systems announced new capabilities that empower enterprise platform teams to provide developer self-service for faster application deployments with the necessary guardrails enterprises require.