Buildkite Test Analytics Released
June 06, 2022

A new tool by Buildkite launches, Test Analytics, promise to fix one of the biggest and most expensive problems in software development — flaky tests.

Buildkite's new product Test Analytics speeds up delivery pipelines for DevOps engineers by eliminating waste in the development process. The tool works seamlessly with Buildkite's CI/CD platform and integrates with any CI system, including CircleCI, GitHub Actions and Jenkins, providing continuous performance monitoring and real-time insights for test suites. These insights help software development teams identify, optimize, and resolve flaky and unreliable tests faster than ever before, freeing up teams to focus on fixing bugs and rolling out new features.

Buildkite's CI/CD platform helps developers run software quickly and reliably, with testing and deployment tools that work for all software projects, whether for building mobile apps, backend applications, or custom hardware.

Tim Lucas, Co-founder and Co-CEO of Buildkite, said, "Flaky and unreliable tests are a nightmare for the developer world. There are three traditional ways of dealing with the issue. The first is to spend an inordinate amount of time and energy identifying the root cause of a flaky test. The second is to run your test repeatedly until it passes, wasting compute capacity and increasing costs. And the third is to ignore the failure altogether, which makes for unhappy developers and erodes trust in your entire testing and delivery process. With Test Analytics, developers can performance-tune their test suites to identify problems more quickly off the back of clear insight and analysis. Development teams not only have access to creating highly performant and stable build infrastructure, they now have the tools for making their own test suites faster and less flaky."

A clear dashboard within Test Analytics shows the slowest and least reliable tests, prioritizing the most critical fixes. Historical views and trend graphs provide further insight into diagnosing recurring problems. User-defined thresholds provide granularity in defining slow or unreliable tests and creating custom alerts. Integrations with commonly-used testing frameworks allow for deep inspection of where tests are spending time, from long-running database queries to API calls timing out.

Share this

Industry News

September 27, 2022

DevOps Institute will host SKILup Festival in Singapore on November 15, 2022.

September 27, 2022

Delinea announced the latest release of DevOps Secrets Vault, its high-speed vault for DevOps and DevSecOps teams.

September 27, 2022

The Apptainer community announced version 1.1.0 of the popular container system for secure, high-performance computing (HPC). Improvements in the new version provide a smaller attack surface for production deployments while offering features that improve and simplify the user experience.

September 26, 2022

Secure Code Warrior unveiled Coding Labs, a new mechanism that allows developers to more easily move from learning to applying secure coding knowledge, leading to fewer vulnerabilities in code.

September 26, 2022

ActiveState announced the availability of the ActiveState Artifact Repository.

September 26, 2022

Split Software announced the availability of its Feature Data Platform in the Microsoft Azure Marketplace.

September 22, 2022

Katalon announced the launch of the Katalon Platform, a modern and comprehensive software quality management platform that enables teams of any size to easily and efficiently test, launch, and optimize apps, products, and software.

September 22, 2022

StackHawk announced its Deeper API Security Test Coverage release.

September 21, 2022

Platform9 announced the launch of its latest open source project, Arlon.

September 21, 2022

Redpanda Data announced Redpanda Console.

September 21, 2022

mabl announced its availability as a private listing on Google Cloud Marketplace.

September 21, 2022

Zesty announced a $75 million Series B funding round led by B Capital and Series A investor Sapphire Ventures.

September 20, 2022

Opsera, the Continuous Orchestration platform for DevOps, announced a free trial of its no-code Salesforce Release Management platform for fast and secure Salesforce releases.

September 20, 2022

Sysdig announced ToDo and Remediation Guru.

September 20, 2022

AutoRABIT announced CodeScan Shield.