Buildkite Announces Beta Launch of Test Analytics
October 27, 2021

Test Analytics is designed to help engineers identify problems in code delivery pipelines earlier than ever. With continuous speed, reliability and performance monitoring of the test suite, Test Analytics helps engineers identify flaky tests that cause disruption, and remove them quickly to avoid slowdowns in development pipelines.

Buildkite is used by the world's fastest moving development teams to test and deploy code, quickly and securely, on their own infrastructure. The continuous integration/deployment platform helps users run software faster and more reliably, with testing and deployment tools that work for all software projects — whether it's for building mobile apps, backend applications, or custom hardware.

With Test Analytics, engineers and DevOps managers can view per-test performance breakdowns across multiple test runs, helping them find and fix any underlying problem while allowing for real-time analysis from any CI system. This will allow developers to quickly spot and eliminate bottlenecks and wasted compute, improving both efficiency and performance.

"We've seen an increasing need for DevOps tools that allow users to performance-tune its own test suites to identify the problem quicker," said Tim Lucas, co-founder and co-CEO of Buildkite. "We're excited to finally be able to share Test Analytics with our community, as we've been working hard to design a new solution that gives our customers better insight and analysis into their pipeline reliability. "

Key Test Analytics features include:

- Flaky Test Identification: Dashboard views showing slowest and least reliable tests to assist in separating signal from noise and triaging the most critical fixes.

- Speed and Reliability Monitoring: User-defined thresholds provide granularity in defining slow or unreliable tests, and in creating custom alerts.

- Deep Performance Analysis: Integrations with commonly-used testing frameworks allow for deep inspection of where tests are spending time, from long running database queries to API calls timing out.

- Real-Time Results: Data is sent to Test Analytics as pipeline tests are being run, ensuring problems are identified quickly. Historical views and trend graphs provide further insight in diagnosing recurring problems.

Share this

Industry News

May 18, 2022

Red Hat unveiled updates across its portfolio of developer tools designed to help organizations build and deliver applications faster and more consistently across Kubernetes-based hybrid and multicloud environments.

May 18, 2022

Armory announced public early access to their new Continuous Deployment-as-a-Service product.

May 18, 2022

DataCore Software announced DataCore Bolt, enterprise-grade container-native storage software for DevOps.

May 17, 2022

DevOps Institute, a global professional association for advancing the human elements of DevOps, announced the release of the Upskilling IT 2022 report.

May 17, 2022

Replicated announced a host of new platform features and capabilities that enable their customers to accelerate enterprise adoption of their Kubernetes applications.

May 17, 2022

Codefresh announced that its flagship continuous delivery (CD) platform will be made accessible as a fully-hosted solution for DevOps teams seeking to quickly and easily achieve frictionless, GitOps-based continuous software delivery in the cloud.

May 16, 2022

Red Hat announced new capabilities and enhancements across its portfolio of open hybrid cloud solutions aimed at accelerating enterprise adoption of edge compute architectures through the Red Hat Edge initiative.

May 16, 2022

D2iQ announced a partnership with GitLab.

May 16, 2022

Kasten by Veeam announced the new Kasten by Veeam K10 V5.0 Kubernetes data management platform.

May 12, 2022

Red Hat introduced Red Hat Enterprise Linux 9, the Linux operating system designed to drive more consistent innovation across the open hybrid cloud, from bare metal servers to cloud providers and the farthest edge of enterprise networks.

May 12, 2022

Couchbase announced version 7.1 of Couchbase Server.

May 12, 2022

Copado added Copado Robotic Testing to Copado Essentials.

May 11, 2022

Red Hat announced new advancements within its Red Hat Cloud Services portfolio, delivering a fully-managed and streamlined user experience as organizations build, deploy, manage and scale cloud-native applications across hybrid environments.

May 11, 2022

JFrog introduced a new Docker Desktop Extension for JFrog Xray that allows organizations to automatically scan Docker Containers for vulnerabilities and violations early in the development process.

May 11, 2022

Progress announced a series of updates in Progress Telerik and Progress Kendo UI.