DEVOPSdigest

Test Analytics is designed to help engineers identify problems in code delivery pipelines earlier than ever. With continuous speed, reliability and performance monitoring of the test suite, Test Analytics helps engineers identify flaky tests that cause disruption, and remove them quickly to avoid slowdowns in development pipelines.

Buildkite is used by the world's fastest moving development teams to test and deploy code, quickly and securely, on their own infrastructure. The continuous integration/deployment platform helps users run software faster and more reliably, with testing and deployment tools that work for all software projects — whether it's for building mobile apps, backend applications, or custom hardware.

With Test Analytics, engineers and DevOps managers can view per-test performance breakdowns across multiple test runs, helping them find and fix any underlying problem while allowing for real-time analysis from any CI system. This will allow developers to quickly spot and eliminate bottlenecks and wasted compute, improving both efficiency and performance.

"We've seen an increasing need for DevOps tools that allow users to performance-tune its own test suites to identify the problem quicker," said Tim Lucas, co-founder and co-CEO of Buildkite. "We're excited to finally be able to share Test Analytics with our community, as we've been working hard to design a new solution that gives our customers better insight and analysis into their pipeline reliability. "

Key Test Analytics features include:

- Flaky Test Identification: Dashboard views showing slowest and least reliable tests to assist in separating signal from noise and triaging the most critical fixes.

- Speed and Reliability Monitoring: User-defined thresholds provide granularity in defining slow or unreliable tests, and in creating custom alerts.

- Deep Performance Analysis: Integrations with commonly-used testing frameworks allow for deep inspection of where tests are spending time, from long running database queries to API calls timing out.

- Real-Time Results: Data is sent to Test Analytics as pipeline tests are being run, ensuring problems are identified quickly. Historical views and trend graphs provide further insight in diagnosing recurring problems.