Sauce Labs Launches Failure Analysis
May 13, 2020

Sauce Labs announced the launch of Failure Analysis, a new analytics solution that applies sophisticated machine learning to customers’ pass/fail data in order to surface the most common reasons a given set of tests fail.

Failure Analysis gives developers, testers, and QA managers insight into how often the same type of failure repeats itself across a given test suite, enabling them to move quickly to address the most pervasive issues and drive rapid improvement in test quality.

“Testing is critical to delivering flawless applications and creating great user experiences, yet the task of maintaining a high-quality test suite has only become more difficult as organizations accelerate the pace of development and automate testing at scale,” said Matt Wyman, CPO, Sauce Labs. “With Failure Analysis, developers finally have a machine learning-driven tool to help balance the demand for faster deployments with the heightened need to maintain a reliable test suite. We’re excited to deliver this new resource to aid in the testing community’s collective efforts to improve test quality, increase developer productivity, and build digital confidence.”

The release of Failure Analysis comes as many development teams reach an inflection point in their digital journeys. Though more organizations than ever have shifted to agile development methodologies and implemented continuous testing throughout the software development cycle, poor test quality continues to undermine many efforts to deliver quality applications at speed. Poor test quality also increases the occurrence of false failures, frustrating testers and developers responsible for manually following up on those failures, and eroding confidence in the overall automated testing process.

Failure Analysis from Sauce Labs addresses this increasingly urgent need by helping testers and developers better understand why tests are failing and enabling them to prioritize remediation accordingly. Leveraging powerful machine learning algorithms to analyze an organization’s pass/fail data and its Selenium and Appium command logs, Failure Analysis gives testers and developers visibility into precisely where and how often failure patterns recur within a test suite, all from a single dashboard view within the Sauce Labs UI. Using the learnings provided by Failure Analysis to improve test quality, organizations can also dramatically lower the occurrence of false failures, ensuring that failed tests carry a high signal-to-noise ratio and developers feel confident that a failed test has truly detected a breaking change as opposed to the flaky noise of an unreliable test suite.

Failure Analysis is available now as a standard capability for enterprise customers as part of the Insights package within the Sauce Labs Continuous Testing Cloud. Sauce Labs provides a host of analytics capabilities that provide intelligent views into test data, including a new test overview and trends dashboard, interactive visualizations that enable customers to drill down on granular data sets, and a powerful REST API that allows users to aggregate data into their home-grown quality dashboard or test analytics tools.

Share this

Industry News

September 23, 2021

Shortcut, the collaborative home for modern software teams, announced new Team-to-Workflow functionality.

September 23, 2021

Portainer announced the launch of its Portainer Business Charmed Operator, allowing for seamless integration with Canonical’s Charmed Kubernetes distribution.

September 22, 2021

Parasoft announced the launch and extension of its static application security testing (SAST) and API testing platform with penetration testing, shifting security testing into developer workflows.

September 22, 2021

Synopsys announced a new partnership with The Chertoff Group, a global advisory services firm that applies security expertise, technology insights, and policy intelligence to help clients build resilient organizations, gain competitive advantage, and accelerate growth.

September 21, 2021

ShiftLeft announced that its unified code security platform, ShiftLeft CORE, is now available on the AWS Marketplace.

September 21, 2021

JFrog announced its JFrog Artifactory and JFrog Xray solutions are now accredited in Iron Bank and available via Platform One.

September 21, 2021

GitKraken acquired BigBrassBand and its popular Git Integration for Jira.

September 20, 2021

D2iQ announced version 2.0 of the D2iQ Kubernetes Platform (DKP).

September 20, 2021

Platform9 joined Intel's Open Retail Initiative (ORI) and launched a new software-defined store solution.

September 20, 2021

FireMon has acquired DisruptOps.

September 16, 2021

SnapLogic released the latest version of its new SnapLogic Flows solution.

September 16, 2021

Postman launched a new version of its API Management platform.

September 16, 2021

Progress announced its R3 2021 release of Progress Telerik and Progress Kendo UI.

September 15, 2021

Progress announced the availability of Progress Sitefinity DX 14.0.

September 15, 2021

Launchable, the intelligence platform layer for all software testing, announced their latest addition to the platform, Flaky Tests Insights (beta).