Sauce Labs Launches Failure Analysis
May 13, 2020

Sauce Labs announced the launch of Failure Analysis, a new analytics solution that applies sophisticated machine learning to customers’ pass/fail data in order to surface the most common reasons a given set of tests fail.

Failure Analysis gives developers, testers, and QA managers insight into how often the same type of failure repeats itself across a given test suite, enabling them to move quickly to address the most pervasive issues and drive rapid improvement in test quality.

“Testing is critical to delivering flawless applications and creating great user experiences, yet the task of maintaining a high-quality test suite has only become more difficult as organizations accelerate the pace of development and automate testing at scale,” said Matt Wyman, CPO, Sauce Labs. “With Failure Analysis, developers finally have a machine learning-driven tool to help balance the demand for faster deployments with the heightened need to maintain a reliable test suite. We’re excited to deliver this new resource to aid in the testing community’s collective efforts to improve test quality, increase developer productivity, and build digital confidence.”

The release of Failure Analysis comes as many development teams reach an inflection point in their digital journeys. Though more organizations than ever have shifted to agile development methodologies and implemented continuous testing throughout the software development cycle, poor test quality continues to undermine many efforts to deliver quality applications at speed. Poor test quality also increases the occurrence of false failures, frustrating testers and developers responsible for manually following up on those failures, and eroding confidence in the overall automated testing process.

Failure Analysis from Sauce Labs addresses this increasingly urgent need by helping testers and developers better understand why tests are failing and enabling them to prioritize remediation accordingly. Leveraging powerful machine learning algorithms to analyze an organization’s pass/fail data and its Selenium and Appium command logs, Failure Analysis gives testers and developers visibility into precisely where and how often failure patterns recur within a test suite, all from a single dashboard view within the Sauce Labs UI. Using the learnings provided by Failure Analysis to improve test quality, organizations can also dramatically lower the occurrence of false failures, ensuring that failed tests carry a high signal-to-noise ratio and developers feel confident that a failed test has truly detected a breaking change as opposed to the flaky noise of an unreliable test suite.

Failure Analysis is available now as a standard capability for enterprise customers as part of the Insights package within the Sauce Labs Continuous Testing Cloud. Sauce Labs provides a host of analytics capabilities that provide intelligent views into test data, including a new test overview and trends dashboard, interactive visualizations that enable customers to drill down on granular data sets, and a powerful REST API that allows users to aggregate data into their home-grown quality dashboard or test analytics tools.

Share this

Industry News

March 28, 2024

Check Point® Software Technologies Ltd. announced a collaboration with Microsoft that utilizes the Microsoft Azure OpenAI Service to enhance Check Point Infinity AI Copilot, marking a significant advancement in cyber security AI applications.

March 28, 2024

ArmorCode announced ArmorCode Risk Prioritization, providing a 3D scoring approach for managing application security risks.

March 28, 2024

AppViewX and Fortanix announced a partnership to offer cloud-delivered secure digital identity management and code signing.

March 27, 2024

WaveMaker has updated its platform in response to customer demand for more sophisticated API and code management tools.

March 27, 2024

Vercara announced the launch of UltraAPI™, a product suite that protects APIs and web applications from malicious bots and fraudulent activity while ensuring regulatory compliance.

March 27, 2024

Legit Security announced the launch of its standalone enterprise secrets scanning product, which can detect, remediate, and prevent secrets exposure across the software development pipeline.

March 26, 2024

Progress announced a strategic partnership with Veeam® Software, the #1 leader by market share in Data Protection and Ransomware Recovery, to provide customers with an enterprise-ready cyber defense solution that strengthens the security of their business-critical data.

March 26, 2024

GitGuardian released its Software Composition Analysis (SCA) module.

March 26, 2024

DataStax announced a milestone in its journey to simplify enterprise retrieval-augmented generation (RAG) for developers by integrating with Microsoft Semantic Kernel.

March 25, 2024

Check Point® Software Technologies Ltd. is collaborating with NVIDIA to enhance the security of AI cloud infrastructure. Integrating NVIDIA BlueField DPUs, which feature a broad range of purpose-built, innovative security capabilities, the new Check Point AI Cloud Protect solution will help prevent threats at both the network and host levels.

March 25, 2024

Sentry announced the release of Autofix, an AI-powered feature to debug and fix code in minutes, saving important time and resources.

March 25, 2024

Apiiro announced a product integration and partnership with Secure Code Warrior, the agile developer security training platform, to extend its ASPM technology and processes to the people layer.

March 21, 2024

Progress announced that Progress® Semaphore™, its metadata management and semantic AI platform, was named a Champion in SoftwareReviews’ 2024 Metadata Management Emotional Footprint Awards.

March 21, 2024

The Cloud Native Computing Foundation® (CNCF®) has partnered with Udemy, an online skills marketplace and learning platform.

March 21, 2024

GitLab has acquired Oxeye, the provider of a cloud-native application security and risk management solution.