Agile Methodologies Lead to Testing Earlier and More Often
February 24, 2015

Jim Cerna
Sauce Labs

A shift to continuous integration (CI) and other agile methodologies is driving a massive change in the way that development and testing professionals approach testing, according to an independent, global developer survey titled Web and Mobile Testing Trends, conducted by Dimensional Research for Sauce Labs.

As applications are accessed on increasing numbers of different device and browser types, development teams must find ways to identify and fix an increasing range of environment-specific issues. As more and more development teams adopt agile methodologies, it's forcing organizations to re-think how they approach testing in a context of greatly increased demand for test suite reliability and speed. This study shows that as continuous integration and other agile methodologies are introduced into the environment, developers are testing earlier and more often – ultimately leading to better quality software.

Key findings from the report include:

Modern software development approaches change testing

■ 94 percent of respondents say adopting CI or other agile methodologies have changed the way they test

■ 69 percent do more automated testing

■ 61 percent test earlier in the development cycle

■ CI and agile development teams do more of all types of testing with the exception of manual testing

Mobile testing creates unique challenges

■ Mobile testing embraces both web applications used in mobile browsers (89 percent) as well as native or hybrid mobile apps (53 percent)

■ The survey revealed no standard approach for testing diverse mobile environments

■ 29 percent use only simulators or emulators

■ 37 percent use only real devices

■ 34 percent use a combination of simulators and real devices

Cross browser testing remains vital

■ 80 percent say cross browser testing is "very important"

■ 43 percent test only the most recent version of each browser

■ 76 percent do cross browser testing across mobile and desktop browsers

■ 79 percent say testing more types or versions of browsers would increase quality

Other trends impacting testing

■ 43 percent run unit or functional tests for web and mobile in the cloud

■ Only 45 percent have fully ended support for Windows XP

"The large number of web developers testing their applications in mobile browsers – 76 percent – was surprising to me. This is a big deal for testers and developers," said Diane Hagglund, Senior Researcher at Dimensional Research. "Today, users can access web applications on any mobile or desktop browser, and web application developers consequently need to be prepared to think about each and every user experience for every device."

Survey Methodology: In January 2015, a global database of technology professionals responsible for testing web and mobile applications was emailed an invitation to participate in a Web survey on the topic of testing trends. A total of 504 individuals completed the survey. Participants included a variety of roles, company sizes, industries and regions.

Jim Cerna is CEO of Sauce Labs.

Share this

Industry News

April 11, 2024

Check Point® Software Technologies Ltd. announced new email security features that enhance its Check Point Harmony Email & Collaboration portfolio: Patented unified quarantine, DMARC monitoring, archiving, and Smart Banners.

April 11, 2024

Automation Anywhere announced an expanded partnership with Google Cloud to leverage the combined power of generative AI and its own specialized, generative AI automation models to give companies a powerful solution to optimize and transform their business.

April 11, 2024

Jetic announced the release of Jetlets, a low-code and no-code block template, that allows users to easily build any technically advanced integration use case, typically not covered by alternative integration platforms.

April 10, 2024

Progress announced new powerful capabilities and enhancements in the latest release of Progress® Sitefinity®.

April 10, 2024

Buildkite signed a multi-year strategic collaboration agreement (SCA) with Amazon Web Services (AWS), the world's most comprehensive and broadly adopted cloud, to accelerate delivery of cloud-native applications across multiple industries, including digital native, financial services, retail or any enterprise undergoing digital transformation.

April 10, 2024

AppViewX announced new functionality in the AppViewX CERT+ certificate lifecycle management automation product that helps organizations prepare for Google’s proposed 90-day TLS certificate validity policy.

April 09, 2024

Rocket Software is addressing the growing demand for integrated security, compliance, and automation in software development with its latest release of Rocket® DevOps, formerly known as Aldon®.

April 09, 2024

Wind River announced the latest release of Wind River Studio Developer, an edge-to-cloud DevSecOps platform that accelerates development, deployment, and operation of mission-critical systems.

April 09, 2024

appCD announced its generative infrastructure from code solution now supports Azure Kubernetes Service (AKS).

April 09, 2024

Synopsys announced the availability of Black Duck® Supply Chain Edition, a new software composition analysis (SCA) offering that enables organizations to mitigate upstream risk in their software supply chains.

April 09, 2024

DataStax announced innovative integrations with API extensions to Google Cloud’s Vertex AI Extension and Vertex AI Search, offering developers an easier time leveraging their own data.

April 08, 2024

Parasoft introduced C/C++test CT, a comprehensive solution tailored for large teams engaged in the development of safety- and security-critical C and C++ products.

April 08, 2024

Endor Labs announced a strategic partnership with GuidePoint Security.

April 08, 2024

Hasura announced the V3 of its platform, providing on-demand API composability with a new domain-centric supergraph modeling framework, a distributed supergraph execution engine and a rich and extensible ecosystem of open source connectors to address the challenges faced during integration of data and APIs.

April 04, 2024

DataStax has entered into a definitive agreement to acquire AI startup, Logspace, the creators of Langflow, an open source visual framework for building retrieval-augmented generation (RAG) applications.1