Agile Methodologies Lead to Testing Earlier and More Often
February 24, 2015

Jim Cerna
Sauce Labs

A shift to continuous integration (CI) and other agile methodologies is driving a massive change in the way that development and testing professionals approach testing, according to an independent, global developer survey titled Web and Mobile Testing Trends, conducted by Dimensional Research for Sauce Labs.

As applications are accessed on increasing numbers of different device and browser types, development teams must find ways to identify and fix an increasing range of environment-specific issues. As more and more development teams adopt agile methodologies, it's forcing organizations to re-think how they approach testing in a context of greatly increased demand for test suite reliability and speed. This study shows that as continuous integration and other agile methodologies are introduced into the environment, developers are testing earlier and more often – ultimately leading to better quality software.

Key findings from the report include:

Modern software development approaches change testing

■ 94 percent of respondents say adopting CI or other agile methodologies have changed the way they test

■ 69 percent do more automated testing

■ 61 percent test earlier in the development cycle

■ CI and agile development teams do more of all types of testing with the exception of manual testing

Mobile testing creates unique challenges

■ Mobile testing embraces both web applications used in mobile browsers (89 percent) as well as native or hybrid mobile apps (53 percent)

■ The survey revealed no standard approach for testing diverse mobile environments

■ 29 percent use only simulators or emulators

■ 37 percent use only real devices

■ 34 percent use a combination of simulators and real devices

Cross browser testing remains vital

■ 80 percent say cross browser testing is "very important"

■ 43 percent test only the most recent version of each browser

■ 76 percent do cross browser testing across mobile and desktop browsers

■ 79 percent say testing more types or versions of browsers would increase quality

Other trends impacting testing

■ 43 percent run unit or functional tests for web and mobile in the cloud

■ Only 45 percent have fully ended support for Windows XP

"The large number of web developers testing their applications in mobile browsers – 76 percent – was surprising to me. This is a big deal for testers and developers," said Diane Hagglund, Senior Researcher at Dimensional Research. "Today, users can access web applications on any mobile or desktop browser, and web application developers consequently need to be prepared to think about each and every user experience for every device."

Survey Methodology: In January 2015, a global database of technology professionals responsible for testing web and mobile applications was emailed an invitation to participate in a Web survey on the topic of testing trends. A total of 504 individuals completed the survey. Participants included a variety of roles, company sizes, industries and regions.

Jim Cerna is CEO of Sauce Labs.

Share this

Industry News

December 03, 2024

SmartBear announced its acquisition of QMetry, provider of an AI-enabled digital quality platform designed to scale software quality.

December 03, 2024

Red Hat signed a strategic collaboration agreement (SCA) with Amazon Web Services (AWS) to scale availability of Red Hat open source solutions in AWS Marketplace, building upon the two companies’ long-standing relationship.

December 03, 2024

CloudZero announced the launch of CloudZero Intelligence — an AI system powering CloudZero Advisor, a free, publicly available tool that uses conversational AI to help businesses accurately predict and optimize the cost of cloud infrastructure.

December 03, 2024

Opsera has been accepted into the Amazon Web Services (AWS) Independent Software Vendor (ISV) Accelerate Program, a co-sell program for AWS Partners that provides software solutions that run on or integrate with AWS.

December 02, 2024

Spectro Cloud is a launch partner for the new Amazon EKS Hybrid Nodes feature debuting at AWS re:Invent 2024.

December 02, 2024

Couchbase unveiled Capella AI Services to help enterprises address the growing data challenges of AI development and deployment and streamline how they build secure agentic AI applications at scale.

December 02, 2024

Veracode announced innovations to help developers build secure-by-design software, and security teams reduce risk across their code-to-cloud ecosystem.

December 02, 2024

Traefik Labs unveiled the Traefik AI Gateway, a centralized cloud-native egress gateway for managing and securing internal applications with external AI services like Large Language Models (LLMs).

December 02, 2024

Generally available to all customers today, Sumo Logic Mo Copilot, an AI Copilot for DevSecOps, will empower the entire team and drastically reduce response times for critical applications.

December 02, 2024

iTMethods announced a strategic partnership with CircleCI, a continuous integration and delivery (CI/CD) platform. Together, they will deliver a seamless, end-to-end solution for optimizing software development and delivery processes.

November 26, 2024

Check Point® Software Technologies Ltd. has been recognized as a Leader and Fast Mover in the latest GigaOm Radar Report for Cloud-Native Application Protection Platforms (CNAPPs).

November 26, 2024

Spectro Cloud, provider of the award-winning Palette Edge™ Kubernetes management platform, announced a new integrated edge in a box solution featuring the Hewlett Packard Enterprise (HPE) ProLiant DL145 Gen11 server to help organizations deploy, secure, and manage demanding applications for diverse edge locations.

November 26, 2024

Red Hat announced the availability of Red Hat JBoss Enterprise Application Platform (JBoss EAP) 8 on Microsoft Azure.

November 26, 2024

Launchable by CloudBees is now available on AWS Marketplace, a digital catalog with thousands of software listings from independent software vendors that make it easy to find, test, buy, and deploy software that runs on Amazon Web Services (AWS).