3 Tips to Help DevOps Teams Cope With Demand for Feature Delivery Speed
February 05, 2020

Dave Karow
Split Software

The demand to deliver a consistently positive and innovative customer experience is something that many companies — more specifically, their DevOps teams — are currently grappling with.

Expectations from customers to have fresh new content, features and visuals have driven companies like Netflix to deploy hundreds of releases a month. But it's not just the big names like Walmart and Reddit who are feeling the pressure to deliver coding updates regularly. In fact, a recent DevOps survey of over 100 organizations conducted by Split Software showed that 67% are releasing new features every two weeks and nearly 20% are releasing new features daily. On top of that, the latest DORA report's results showed that of the organizations surveyed, 46% were releasing new features weekly. This is much faster than ever before.

While the ability to push out multiple features a week may appear as a great accomplishment for DevOps teams, the same survey showed that 82% commonly discover bugs in production. This may not seem like such a big issue, but with 40% of organizations stating that it takes them more than a day to resolve the problem and get back to normal, this can cause quite a bit of damage to an organization's reputation and bottom line.

In addition to the discovery of bugs after deployment, the recent DORA report showed that 23% of software changes fail in organizations that deploy code weekly, and in the DevOps survey of more than 100 organizations, 27% stated that they commonly experience downtime after releasing a feature.

According to IDC, one hour of downtime can cost upwards of $500,000. The survey revealed that 74% of teams take greater than one hour to detect issues with new features (38% take more than one day), and 41% of teams rollback or hotfix more than 10% of new features. Of those teams, roughly a third primarily do hotfixes (AKA "fail forward"), one-third do rollbacks and one-third do both. Most concerning, the mean time to resolve (MTTR) was greater than one hour for 88% and greater than one day for 40%  — a potential of millions of dollars in revenue loss from a single incident.

It's ironic that amidst all of this rush to push out features, 27% of the teams surveyed reported that new features were often poorly adopted or utilized, pointing to great waste amidst the rush.

The speed at which DevOps teams are deploying new features is unlikely to slow down. Instead, as consumer demand for a more efficient and innovative customer experience continues to grow, it may actually speed up. The following three tips could assist DevOps teams in handling the growing pressure for speed of deployment of new features while still ensuring what they release is not negatively impacting their users or their company.

1. Gradual Rollouts

Gradually rolling out a new feature can allow for bugs and issues to be detected earlier and greatly reduces the blast radius. Practical gradual rollouts include releasing the new feature to only internal users and/or beta testers, and then progressively to larger portions of users. Feature flags are a great tool to use for gradual rollouts, as they provide granular targeting of a release specific subsets of your users and changes to targeting can be made instantly without a new deployment.

2. Integrated Feature Monitoring

Integrated feature monitoring is when the application monitoring, error monitoring, and feature flags are tied together. It increases the speed and efficiency of detecting bugs and issues at an early stage. Integrated feature monitoring can both detect small changes in performance or errors and can assign a root cause to the feature at fault.

3. Avoid Unnecessary Work

It is important that DevOps teams focus their attention on factors that will have a true impact. Using experimentation can help. Using online experimentation to test the effectiveness of a new feature will ensure that the work put in by the DevOps teams into the development process is valuable.

While the recent survey showed that the need for speed in feature deployment is causing a decrease in the quality and efficiency of new features, there is still hope. DevOps teams are already moving quickly and consumers are used to this level of speed, so slowing down is not an option. But implementing the three tips above will help with reducing the numbers we see associated with bugs, issues, and downtime, resulting in better experiences for users and a better reputation for the company.

Dave Karow is the Continuous Delivery Evangelist at Split Software
Share this

Industry News

September 17, 2020

env0, a developer of Infrastructure-as-Code (IaC) management software, announced the availability of its new open source solution for Terraform users, Terratag.

September 17, 2020

Push Technology announced a partnership with Innova Solutions, an ACS Solutions company, specializing in global information technology services.

September 17, 2020

Alcide achieved the AWS Outposts Ready designation, part of the Amazon Web Services (AWS) Service Ready Program.

September 16, 2020

Portshift announced serverless container security support for AWS Fargate.

September 16, 2020

Sonatype and NeuVector announced a new integration that provides a comprehensive view of all Kubernetes and Container open source risk in one place.

September 16, 2020

Pure Storage entered into a definitive agreement to acquire Portworx, a Kubernetes data services platform enterprises trust to run mission-critical applications in containers in production.

September 15, 2020

OutSystems announced a series of new tools and capabilities that will empower organizations of all sizes to build applications quickly, build them right, and build them for the future.

September 15, 2020

VMware unveiled new offerings to help customers further accelerate their app and infrastructure modernization initiatives. VMware vSphere 7 Update 1, VMware vSAN 7 Update 1 and VMware Cloud Foundation 4.1 product releases streamline customer adoption of Kubernetes and support stateful applications with new developer-ready capabilities and enhance scalability and operations with new features.

September 15, 2020

Oracle announced the general availability of Java 15 (Oracle JDK 15).

September 14, 2020

Actifio announced a global alliance with Persistent Systems, a global solutions company with deep technology expertise, to help enterprises with data stack modernization and acceleration of digital transformation initiatives.

September 14, 2020

Perforce Software announced the release of the Helix TeamHub Command-Line Client (hth-cli).

September 14, 2020

StackRox secured an additional $26.5 million in funding.

September 10, 2020

JourneyApps announced the official launch of its OXIDE Integrated Development Environment (IDE) which ushers in a new paradigm of building, deploying and managing secure and powerful business applications.

September 10, 2020

Solo.io announced the WebAssembly OCI Image Specification, which defines a standard format for bundling and storing a Wasm module and its metadata as an OCI (Open Container Initiative) image in order to facilitate interoperability across different solutions.

September 10, 2020

Flexential announced new dedicated Hosted Private Cloud - vCenter Access capabilities that enable organizations to use industry-leading third-party tools to manage workloads and data protection requirements on a single, consolidated cloud platform.