3 Tips to Help DevOps Teams Cope With Demand for Feature Delivery Speed
February 05, 2020

Dave Karow
Split Software

The demand to deliver a consistently positive and innovative customer experience is something that many companies — more specifically, their DevOps teams — are currently grappling with.

Expectations from customers to have fresh new content, features and visuals have driven companies like Netflix to deploy hundreds of releases a month. But it's not just the big names like Walmart and Reddit who are feeling the pressure to deliver coding updates regularly. In fact, a recent DevOps survey of over 100 organizations conducted by Split Software showed that 67% are releasing new features every two weeks and nearly 20% are releasing new features daily. On top of that, the latest DORA report's results showed that of the organizations surveyed, 46% were releasing new features weekly. This is much faster than ever before.

While the ability to push out multiple features a week may appear as a great accomplishment for DevOps teams, the same survey showed that 82% commonly discover bugs in production. This may not seem like such a big issue, but with 40% of organizations stating that it takes them more than a day to resolve the problem and get back to normal, this can cause quite a bit of damage to an organization's reputation and bottom line.

In addition to the discovery of bugs after deployment, the recent DORA report showed that 23% of software changes fail in organizations that deploy code weekly, and in the DevOps survey of more than 100 organizations, 27% stated that they commonly experience downtime after releasing a feature.

According to IDC, one hour of downtime can cost upwards of $500,000. The survey revealed that 74% of teams take greater than one hour to detect issues with new features (38% take more than one day), and 41% of teams rollback or hotfix more than 10% of new features. Of those teams, roughly a third primarily do hotfixes (AKA "fail forward"), one-third do rollbacks and one-third do both. Most concerning, the mean time to resolve (MTTR) was greater than one hour for 88% and greater than one day for 40%  — a potential of millions of dollars in revenue loss from a single incident.

It's ironic that amidst all of this rush to push out features, 27% of the teams surveyed reported that new features were often poorly adopted or utilized, pointing to great waste amidst the rush.

The speed at which DevOps teams are deploying new features is unlikely to slow down. Instead, as consumer demand for a more efficient and innovative customer experience continues to grow, it may actually speed up. The following three tips could assist DevOps teams in handling the growing pressure for speed of deployment of new features while still ensuring what they release is not negatively impacting their users or their company.

1. Gradual Rollouts

Gradually rolling out a new feature can allow for bugs and issues to be detected earlier and greatly reduces the blast radius. Practical gradual rollouts include releasing the new feature to only internal users and/or beta testers, and then progressively to larger portions of users. Feature flags are a great tool to use for gradual rollouts, as they provide granular targeting of a release specific subsets of your users and changes to targeting can be made instantly without a new deployment.

2. Integrated Feature Monitoring

Integrated feature monitoring is when the application monitoring, error monitoring, and feature flags are tied together. It increases the speed and efficiency of detecting bugs and issues at an early stage. Integrated feature monitoring can both detect small changes in performance or errors and can assign a root cause to the feature at fault.

3. Avoid Unnecessary Work

It is important that DevOps teams focus their attention on factors that will have a true impact. Using experimentation can help. Using online experimentation to test the effectiveness of a new feature will ensure that the work put in by the DevOps teams into the development process is valuable.

While the recent survey showed that the need for speed in feature deployment is causing a decrease in the quality and efficiency of new features, there is still hope. DevOps teams are already moving quickly and consumers are used to this level of speed, so slowing down is not an option. But implementing the three tips above will help with reducing the numbers we see associated with bugs, issues, and downtime, resulting in better experiences for users and a better reputation for the company.

Dave Karow is the Continuous Delivery Evangelist at Split Software
Share this

Industry News

October 03, 2023

Parasoft announced new advancements in its Continuous Quality Platform for functional solutions, which include Parasoft Virtualize, SOAtest, CTP, and DTP.

The latest releases introduce capabilities including:

- GenAI integration for API testing

- Comprehensive microservices code coverage

- Web accessibility testing

- Powerful learning mode for creating and updating virtual assets

These innovations are set to transform the landscape of software testing for enterprise application development and test teams.

October 03, 2023

LinearB announced the release of free DORA Metrics dashboards.

October 03, 2023

PerfectScale, a provider of Kubernetes optimization, has successfully closed $7.1 million in seed funding.

October 02, 2023

Spectro Cloud announced Palette EdgeAI to simplify how organizations deploy and manage AI workloads at scale across simple to complex edge locations, such as retail, healthcare, industrial automation, oil and gas, automotive/connected cars, and more.

September 28, 2023

Kong announced Kong Konnect Dedicated Cloud Gateways, the simplest and most cost-effective way to run Kong Gateways in the cloud fully managed as a service and on enterprise dedicated infrastructure.

September 28, 2023

Sisense unveiled the public preview of Compose SDK for Fusion.

September 28, 2023

Cloudflare announced Hyperdrive to make every local database global. Now developers can easily build globally distributed applications on Cloudflare Workers, the serverless developer platform used by over one million developers, without being constrained by their existing infrastructure.

September 27, 2023

Kong announced full support for Kong Mesh in Konnect, making Kong Konnect an API lifecycle management platform with built-in support for Kong Gateway Enterprise, Kong Ingress Controller and Kong Mesh via a SaaS control plane.

September 27, 2023

Vultr announced the launch of the Vultr GPU Stack and Container Registry to enable global enterprises and digital startups alike to build, test and operationalize artificial intelligence (AI) models at scale — across any region on the globe. \

September 27, 2023

Salt Security expanded its partnership with CrowdStrike by integrating the Salt Security API Protection Platform with the CrowdStrike Falcon® Platform.

September 26, 2023

Progress announced a partnership with Software Improvement Group (SIG), an independent technology and advisory firm for software quality, security and improvement, to help ensure the long-term maintainability and modernization of business-critical applications built on the Progress® OpenEdge® platform.

September 26, 2023

Solace announced a new version of its Solace Event Portal solution that gives organizations with Apache Kafka deployments better visibility into, and control over, their Kafka event streams, brokers and associated assets.

September 26, 2023

Reply launched a proprietary framework for generative AI-based software development, KICODE Reply.

September 26, 2023

Harness announced the industry-wide Engineering Excellence Collective™, an engineering leadership community.

September 25, 2023

Harness announced four new product modules on the Harness platform.