3 Tips to Help DevOps Teams Cope With Demand for Feature Delivery Speed
February 05, 2020

Dave Karow
Split Software

The demand to deliver a consistently positive and innovative customer experience is something that many companies — more specifically, their DevOps teams — are currently grappling with.

Expectations from customers to have fresh new content, features and visuals have driven companies like Netflix to deploy hundreds of releases a month. But it's not just the big names like Walmart and Reddit who are feeling the pressure to deliver coding updates regularly. In fact, a recent DevOps survey of over 100 organizations conducted by Split Software showed that 67% are releasing new features every two weeks and nearly 20% are releasing new features daily. On top of that, the latest DORA report's results showed that of the organizations surveyed, 46% were releasing new features weekly. This is much faster than ever before.

While the ability to push out multiple features a week may appear as a great accomplishment for DevOps teams, the same survey showed that 82% commonly discover bugs in production. This may not seem like such a big issue, but with 40% of organizations stating that it takes them more than a day to resolve the problem and get back to normal, this can cause quite a bit of damage to an organization's reputation and bottom line.

In addition to the discovery of bugs after deployment, the recent DORA report showed that 23% of software changes fail in organizations that deploy code weekly, and in the DevOps survey of more than 100 organizations, 27% stated that they commonly experience downtime after releasing a feature.

According to IDC, one hour of downtime can cost upwards of $500,000. The survey revealed that 74% of teams take greater than one hour to detect issues with new features (38% take more than one day), and 41% of teams rollback or hotfix more than 10% of new features. Of those teams, roughly a third primarily do hotfixes (AKA "fail forward"), one-third do rollbacks and one-third do both. Most concerning, the mean time to resolve (MTTR) was greater than one hour for 88% and greater than one day for 40%  — a potential of millions of dollars in revenue loss from a single incident.

It's ironic that amidst all of this rush to push out features, 27% of the teams surveyed reported that new features were often poorly adopted or utilized, pointing to great waste amidst the rush.

The speed at which DevOps teams are deploying new features is unlikely to slow down. Instead, as consumer demand for a more efficient and innovative customer experience continues to grow, it may actually speed up. The following three tips could assist DevOps teams in handling the growing pressure for speed of deployment of new features while still ensuring what they release is not negatively impacting their users or their company.

1. Gradual Rollouts

Gradually rolling out a new feature can allow for bugs and issues to be detected earlier and greatly reduces the blast radius. Practical gradual rollouts include releasing the new feature to only internal users and/or beta testers, and then progressively to larger portions of users. Feature flags are a great tool to use for gradual rollouts, as they provide granular targeting of a release specific subsets of your users and changes to targeting can be made instantly without a new deployment.

2. Integrated Feature Monitoring

Integrated feature monitoring is when the application monitoring, error monitoring, and feature flags are tied together. It increases the speed and efficiency of detecting bugs and issues at an early stage. Integrated feature monitoring can both detect small changes in performance or errors and can assign a root cause to the feature at fault.

3. Avoid Unnecessary Work

It is important that DevOps teams focus their attention on factors that will have a true impact. Using experimentation can help. Using online experimentation to test the effectiveness of a new feature will ensure that the work put in by the DevOps teams into the development process is valuable.

While the recent survey showed that the need for speed in feature deployment is causing a decrease in the quality and efficiency of new features, there is still hope. DevOps teams are already moving quickly and consumers are used to this level of speed, so slowing down is not an option. But implementing the three tips above will help with reducing the numbers we see associated with bugs, issues, and downtime, resulting in better experiences for users and a better reputation for the company.

Dave Karow is the Continuous Delivery Evangelist at Split Software
Share this

Industry News

November 29, 2022

Codenotary announced TrueSBOM for Serverless, a self-updating Software Bill of Materials (SBOM) for applications running on AWS Lamda, Google Cloud Functions and Microsoft Azure Functions that is made possible by simply adding one line to the application source code.

November 29, 2022

Code Intelligence announced its open-source Command-Line Interface (CLI) tool, CI Fuzz CLI, now allows Java developers to easily incorporate fuzz testing into their existing JUnit setup in order to find functional bugs and security vulnerabilities at scale.

November 29, 2022

Parasoft announced the 2022.2 release of Parasoft C/C++test with support for MISRA C:2012 Amendment 3 and a draft version of MISRA C++ 202x.

November 28, 2022

Kasm Technologies announced the release of Kasm Workspaces v1.12, providing major enhancements to its portfolio of digital workspaces delivering Desktop as a Service (DaaS), Virtualized Desktop Infrastructure (VDI), Remote Browser Isolation (RBI), Open-Source Intelligence Collection (OSINT), Training/Sandboxes, and Containerized Application Streaming (CAS).

November 28, 2022

Cloud4C has achieved Amazon Web Services (AWS) DevOps Competency status.

November 28, 2022

Simplilearn has acquired Fullstack Academy, for an all-cash transaction.

November 22, 2022

Red Hat introduced Red Hat Enterprise Linux 9.1and Red Hat Enterprise Linux 8.7.

November 22, 2022

Armory announced its new cloud-based solution called Continuous Deployment-as-a-Service, now available on the AWS Marketplace.

November 22, 2022

Rapid has has formally rebranded Paw to RapidAPI for Mac.

November 21, 2022

Red Hat announced the general availability of Migration Toolkit for Applications 6, based on the open source project Konveyor, aimed at helping customers accelerate large-scale application modernization efforts.

November 21, 2022

Palo Alto Networks signed a definitive agreement to acquire Cider Security (Cider).

November 17, 2022

OutSystems announced its new cloud-native development solution OutSystems Developer Cloud (ODC).

November 17, 2022

Retool announced Retool Workflows, a fast, extensible way for developers to build cron jobs, scheduled notifications, ETL tasks, and everything in between.

November 15, 2022

OutSystems announced the new OutSystems AI Mentor System.

November 15, 2022

Redpanda launched the general availability of its Redpanda Cloud managed service.