How Healthy Are Your Apps? Data for Comparing Your App Stability with Industry Peers
February 08, 2021

James Smith

The importance of app stability cannot be overstated. Today, more consumers purchase items or services online and more employees use business apps as part of their day-to-day work. While B2C apps offer new ways for customers to engage with brands and help drive growing revenue, B2B apps offer enterprises the opportunity to modernize operations without significant training. In short, apps are more prevalent than ever in both our personal and work lives, so it's critical that organizations deliver an error-free app experience.

While stability is a KPI owned by engineering organizations and gaining ground, it has a significant impact on overall business performance and growth. Simply put, users can't stand it when an app stalls or crashes. One bad experience can lose someone forever. And with social media and app store reviews and ratings, that one bad experience can have a ripple effect that reaches more than just the original users, severely harming a business's bottom line.

To provide engineering teams with hard data on how their apps compare to others in the industry, Bugsnag recently announced the results of its new report, Application Stability Index: Are your Apps Healthy? In order to ensure accurate insights, we drew on a wealth of data, analyzing the performance of approximately 2,500 top mobile and web applications (as defined by session volume) within our customer base. This included data from eCommerce, media and entertainment, financial services, logistics and gaming companies, among other verticals. Hopefully, this data can serve as a benchmark to help engineering teams determine their own application stability SLAs and SLOs and provide guidance about when to build features vs. fix bugs based on the app's current stability.

We viewed the results from the lens of "five nines," the goal infrastructure and operations teams have for 99.999% app uptime and availability. From this vantage point, while the data showed the average mobile and web app have achieved strong stability scores, there's still room for improvement. Here's a deeper look at what we discovered about mobile and web app stability.

Mobile App Stability

The report evaluated apps from several mobile development platforms, including Android, iOS, React Native, and Unity. Stability scores were negatively impacted by session-ending events, which include things like crashes as well as ANRs (Application Not Responding) in Android, React Native, and Unity applications and OOMs (Out of Memory) in iOS applications.

Overall, the median stability score of mobile apps came in at 99.63%. This means that nearly one out of every 250 customers could be having a completely broken experience with a mobile application. Compared to the "five nines" standard, a median stability of 99.63% indicates that engineering organizations have a clear opportunity to commit more resources to measuring and improving app stability and customer experience.

Here's how the four mobile development platforms stacked up:

Android and iOS native applications tend to have a high median stability because there are very specialized developers working on these apps who have the expertise required to understand and address any stability issues effectively. Compared to iOS applications, Android apps tend to have a slightly lower median stability because Android presents a much less constrained development environment. Increased fragmentation of Android devices makes it more difficult to test applications whereas iOS development teams only need to provide a stable experience on a limited number of devices that Apple releases every year.

Web App Stability

The report evaluated five front-end development platforms, including Angular, Backbone, Ember, React, and Vue. Web stability score was determined by unhandled exceptions, such as a bug which prevents the entire page from rendering, an event handler bug which causes the user interaction to fail, an unhandled promise rejection warning, and others.

Overall, web apps had a median stability score of 99.39%, lower than mobile apps. The difference between web and mobile app stability may be driven by the fact that monitoring and addressing client-side issues in JavaScript applications generally requires more effort than doing so in mobile applications. Also, since mobile apps are newer, there's more of an emphasis on managing errors from the get-go, whereas web is an older discipline that had to learn this over time.

Angular, Ember, React, and Vue are modern, opinionated JavaScript frameworks that are built with consideration for error handling. Angular and React were created and sponsored by development teams at Google and Facebook. Engineering organizations working with these platforms have access to the resources and documentation they need to investigate and fix errors that may affect application stability. On the other hand, Backbone is an older and less opinionated web development framework. Dev teams don't have access to the same coding guidelines, best practices, and considerations for error handling that the other more recent development frameworks offer, which may explain the lower median stability and wider range for Backbone apps.

New Features Must be Balanced with App Stability

App stability plays a crucial role in driving broad business outcomes, impacting conversion rates, engagement, loyalty, developer productivity, and competitive advantage. While delivering new features at a steady pace is also extremely important, these features will provide little value if an app is frequently crashing. Organizations must balance the need for new functionality with the need for an error-free experience.

James Smith is Co-Founder and CEO of Bugsnag
Share this

Industry News

March 30, 2023

CloudBees announced the integration of CloudBees’ continuous delivery and release orchestration solution, CloudBees CD/RO, with Argo Rollouts.

March 30, 2023, a Mirantis company, announced that its fully-managed application delivery platform is available in AWS Marketplace.

March 30, 2023

env0 secured an additional $18.1 million of funding to conclude its Series A investment round with a total of $35.1 million.

March 29, 2023

Planview announced a new strategic collaboration with UiPath. The integration is designed to fuse the UiPath Business Automation Platform with the Planview Value Stream Management (VSM) solution Planview® Tasktop Hub.

March 29, 2023

Noname Security announced major enhancements to its API security platform to help organizations protect their API ecosystem, secure their applications, and increase cyber resilience.

March 28, 2023

Mirantis announced the latest version of Mirantis Container Cloud -- MCC 2.23 -- that simplifies operations with the ability to monitor applications performance with a new Grafana dashboard and to make updates to Kubernetes clusters with a one-click “upgrade” button from a web interface.

March 28, 2023

Pegasystems announced updates to Pega Cloud supported by an enhanced Global Operations Center to deliver a more scalable, reliable, and secure foundation for its suite of AI-powered decisioning and workflow automation solutions.

March 28, 2023

D2iQ announced the launch of DKP Gov, a new container-management solution optimized for deployment within the government sector.

March 28, 2023

StackHawk announced the availability of StackHawk Pro and StackHawk Enterprise for trial and purchase through the Amazon Web Services (AWS) Marketplace.

March 27, 2023

Octopus Deploy announced the results KinderSystems has seen working with Octopus. Through the use of Octopus, KinderSystems automates its software deployment processes to meet the complex needs of its customers and reduce the time to deploy software.

March 27, 2023

Elastic Path announced Integrations Hub, a library of instant-on, no-code integrations that are fully managed and hosted by Elastic Path.

March 27, 2023

Yugabyte announced key updates to YugabyteDB Managed, including the launch of the YugabyteDB Managed Command Line Interface (CLI).

March 23, 2023

Ambassador Labs released Telepresence for Docker, designed to make it easy for developer teams to build, test and deliver apps at scale across Kubernetes.

March 23, 2023

Fermyon Technologies introduced Spin 1.0, a major new release of the serverless functions framework based on WebAssembly.

March 23, 2023

Torc announced the acquisition of coding performance measurement application Codealike to empower software developers with even more data that increases skills, job opportunities and enterprise value.