Shift to Modern Software Delivery Creates Major Pain Point for DevOps Observability
July 26, 2018

Organizations are shifting away from traditional, monolithic architectures, with three-quarters of survey respondents delivering at least some of their applications and more than one-third delivering most of their applications as microservices, according to the
State of DevOps Observability Report from Scalyr.

Jump to Infographic Below

Practitioners are also delivering software more rapidly than ever, with 71 percent of engineers pushing code into production at least weekly and nearly one-third doing so at least once per day.

This transition has put pressure on DevOps observability. Despite having multiple visibility tools, respondents who deliver software in this modern way — delivering their applications as mostly microservices and pushing code more than once per day — say that most of their companies’ engineering time is spent troubleshooting and debugging software issues.

When it comes to log management, the capability respondents care most about is ad-hoc query speed. However, more than half of respondents who deliver software in this modern way spend the majority of their total investigation time waiting for queries to complete.

“Engineering teams have really upped their game, delivering software more quickly and efficiently than ever before,” said Steve Newman, CEO of Scalyr. “However, their modern approach puts increased pressure on monitoring and troubleshooting. Companies that are undergoing a transition to microservices and a rapid or continuous software delivery pipeline need to make sure their observability tools and processes can keep up.”

Key findings:

Companies are delivering software in a modern way:

■ Three-quarters of respondents deliver some and more than one-third deliver most of their applications as microservices.

■ 71 percent of engineers push code at least once per week, and nearly one-third push code at least once per day.

Companies rely on many tools for observability:

■ Nearly half of respondents have five or more observability tools.

■ 58 percent of respondents in a DevOps role have five or more such tools.

Engineering teams spend a lot of time troubleshooting:

■ 40 percent of respondents say their companies’ engineers spend most of their time troubleshooting software issues.

■ This percentage increases to 62 percent for respondents who deliver mostly microservices and 73 percent for those who push code at least once per day.

Ad-hoc query speed is the top log management requirement:

■ 54 percent of respondents care most about ad-hoc query speed in log management.

■ This number jumps to 61 percent for respondents who push code at least once per day and 68 percent for those who deliver mostly microservices.

■ Other top requirements include ability to parse and operate intelligently on complex logs and alert speed.

Respondents who deliver software in a modern way spend most of their investigation time waiting:

■ One-fourth of respondents spend most of their log management investigation time waiting for queries to complete.

■ This number jumps to 53 percent for respondents who deliver mostly microservices and 81 percent for those who push code at least once per day.

Methodology: Scalyr surveyed 155 practitioners between April 2 and May 31, 2018 to understand the latest software development observability practices.

Share this

Industry News

February 13, 2020

CyberArk announced the CyberArk Blueprint for Privileged Access Management Success, designed to help customers take a future-proof, phased and measurable approach to reducing privilege-related risk.

February 13, 2020

Cloudentity announced a partnership with Signal Sciences to provide a holistic approach for enterprise companies looking to secure their web applications and APIs.

February 13, 2020

OutSystems announced that the Portuguese government has agreed to co-finance €5.1 million through the Portugal 2020 economic development program for a pair of innovative research and development programs led by OutSystems.

February 12, 2020

Tata Consultancy Services (TCS) launched Jile 4.0, a major release of its on-the-cloud enterprise Agile DevOps platform that enables software teams to manage, automate and measure the end-to-end software delivery value stream from ideation to deployment.

February 12, 2020

Synopsys announced that on Feb. 18 it will release a major update to the Polaris Software Integrity Platform to extend its static application security testing (SAST) and software composition analysis (SCA) capabilities to the developer's desktop through the native integration of the Code Sight IDE plugin.

February 12, 2020

Tufin announced the availability of Tufin SecureCloud, a security policy automation service for enterprises needing to gain visibility and control of the security posture of their cloud-native and hybrid cloud environments.

February 11, 2020

Applause released its new Applause Accessibility Tool that automatically finds and fixes key accessibility issues earlier in the software development lifecycle.

February 11, 2020

Chef announced a new channel program specifically designed to ensure that partners and customers are able to take maximum advantage of Chef’s 100 percent open source business model.

February 11, 2020

IT Revolution announced the first round of speakers for DevOps Enterprise Summit London 2020.

February 10, 2020

Dynatrace announced new enhancements to its support for Kubernetes.

February 06, 2020

DevOps Institute announced its newly revamped Global Education Partner Program.

February 06, 2020

Automox raised $30 million in Series B funding.

February 05, 2020

Couchbase introduced Couchbase Cloud, a fully-managed Database-as-a-Service (DBaaS).

February 05, 2020

Univa announced the general availability of Navops Launch 2.0, its flagship cloud-automation platform, designed to help enterprises simplify the migration of HPC and AI workloads to their choice of cloud.

February 05, 2020

Fugue announced a Team plan to help cloud engineering teams collaborate and innovate faster and more securely.