The Top 10% of Engineering Teams Have Gone Beyond Dora Metrics - Here's How
August 08, 2023

Ori Keren
LinearB

What makes an engineering team elite?

This is a question many technical leaders before me have been asked or asked themselves and one that I returned to often throughout my career. While I won't be the last to ask this question, our industry has come a long way in defining engineering excellence, providing parameters through which to define what constitutes as "elite."

But what exactly should you measure to benchmark elite engineering performance?

According to data sourced from nearly 2,000 engineering teams and 4.5 million branches, pull requests and merge requests in our engineering benchmarks report, elite teams — those within the top 10% — are great in 3 or more of these categories:

■ Cycle time under 42 hours

■ Coding time less than 30 minutes

■ Pickup time under 1 hour

■ Review time under 1 hour

■ Deploy time under 1 hour

■ Deployments on a daily basis

■ Fewer than 105 code changes in their pull requests (PRs)

■ Rework rate under 2%

■ Planning accuracy of 80% or more

■ Capacity accuracy above 85%

*Calculated using 75th percentile

Augmenting DORA metrics to measure excellence

You may have noticed these metrics aren't just the typical indicators of engineering performance: DORA metrics. These new metrics build on DORA to provide a more comprehensive view and fresher perspective on software delivery management by benchmarking metrics that translate into meaningful insights and create action.

We can measure all we want, but measurements are meaningless unless they ignite change in the behaviors of your engineering organization.

Yes, DORA metrics are a fantastic jumping-off point for benchmarking your engineering team. However, context is crucial when it comes to truly improving performance, and DORA metrics just don't provide enough information to chart a new course for your engineering ship on their own:

Three reasons to build on your DORA metrics

1. DORA metrics are lagging indicators

While understanding past performance through lagging indicators of success (like DORA metrics) is essential for engineering leaders, it isn't the most crucial aspect of performance to understand. Technical leaders must have a firm grip on leading indicators of success that actually foster proactivity and change in real-time, such as pull request size and coding time.

2. DORA metrics don't clearly connect to business impact

Even if we meet our goals according to the DORA metrics, we may still fail to deliver actual business value. How? Often, we simply aren't speaking the same language as our non-technical executive peers, setting us up for misalignment. Alternatively, metrics like planning accuracy allow engineering leaders to highlight their successes in a way that makes sense to the non-technical crowd. When this harmony is achieved, engineering success will align with business goals and customer needs, creating synergy between all stakeholders.

3. DORA metrics don't show us where to improve workflows

While DORA metrics measure progress in the software delivery lifecycle, they don't provide the context in workflows we need to adjust our performance proactively. Metrics like pull-request size and rework rate offer better context and real-time data around engineering improvement.

Adding elite engineering metrics to DORA metrics

As we look beyond DORA metrics, we can break down the benchmarks of an elite engineering team into three categories: delivery lifecycle, developer workflow and business alignment. These three categories work together to create a harmonious flow of proactive improvement and, ultimately, engineering excellence.

1. Delivery lifecycle benchmarks for elite engineering teams

There are five key metrics to look at when benchmarking the delivery lifecycle: cycle time, coding time, pickup time, review time and deploy time.

Cycle time — lead time for changes as a DORA metric — is one of my favorite engineering metrics because it gives such an overarching view of your delivery lifecycle. As you review the time it takes from first commit to release, you can optimize your processes to deliver new features to your customers faster by drilling down into coding time, pickup time, review time and deployment time.

BENCHMARK: Elite engineering teams see a cycle time of under 42 hours, with coding time under 30 minutes and pickup, review and deploy times under one hour.

2. Developer workflow benchmarks for elite engineering teams

Three key metrics help us measure developer workflow: Pull-request size, deploy frequency, and rework rate. Pull-request size (or merge requests) shows us the average code footprint of a change. Deploy frequency offers a deeper understanding of cycle time by measuring the frequency at which code is sent to production and enabling developers to complete a delivery end-to-end. Rework rate shows us the average code churn.

BENCHMARK: Elite engineering teams see fewer than 105 code changes in their pull requests, daily deployments, and a rework rate under 2%.

3. Business alignment benchmarks for elite engineering teams

Two metrics are king when it comes to business alignment benchmarks for elite engineering teams: planning accuracy and capacity accuracy. Planning accuracy demonstrates how often your team delivers on their promises. On the other hand, capacity accuracy illustrates your team's ability to deliver on unplanned work by measuring all completed work against planned work, delivering a ratio to hold your team accountable.

BENCHMARK: Elite engineering teams see planning accuracy of 80% or more and capacity accuracy above 85%.

Achieving elite status matters

I have come to understand that settling for "okay" isn't an option, especially in the current tech ecosystem. A recent report by StartupGenome indicated that 90% of startups unfortunately do not make it. Of the remaining 10% that do survive, only 15% exit for $50 million or more. These statistics are not shared to discourage, but to set a realistic picture of the competitive environment we find ourselves in.

While DORA metrics provide helpful snapshots of our work, they can't be the sole measure of elite engineering teams. We must look deeper into our everyday processes to set engineering benchmarks that help us achieve our status as engineering elites. If you haven't considered moving beyond DORA metrics, I encourage you to be the visionary in your engineering organization and initiate a discussion around implementing elite engineering benchmarks in your organization today.

Ori Keren is CEO and Co-Founder of LinearB
Share this

Industry News

December 06, 2023

ngrok unveiled its JavaScript and Python SDKs, enabling developers to programmatically serve their applications and manage traffic by embedding ingress with a single line of code.

December 06, 2023

Data Theorem introduced API Attack Path Visualization capabilities for the protection of APIs and the software supply chain.

December 05, 2023

Security Journey announced support for WCAG, SCIM and continued compliance with SOC2 Type 2, which are leading industry standards.

December 05, 2023

Vercel announced a new suite of features for its Developer Experience (DX) Platform, made for enterprise teams with large codebases.

December 04, 2023

Atlassian Corporation has completed the acquisition of Loom, a video messaging platform that helps users communicate through instantly shareable videos.

December 04, 2023

Orca Security announced that the Orca Cloud Security Platform has achieved the Amazon Web Services (AWS) Built-in Competency.

November 30, 2023

Parasoft, a global leader in automated software testing solutions, today announced complete support for MISRA C++ 2023 with the upcoming release of Parasoft C/C++test 2023.2.

November 30, 2023

Solo.io achieved the Amazon Elastic Kubernetes Service (Amazon EKS) Ready designation from Amazon Web Services (AWS).

November 29, 2023

CircleCI implemented a gen2 GPU resource class, leveraging Amazon Elastic Compute Cloud (Amazon EC2) G5 instances, offering the latest generation of NVIDIA GPUs and new images tailored for artificial intelligence/machine learning (AI/ML) workflows.

November 29, 2023

XM Cyber announced new capabilities that provide complete and continuous visibility into risks and vulnerabilities in Kubernetes environments.

November 29, 2023

PerfectScale has achieved the Amazon Elastic Kubernetes Service (Amazon EKS) Ready designation from Amazon Web Services (AWS).

November 28, 2023

BMC announced two new product innovations, BMC AMI DevX Code Insights and BMC AMI zAdviser Enterprise.

November 28, 2023

Rafay Systems announced the availability of the Rafay Cloud Automation Platform — the evolution of its Kubernetes Operations Platform — to enable platform teams to deliver automation and self-service capabilities to developers, data scientists and other cloud users.

November 28, 2023

Bitrise is integrating with Amazon Web Services (AWS) to provide compliance-conscious companies with greater access to CI/CD capabilities for mobile app development.

November 28, 2023

Armory announced a new unified declarative deployment capability for AWS Lambda.