What Our Industry Is Getting Wrong About DORA Metrics
July 25, 2023

Ori Keren

As engineering leaders, we've all become familiar with DORA metrics: deployment frequency, lead time for changes, change failure rate and mean time to restore. Many of us have looked to these metrics as how we measure the health and success of our engineering orgs.

In fact, our industry has started to view success through the lens of DORA metrics. That view is incomplete and, worse, often misunderstood. For a complete view on how to view DORA metrics and use them to improve engineering teams, we need to acknowledge some long-held misinterpretations.

3 Major Shortcomings for How Dora Is Being Used

1. Business leaders don't always understand how DORA metrics translate to business outcomes

If you've ever mentioned cycle time or deployment frequency to a non-technical leader, you'll immediately remember the blank stare you likely received in return. That's because these are still engineering metrics and non-engineering leaders don't necessarily understand — or care to understand — how the release of a tiny block of work to production helps you reach your monthly or quarterly business goals.

When we use DORA metrics, we aren't speaking about business outcomes. Business leaders want to know how quickly you're able to deliver a full feature, and they want reassurance that shipped features are meeting customer demands at the promised time.

2. Engineering improvement doesn't start with a deck

Having been a developer, I can confidently say developers tend to be interested in one thing: doing their job effectively without idle time in the middle.

When developers are expected to step out of their workflow to make connections between their work and business outcomes (as in when they're handed a deck tracking metrics like revenue and customer churn), it can be extremely frustrating.

We won't see true improvement in engineering organizations until we can quickly make those connections between developer experience and business success.

3. We're overlooking leading indicators of success

DORA metrics are fantastic at measuring lagging indicators of success. As an industry focused on these metrics, though, we're completely overlooking leading indicators — like the review process and pull-request size — that can help us make our teams and workflows quicker.

Bridging the Metrics Gap Between Engineering and Business Outcomes

While it may be difficult to directly connect engineering metrics to business metrics like revenue, there are a few metrics that can act as a bridge between engineering and business teams. These are metrics that focus on the speed at which you deliver new features and your ability to deliver on promises.

Although DORA metrics do not track follow-through or the speed at which new products ship, these metrics can reveal plenty about your engineering team's effectiveness. Here's how:

1. Investment Carvings

Investment Carvings show how much effort is going into a set of self-explanatory, predefined categories of resource deployment. These investment categories include things developers work on like Keeping the Lights On, Developer Experience, Feature Enhancements, and New Capabilities. They can help you understand where your team is compared to industry benchmarks and navigate the organization according to your needs.

2. Project Allocation

Project Allocation shows you what percent of your team is working on each project. This metric is critical to non-engineering leaders because it demonstrates that the team is prioritizing business-critical projects.

Meanwhile, it's critical to you because it provides the ability to say "no" or "not now" to projects of lower priority if your team's time is already spoken for. On top of that, it gives you ammo to ask for additional headcount if you spot gaps in labor allocation.

3. Project Planning Accuracy

Project Planning Accuracy speaks to how often you're able to deliver on promises. This metric is critical to business leaders because it proves they can count on your team to deliver on customer needs. It's critical to you because it shows you where you may be over-promising and under-delivering.

This metric is also one that works in harmony with DORA metrics — with deployment frequency, cycle time, change failure rate and mean time to restore — acting as leading indicators of Project Planning Accuracy.

Make Metrics Matter

As you begin measuring a wider breadth of metrics and bridging the gap between engineering success and the business at large, you'll quickly see engineering improvement, less hostility between engineering and other business functions, and ultimately happier customers and happier developers. Our industry has been using DORA metrics wrong.

Ori Keren is CEO and Co-Founder of LinearB
Share this

Industry News

December 06, 2023

ngrok unveiled its JavaScript and Python SDKs, enabling developers to programmatically serve their applications and manage traffic by embedding ingress with a single line of code.

December 06, 2023

Data Theorem introduced API Attack Path Visualization capabilities for the protection of APIs and the software supply chain.

December 05, 2023

Security Journey announced support for WCAG, SCIM and continued compliance with SOC2 Type 2, which are leading industry standards.

December 05, 2023

Vercel announced a new suite of features for its Developer Experience (DX) Platform, made for enterprise teams with large codebases.

December 04, 2023

Atlassian Corporation has completed the acquisition of Loom, a video messaging platform that helps users communicate through instantly shareable videos.

December 04, 2023

Orca Security announced that the Orca Cloud Security Platform has achieved the Amazon Web Services (AWS) Built-in Competency.

November 30, 2023

Parasoft, a global leader in automated software testing solutions, today announced complete support for MISRA C++ 2023 with the upcoming release of Parasoft C/C++test 2023.2.

November 30, 2023

Solo.io achieved the Amazon Elastic Kubernetes Service (Amazon EKS) Ready designation from Amazon Web Services (AWS).

November 29, 2023

CircleCI implemented a gen2 GPU resource class, leveraging Amazon Elastic Compute Cloud (Amazon EC2) G5 instances, offering the latest generation of NVIDIA GPUs and new images tailored for artificial intelligence/machine learning (AI/ML) workflows.

November 29, 2023

XM Cyber announced new capabilities that provide complete and continuous visibility into risks and vulnerabilities in Kubernetes environments.

November 29, 2023

PerfectScale has achieved the Amazon Elastic Kubernetes Service (Amazon EKS) Ready designation from Amazon Web Services (AWS).

November 28, 2023

BMC announced two new product innovations, BMC AMI DevX Code Insights and BMC AMI zAdviser Enterprise.

November 28, 2023

Rafay Systems announced the availability of the Rafay Cloud Automation Platform — the evolution of its Kubernetes Operations Platform — to enable platform teams to deliver automation and self-service capabilities to developers, data scientists and other cloud users.

November 28, 2023

Bitrise is integrating with Amazon Web Services (AWS) to provide compliance-conscious companies with greater access to CI/CD capabilities for mobile app development.

November 28, 2023

Armory announced a new unified declarative deployment capability for AWS Lambda.