Maturity Metrics - Charting Your DevOps Progress
December 09, 2015

Aruna Ravichandran
CA Technologies

The application of maturity metrics to everything that we do in today's business environment frequently creates the requirement to perform difficult, far-reaching calculations.

It's not necessarily those measurements that span huge sets of complex data that present the most challenging prospects. Often, it's a compilation of those metrics that attempt to analyze the advancement of fuzzier, process-oriented initiatives that can leave one grasping for just the right analysis methods.

Attempting to weigh the current level of DevOps maturity within your organization is precisely one of those daunting propositions that can leave today's business and technology pros searching for meaningful answers.

Sure, there are some well-established metrics that can serve as inherent measurements of overall DevOps success, including deployment frequency rates, average lead times, meant time to recovery (MTTR), and of course, any figures resulting from dedicated Application Performance Monitoring (APM).

Yet, perhaps even more valuable than some of these numbers, or of greater import to practitioners for purposes of self-assessment, are metrics that help analyze precisely how ongoing DevOps adoption compares to similar efforts among peers.

At the end of the day, widely touted unicorns can publicize stunning evidence of their agile transformations, driven by DevOps methodologies; yet, for most organizations this is a long-term, iterative process aided greatly by some understanding of how they compare to less revolutionary examples.

After all, getting a feel for where you're ahead of the curve or behind the 8-ball might be just the thing to help DevOps-oriented teams offer evidence of progress, or the need for increased investment, the next time management comes looking for answers.

For instance, related to development, perhaps your teams are already actively tracking feature request lead times; but is there an agreement between business, dev and ops regarding the performance of critical services (transaction counts, performance, uptime, etc.) necessary to meet pre-defined business goals?

In the deployment arena, you likely have systems in place to note changes in frequency; however, does your organizational structure and tooling support cross-functional teams that put greater emphasis on the processes associated with releasing new capabilities, rather than supporting individual roles?

As far as management is concerned, you're probably employing APM to ensure improved visibility, response, uptime and availability. That said, is your monitoring able to distinguish the most critical and recurrent problems, and how they impact business services – without necessitating lengthy configuration and base-lining?

Take A DevOps Assessment

To help practitioners measure DevOps maturity, CA recently launched its latest online DevOps Assessment tool. Broken up into three short surveys covering key domains of the larger DevOps ecosystem – “Develop and Test”, “Release and Deploy”, and “Manage and Monitor” – this free survey offers detailed visibility into your organization's current state of process maturity.

The issues discussed in this blog are just a few of the specific questions encompassed by the 2016 iteration of the DevOps Assessment, updated to directly reflect the current trends that we hear about most frequently from real-world practitioners.

Perhaps the coolest element of the survey is that respondents are immediately presented with how their answers compare to those that have already completed the questionnaire. There's no waiting for some deep-dive report or heavily editorialized conclusions, or even the mandate for user registration. In terms of research, this is a model for continuous delivery.

Key metrics providing answers to important questions of DevOps maturity – how your organization compares to broader trends in adoption – await.

Click here, and take the new DevOps Assessment today!

Aruna Ravichandran is VP, Product & Solutions Marketing, DevOps, CA Technologies

The Latest

August 15, 2018

Microservices are a hot topic in IT circles these days. The idea of a modular approach to system building – where you have numerous, smaller software services that talk to each other instead of monolithic components – has many benefits ...

August 13, 2018

Agile is expanding within the enterprise. Agile adoption is growing within organizations, both more broadly and deeply, according to the 12th annual State of Agile report from CollabNet VersionOne. A higher percentage of respondents this year report that "all or almost all" of their teams are agile, and that agile principles and practices are being adopted at higher levels in the organization ...

August 09, 2018

For the past 13 years, the Ponemon Institute has examined the cost associated with data breaches of less than 100,000 records, finding that the costs have steadily risen over the course of the study. The average cost of a data breach was $3.86 million in the 2018 study, compared to $3.50 million in 2014 – representing nearly 10 percent net increase over the past 5 years of the study ...

August 08, 2018

Hidden costs in data breaches – such as lost business, negative impact on reputation and employee time spent on recovery – are difficult and expensive to manage, according to the 2018 Cost of a Data Breach Study, sponsored by IBM Security and conducted by Ponemon Institute. The study found that the average cost of a data breach globally is $3.86 million ...

August 06, 2018

The previous chapter in this WhiteHat Security series discussed dependencies as the second step of the Twelve-Factor App. This next chapter examines the security component of step three of the Twelve-Factor methodology — storing configurations within the environment.

August 02, 2018

Results from new Forrester Consulting research reveal the 20 most important Agile and DevOps quality metrics that separate DevOps/Agile experts from their less advanced peers ...

July 31, 2018

Even organizations that understand the importance of cybersecurity in theory often stumble when it comes to marrying security initiatives with their development and operations processes. Most businesses agree that everyone should be responsible for security, but this principle is not being upheld on a day-to-day basis in many organizations. That’s bad news for everyone. Here are some best practices for implementing SecOps ...

July 30, 2018

While the technologies, processes, and cultural shifts of DevOps have improved the ability of software teams to deliver reliable work rapidly and effectively, security has not been a focal point in the transformation of cloud IT infrastructure. SecOps is a methodology that seeks to address this by operationalizing and hardening security throughout the software lifecycle ...

July 26, 2018

Organizations are shifting away from traditional, monolithic architectures, with three-quarters of survey respondents delivering at least some of their applications and more than one-third delivering most of their applications as microservices, according to the State of DevOps Observability Report from Scalyr ...

July 24, 2018

What top considerations must companies make to ensure – or at least help improve – Agile at scale? The following are key techniques and practices to help accelerate Agile delivery rollouts and scale Agile and DevOps in the Enterprise ...

Share this