Big Data and Cloud Problems Are an Employment Problem
February 16, 2016

Brad Kolarov
B23

Regardless of the industry, we are finding these days all businesses are becoming data businesses. To keep up with competition, companies need to collect and analyze data, gain insight on that data and act on that insight.

That's easier said than done. At the moment, many companies can't keep up with their data, let alone their competition. That's not a technology problem; it's an employee skillset problem.

The proliferation of data and the pace of innovation within the open source software ecosystem are driving the convergence of Big Data, Cloud Computing, and DevOps/Automation. Proficiency across these functional areas is essential in this rapidly evolving, converging IT environment. At the moment, however, there's a lack of qualified talent with these cross-disciplinary skills.

To an extent, the emergence of DevOps itself has led to a skills imbalance across disciplines.

In the recession of 2007–2009, business cost cutting led to many technical efficiencies. This included the migration from waterfall to agile development – which created the need for DevOps, bridging software engineering, technology operations and quality assurance. DevOps, therefore, emerged as an active and growing skillset (DevOps is the convergence of software development, IT Operations and Quality Assurance). Many technologists immersed themselves in the skills related to DevOps.

In fact, though, DevOps is only a subset in the much larger convergence of technical skills needed in today's data-centric business environment.

Here's the real need:


The center of these overlapping circles is where the real action is. But it's also a real challenge.

Finding qualified candidates who can work with Big Data (Hadoop, NoSQL, Storm, Kafka, etc.) tools is very difficult. Understanding Cloud (AWS, Azure, Google, etc.) is just as hard. Those with experience with DevOps/Automation (Chef/Puppet/Ansible/Salt, etc.) is a little easier but nonetheless challenging.

And it's not enough to have a certification in certain technology skills. Certification and experience are not synonymous. Of course, certifications are a great prerequisite, and a start towards a true cross-disciplinary skillset, but certifications are not necessarily an indicator of real world experience.

■ In Big Data, what's important is having built a production Big Data system. What's not is something like Hadoop Certification (nice but not essential).

■ In Cloud Computing, what's important is being able to use SDKs and APIs, and to implement with best practices in your coding. What's not is something like AWS Certification (nice but not essential).

■ In DevOps/Automation, what's important is being able to work with full stack automation. What's not is working with software installation scripts (do we even need to explain why that's not important?)

It's quite uncommon to have a great developer come to the table with all three of these skill sets. Softer skills are often a good indicator of future capability. For example, when our company hires new technology talent, the most desirable traits among our qualified candidates are  proven aptitude and motivation to learn.

As rare as it is to find people with the ability to work in today's converging technologies, it is still vitally important. Businesses with a shortage in these skills are definitely at a technical disadvantage compared with their better-heeled competitors.

For most companies, hiring individuals with these cross-disciplinary skills is not scalable. To level the playing field, businesses should create opportunities to gain these technology benefits.

Collaboration with integrators and consultants that have invested specifically in product and service offerings across the three disciplines of Big Data, Cloud and DevOps/Automation can go a long way to building real world capability in your own organization, without having to scale up in either internal cost or human resources.

Brad Kolarov is a Co-Founder and Managing Partner at B23.

The Latest

September 20, 2018

The latest Accelerate State of DevOps Report from DORA focuses on the importance of the database and shows that integrating it into DevOps avoids time-consuming, unprofitable delays that can derail the benefits DevOps otherwise brings. It highlights four key practices that are essential to successful database DevOps ...

September 18, 2018

To celebrate IT Professionals Day 2018 (this year on September 18), the SolarWinds IT Pro Day 2018: A World Powered by Tech Pros survey explores a "Tech PROactive" world where technology professionals have the time, resources, and ability to use their technology prowess to do absolutely anything ...

September 17, 2018

The role of DevOps in capitalizing on the benefits of hybrid cloud has become increasingly important, with developers and IT operations now working together closer than ever to continuously plan, develop, deliver, integrate, test, and deploy new applications and services in the hybrid cloud ...

September 13, 2018

"Our research provides compelling evidence that smart investments in technology, process, and culture drive profit, quality, and customer outcomes that are important for organizations to stay competitive and relevant -- both today and as we look to the future," said Dr. Nicole Forsgren, co-founder and CEO of DevOps Research and Assessment (DORA), referring to the organization's latest report Accelerate: State of DevOps 2018: Strategies for a New Economy ...

September 12, 2018

This next blog examines the security component of step four of the Twelve-Factor methodology — backing services. Here follows some actionable advice from the WhiteHat Security Addendum Checklist, which developers and ops engineers can follow during the SaaS build and operations stages ...

September 10, 2018

When thinking about security automation, a common concern from security teams is that they don't have the coding capabilities needed to create, implement, and maintain it. So, what are teams to do when internal resources are tight and there isn't budget to hire an outside consultant or "unicorn?" ...

September 06, 2018

In evaluating 316 million incidents, it is clear that attacks against the application are growing in volume and sophistication, and as such, continue to be a major threat to business, according to Security Report for Web Applications (Q2 2018) from tCell ...

September 04, 2018

There's a welcome insight in the 2018 Accelerate State of DevOps Report from DORA, because for the first time it calls out database development as a key technical practice which can drive high performance in DevOps ...

August 29, 2018

While everyone is convinced about the benefits of containers, to really know if you're making progress, you need to measure container performance using KPIs.These KPIs should shed light on how a DevOps team is faring in terms of important parameters like speed, quality, availability, and efficiency. Let's look at the specific KPIs to track for each of these broad categories ...

August 27, 2018

Protego Labs recently discovered that 98 percent of functions in serverless applications are at risk, with 16 percent considered "serious" ...

Share this