|By John Cowan||
|September 9, 2012 12:00 PM EDT||
This is Part IV in a series by 6fusion Co-founder and CEO John Cowan on the emerging trend of Cloud Brokerage and the impact it will have on the technology industry and markets. Be sure to check out Part I of the series here, Part II here, and Part III here.
The IT industry to me looks a lot like the commercial airline industry did many years ago and I think the latter is rife with lessons about the power of a true commodity market.
For those of you keeping score, late last year American Airlines’ parent AMR declared bankruptcy. The Chapter 11 filing of the once largest airline in the world brought to a conclusion the era of disintegration for the legacy commercial airline market. You can argue about the principal cause for the airline industry’s demise, but ultimately it came down to the fact that the market leaders in the industry refused to adapt to the changes going on around it while others embraced it and found creative ways to rise to the top.
Flying around on airplanes became a mass-market product over the last 40 years. And with a mass market product comes mass market demands – particularly around pricing. Incumbent airlines had the benefit of established market share but the trouble of managing a return on investment in infrastructure in a changing financial dynamic. The signs were there in the 1990’s but the dramatic collapse really took place over the last 10 years or so, which I will come back to later.
The cloud computing industry is structured and organized very much like the airline industry in the years leading up to its rapid disintegration. There are a handful of incumbents that some say are untouchable and then there’s everybody else in the market.
Amazon Web Services (AWS) is one such incumbent.
Competitors to AWS are really not unlike the competitors in the airline industry. Competition centers on squeezing more value into the same dollar with hopes of swaying customer loyalty. This is further compounded by the arrival of new entrants aggressively positioned to challenge the market leaders. I see no difference between the airline that boasts three extra inches of legroom in coach and the cloud operator that boasts an extra 9 on an SLA. This is simply the nature of an increasingly competitive market.
Let me get back to the dramatic collapse of the airline industry for a moment.
After careful examination of the commodity market demand, Southwest Airlines determined the answer to challenging its industry peers had little to do with product innovation. Instead, it had much more to do with financial innovation. How did they do this? Among some other things, they began a sophisticated program to hedge their projected jet fuel consumption. Hedging jet fuel was nothing new to the industry, but Southwest made it the centerpiece of an operating strategy. If you want, you can read an extended analysis of the Southwest case study here. In short, their strategy allowed them to accurately forecast their future costs, and hence offer aggressive pricing to undercut the market, whilst remaining profitable in a market forcibly applying downward pricing pressure. It was a commodity market that allowed Southwest to give the market what it wanted – a low cost, no frills flying experience.
For an airline, Southwest’s strategy is about as radical as it gets.
It is telling at this point to illustrate the reaction of the incumbent vendors in the industry when Southwest made its move. “I don’t think any sensible airline believes that by hedging it saves on its fuel bills,” they said.
As history proved, they totally missed the point.
Southwest had worked out that it could employ hedging strategies to make the derivatives market for jet fuel work in its favor. They dramatically reorganized their financial operation in order to turn the process of commoditization into a dangerous market weapon.
Which brings me back to the subject of compute, network and storage resources. If a derivatives market for jet fuel could underpin the upheaval of the airline business, could the same thing be possible in the market for cloud computing? Not only do I think it possible, I believe it is going to happen.
Not too long ago I was chatting with Joe Weinman, author of Cloudonomics, in his Manhattan office. As I explained my perspective on the industry we both spend a lot of our time thinking about he interrupted me to ask if I had ever heard of Dr. James Mitchell. I hadn’t. James, as it turns out, is a former Morgan Stanley commodities trader who now runs what would appear to be the world’s first “cloud broker-dealer”.
Something James is not is a “technology guy”. Doctorate in physics, yes – IT background, not so much. As far as he is concerned, cloud computing infrastructure as a service is just another commodity like electricity, coal, oil or potatoes, and should be treated as such.
Sound familiar? In Part II: The Cloud Vendor and the Agnostic Intermediary I characterized the evolution of the cloud brokerage model as one that would see two distinct groups playing a role: Those that dealt with the business of compute and those that dealt with the technical organization of compute.
When I met him he expressed his frustration at having to trade compute, network and storage resources in an inefficient manner because each providers’ cloud offering was separated by qualitative differentiation. You trade a “barrel of oil”, a “kWh of electricity” or a “kilogram of coal”. “So what is the unit of cloud computing?” he asked. He made the reverse of the usual analogy between electricity and cloud computing. He said, “can you imagine letting your electricity supplier bill you for your electricity using a measurement that they have made, using a meter that they invented, and then quoting it to you in a unit that they have pulled out of thin air, that cannot be compared to their competitors? Ridiculous!”
James and I agree on two fundamental principles on which the future of the cloud industry will be based.
The first is that cloud brokering has little to do with technology. Let’s consider an illustration of my point (techie readers, you might want to tune out for a moment). Provided that there is an independent third party who is able to measure what gets consumed on various different cloud providers, then it is possible to calculate a reference price for a reference quantity. Even if what a customer actually uses is different from the standard measurement, this does not matter as the variation in the different pricing between a “special” cloud infrastructure and a “standard” cloud infrastructure will vary slowly compared to the price for the “standard” cloud infrastructure. This is akin to proxy hedging a particular type of coal with a financial settlement on an API-2 index price for standard coal delivered in, say, Amsterdam (to give a very specific analogy).
The second is that the capability to trade cloud like a real commodity will create a world where the immovable IT asset can become movable for the first time in history. IT is arguably among the single biggest sunk cost in any modern enterprise and the albatross that hobbles disrupters from challenging market incumbents in the emerging cloud computing industry. As I illustrated in Part III: The Market Unified, more than $1 Trillion is spent every year on compute, network and storage resources. Nearly all of this spend is done in a fixed capitalization structure that sits on the balance sheet for years.
Every business that consumes a significant commodity resource speculates and hedges its overall position. It is clear to me that if the opportunity to establish liquidity in IT becomes real for the modern enterprise and market brokers, compute, network and storage resources will become to the emerging service provider what jet fuel is to an airline operator. And when that happens, you will want to be Southwest, not AMR. This is a reality that few cloud incumbents see coming and, like the once powerful commercial airliners, a dynamic few will choose to embrace.
A commodity exchange cannot exist without transaction velocity and price volatility, and brokers do just that in any other example. This is precisely why the role of “cloud broker” will become so important in the years ahead. This is why, as I’ve stated so often in the past, “the future of the cloud brokerage belongs to a new cadre of agnostic intermediaries that will enable a true utility computing marketplace to flourish.” And when the modern enterprise or resource supplier can apply the principles of financial trading to the IT industry we are going to see a force capable of completely redefining everything we currently think we know about the business of technology delivery.
Considering that new thinkers like Dr. James Mitchell are already on the scene I wouldn’t go making any bets that what we see is merely a distant future.
This recent research on cloud computing from the Register delves a little deeper than many of the "We're all adopting cloud!" surveys we've seen. They found that meaningful cloud adoption and the idea of the cloud-first enterprise are still not reality for many businesses. The Register's stats also show a more gradual cloud deployment trend over the past five years, not any sort of explosion. One important takeaway is that coherence across internal and external clouds is essential for IT right n...
Apr. 25, 2017 12:15 PM EDT Reads: 1,580
Back in February of 2017, Andrew Clay Schafer of Pivotal tweeted the following: “seriously tho, the whole software industry is stuck on deployment when we desperately need architecture and telemetry.” Intrigue in a 140 characters. For me, I hear Andrew saying, “we’re jumping to step 5 before we’ve successfully completed steps 1-4.”
Apr. 25, 2017 11:15 AM EDT Reads: 1,622
Enterprise architects are increasingly adopting multi-cloud strategies as they seek to utilize existing data center assets, leverage the advantages of cloud computing and avoid cloud vendor lock-in. This requires a globally aware traffic management strategy that can monitor infrastructure health across data centers and end-user experience globally, while responding to control changes and system specification at the speed of today’s DevOps teams. In his session at 20th Cloud Expo, Josh Gray, Chie...
Apr. 25, 2017 06:30 AM EDT Reads: 3,140
In his session at 20th Cloud Expo, Scott Davis, CTO of Embotics, will discuss how automation can provide the dynamic management required to cost-effectively deliver microservices and container solutions at scale. He will discuss how flexible automation is the key to effectively bridging and seamlessly coordinating both IT and developer needs for component orchestration across disparate clouds – an increasingly important requirement at today’s multi-cloud enterprise.
Apr. 25, 2017 06:00 AM EDT Reads: 4,316
To more closely examine the variety of ways in which IT departments around the world are integrating cloud services, and the effect hybrid IT has had on their organizations and IT job roles, SolarWinds recently released the SolarWinds IT Trends Report 2017: Portrait of a Hybrid Organization. This annual study consists of survey-based research that explores significant trends, developments, and movements related to and directly affecting IT and IT professionals.
Apr. 25, 2017 05:30 AM EDT Reads: 1,585
Developers want to create better apps faster. Static clouds are giving way to scalable systems, with dynamic resource allocation and application monitoring. You won't hear that chant from users on any picket line, but helping developers to create better apps faster is the mission of Lee Atchison, principal cloud architect and advocate at New Relic Inc., based in San Francisco. His singular job is to understand and drive the industry in the areas of cloud architecture, microservices, scalability ...
Apr. 25, 2017 05:00 AM EDT Reads: 3,392
Keeping pace with advancements in software delivery processes and tooling is taxing even for the most proficient organizations. Point tools, platforms, open source and the increasing adoption of private and public cloud services requires strong engineering rigor – all in the face of developer demands to use the tools of choice. As Agile has settled in as a mainstream practice, now DevOps has emerged as the next wave to improve software delivery speed and output. To make DevOps work, organization...
Apr. 25, 2017 03:15 AM EDT Reads: 8,845
In his general session at 19th Cloud Expo, Manish Dixit, VP of Product and Engineering at Dice, discussed how Dice leverages data insights and tools to help both tech professionals and recruiters better understand how skills relate to each other and which skills are in high demand using interactive visualizations and salary indicator tools to maximize earning potential. Manish Dixit is VP of Product and Engineering at Dice. As the leader of the Product, Engineering and Data Sciences team at D...
Apr. 25, 2017 03:00 AM EDT Reads: 5,874
Is your application too difficult to manage? Do changes take dozens of developers hundreds of hours to execute, and frequently result in downtime across all your site’s functions? It sounds like you have a monolith! A monolith is one of the three main software architectures that define most applications. Whether you’ve intentionally set out to create a monolith or not, it’s worth at least weighing the pros and cons of the different architectural approaches and deciding which one makes the most s...
Apr. 24, 2017 09:00 PM EDT Reads: 2,683
Cloud Expo, Inc. has announced today that Aruna Ravichandran, vice president of DevOps Product and Solutions Marketing at CA Technologies, has been named co-conference chair of DevOps at Cloud Expo 2017. The @DevOpsSummit at Cloud Expo New York will take place on June 6-8, 2017, at the Javits Center in New York City, New York, and @DevOpsSummit at Cloud Expo Silicon Valley will take place Oct. 31-Nov. 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
Apr. 24, 2017 07:15 PM EDT Reads: 2,466
In large enterprises, environment provisioning and server provisioning account for a significant portion of the operations team's time. This often leaves users frustrated while they wait for these services. For instance, server provisioning can take several days and sometimes even weeks. At the same time, digital transformation means the need for server and environment provisioning is constantly growing. Organizations are adopting agile methodologies and software teams are increasing the speed ...
Apr. 23, 2017 08:00 PM EDT Reads: 3,260
Software as a service (SaaS), one of the earliest and most successful cloud services, has reached mainstream status. According to Cisco, by 2019 more than four-fifths (83 percent) of all data center traffic will be based in the cloud, up from 65 percent today. The majority of this traffic will be applications. Businesses of all sizes are adopting a variety of SaaS-based services – everything from collaboration tools to mission-critical commerce-oriented applications. The rise in SaaS usage has m...
Apr. 22, 2017 06:15 PM EDT Reads: 4,758
The proper isolation of resources is essential for multi-tenant environments. The traditional approach to isolate resources is, however, rather heavyweight. In his session at 18th Cloud Expo, Igor Drobiazko, co-founder of elastic.io, drew upon his own experience with operating a Docker container-based infrastructure on a large scale and present a lightweight solution for resource isolation using microservices. He also discussed the implementation of microservices in data and application integrat...
Apr. 22, 2017 05:45 AM EDT Reads: 6,124
We'd all like to fulfill that "find a job you love and you'll never work a day in your life" cliché. But in reality, every job (even if it's our dream job) comes with its downsides. For you, the constant fight against shadow IT might get on your last nerves. For your developer coworkers, infrastructure management is the roadblock that stands in the way of focusing on coding. As you watch more and more applications and processes move to the cloud, technology is coming to developers' rescue-most r...
Apr. 22, 2017 04:00 AM EDT Reads: 4,032
2016 has been an amazing year for Docker and the container industry. We had 3 major releases of Docker engine this year , and tremendous increase in usage. The community has been following along and contributing amazing Docker resources to help you learn and get hands-on experience. Here’s some of the top read and viewed content for the year. Of course releases are always really popular, particularly when they fit requests we had from the community.
Apr. 22, 2017 03:45 AM EDT Reads: 3,517
Today we can collect lots and lots of performance data. We build beautiful dashboards and even have fancy query languages to access and transform the data. Still performance data is a secret language only a couple of people understand. The more business becomes digital the more stakeholders are interested in this data including how it relates to business. Some of these people have never used a monitoring tool before. They have a question on their mind like “How is my application doing” but no id...
Apr. 21, 2017 11:45 PM EDT Reads: 7,090
Even for the most seasoned IT pros, the cloud is complicated. It can be difficult just to wrap your head around the many terms and acronyms that make up the cloud dictionary-not to mention actually mastering the technology. Unfortunately, complicated cloud terms are often combined to the point that their meanings are lost in a sea of conflicting opinions. Two terms that are used interchangeably (but shouldn't be) are hybrid cloud and multicloud. If you want to be the cloud expert your company ne...
Apr. 21, 2017 04:15 PM EDT Reads: 2,210
SYS-CON Events announced today that CollabNet, a global leader in enterprise software development, release automation and DevOps solutions, will be a Bronze Sponsor of SYS-CON's 20th International Cloud Expo®, taking place from June 6-8, 2017, at the Javits Center in New York City, NY. CollabNet offers a broad range of solutions with the mission of helping modern organizations deliver quality software at speed. The company’s latest innovation, the DevOps Lifecycle Manager (DLM), supports Value S...
Apr. 18, 2017 03:30 PM EDT Reads: 4,375
The human body is the most complex machine ever created! With a complex network of interconnected organs, millions of cells and the most advanced processor, human body is the most automated system in this planet. In this article, we will draw comparisons between working of a human body to that of a datacenter. We will learn how self-defense and self-healing capabilities of our human body is similar to firewalls and intelligent monitoring capabilities in our datacenters. We will draw parallels b...
Apr. 16, 2017 01:00 PM EDT Reads: 2,753
Cloud adoption is often driven by a desire to increase efficiency, boost agility and save money. All too often, however, the reality involves unpredictable cost spikes and lack of oversight due to resource limitations. In his session at 20th Cloud Expo, Joe Kinsella, CTO and Founder of CloudHealth Technologies, will tackle the question: “How do you build a fully optimized cloud?” He will examine: Why TCO is critical to achieving cloud success – and why attendees should be thinking holisticall...
Apr. 16, 2017 10:00 AM EDT Reads: 2,888