Click here to close now.


Microservices Expo Authors: Yeshim Deniz, Jason Bloomberg, Carmen Gonzalez, Elizabeth White, Liz McMillan

Blog Feed Post

Cloud Brokerage and the Future of the IT Utility

Abstract:  Cloud Brokerage is an emerging trend in the broader cloud computing industry.  Opinions differ widely about what it means to be a broker and the significance brokers will have on the future of the industry as a whole.    The reality is that the brokerage model signals the real potential to commoditize the compute utility, which will climax with the genesis of compute as a tradable commodity like soybeans, oil or minerals.  In this four part series we will take a deep dive into the concept of cloud brokerage and connect the dots between the key trends and market demands that will shape a force few in the industry see coming and fewer still are prepared to accept.

Part I:  The Analysts Weigh In

The National Institute of Standards and Technology (NIST) has established a working paper on the subject of cloud brokerage, signaling the importance of a movement that is taking shape inside the cloud computing industry as a whole.

The NIST working document describes the Cloud Brokerage success criteria as follows:

cloud-user wishes to carry out an action on cloud-provider-1 using a federated interface, with no direct knowledge of cloud-provider-1 commands or interfaces. A cloud-management-broker offers the cloud-user a federated interface to multiple cloud-providers through a human user interface, an application programming interface or both.  The cloud-user selects desired cloud-provider-1 resources, action and action parameters using the cloud-management-broker interface.  The cloud-management-broker collects and marshals the selected action and parameters from the cloud-user‘s selection and issues the desired command to cloud-provider-1 using cloud-provider-1 native interface.

The idea of cloud brokerage warranted enough noise to be covered in detail within the analyst community in 2011.   However, depending with whom you subscribe, cloud brokerage has very different meanings.  While there has been definite progress on the behalf of the analyst community, I think the potential for what this model could mean for the cloud computing market goes much deeper.

To be clear, I believe the role of what I am calling the “infrastructure broker” will be the most significant movement in the computing industry since the advent of virtualization and cloud.

Before I get into the immense complexities of that statement, let’s take a look a few perspectives from key industry analysts:


According to Gartner research expert Benoit Lheureux, the role of the Cloud Service Broker (CSB) is to “aggregate and add value to cloud services by providing a single point of entry to different types of cloud services.”   Gartner goes on to illustrate some key defining characteristics of a cloud broker.  According to Gartner, a CSB is a CSB if they genuinely perform:

  • Aggregation across VARS and IT Distributors
  • Integration with Systems Integrators
  • Customization for SI’s and Professional Services organizations

Gartner’s definition of Cloud Brokerage is by far the lightest among the analysts.  If you believe Lheureux, Cloud Brokerage is really just the modernization of the IT channel.

451 Group:

451 generally consider the category of CSB a part of broader market called cloud on-ramps.   In addition to providing some sort of provisioning technology, CSBs differ “in that they provide a value-added economic function, which matches workloads to the best execution venues.”

While I think 451 only provides cursory attention to cloud brokerage as a concept, the are at least more directionally correct in the sense that they see Brokerage providing a level of sophistication that is unique in the delivery of cloud services – namely the concept of ‘workload matching’.


I think Forrester has done the best job among the research outfits when it comes to taking a seriously deep look at the CSB market definition.   Forrester sees the CSBCloud Value Propositionsplaying a pivotal role in the future of the entire industry.   Analyst Stefan Reid’s taxonomy picture does a fantastic job of identifying the interaction of different players.

According to Forrester, “the simple broker model gains value only by comparing similar cloud provider options and using dynamic provisioning based on the actual spot prices of these resources.”  This sounds similar to 451 and Gartner in direction and tone.

But Forrester goes on to elaborate on what they see the as the evolution of the brokerage model.  “The full broker [model] goes far beyond [the simple broker].  It uses “cloud bursting” to provide IT users with higher value for a lower price.”  Cloud Bursting, Forrester explains, “is the dynamic relocation of workloads from private environments to cloud providers and vice versa.”   I’ll admit a slight sigh when I hear the cloud ‘bursting’ term (again), but I think Forrester has a great grasp on the technical role of the broker.

Gartner sees brokering as little more than modern distribution.   451 sees the concept as something they instinctually must cover but the details are hazy.   Forrester has obviously put the most thought into their analysis.  But the consistent underlying theme within these analysts is that brokerage insinuates a model whereby vendors inserting themselves and their technology between supplier and consumer to provide a layer of transactional value.

The debate and discussion goes much deeper than this and the potential for the cloud broker is much more profound.

In Part II of this post we will take a closer look at the role of the intermediary and who is likely to take up this position in the market.



Read the original blog entry...

More Stories By John Cowan

John Cowan is co-founder and CEO of 6fusion. John is credited as 6fusion's business model visionary, bridging concepts and services behind cloud computing to the IT Service channel. In 2008, he along with his 6fusion collaborators successfully launched the industry's first single unit of meausurement for x86 computing, known as the Workload Allocation Cube (WAC). John is a 12 year veteran of business and product development within the IT and Telecommunications sectors and a graduate of Queen's University at Kingston.

@MicroservicesExpo Stories
DevOps has often been described in terms of CAMS: Culture, Automation, Measuring, Sharing. While we’ve seen a lot of focus on the “A” and even on the “M”, there are very few examples of why the “C" is equally important in the DevOps equation. In her session at @DevOps Summit, Lori MacVittie, of F5 Networks, will explore HTTP/1 and HTTP/2 along with Microservices to illustrate why a collaborative culture between Dev, Ops, and the Network is critical to ensuring success.
Overgrown applications have given way to modular applications, driven by the need to break larger problems into smaller problems. Similarly large monolithic development processes have been forced to be broken into smaller agile development cycles. Looking at trends in software development, microservices architectures meet the same demands. Additional benefits of microservices architectures are compartmentalization and a limited impact of service failure versus a complete software malfunction....
Despite all the talk about public cloud services and DevOps, you would think the move to cloud for enterprises is clear and simple. But in a survey of almost 1,600 IT decision makers across the USA and Europe, the state of the cloud in enterprise today is still fraught with considerable frustration. The business case for apps in the real world cloud is hybrid, bimodal, multi-platform, and difficult. Download this report commissioned by NTT Communications to see the insightful findings – registra...
Achim Weiss is Chief Executive Officer and co-founder of ProfitBricks. In 1995, he broke off his studies to co-found the web hosting company "Schlund+Partner." The company "Schlund+Partner" later became the 1&1 web hosting product line. From 1995 to 2008, he was the technical director for several important projects: the largest web hosting platform in the world, the second largest DSL platform, a video on-demand delivery network, the largest eMail backend in Europe, and a universal billing syste...
Docker is hot. However, as Docker container use spreads into more mature production pipelines, there can be issues about control of Docker images to ensure they are production-ready. Is a promotion-based model appropriate to control and track the flow of Docker images from development to production? In his session at DevOps Summit, Fred Simon, Co-founder and Chief Architect of JFrog, will demonstrate how to implement a promotion model for Docker images using a binary repository, and then show h...
Manufacturing has widely adopted standardized and automated processes to create designs, build them, and maintain them through their life cycle. However, many modern manufacturing systems go beyond mechanized workflows to introduce empowered workers, flexible collaboration, and rapid iteration. Such behaviors also characterize open source software development and are at the heart of DevOps culture, processes, and tooling.
Containers have changed the mind of IT in DevOps. They enable developers to work with dev, test, stage and production environments identically. Containers provide the right abstraction for microservices and many cloud platforms have integrated them into deployment pipelines. DevOps and Containers together help companies to achieve their business goals faster and more effectively.
Containers are revolutionizing the way we deploy and maintain our infrastructures, but monitoring and troubleshooting in a containerized environment can still be painful and impractical. Understanding even basic resource usage is difficult - let alone tracking network connections or malicious activity. In his session at DevOps Summit, Gianluca Borello, Sr. Software Engineer at Sysdig, will cover the current state of the art for container monitoring and visibility, including pros / cons and li...
DevOps Summit at Cloud Expo 2014 Silicon Valley was a terrific event for us. The Qubell booth was crowded on all three days. We ran demos every 30 minutes with folks lining up to get a seat and usually standing around. It was great to meet and talk to over 500 people! My keynote was well received and so was Stan's joint presentation with RingCentral on Devops for BigData. I also participated in two Power Panels – ‘Women in Technology’ and ‘Why DevOps Is Even More Important than You Think,’ both ...
In a report titled “Forecast Analysis: Enterprise Application Software, Worldwide, 2Q15 Update,” Gartner analysts highlighted the increasing trend of application modernization among enterprises. According to a recent survey, 45% of respondents stated that modernization of installed on-premises core enterprise applications is one of the top five priorities. Gartner also predicted that by 2020, 75% of
As the world moves towards more DevOps and microservices, application deployment to the cloud ought to become a lot simpler. The microservices architecture, which is the basis of many new age distributed systems such as OpenStack, NetFlix and so on, is at the heart of Cloud Foundry - a complete developer-oriented Platform as a Service (PaaS) that is IaaS agnostic and supports vCloud, OpenStack and AWS. In his session at 17th Cloud Expo, Raghavan "Rags" Srinivas, an Architect/Developer Evangeli...
The web app is agile. The REST API is agile. The testing and planning are agile. But alas, data infrastructures certainly are not. Once an application matures, changing the shape or indexing scheme of data often forces at best a top down planning exercise and at worst includes schema changes that force downtime. The time has come for a new approach that fundamentally advances the agility of distributed data infrastructures. Come learn about a new solution to the problems faced by software organ...
Our guest on the podcast this week is Jason Bloomberg, President at Intellyx. When we build services we want them to be lightweight, stateless and scalable while doing one thing really well. In today's cloud world, we're revisiting what to takes to make a good service in the first place. Listen in to learn why following "the book" doesn't necessarily mean that you're solving key business problems.
For it to be SOA – let alone SOA done right – we need to pin down just what "SOA done wrong" might be. First-generation SOA with Web Services and ESBs, perhaps? But then there's second-generation, REST-based SOA. More lightweight and cloud-friendly, but many REST-based SOA practices predate the microservices wave. Today, microservices and containers go hand in hand – only the details of "container-oriented architecture" are largely on the drawing board – and are not likely to look much like S...
In their session at DevOps Summit, Asaf Yigal, co-founder and the VP of Product at, and Tomer Levy, co-founder and CEO of, will explore the entire process that they have undergone – through research, benchmarking, implementation, optimization, and customer success – in developing a processing engine that can handle petabytes of data. They will also discuss the requirements of such an engine in terms of scalability, resilience, security, and availability along with how the archi...
Any Ops team trying to support a company in today’s cloud-connected world knows that a new way of thinking is required – one just as dramatic than the shift from Ops to DevOps. The diversity of modern operations requires teams to focus their impact on breadth vs. depth. In his session at DevOps Summit, Adam Serediuk, Director of Operations at xMatters, Inc., will discuss the strategic requirements of evolving from Ops to DevOps, and why modern Operations has begun leveraging the “NoOps” approa...
The last decade was about virtual machines, but the next one is about containers. Containers enable a service to run on any host at any time. Traditional tools are starting to show cracks because they were not designed for this level of application portability. Now is the time to look at new ways to deploy and manage applications at scale. In his session at @DevOpsSummit, Brian “Redbeard” Harrington, a principal architect at CoreOS, will examine how CoreOS helps teams run in production. Attende...
With containerization using Docker, the orchestration of containers using Kubernetes, the self-service model for provisioning your projects and applications and the workflows we built in OpenShift is the best in class Platform as a Service that enables introducing DevOps into your organization with ease. In his session at DevOps Summit, Veer Muchandi, PaaS evangelist with RedHat, will provide a deep dive overview of OpenShift v3 and demonstrate how it helps with DevOps.
All we need to do is have our teams self-organize, and behold! Emergent design and/or architecture springs up out of the nothingness! If only it were that easy, right? I follow in the footsteps of so many people who have long wondered at the meanings of such simple words, as though they were dogma from on high. Emerge? Self-organizing? Profound, to be sure. But what do we really make of this sentence?
Application availability is not just the measure of “being up”. Many apps can claim that status. Technically they are running and responding to requests, but at a rate which users would certainly interpret as being down. That’s because excessive load times can (and will be) interpreted as “not available.” That’s why it’s important to view ensuring application availability as requiring attention to all its composite parts: scalability, performance, and security.