Welcome!

Microservices Expo Authors: Elizabeth White, Gregor Petri, Gerardo A Dada, Roger Strukhoff, XebiaLabs Blog

Blog Feed Post

The Evolution & Emergence of the Hybrid Cloud

How have most organizations been building hybrid clouds to date?

Despite all the marketing and promotion surrounding the benefits of dynamically bursting into a hybrid cloud from inception, this rarely seems to be the case. If anything the current trend towards building hybrid clouds still stems from an organic growth and demand that has emanated from either an existent public or private cloud deployment. Certainly private clouds are the most common origins of hybrid clouds as organisations look towards adding further agility to the many benefits they've attained.

A lot of organizations have also recently been pushed towards the many new vendor hybrid cloud offerings that have hit the market. Here the initiative is drawn to promises of a seamless management experience across they're already deployed private cloud and newly considered public cloud as well as vice versa.


What have been the limitations of these methods?

Quite simply it's people and processes. Agility is the key driver towards a hybrid cloud model as applications can dynamically move across either the public or private cloud platform depending on its requirements and criticality. To achieve this successfully there needs to be drastic changes in the traditional IT operational processes where a siloed IT culture focuses on in-house technical expertise. Where hybrid clouds have emerged from initial private cloud deployments, the existent, stagnated siloed processes aren't suitable for the fully automated, self-service service-oriented approach of hybrid clouds.

Very few organizations are thinking of a hybrid cloud from the onset where the idea of also outsourcing their IT operations to the public cloud is a genuine consideration. Instead it's been a staged progression that has coincided with a staged changing of mindset. Private clouds that have adopted converged infrastructure platforms have made headway in this regard as many of the traditional siloes are broken down in favor of more dynamic and centralized teams but there's still a long way to go for most organisations.

As for the new hybrid cloud offerings that are being touted by a lot of the mainstream vendors, they still lack the maturity to help organizations transform their operations. While a technology offering may provide a technical solution, the people and processes challenge still doesn't get easily solved.
Platforms need to enable applications to seamlessly move to and from a public cloud based service 

Are organizations right to be scared of the public cloud when it comes to business critical data?

The reality is that most large enterprise companies such as financials and pharmaceuticals will always be hesitant to move their critical data and IT operations into a public cloud. If such organizations are using the public cloud it's typically for test and development environments or backup and archiving. In such instances the hybrid cloud is adopted to maintain control over the large internal infrastructures that host their critical data while concurrently optimizing the performance of those applications.

Whether such organizations are right to be scared of the public cloud mainly stems from the ambiguity that lies in the liability for mission critical application SLAs, their security, performance and their requirement to be available 24/7. For this to change the consumer needs to place different demands on the public cloud provider that incorporates clarity from such ambiguity where for example SLAs are not just focused on uptime and availability but also performance metrics and response times. For organizations to feel comfortable to relinquish the control of their mission critical data, the public cloud needs to provide an improvement on what the consumer can provide themselves internally in terms of performance, security, availability and SLAs.

CIOs are blinded by conflicting information about cloud. How can they decide what data to put where?

Any such decision or initiative requires some form of classification and understanding of the organization's data value. Additionally there needs to be an assessment of the criticality of that data in terms of data loss and consequently the risk it introduces to the business. For example archived data may not be needed on an internal high-end performance public cloud infrastructure, yet its criticality could be measured by the fact that any security breach of that archived data could mean the end of the business. Any consideration that involves data being migrated to an external provider (public cloud storage), requires a thorough understanding of the potential impact and revenue loss should that data be compromised.

Moreover the service provider should not just be considered for its technical, security and service merits but also its stability as a business. The last thing an organization needs is to have its data migrated offsite to a cloud provider that eventually goes bankrupt or taken over by another company. As long as the groundwork is done in terms of researching the data as well as the stability of the potential provider the public cloud is a more than viable option for a large number of workloads such as archives, backup copies and test environments.

The rise of hybrid cloud architectures has led to the creation of Cloud Service Brokers - is this a necessary role going forward?

While still an emerging role, for organizations that are considering moving to the cloud and are finding that it's not a simple process dealing with multiple relations, contracts, vendors, providers etc. the Cloud Service Broker is a necessity. Having a dedicated resource whether internal or external to the organization that can work closely amongst a multitude of cloud providers to negotiate and attain the best price, offerings and services on your behalf is essential in attaining the most benefit from your cloud initiative.

Additionally brokers are also key to saving time by alleviating organizations the burden of researching services from different vendors and how they will coincide with the organization's work processes, budgets and data values as well as financial background checks of potential providers.

The role and benefit of a Cloud Service Broker is not just key to the pre-deployment process but also the post Cloud deployment phase. Having been the broker to negotiate the best deals, services and offerings on your behalf based on their existent relationships, the Cloud Service Broker also offers the opportunity to be the first point of call if and when any issues or problems occur. If there are problems with the service provider such as breach of contracts, missing SLAs etc. the Cloud Service Broker is an integral role in resolving any disputes while consequently isolating your organization from having to deal with the issues. As the hybrid cloud market matures and grows the role of the Cloud Service Broker will certainly become more prevalent.

How important is it to easily move data between private and public clouds?

The challenge of creating a hybrid cloud is far greater than a dedicated private or public deployment. The main challenge is that the processes required to scale and shift data across the hybrid cloud can't be successfully achieved with the traditional methods used in migrating data to and from public and private clouds. The ability to seamlessly move data across the hybrid cloud based on application requirements and demands as well as data classification is key to the hybrid model being adopted by the mainstream.

The hybrid model is being considered by many because it offers the opportunity to improve efficiencies, geographical coverage and economies of scale. To truly achieve this workloads need to be moved seamlessly between private and public clouds based on their requirements, where a standardized and centralized portal alongside common management tools present the hybrid cloud as a ubiquitous pool of resources. In this instance the requirement for the simplification, automation and ease of data movement is axiomatic.

How is the movement towards SDDCs impacting the hybrid cloud trend?

While the adoption of the SDDC is still in its infancy, its ability to provide the standardized framework for data to be moved to and from public clouds based on application requirements, regardless of geographical location is quintessential. The SDDC provides the opportunity for organizations to reap the agility of the cloud computing while maintaining legacy applications that aren't suitable for the public cloud for whatever reason. For example in the hybrid model new services could benefit from development and coding that goes directly into the private cloud, while the core services that run the business can remain onsite while still benefiting from any bug fixes and code releases in a seamless manner.

With the SDDC providing the intelligence and consequent automation of workloads, the hybrid cloud model can quickly be emancipated from the shackles of traditional operational processes and siloes making its benefits and subsequent adoption considerably greater. Furthermore it will lead the way for hybrid clouds to be considered as an immediate initiative as opposed to the evolutionary process we are currently seeing in the market.

What are the most common hybrid architectures that we will see over the next year and why?

We will certainly see the adoption of hybrid architectures and models grow, much like we saw the adoption of private clouds. Over the next year the model that we'll more than likely see is the continuation of legacy application infrastructures that preserve organizations' large investments and are then coupled with hybrid automation solutions that enable them to leverage on demand cloud resources. The security concerns of public clouds as well as the need to ensure application performance and optimization will be the key drivers for this.

Indeed we may see a further shift away of some workloads from the public to the hybrid model as organizations start to reassess the financial benefits of public cloud deployments based on the economies of scale they could achieve with a Private Cloud deployment. As organizations become more familiar with their on going cloud costs, there'll be more of a demand for platforms that enable them to seamlessly move their applications to and from a public cloud-based service. Adopters of converged infrastructure are certainly moving towards this path as they've recognized the agility, speed and consequent capex and opex savings they've achieved with their Private Clouds.

Indeed the anticipated and most likely approach for organizations next year will not be a decision of whether to utilize a large existent infrastructure investment or a scalable on demand public cloud service but rather the most effective strategy to leverage both.

Taken from the June 2014 Archie Hendryx interview with Information Age magazine.

Read the original blog entry...

More Stories By Archie Hendryx

SAN, NAS, Back Up / Recovery & Virtualisation Specialist.

@MicroservicesExpo Stories
Kubernetes is a new and revolutionary open-sourced system for managing containers across multiple hosts in a cluster. Ansible is a simple IT automation tool for just about any requirement for reproducible environments. In his session at @DevOpsSummit at 18th Cloud Expo, Patrick Galbraith, a principal engineer at HPE, discussed how to build a fully functional Kubernetes cluster on a number of virtual machines or bare-metal hosts. Also included will be a brief demonstration of running a Galera MyS...
About a year ago we tuned into “the need for speed” and how a concept like "serverless computing” was increasingly catering to this. We are now a year further and the term “serverless” is taking on unexpected proportions. With some even seeing it as the successor to cloud in general or at least as a successor to the clouds’ poorer cousin in terms of revenue, hype and adoption: PaaS. The question we need to ask is whether this constitutes an example of Hype Hopping: to effortlessly pivot to the ...
Today’s IT environments are increasingly heterogeneous, with Linux, Java, Oracle and MySQL considered nearly as common as traditional Windows environments. In many cases, these platforms have been integrated into an organization’s Windows-based IT department by way of an acquisition of a company that leverages one of those platforms. In other cases, the applications may have been part of the IT department for years, but managed by a separate department or singular administrator. Still, whether...
As we enter the final week before the 19th International Cloud Expo | @ThingsExpo in Santa Clara, CA, it's time for me to reflect on six big topics that will be important during the show. Hybrid Cloud: This general-purpose term seems to provide a comfort zone for many enterprise IT managers. It sounds reassuring to be able to work with one of the major public-cloud providers like AWS or Microsoft Azure while still maintaining an on-site presence.
I’m a huge fan of open source DevOps tools. I’m also a huge fan of scaling open source tools for the enterprise. But having talked with my fair share of companies over the years, one important thing I’ve learned is that you can’t scale your release process using open source tools alone. They simply require too much scripting and maintenance when used that way. Scripting may be fine for smaller organizations, but it’s not ok in an enterprise environment that includes many independent teams and to...
Get deep visibility into the performance of your databases and expert advice for performance optimization and tuning. You can't get application performance without database performance. Give everyone on the team a comprehensive view of how every aspect of the system affects performance across SQL database operations, host server and OS, virtualization resources and storage I/O. Quickly find bottlenecks and troubleshoot complex problems.
Between 2005 and 2020, data volumes will grow by a factor of 300 – enough data to stack CDs from the earth to the moon 162 times. This has come to be known as the ‘big data’ phenomenon. Unfortunately, traditional approaches to handling, storing and analyzing data aren’t adequate at this scale: they’re too costly, slow and physically cumbersome to keep up. Fortunately, in response a new breed of technology has emerged that is cheaper, faster and more scalable. Yet, in meeting these new needs they...
In his general session at 19th Cloud Expo, Manish Dixit, VP of Product and Engineering at Dice, discussed how Dice leverages data insights and tools to help both tech professionals and recruiters better understand how skills relate to each other and which skills are in high demand using interactive visualizations and salary indicator tools to maximize earning potential. Manish Dixit is VP of Product and Engineering at Dice. As the leader of the Product, Engineering and Data Sciences team at D...
In IT, we sometimes coin terms for things before we know exactly what they are and how they’ll be used. The resulting terms may capture a common set of aspirations and goals – as “cloud” did broadly for on-demand, self-service, and flexible computing. But such a term can also lump together diverse and even competing practices, technologies, and priorities to the point where important distinctions are glossed over and lost.
Monitoring of Docker environments is challenging. Why? Because each container typically runs a single process, has its own environment, utilizes virtual networks, or has various methods of managing storage. Traditional monitoring solutions take metrics from each server and applications they run. These servers and applications running on them are typically very static, with very long uptimes. Docker deployments are different: a set of containers may run many applications, all sharing the resource...
The 20th International Cloud Expo has announced that its Call for Papers is open. Cloud Expo, to be held June 6-8, 2017, at the Javits Center in New York City, brings together Cloud Computing, Big Data, Internet of Things, DevOps, Containers, Microservices and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding business opportunity. Submit your speaking proposal ...
You have great SaaS business app ideas. You want to turn your idea quickly into a functional and engaging proof of concept. You need to be able to modify it to meet customers' needs, and you need to deliver a complete and secure SaaS application. How could you achieve all the above and yet avoid unforeseen IT requirements that add unnecessary cost and complexity? You also want your app to be responsive in any device at any time. In his session at 19th Cloud Expo, Mark Allen, General Manager of...
In his session at 19th Cloud Expo, Claude Remillard, Principal Program Manager in Developer Division at Microsoft, contrasted how his team used config as code and immutable patterns for continuous delivery of microservices and apps to the cloud. He showed how the immutable patterns helps developers do away with most of the complexity of config as code-enabling scenarios such as rollback, zero downtime upgrades with far greater simplicity. He also demoed building immutable pipelines in the cloud ...
"Dice has been around for the last 20 years. We have been helping tech professionals find new jobs and career opportunities," explained Manish Dixit, VP of Product and Engineering at Dice, in this SYS-CON.tv interview at 19th Cloud Expo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
@DevOpsSummit taking place June 6-8, 2017 at Javits Center, New York City, is co-located with the 20th International Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. @DevOpsSummit at Cloud Expo New York Call for Papers is now open.
Rapid innovation, changing business landscapes, and new IT demands force businesses to make changes quickly. In the eyes of many, containers are at the brink of becoming a pervasive technology in enterprise IT to accelerate application delivery. In this presentation, attendees learned about the: The transformation of IT to a DevOps, microservices, and container-based architecture What are containers and how DevOps practices can operate in a container-based environment A demonstration of how ...
Cloud Expo, Inc. has announced today that Andi Mann returns to 'DevOps at Cloud Expo 2017' as Conference Chair The @DevOpsSummit at Cloud Expo will take place on June 6-8, 2017, at the Javits Center in New York City, NY. "DevOps is set to be one of the most profound disruptions to hit IT in decades," said Andi Mann. "It is a natural extension of cloud computing, and I have seen both firsthand and in independent research the fantastic results DevOps delivers. So I am excited to help the great t...
Without lifecycle traceability and visibility across the tool chain, stakeholders from Planning-to-Ops have limited insight and answers to who, what, when, why and how across the DevOps lifecycle. This impacts the ability to deliver high quality software at the needed velocity to drive positive business outcomes. In his general session at @DevOpsSummit at 19th Cloud Expo, Phil Hombledal, Solution Architect at CollabNet, discussed how customers are able to achieve a level of transparency that e...
Application transformation and DevOps practices are two sides of the same coin. Enterprises that want to capture value faster, need to deliver value faster – time value of money principle. To do that enterprises need to build cloud-native apps as microservices by empowering teams to build, ship, and run in production. In his session at @DevOpsSummit at 19th Cloud Expo, Neil Gehani, senior product manager at HPE, discussed what every business should plan for how to structure their teams to delive...
DevOps is being widely accepted (if not fully adopted) as essential in enterprise IT. But as Enterprise DevOps gains maturity, expands scope, and increases velocity, the need for data-driven decisions across teams becomes more acute. DevOps teams in any modern business must wrangle the ‘digital exhaust’ from the delivery toolchain, "pervasive" and "cognitive" computing, APIs and services, mobile devices and applications, the Internet of Things, and now even blockchain. In this power panel at @...