Welcome!

Microservices Expo Authors: Pat Romanski, John Katrick, Elizabeth White, Liz McMillan, Yeshim Deniz

Related Topics: Microservices Expo, Containers Expo Blog, @CloudExpo

Microservices Expo: Blog Feed Post

Zebras, Giraffes, and Horses

SSPs, Cloud Storage Providers, and Internal Clouds

My youngest daughter used to have trouble with her animals. Whenever she saw a giraffe, she would say "zebra" and whenever she saw a zebra she would say "giraffe!" Although an adult would never make that mistake, one can understand why a child would: She was new to these names, and they were entirely arbitrary words. Besides, both are quadrupeds with bizarre coloration and patterns. But my daughter definitely knew a horse when she saw one!

Private Clouds and SSPs: Horses and Zebras
Today's cloud storage world can be equally confusing to the uninitiated. Long-time IT folks remember the storage service providers (SSPs) of a decade ago and have watched as storage and server virtualization have gained prominence.

When cloud storage began to get some press a couple of years ago, it was natural to try to fit it into the existing paradigms and understandable to fail to spot the differences.

Internal IT systems have been on the road to virtualization for years. I recall being excited about the potential of server and storage virtualization over a decade ago. But storage service providers like StorageNetworks (where I worked in 2000) didn't use any of this fancy stuff. Rather, the SSPs of last decade were zebras, built of the same storage area network (SAN) storage systems used by their customers but clothed as a service-oriented business.

As Hu Yoshida of HDS points out in his blog, SSPs were not a raging success. But they were not the colossal failure many assume - just ask the vast assortment of StorageNetworks alumni now in charge at places like HDS! True, all that conventional enterprise storage gear had trouble with multi-tenancy, but the real issue for SSPs was financial. They built out world-class storage networks (pardon the pun) and wrapped them in expensive home-built management and provisioning software. By the time they had a workable offering, the price tag had risen to levels that were hard to justify.

Today's private storage clouds, as touted by HDS, NetApp, and others, are horses of a different color. Enterprise storage systems are much more flexible and sharable thanks to integrated virtualization and advanced management features. But they retain the traditional enterprise storage access mechanisms, construction, and cost. If you're looking for a horse, it's a blessing to find one: These "cloudy storage" solutions can be plugged in and used precisely because they are conventional. The kind of storage workload described in Hu's blog (massive I/O connected to virtual servers) is best served by these impressive but ordinary storage devices.

Public Cloud is a Different Animal
Not every workload needs a workhorse, however. Many have questioned how widespread the need is for the next generation of high performance connectivity. Database systems remain the only really common high-I/O workload, though highly-concentrated server virtualization systems will also soon join this club. But these make up only a small percentage of overall IT server and storage deployments. The majority of applications demand low cost and high flexibility more than extreme performance.

This is especially true of the types of applications using public cloud storage today. Regardless of industry vertical, every business would benefit from having their vast reference and archival datasets available online rather than moldering on tape. Intelligent cloud storage platforms are rapidly being integrated with the best data management and archiving applications to make this a reality. Already, companies like Nirvanix are hosting petabytes of archival data for the largest corporations and governmental entities. They chose public cloud storage over internal disk or tape because it was competitive on cost as well as being exceptionally available.

The next generation of business applications will make use of the other big benefit of cloud storage: Collaboration. Forward-thinking businesses have already deployed applications with integrated data sharing using public cloud storage to enhance their technical support and customer service activities. A new wave of similar business-to-business collaboration tools is on the way. IT infrastructure folks might not have noticed this shift in focus by developers, but the revolution in collaborative software is about to strike.

Although the casual observer might not discern it, public cloud storage solutions are as different from virtualized internal systems and the old SSP offerings as giraffes are from horses or zebras. Today's cloud storage providers are rejecting conventional enterprise storage devices in favor of software solutions based on commodity server hardware. Server and storage virtualization, Fibre Channel SANs, and even enterprise NAS are rare in the data centers of cloud storage providers. Instead, they have re-thought the challenge of protecting data and servicing customers and their solutions have the side effect of being much less expensive. Hardware cost is disappearing, and cloud providers are instead focusing on the "glass floor" of operations and management costs, as well as raising the bar on service and availability.

Place Your Bets
This new world will not erase the old, but cloud solutions have little use for traditional server and storage infrastructure approaches. There is a race "up the stack" as IT companies deploy platforms and services rather than merely offering faster versions of last year's server and storage equipment. This is the reason for VMware's acquisition of SpringSource (and perhaps Zimbra) and a series of investments on the part of EMC, Cisco, Dell, HP, IBM, and the rest. There will still be a market for the nuts and bolts products that support traditional IT systems, but these big players are betting that the action is elsewhere.

More Stories By Stephen Foskett

Stephen Foskett has provided vendor-independent end user consulting on storage topics for over 10 years. He has been a storage columnist and has authored numerous articles for industry publications. Stephen is a popular presenter at industry events and recently received Microsoft’s MVP award for contributions to the enterprise storage community. As the director of consulting for Nirvanix, Foskett provides strategic consulting to assist Fortune 500 companies in developing strategies for service-based tiered and cloud storage. He holds a bachelor of science in Society/Technology Studies, from Worcester Polytechnic Institute.

@MicroservicesExpo Stories
For organizations that have amassed large sums of software complexity, taking a microservices approach is the first step toward DevOps and continuous improvement / development. Integrating system-level analysis with microservices makes it easier to change and add functionality to applications at any time without the increase of risk. Before you start big transformation projects or a cloud migration, make sure these changes won’t take down your entire organization.
When you focus on a journey from up-close, you look at your own technical and cultural history and how you changed it for the benefit of the customer. This was our starting point: too many integration issues, 13 SWP days and very long cycles. It was evident that in this fast-paced industry we could no longer afford this reality. We needed something that would take us beyond reducing the development lifecycles, CI and Agile methodologies. We made a fundamental difference, even changed our culture...
In his session at 20th Cloud Expo, Mike Johnston, an infrastructure engineer at Supergiant.io, discussed how to use Kubernetes to set up a SaaS infrastructure for your business. Mike Johnston is an infrastructure engineer at Supergiant.io with over 12 years of experience designing, deploying, and maintaining server and workstation infrastructure at all scales. He has experience with brick and mortar data centers as well as cloud providers like Digital Ocean, Amazon Web Services, and Rackspace. H...
You often hear the two titles of "DevOps" and "Immutable Infrastructure" used independently. In his session at DevOps Summit, John Willis, Technical Evangelist for Docker, covered the union between the two topics and why this is important. He provided an overview of Immutable Infrastructure then showed how an Immutable Continuous Delivery pipeline can be applied as a best practice for "DevOps." He ended the session with some interesting case study examples.
Without lifecycle traceability and visibility across the tool chain, stakeholders from Planning-to-Ops have limited insight and answers to who, what, when, why and how across the DevOps lifecycle. This impacts the ability to deliver high quality software at the needed velocity to drive positive business outcomes. In his general session at @DevOpsSummit at 19th Cloud Expo, Eric Robertson, General Manager at CollabNet, will discuss how customers are able to achieve a level of transparency that e...
"DivvyCloud as a company set out to help customers automate solutions to the most common cloud problems," noted Jeremy Snyder, VP of Business Development at DivvyCloud, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
The Jevons Paradox suggests that when technological advances increase efficiency of a resource, it results in an overall increase in consumption. Writing on the increased use of coal as a result of technological improvements, 19th-century economist William Stanley Jevons found that these improvements led to the development of new ways to utilize coal. In his session at 19th Cloud Expo, Mark Thiele, Chief Strategy Officer for Apcera, compared the Jevons Paradox to modern-day enterprise IT, examin...
We all know that end users experience the internet primarily with mobile devices. From an app development perspective, we know that successfully responding to the needs of mobile customers depends on rapid DevOps – failing fast, in short, until the right solution evolves in your customers' relationship to your business. Whether you’re decomposing an SOA monolith, or developing a new application cloud natively, it’s not a question of using microservices - not doing so will be a path to eventual ...
In his session at 20th Cloud Expo, Scott Davis, CTO of Embotics, discussed how automation can provide the dynamic management required to cost-effectively deliver microservices and container solutions at scale. He also discussed how flexible automation is the key to effectively bridging and seamlessly coordinating both IT and developer needs for component orchestration across disparate clouds – an increasingly important requirement at today’s multi-cloud enterprise.
Your homes and cars can be automated and self-serviced. Why can't your storage? From simply asking questions to analyze and troubleshoot your infrastructure, to provisioning storage with snapshots, recovery and replication, your wildest sci-fi dream has come true. In his session at @DevOpsSummit at 20th Cloud Expo, Dan Florea, Director of Product Management at Tintri, provided a ChatOps demo where you can talk to your storage and manage it from anywhere, through Slack and similar services with...
Containers are rapidly finding their way into enterprise data centers, but change is difficult. How do enterprises transform their architecture with technologies like containers without losing the reliable components of their current solutions? In his session at @DevOpsSummit at 21st Cloud Expo, Tony Campbell, Director, Educational Services at CoreOS, will explore the challenges organizations are facing today as they move to containers and go over how Kubernetes applications can deploy with lega...
Learn how to solve the problem of keeping files in sync between multiple Docker containers. In his session at 16th Cloud Expo, Aaron Brongersma, Senior Infrastructure Engineer at Modulus, discussed using rsync, GlusterFS, EBS and Bit Torrent Sync. He broke down the tools that are needed to help create a seamless user experience. In the end, can we have an environment where we can easily move Docker containers, servers, and volumes without impacting our applications? He shared his results so yo...
Enterprise architects are increasingly adopting multi-cloud strategies as they seek to utilize existing data center assets, leverage the advantages of cloud computing and avoid cloud vendor lock-in. This requires a globally aware traffic management strategy that can monitor infrastructure health across data centers and end-user experience globally, while responding to control changes and system specification at the speed of today’s DevOps teams. In his session at 20th Cloud Expo, Josh Gray, Chie...
Don’t go chasing waterfall … development, that is. According to a recent post by Madison Moore on Medium featuring insights from several software delivery industry leaders, waterfall is – while still popular – not the best way to win in the marketplace. With methodologies like Agile, DevOps and Continuous Delivery becoming ever more prominent over the past 15 years or so, waterfall is old news. Or, is it? Moore cites a recent study by Gartner: “According to Gartner’s IT Key Metrics Data report, ...
Kubernetes is a new and revolutionary open-sourced system for managing containers across multiple hosts in a cluster. Ansible is a simple IT automation tool for just about any requirement for reproducible environments. In his session at @DevOpsSummit at 18th Cloud Expo, Patrick Galbraith, a principal engineer at HPE, discussed how to build a fully functional Kubernetes cluster on a number of virtual machines or bare-metal hosts. Also included will be a brief demonstration of running a Galera MyS...
In his session at Cloud Expo, Alan Winters, U.S. Head of Business Development at MobiDev, presented a success story of an entrepreneur who has both suffered through and benefited from offshore development across multiple businesses: The smart choice, or how to select the right offshore development partner Warning signs, or how to minimize chances of making the wrong choice Collaboration, or how to establish the most effective work processes Budget control, or how to maximize project result...
In his keynote at 19th Cloud Expo, Sheng Liang, co-founder and CEO of Rancher Labs, discussed the technological advances and new business opportunities created by the rapid adoption of containers. With the success of Amazon Web Services (AWS) and various open source technologies used to build private clouds, cloud computing has become an essential component of IT strategy. However, users continue to face challenges in implementing clouds, as older technologies evolve and newer ones like Docker c...
In IT, we sometimes coin terms for things before we know exactly what they are and how they’ll be used. The resulting terms may capture a common set of aspirations and goals – as “cloud” did broadly for on-demand, self-service, and flexible computing. But such a term can also lump together diverse and even competing practices, technologies, and priorities to the point where important distinctions are glossed over and lost.
In his session at @DevOpsSummit at 20th Cloud Expo, Kelly Looney, director of DevOps consulting for Skytap, showed how an incremental approach to introducing containers into complex, distributed applications results in modernization with less risk and more reward. He also shared the story of how Skytap used Docker to get out of the business of managing infrastructure, and into the business of delivering innovation and business value. Attendees learned how up-front planning allows for a clean sep...
"I will be talking about ChatOps and ChatOps as a way to solve some problems in the DevOps space," explained Himanshu Chhetri, CTO of Addteq, in this SYS-CON.tv interview at @DevOpsSummit at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.