Click here to close now.

Welcome!

Microservices Journal Authors: Jason Bloomberg, Yeshim Deniz, Liz McMillan, Carmen Gonzalez, Elizabeth White

Related Topics: Cloud Expo, Java, Microservices Journal, Virtualization, SDN Journal

Cloud Expo: Article

Data Optimization in Cloud Storage

The crucial technology that will provide service providers with the greatest cost reduction is data optimization

The promise of "the cloud" is that cloud storage delivers users seamless "just in time" storage scalability to handle growth and quickly respond to peak loads. The economics and business impact of cloud storage also delivers a compelling financial proposition in today's budget constrained IT environments. To the IT consumer shifting what was a capital expense and a fixed cost to a variable cost operating expense is financially compelling. Additionally, the ability to function in a "just in time" mode versus a "predictive" model for consumable storage also changes the CAPEX impact further assisting in justifying an already strong value proposition for adopting cloud storage.

IDC forecasts that cloud-based storage will represent a $15.6B market by 2015 with a compound annual growth rate (CAGR) of 32%. They also predict 10,000 service providers will focus on cloud storage with a data protection emphasis. The economics of this market transition will continue to evolve and accelerate as costs of delivering cloud services are optimized by service providers that become more efficient - ever mindful of the cost of their plant/facility, operating expenses and business margins.

The crucial technology that will provide service providers with the greatest cost reduction is data optimization. Data optimization incorporates deduplication, compression and thin provisioning technologies that maximize storage efficiency. Data optimization is the most significant innovation in the storage industry, enabling organizations to save more information in a smaller physical footprint. Nowhere does the fundamental concept of storing less data dramatically change economics more than for providers of cloud storage infrastructure.

When applied to the cloud, data optimization is a disruptive technology. It increases storage efficiency on a 5X to 35X scale. In cloud storage environments the impact is simple and compelling. For a data mix that yields a 5X boost to storage efficiency, costs drop to 20% of what they previously were. In addition, reductions in floor space, power and cooling and manpower all significantly improve operating efficiency. With a clearly differentiated value proposition the disruptive nature of applying data optimization enables the service provider to grow their business by gaining market share at the competitor's expense.

Data optimization's impact on storage consumption in the cloud or in the data center yields operating efficiency and critical business advantages;

  • Reduced capital expense - in any storage environment media is a substantial expense. Disk drives and now SSDs are a significant cost because they need to be available in anticipation of demand. Reducing cost to store data will have a direct impact on the IT expense budget's bottom line. Data optimization applied here will drive down capital storage costs by 80% or more.
  • Data center operating efficiency - with a 5X increase in storage efficiency the requirements for the cloud or data center proportionately decrease. The same data is stored on data optimized storage that is now 80% less and is delivered with 20% of existing floor space, power and cooling costs.
  • Additional benefits are realized through data optimization in network bandwidth consumption, manpower requirements, operational systems needed to support the infrastructure and overall management of the cloud service provider or data center.

Market Drivers
Worldwide data growth is consistently in the 50% per year range. The storage necessary to house this data dramatically impacts enterprise IT operations and their capital budgets. Enterprises are evaluating and planning to use cloud storage to gain business agility and manage capital cost variations. Cloud service providers compete on location, cost, reputation and SLAs. Providers must increasingly differentiate their offering either by developing technology in house or by leveraging third party solutions from major storage vendors. .

Industry analysts, well aware of the impact of continued data growth on IT budgets and the rapid adoption of cloud storage, continue to observe the impact of how data optimization significantly increases IT efficiency and recommend data optimization technologies for all phases of data storage from primary through to the cloud.

At a recent Gartner Conference, one of the keynote speakers was adamant that throwing hardware at the problem of rampant data growth will not work. His view was that IT needs to optimize storage capacity consumption with virtualization, data deduplication and bandwidth optimization. I found this to be quite a contrarian view since the platform vendors have dominated the dialogue in IT informatics. Here was a keynote speaker saying hardware is not the answer to managing the data glut...it's a software fix that we need. Later in the event another session, another speaker, and data deduplication was raised as "emerging as a top opportunity to positively impact data growth because of its ability to reduce the amount of data consuming costly storage." Additionally, the discussion also evolved to include the "green impact" of reducing the amount of data which in turn impacts floor space, power and cooling consumption. Seems that deduplication and data optimization is a win-win.

Summary
Disruptive technologies deliver competitive advantage. Data optimization is one of those technologies that can make market leaders by clearly differentiating what they offer versus their competitors. Sometimes it's economic and other times it can be technical leadership. In the case of both economic and technology leadership, a market disruptive technology, such as data optimization, will drive market share growth and enable rapid business growth at the expense of competitors.

In the case of cloud storage, the first storage systems vendor to bring cloud storage products to market with integrated data optimization technology will gain a huge advantage in the rapidly growing cloud service provider space. In addition, their products will become deeply entrenched into the cloud provider infrastructure because they reduce storage costs and increase overall operational efficiency.

More Stories By Wayne Salpietro

Wayne Salpietro is the director of product and social media marketing at data storage and cloud backup services provider Permabit Technology Corp. He has served in this capacity for the past six years, prior to which he held product marketing and managerial roles at CA, HP, and IBM.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@MicroservicesExpo Stories
Announced separately, New Relic is joining the Cloud Foundry Foundation to continue the support of customers and partners investing in this leading PaaS. As a member, New Relic is contributing the New Relic tile, service broker and build pack with the goal of easing the development of applications on Cloud Foundry and enabling the success of these applications without dedicated monitoring infrastructure. Supporting Quotes "The proliferation of microservices and new technologies like Docker ha...
You often hear the two titles of "DevOps" and "Immutable Infrastructure" used independently. In his session at DevOps Summit, John Willis, Technical Evangelist for Docker, will cover the union between the two topics and why this is important. He will cover an overview of Immutable Infrastructure then show how an Immutable Continuous Delivery pipeline can be applied as a best practice for "DevOps." He will end the session with some interesting case study examples.
SYS-CON Media named Andi Mann editor of DevOps Journal. DevOps Journal is focused on this critical enterprise IT topic in the world of cloud computing. DevOps Journal brings valuable information to DevOps professionals who are transforming the way enterprise IT is done. Andi Mann, Vice President, Strategic Solutions, at CA Technologies, is an accomplished digital business executive with extensive global expertise as a strategist, technologist, innovator, marketer, communicator, and thought lea...
Even though it’s now Microservices Journal, long-time fans of SOA World Magazine can take comfort in the fact that the URL – soa.sys-con.com – remains unchanged. And that’s no mistake, as microservices are really nothing more than a new and improved take on the Service-Oriented Architecture (SOA) best practices we struggled to hammer out over the last decade. Skeptics, however, might say that this change is nothing more than an exercise in buzzword-hopping. SOA is passé, and now that people are ...
The 5th International DevOps Summit, co-located with 17th International Cloud Expo – being held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA – announces that its Call for Papers is open. Born out of proven success in agile development, cloud computing, and process automation, DevOps is a macro trend you cannot afford to miss. From showcase success stories from early adopters and web-scale businesses, DevOps is expanding to organizations of all sizes, including the...
"People are a lot more knowledgeable about APIs now. There are two types of people who work with APIs - IT people who want to use APIs for something internal and the product managers who want to do something outside APIs for people to connect to them," explained Roberto Medrano, Executive Vice President at SOA Software, in this SYS-CON.tv interview at Cloud Expo, held Nov 4–6, 2014, at the Santa Clara Convention Center in Santa Clara, CA.
The 17th International Cloud Expo has announced that its Call for Papers is open. 17th International Cloud Expo, to be held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA, brings together Cloud Computing, APM, APIs, Microservices, Security, Big Data, Internet of Things, DevOps and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding bu...
An effective way of thinking in Big Data is composed of a methodical framework for dealing with the predicted shortage of 50-60% of the qualified Big Data resources in the U.S. This holistic model comprises the scientific and engineering steps that are involved in accelerating Big Data solutions: problem, diagnosis, facts, analysis, hypothesis, solution, prototype and implementation. In his session at Big Data Expo®, Tony Shan focused on the concept, importance, and considerations for each of t...
T-Mobile has been transforming the wireless industry with its “Uncarrier” initiatives. Today as T-Mobile’s IT organization works to transform itself in a like manner, technical foundations built over the last couple of years are now key to their drive for more Agile delivery practices. In his session at DevOps Summit, Martin Krienke, Sr Development Manager at T-Mobile, will discuss where they started their Continuous Delivery journey, where they are today, and where they are going in an effort ...
The cloud is everywhere and growing, and with it SaaS has become an accepted means for software delivery. SaaS is more than just a technology, it is a thriving business model estimated to be worth around $53 billion dollars by 2015, according to IDC. The question is - how do you build and scale a profitable SaaS business model? In his session at 15th Cloud Expo, Jason Cumberland, Vice President, SaaS Solutions at Dimension Data, discussed the common mistakes businesses make when transitioning t...
Storage administrators find themselves walking a line between meeting employees’ demands to use public cloud storage services, and their organizations’ need to store information on-premises for security, performance, cost and compliance reasons. However, as file sharing protocols like CIFS and NFS continue to lose their relevance, simply relying only on a NAS-based environment creates inefficiencies that hurt productivity and the bottom line. IT wants to implement cloud storage it can purchase a...
“Oh, dev is dev and ops is ops, and never the twain shall meet.” With apoloies to Rudyard Kipling and all of his fans, this describes the early state of the two sides of DevOps. Yet the DevOps approach is demanded by cloud computing, as the speed, flexibility, and scalability in today's so-called “Third Platform” must not be hindered by the traditional limitations of software development and deployment. A recent report by Gartner, for example, says that 25% of Global 2000 companies will b...
17th Cloud Expo, taking place Nov 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA, will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud strategy. Meanwhile, 94% of enterprises a...
The Workspace-as-a-Service (WaaS) market will grow to $6.4B by 2018. In his session at 16th Cloud Expo, Seth Bostock, CEO of IndependenceIT, will begin by walking the audience through the evolution of Workspace as-a-Service, where it is now vs. where it going. To look beyond the desktop we must understand exactly what WaaS is, who the users are, and where it is going in the future. IT departments, ISVs and service providers must look to workflow and automation capabilities to adapt to growing ...
The truth is, today’s databases are anything but agile – they are effectively static repositories that are cumbersome to work with, difficult to change, and cannot keep pace with application demands. Performance suffers as a result, and it takes far longer than it should to deliver new features and capabilities needed to make your organization competitive. As your application and business needs change, data repositories and structures get outmoded rapidly, resulting in increased work for applica...
In this scenarios approach Joe Thykattil, Technology Architect & Sales at TimeWarner / Navisite, presented examples that will allow business-savvy professionals to make informed decisions based on a sound business model. This model covered the technology options in detail as well as a financial analysis. The TCO (Total Cost of Ownership) and ROI (Return on Investment) demonstrated how to start, develop and formulate a business case that will allow both small and large scale projects to achieve...
The speed of product development has increased massively in the past 10 years. At the same time our formal secure development and SDL methodologies have fallen behind. This forces product developers to choose between rapid release times and security. In his session at DevOps Summit, Michael Murray, Director of Cyber Security Consulting and Assessment at GE Healthcare, examined the problems and presented some solutions for moving security into the DevOps lifecycle to ensure that we get fast AND ...
After a couple of false starts, cloud-based desktop solutions are picking up steam, driven by trends such as BYOD and pervasive high-speed connectivity. In his session at 15th Cloud Expo, Seth Bostock, CEO of IndependenceIT, cut through the hype and the acronyms, and discussed the emergence of full-featured cloud workspaces that do for the desktop what cloud infrastructure did for the server. He also discussed VDI vs DaaS, implementation strategies and evaluation criteria.
Thanks to Docker, it becomes very easy to leverage containers to build, ship, and run any Linux application on any kind of infrastructure. Docker is particularly helpful for microservice architectures because their successful implementation relies on a fast, efficient deployment mechanism – which is precisely one of the features of Docker. Microservice architectures are therefore becoming more popular, and are increasingly seen as an interesting option even for smaller projects, instead of bein...
With major technology companies and startups seriously embracing IoT strategies, now is the perfect time to attend @ThingsExpo in Silicon Valley. Learn what is going on, contribute to the discussions, and ensure that your enterprise is as "IoT-Ready" as it can be! Internet of @ThingsExpo, taking place Nov 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 17th Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading in...