Welcome!

Microservices Expo Authors: Anders Wallgren, Elizabeth White, Derek Weeks, Jason Bloomberg, Aruna Ravichandran

Related Topics: Containers Expo Blog, Microservices Expo

Containers Expo Blog: Article

A New Era of Post-Production Data Management Software

Solving legacy problems of backup to tape

By Jerome M. Wendt

Nearly every small, medium or large organization is heading down the path of adopting disk-based data protection as a way to solve their legacy problems of backup to tape. But what many of these organizations have yet to recognize is that as they adopt disk to store these post-production copies of data, a new opportunity is presenting itself. They now have the option to manage and leverage post-production data in ways that were never possible when on tape but now lack the tools to do so.

Nearly every organization is somewhere on the journey towards implementing disk-based backup. But that does not mean every organization is implementing it in the same way or using the same technologies. Some are introducing disk in lieu of tape as a backup target. Others are using disk-based snapshots while still others are using some form of replication. Some are even using a combination all of these forms of disk-based data protection.

Then as they store this post-production data on disk they are looking to optimize how this data is stored. This is leading most organizations to try to deduplicate this data whenever possible and then use replication to move the data off-site.

But now that organizations are storing all of this data to disk, they have both a new opportunity and a new challenge in front of them. The opportunity is they now have near-real time copies of production data on disk.

These post-production copies of data are at most 24 hours old and may only be hours, minutes or seconds removed from the production copy of data from which they were derived. As such, they are excellent candidates for use for testing, development and disaster recovery.

At the same time, the challenge is finding software that can do this "post-production data management." After all, it is one thing to create a backup, snapshot or set up a replication job for a particular set of production data. But it is quite another job to then manage the tens, hundreds or even possibly thousands of these copies of post-production data in such a way that they are useable and easily managed by an organization.

These requirements are making it evident that a new category of software, which I refer to as "post-production data management software," needs to emerge. This software needs to give organizations the ability to manage this post-production data in such a way that they may perform tasks like:

  • Minimizing or eliminating backup and recovery windows by ensuring that data is on the right tier of disk at the right time
  • Ensuring that these post-production copies of data (backups, snapshots, replicated) are deduplicated whenever possible to conserve storage capacity
  • Data is replicated locally or remotely so business continuity and disaster recovery can occur automatically with minimal need for setup or ongoing management

Already we are seeing these next generation types of post-production data management capabilities begin to emerge. This last week FalconStor announced its new RecoverTrac technology that is now part of its Continuous Data Protector (CDP) software. RecoverTrac's purpose is to help CDP's snapshots and replication features deliver real world, turnkey business continuity and disaster recovery functionality without requiring organizations to spend tens or hundreds of thousands of dollars and numerous man hours in order to deploy, test, implement and manage it.

InMage is another company that has also been doing something similar for some time. In a series of two blog entries I wrote a couple of years ago I covered how a Dr. James Tu, an Information Security Officer at a real estate company, was using InMage Scout's replication capabilities to replicate data between two sites. Then within Scout he was creating virtual mount points so he could use them to perform recoveries at the secondary site.

Yet possibly the most interesting entrant in this emerging space is a new company called Actifio. It has built its entire platform around this concept of post-production data management and has gone beyond just acting as a backup target, replicating production data or creating snapshots of production data. While it can perform all three of these functions (it can act as either a backup target or a production file system which replicates or takes snapshots of production data) its ultimate objective is to optimally manage the post-production data under its control.

Once it has these post-production copies of data in whatever form they take (backup, snapshot or replicated,) Actifio can then deduplicate this data, put it on the appropriate tier of disk for recoveries or replicate it offsite for DR.

What specifically makes Actifio unique is its virtualization technology to re-purpose a unique copy of all post-production data for each of the different operational requirements. Instead of the complexity and cost of multiple tools for backup, snapshot, deduplication, disaster recovery or business continuance, Actifio is a single solution that manages data through its entire life cycle.

In the next few years I expect almost every size company to complete the transition from tape-based backup to using some form of disk-based data protection. However once that transition is complete, these organizations are going to recognize that just having all of their post-production data stored on disk adds insufficient value to their organization.

Instead they will want the option to easily and centrally manage where this post-production data is placed to facilitate business continuity, disaster recoveries and even operational testing and development of production applications. It is for this reason that I believe that companies will rapidly move beyond just implementing disk-based data protection and that a new era of organizations wanting and needing software that automates the management and placement of their post-production data is dawning.

More Stories By Derek Harris

Derek Harris Sr. is a senior technology writer and blogger with more than 20 years experience in journalism.

While covering a broad spectrum of technology segments, his focus is weighted on enterprise technologies in the data storage, security and infrastructure spaces.

@MicroservicesExpo Stories
With DevOps becoming more well-known and established practice in nearly every industry that delivers software, it is important to continually reassess its efficacy. This week’s top 10 includes a discussion on how the quick uptake of DevOps adoption in the enterprise has posed some serious challenges. Additionally, organizations who have taken the DevOps plunge must find ways to find, hire and keep their DevOps talent in order to keep the machine running smoothly.
Between the mockups and specs produced by analysts, and resulting applications built by developers, there exists a gulf where projects fail, costs spiral, and applications disappoint. Methodologies like Agile attempt to address this with intensified communication, with partial success but many limitations. In his session at 18th Cloud Expo, Charles Kendrick, CTO & Chief Architect at Isomorphic Software, will present a revolutionary model enabled by new technologies. Learn how business and devel...
Call it DevOps or not, if you are concerned about releasing more code faster and at a higher quality, the resulting software delivery chain and process will look and smell like DevOps. But for existing development teams, no matter what the velocity objective is, getting from here to there is not something that can be done without a plan. Moving your release cadence from months to weeks is not just about learning Agile practices and getting some automation tools. It involves people, tooling and ...
The notion of customer journeys, of course, are central to the digital marketer’s playbook. Clearly, enterprises should focus their digital efforts on such journeys, as they represent customer interactions over time. But making customer journeys the centerpiece of the enterprise architecture, however, leaves more questions than answers. The challenge arises when EAs consider the context of the customer journey in the overall architecture as well as the architectural elements that make up each...
Much of the discussion around cloud DevOps focuses on the speed with which companies need to get new code into production. This focus is important – because in an increasingly digital marketplace, new code enables new value propositions. New code is also often essential for maintaining competitive parity with market innovators. But new code doesn’t just have to deliver the functionality the business requires. It also has to behave well because the behavior of code in the cloud affects performan...
APIs have taken the world by storm in recent years. The use of APIs has gone beyond just traditional "software" companies, to companies and organizations across industries using APIs to share information and power their applications. For some organizations, APIs are the biggest revenue drivers. For example, Salesforce generates nearly 50% of annual revenue through APIs. In other cases, APIs can increase a business's footprint and initiate collaboration. Netflix, for example, reported over 5 bi...
As the software delivery industry continues to evolve and mature, the challenge of managing the growing list of the tools and processes becomes more daunting every day. Today, Application Lifecycle Management (ALM) platforms are proving most valuable by providing the governance, management and coordination for every stage of development, deployment and release. Recently, I spoke with Madison Moore at SD Times about the changing market and where ALM is headed.
If there is anything we have learned by now, is that every business paves their own unique path for releasing software- every pipeline, implementation and practices are a bit different, and DevOps comes in all shapes and sizes. Software delivery practices are often comprised of set of several complementing (or even competing) methodologies – such as leveraging Agile, DevOps and even a mix of ITIL, to create the combination that’s most suitable for your organization and that maximize your busines...
Struggling to keep up with increasing application demand? Learn how Platform as a Service (PaaS) can streamline application development processes and make resource management easy.
New Relic, Inc. has announced a set of new features across the New Relic Software Analytics Cloud that offer IT operations teams increased visibility, and the ability to diagnose and resolve performance problems quickly. The new features further IT operations teams’ ability to leverage data and analytics, as well as drive collaboration and a common, shared understanding between teams. Software teams are under pressure to resolve performance issues quickly and improve availability, as the comple...
The goal of any tech business worth its salt is to provide the best product or service to its clients in the most efficient and cost-effective way possible. This is just as true in the development of software products as it is in other product design services. Microservices, an app architecture style that leans mostly on independent, self-contained programs, are quickly becoming the new norm, so to speak. With this change comes a declining reliance on older SOAs like COBRA, a push toward more s...
The proper isolation of resources is essential for multi-tenant environments. The traditional approach to isolate resources is, however, rather heavyweight. In his session at 18th Cloud Expo, Igor Drobiazko, co-founder of elastic.io, will draw upon their own experience with operating a Docker container-based infrastructure on a large scale and present a lightweight solution for resource isolation using microservices. He will also discuss the implementation of microservices in data and applicat...
Join IBM June 8 at 18th Cloud Expo at the Javits Center in New York City, NY, and learn how to innovate like a startup and scale for the enterprise. You need to deliver quality applications faster and cheaper, attract and retain customers with an engaging experience across devices, and seamlessly integrate your enterprise systems. And you can't take 12 months to do it.
This is not a small hotel event. It is also not a big vendor party where politicians and entertainers are more important than real content. This is Cloud Expo, the world's longest-running conference and exhibition focused on Cloud Computing and all that it entails. If you want serious presentations and valuable insight about Cloud Computing for three straight days, then register now for Cloud Expo.
SYS-CON Events announced today that Stratoscale, the software company developing the next generation data center operating system, will exhibit at SYS-CON's 18th International Cloud Expo®, which will take place on June 7-9, 2016, at the Javits Center in New York City, NY. Stratoscale is revolutionizing the data center with a zero-to-cloud-in-minutes solution. With Stratoscale’s hardware-agnostic, Software Defined Data Center (SDDC) solution to store everything, run anything and scale everywhere...
SYS-CON Events announced today that Men & Mice, the leading global provider of DNS, DHCP and IP address management overlay solutions, will exhibit at SYS-CON's 18th International Cloud Expo®, which will take place on June 7-9, 2016, at the Javits Center in New York City, NY. The Men & Mice Suite overlay solution is already known for its powerful application in heterogeneous operating environments, enabling enterprises to scale without fuss. Building on a solid range of diverse platform support,...
You deployed your app with the Bluemix PaaS and it's gaining some serious traction, so it's time to make some tweaks. Did you design your application in a way that it can scale in the cloud? Were you even thinking about the cloud when you built the app? If not, chances are your app is going to break. Check out this webcast to learn various techniques for designing applications that will scale successfully in Bluemix, for the confidence you need to take your apps to the next level and beyond.
Digital means customer preferences and behavior are driving enterprise technology decisions to be sure, but let’s not forget our employees. After all, when we say customer, we mean customer writ large, including partners, supply chain participants, and yes, those salaried denizens whose daily labor forms the cornerstone of the enterprise. While your customers bask in the warm rays of your digital efforts, are your employees toiling away in the dark recesses of your enterprise, pecking data into...
SYS-CON Events announced today that DatacenterDynamics has been named “Media Sponsor” of SYS-CON's 18th International Cloud Expo, which will take place on June 7–9, 2016, at the Javits Center in New York City, NY. DatacenterDynamics is a brand of DCD Group, a global B2B media and publishing company that develops products to help senior professionals in the world's most ICT dependent organizations make risk-based infrastructure and capacity decisions.
These days I mostly make my living as a consultant. Consultants in general are probably not the best loved group in the world. It is common to think of consultants wafting-in to your organization, telling you things that you already know and advising you to “change your culture”, whatever that means. Subsequently they depart, no-doubt with a fat fee, and leave you as you were before with the same problems and no progress made.