Welcome!

Microservices Expo Authors: Elizabeth White, XebiaLabs Blog, Jason Bloomberg, Roger Strukhoff, Liz McMillan

Related Topics: Containers Expo Blog, Microservices Expo

Containers Expo Blog: Article

A New Era of Post-Production Data Management Software

Solving legacy problems of backup to tape

By Jerome M. Wendt

Nearly every small, medium or large organization is heading down the path of adopting disk-based data protection as a way to solve their legacy problems of backup to tape. But what many of these organizations have yet to recognize is that as they adopt disk to store these post-production copies of data, a new opportunity is presenting itself. They now have the option to manage and leverage post-production data in ways that were never possible when on tape but now lack the tools to do so.

Nearly every organization is somewhere on the journey towards implementing disk-based backup. But that does not mean every organization is implementing it in the same way or using the same technologies. Some are introducing disk in lieu of tape as a backup target. Others are using disk-based snapshots while still others are using some form of replication. Some are even using a combination all of these forms of disk-based data protection.

Then as they store this post-production data on disk they are looking to optimize how this data is stored. This is leading most organizations to try to deduplicate this data whenever possible and then use replication to move the data off-site.

But now that organizations are storing all of this data to disk, they have both a new opportunity and a new challenge in front of them. The opportunity is they now have near-real time copies of production data on disk.

These post-production copies of data are at most 24 hours old and may only be hours, minutes or seconds removed from the production copy of data from which they were derived. As such, they are excellent candidates for use for testing, development and disaster recovery.

At the same time, the challenge is finding software that can do this "post-production data management." After all, it is one thing to create a backup, snapshot or set up a replication job for a particular set of production data. But it is quite another job to then manage the tens, hundreds or even possibly thousands of these copies of post-production data in such a way that they are useable and easily managed by an organization.

These requirements are making it evident that a new category of software, which I refer to as "post-production data management software," needs to emerge. This software needs to give organizations the ability to manage this post-production data in such a way that they may perform tasks like:

  • Minimizing or eliminating backup and recovery windows by ensuring that data is on the right tier of disk at the right time
  • Ensuring that these post-production copies of data (backups, snapshots, replicated) are deduplicated whenever possible to conserve storage capacity
  • Data is replicated locally or remotely so business continuity and disaster recovery can occur automatically with minimal need for setup or ongoing management

Already we are seeing these next generation types of post-production data management capabilities begin to emerge. This last week FalconStor announced its new RecoverTrac technology that is now part of its Continuous Data Protector (CDP) software. RecoverTrac's purpose is to help CDP's snapshots and replication features deliver real world, turnkey business continuity and disaster recovery functionality without requiring organizations to spend tens or hundreds of thousands of dollars and numerous man hours in order to deploy, test, implement and manage it.

InMage is another company that has also been doing something similar for some time. In a series of two blog entries I wrote a couple of years ago I covered how a Dr. James Tu, an Information Security Officer at a real estate company, was using InMage Scout's replication capabilities to replicate data between two sites. Then within Scout he was creating virtual mount points so he could use them to perform recoveries at the secondary site.

Yet possibly the most interesting entrant in this emerging space is a new company called Actifio. It has built its entire platform around this concept of post-production data management and has gone beyond just acting as a backup target, replicating production data or creating snapshots of production data. While it can perform all three of these functions (it can act as either a backup target or a production file system which replicates or takes snapshots of production data) its ultimate objective is to optimally manage the post-production data under its control.

Once it has these post-production copies of data in whatever form they take (backup, snapshot or replicated,) Actifio can then deduplicate this data, put it on the appropriate tier of disk for recoveries or replicate it offsite for DR.

What specifically makes Actifio unique is its virtualization technology to re-purpose a unique copy of all post-production data for each of the different operational requirements. Instead of the complexity and cost of multiple tools for backup, snapshot, deduplication, disaster recovery or business continuance, Actifio is a single solution that manages data through its entire life cycle.

In the next few years I expect almost every size company to complete the transition from tape-based backup to using some form of disk-based data protection. However once that transition is complete, these organizations are going to recognize that just having all of their post-production data stored on disk adds insufficient value to their organization.

Instead they will want the option to easily and centrally manage where this post-production data is placed to facilitate business continuity, disaster recoveries and even operational testing and development of production applications. It is for this reason that I believe that companies will rapidly move beyond just implementing disk-based data protection and that a new era of organizations wanting and needing software that automates the management and placement of their post-production data is dawning.

More Stories By Derek Harris

Derek Harris Sr. is a senior technology writer and blogger with more than 20 years experience in journalism.

While covering a broad spectrum of technology segments, his focus is weighted on enterprise technologies in the data storage, security and infrastructure spaces.

@MicroservicesExpo Stories
Get deep visibility into the performance of your databases and expert advice for performance optimization and tuning. You can't get application performance without database performance. Give everyone on the team a comprehensive view of how every aspect of the system affects performance across SQL database operations, host server and OS, virtualization resources and storage I/O. Quickly find bottlenecks and troubleshoot complex problems.
I’m a huge fan of open source DevOps tools. I’m also a huge fan of scaling open source tools for the enterprise. But having talked with my fair share of companies over the years, one important thing I’ve learned is that you can’t scale your release process using open source tools alone. They simply require too much scripting and maintenance when used that way. Scripting may be fine for smaller organizations, but it’s not ok in an enterprise environment that includes many independent teams and to...
IT leaders face a monumental challenge. They must figure out how to sort through the cacophony of new technologies, buzzwords, and industry hype to find the right digital path forward for their organizations. And they simply cannot afford to fail. Those organizations that are fastest to the right digital path will be the ones that win. The path forward, however, is strewn with the legacy of decisions made long ago — often before any of the current leadership team assumed their roles. While it’s ...
As we enter the final week before the 19th International Cloud Expo | @ThingsExpo in Santa Clara, CA, it's time for me to reflect on six big topics that will be important during the show. Hybrid Cloud: This general-purpose term seems to provide a comfort zone for many enterprise IT managers. It sounds reassuring to be able to work with one of the major public-cloud providers like AWS or Microsoft Azure while still maintaining an on-site presence.
In IT, we sometimes coin terms for things before we know exactly what they are and how they’ll be used. The resulting terms may capture a common set of aspirations and goals – as “cloud” did broadly for on-demand, self-service, and flexible computing. But such a term can also lump together diverse and even competing practices, technologies, and priorities to the point where important distinctions are glossed over and lost.
SYS-CON Events has announced today that Roger Strukhoff has been named conference chair of Cloud Expo and @ThingsExpo 2017 New York. The 20th Cloud Expo and 7th @ThingsExpo will take place on June 6-8, 2017, at the Javits Center in New York City, NY. "The Internet of Things brings trillions of dollars of opportunity to developers and enterprise IT, no matter how you measure it," stated Roger Strukhoff. "More importantly, it leverages the power of devices and the Internet to enable us all to im...
In his general session at 19th Cloud Expo, Manish Dixit, VP of Product and Engineering at Dice, discussed how Dice leverages data insights and tools to help both tech professionals and recruiters better understand how skills relate to each other and which skills are in high demand using interactive visualizations and salary indicator tools to maximize earning potential. Manish Dixit is VP of Product and Engineering at Dice. As the leader of the Product, Engineering and Data Sciences team at D...
Financial Technology has become a topic of intense interest throughout the cloud developer and enterprise IT communities. Accordingly, attendees at the upcoming 20th Cloud Expo at the Javits Center in New York, June 6-8, 2017, will find fresh new content in a new track called FinTech.
Monitoring of Docker environments is challenging. Why? Because each container typically runs a single process, has its own environment, utilizes virtual networks, or has various methods of managing storage. Traditional monitoring solutions take metrics from each server and applications they run. These servers and applications running on them are typically very static, with very long uptimes. Docker deployments are different: a set of containers may run many applications, all sharing the resource...
You have great SaaS business app ideas. You want to turn your idea quickly into a functional and engaging proof of concept. You need to be able to modify it to meet customers' needs, and you need to deliver a complete and secure SaaS application. How could you achieve all the above and yet avoid unforeseen IT requirements that add unnecessary cost and complexity? You also want your app to be responsive in any device at any time. In his session at 19th Cloud Expo, Mark Allen, General Manager of...
Today’s IT environments are increasingly heterogeneous, with Linux, Java, Oracle and MySQL considered nearly as common as traditional Windows environments. In many cases, these platforms have been integrated into an organization’s Windows-based IT department by way of an acquisition of a company that leverages one of those platforms. In other cases, the applications may have been part of the IT department for years, but managed by a separate department or singular administrator. Still, whether...
Without lifecycle traceability and visibility across the tool chain, stakeholders from Planning-to-Ops have limited insight and answers to who, what, when, why and how across the DevOps lifecycle. This impacts the ability to deliver high quality software at the needed velocity to drive positive business outcomes. In his general session at @DevOpsSummit at 19th Cloud Expo, Phil Hombledal, Solution Architect at CollabNet, discussed how customers are able to achieve a level of transparency that e...
Logs are continuous digital records of events generated by all components of your software stack – and they’re everywhere – your networks, servers, applications, containers and cloud infrastructure just to name a few. The data logs provide are like an X-ray for your IT infrastructure. Without logs, this lack of visibility creates operational challenges for managing modern applications that drive today’s digital businesses.
Rapid innovation, changing business landscapes, and new IT demands force businesses to make changes quickly. In the eyes of many, containers are at the brink of becoming a pervasive technology in enterprise IT to accelerate application delivery. In this presentation, attendees learned about the: The transformation of IT to a DevOps, microservices, and container-based architecture What are containers and how DevOps practices can operate in a container-based environment A demonstration of how ...
Cloud Expo, Inc. has announced today that Andi Mann returns to 'DevOps at Cloud Expo 2017' as Conference Chair The @DevOpsSummit at Cloud Expo will take place on June 6-8, 2017, at the Javits Center in New York City, NY. "DevOps is set to be one of the most profound disruptions to hit IT in decades," said Andi Mann. "It is a natural extension of cloud computing, and I have seen both firsthand and in independent research the fantastic results DevOps delivers. So I am excited to help the great t...
If you haven’t heard yet, CollabNet just put out some very big news for managing and gaining value from DevOps. We introduced CollabNet DevOps Lifecycle Manager (DLM) — a platform designed exclusively for providing a single pane of glass, dashboard, and traceability views across your DevOps toolchain and processes from planning to operations and that can be traced back to planning and development.
@DevOpsSummit taking place June 6-8, 2017 at Javits Center, New York City, is co-located with the 20th International Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. @DevOpsSummit at Cloud Expo New York Call for Papers is now open.
SYS-CON Events announced today that Fusion, a leading provider of cloud services, will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Fusion, a leading provider of integrated cloud solutions to small, medium and large businesses, is the industry’s single source for the cloud. Fusion’s advanced, proprietary cloud service platform enables the integration of leading edge solutions in the cloud, including cloud...
@DevOpsSummit at Cloud taking place June 6-8, 2017, at Javits Center, New York City, is co-located with the 20th International Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to wait for long developm...
The 20th International Cloud Expo has announced that its Call for Papers is open. Cloud Expo, to be held June 6-8, 2017, at the Javits Center in New York City, brings together Cloud Computing, Big Data, Internet of Things, DevOps, Containers, Microservices and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding business opportunity. Submit your speaking proposal ...