Welcome!

Microservices Expo Authors: Derek Weeks, Anders Wallgren, Jason Bloomberg, Yeshim Deniz, Elizabeth White

Related Topics: Containers Expo Blog, Microservices Expo

Containers Expo Blog: Article

A New Era of Post-Production Data Management Software

Solving legacy problems of backup to tape

By Jerome M. Wendt

Nearly every small, medium or large organization is heading down the path of adopting disk-based data protection as a way to solve their legacy problems of backup to tape. But what many of these organizations have yet to recognize is that as they adopt disk to store these post-production copies of data, a new opportunity is presenting itself. They now have the option to manage and leverage post-production data in ways that were never possible when on tape but now lack the tools to do so.

Nearly every organization is somewhere on the journey towards implementing disk-based backup. But that does not mean every organization is implementing it in the same way or using the same technologies. Some are introducing disk in lieu of tape as a backup target. Others are using disk-based snapshots while still others are using some form of replication. Some are even using a combination all of these forms of disk-based data protection.

Then as they store this post-production data on disk they are looking to optimize how this data is stored. This is leading most organizations to try to deduplicate this data whenever possible and then use replication to move the data off-site.

But now that organizations are storing all of this data to disk, they have both a new opportunity and a new challenge in front of them. The opportunity is they now have near-real time copies of production data on disk.

These post-production copies of data are at most 24 hours old and may only be hours, minutes or seconds removed from the production copy of data from which they were derived. As such, they are excellent candidates for use for testing, development and disaster recovery.

At the same time, the challenge is finding software that can do this "post-production data management." After all, it is one thing to create a backup, snapshot or set up a replication job for a particular set of production data. But it is quite another job to then manage the tens, hundreds or even possibly thousands of these copies of post-production data in such a way that they are useable and easily managed by an organization.

These requirements are making it evident that a new category of software, which I refer to as "post-production data management software," needs to emerge. This software needs to give organizations the ability to manage this post-production data in such a way that they may perform tasks like:

  • Minimizing or eliminating backup and recovery windows by ensuring that data is on the right tier of disk at the right time
  • Ensuring that these post-production copies of data (backups, snapshots, replicated) are deduplicated whenever possible to conserve storage capacity
  • Data is replicated locally or remotely so business continuity and disaster recovery can occur automatically with minimal need for setup or ongoing management

Already we are seeing these next generation types of post-production data management capabilities begin to emerge. This last week FalconStor announced its new RecoverTrac technology that is now part of its Continuous Data Protector (CDP) software. RecoverTrac's purpose is to help CDP's snapshots and replication features deliver real world, turnkey business continuity and disaster recovery functionality without requiring organizations to spend tens or hundreds of thousands of dollars and numerous man hours in order to deploy, test, implement and manage it.

InMage is another company that has also been doing something similar for some time. In a series of two blog entries I wrote a couple of years ago I covered how a Dr. James Tu, an Information Security Officer at a real estate company, was using InMage Scout's replication capabilities to replicate data between two sites. Then within Scout he was creating virtual mount points so he could use them to perform recoveries at the secondary site.

Yet possibly the most interesting entrant in this emerging space is a new company called Actifio. It has built its entire platform around this concept of post-production data management and has gone beyond just acting as a backup target, replicating production data or creating snapshots of production data. While it can perform all three of these functions (it can act as either a backup target or a production file system which replicates or takes snapshots of production data) its ultimate objective is to optimally manage the post-production data under its control.

Once it has these post-production copies of data in whatever form they take (backup, snapshot or replicated,) Actifio can then deduplicate this data, put it on the appropriate tier of disk for recoveries or replicate it offsite for DR.

What specifically makes Actifio unique is its virtualization technology to re-purpose a unique copy of all post-production data for each of the different operational requirements. Instead of the complexity and cost of multiple tools for backup, snapshot, deduplication, disaster recovery or business continuance, Actifio is a single solution that manages data through its entire life cycle.

In the next few years I expect almost every size company to complete the transition from tape-based backup to using some form of disk-based data protection. However once that transition is complete, these organizations are going to recognize that just having all of their post-production data stored on disk adds insufficient value to their organization.

Instead they will want the option to easily and centrally manage where this post-production data is placed to facilitate business continuity, disaster recoveries and even operational testing and development of production applications. It is for this reason that I believe that companies will rapidly move beyond just implementing disk-based data protection and that a new era of organizations wanting and needing software that automates the management and placement of their post-production data is dawning.

More Stories By Derek Harris

Derek Harris Sr. is a senior technology writer and blogger with more than 20 years experience in journalism.

While covering a broad spectrum of technology segments, his focus is weighted on enterprise technologies in the data storage, security and infrastructure spaces.

@MicroservicesExpo Stories
Earlier this week, we hosted a Continuous Discussion (#c9d9) on Continuous Delivery (CD) automation and orchestration, featuring expert panelists Dondee Tan, Test Architect at Alaska Air, Taco Bakker, a LEAN Six Sigma black belt focusing on CD, and our own Sam Fell and Anders Wallgren. During this episode, we discussed the differences between CD automation and orchestration, their challenges with setting up CD pipelines and some of the common chokepoints, as well as some best practices and tips...
When I talk about driving innovation with self-organizing teams, I emphasize that such self-organization includes expecting the participants to organize their own teams, give themselves their own goals, and determine for themselves how to measure their success. In contrast, the definition of skunkworks points out that members of such teams are “usually specially selected.” Good thing he added the word usually – because specially selecting such teams throws a wrench in the entire works, limiting...
SoftLayer operates a global cloud infrastructure platform built for Internet scale. With a global footprint of data centers and network points of presence, SoftLayer provides infrastructure as a service to leading-edge customers ranging from Web startups to global enterprises. SoftLayer's modular architecture, full-featured API, and sophisticated automation provide unparalleled performance and control. Its flexible unified platform seamlessly spans physical and virtual devices linked via a world...
Automation is a critical component of DevOps and Continuous Delivery. This morning on #c9d9 we discussed CD Automation and how you can apply Automation to accelerate release cycles, improve quality, safety and governance? What is the difference between Automation and Orchestration? Where should you begin your journey to introduce both?
SYS-CON Events announced today TechTarget has been named “Media Sponsor” of SYS-CON's 18th International Cloud Expo, which will take place on June 7–9, 2016, at the Javits Center in New York City, NY, and the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. TechTarget is the Web’s leading destination for serious technology buyers researching and making enterprise technology decisions. Its extensive global networ...
SYS-CON Events announced today that Commvault, a global leader in enterprise data protection and information management, has been named “Bronze Sponsor” of SYS-CON's 18th International Cloud Expo, which will take place on June 7–9, 2016, at the Javits Center in New York City, NY, and the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Commvault is a leading provider of data protection and information management...
As AT&Ts VP of Domain 2.0 architecture writes one aspect of their Domain 2.0 strategy is a goal to embrace a Microservices Application Architecture. One page 9 they describe how these envisage them fitting into the ECOMP architecture: "The initial steps of the recipes include a homing and placement task using constraints specified in the requests. ‘Homing and Placement' are micro-services involving orchestration, inventory, and controllers responsible for infrastructure, network, and applicati...
Many banks and financial institutions are experimenting with containers in development environments, but when will they move into production? Containers are seen as the key to achieving the ultimate in information technology flexibility and agility. Containers work on both public and private clouds, and make it easy to build and deploy applications. The challenge for regulated industries is the cost and complexity of container security compliance. VM security compliance is already challenging, ...
A strange thing is happening along the way to the Internet of Things, namely far too many devices to work with and manage. It has become clear that we'll need much higher efficiency user experiences that can allow us to more easily and scalably work with the thousands of devices that will soon be in each of our lives. Enter the conversational interface revolution, combining bots we can literally talk with, gesture to, and even direct with our thoughts, with embedded artificial intelligence, wh...
SYS-CON Events announced today that Tintri Inc., a leading producer of VM-aware storage (VAS) for virtualization and cloud environments, will exhibit at the 18th International CloudExpo®, which will take place on June 7-9, 2016, at the Javits Center in New York City, New York, and the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
Just last week a senior Hybris consultant shared the story of a customer engagement on which he was working. This customer had problems, serious problems. We’re talking about response times far beyond the most liberal acceptable standard. They were unable to solve the issue in their eCommerce platform – specifically Hybris. Although the eCommerce project was delivered by a system integrator / implementation partner, the vendor still gets involved when things go really wrong. After all, the vendo...
SYS-CON Events announced today that EastBanc Technologies will exhibit at SYS-CON's 18th International Cloud Expo®, which will take place on June 7-9, 2016, at the Javits Center in New York City, NY. EastBanc Technologies has been working at the frontier of technology since 1999. Today, the firm provides full-lifecycle software development delivering flexible technology solutions that seamlessly integrate with existing systems – whether on premise or cloud. EastBanc Technologies partners with p...
SYS-CON Events announced today that AppNeta, the leader in performance insight for business-critical web applications, will exhibit and present at SYS-CON's @DevOpsSummit at Cloud Expo New York, which will take place on June 7-9, 2016, at the Javits Center in New York City, NY. AppNeta is the only application performance monitoring (APM) company to provide solutions for all applications – applications you develop internally, business-critical SaaS applications you use and the networks that deli...
The pace of innovation, vendor lock-in, production sustainability, cost-effectiveness, and managing risk… In his session at 18th Cloud Expo, Dan Choquette, Founder of RackN, will discuss how CIOs are challenged finding the balance of finding the right tools, technology and operational model that serves the business the best. He will discuss how clouds, open source software and infrastructure solutions have benefits but also drawbacks and how workload and operational portability between vendors...
SYS-CON Events announced today that BMC Software has been named "Siver Sponsor" of SYS-CON's 18th Cloud Expo, which will take place on June 7-9, 2015 at the Javits Center in New York, New York. BMC is a global leader in innovative software solutions that help businesses transform into digital enterprises for the ultimate competitive advantage. BMC Digital Enterprise Management is a set of innovative IT solutions designed to make digital business fast, seamless, and optimized from mainframe to mo...
In the rush to compete in the digital age, a successful digital transformation is essential, but many organizations are setting themselves up for failure. There’s a common misconception that the process is just about technology, but it’s not. It’s about your business. It shouldn’t be treated as an isolated IT project; it should be driven by business needs with the committed involvement of a range of stakeholders.
While there has been much ado about interoperability, there are still no real solutions, same as last year and the year before that. The large EHR vendors who continue to dominate the market still maintain that interoperability is all but solved, still can't connect EHRs across the continuum causing frustration by providers and a disservice to patients. The ONC pays lip service to the problem, but that is about it. It is time for the healthcare industry to consider alternatives like middleware w...
SYS-CON Events announced today that Isomorphic Software will exhibit at SYS-CON's [email protected] at Cloud Expo New York, which will take place on June 7-9, 2016, at the Javits Center in New York City, NY. Isomorphic Software provides the SmartClient HTML5/AJAX platform, the most advanced technology for building rich, high-productivity enterprise web applications for any device. SmartClient couples the industry’s broadest, deepest UI component set with a java server framework to deliver an end-...
Our CTO, Anders Wallgren, recently sat down to take part in the “B2B Nation: IT” podcast — the series dedicated to serving the IT professional community with expert opinions and advice on the world of information technology. Listen to the great conversation, where Anders shares his thoughts on DevOps lessons from large enterprises, the growth of microservices and containers, and more.
SYS-CON Events announced today the Docker Meets Kubernetes – Intro into the Kubernetes World, being held June 9, 2016, in conjunction with 18th Cloud Expo | @ThingsExpo, at the Javits Center in New York, NY. Register for 'Docker Meets Kubernetes Workshop' Here! This workshop led by Sebastian Scheele, co-founder of Loodse, introduces participants to Kubernetes (container orchestration). Through a combination of instructor-led presentations, demonstrations, and hands-on labs, participants learn ...