Welcome!

Microservices Expo Authors: Elizabeth White, Liz McMillan, Sematext Blog, Pat Romanski, Lori MacVittie

Related Topics: @CloudExpo, Java IoT, Microservices Expo, Linux Containers, Containers Expo Blog, @BigDataExpo

@CloudExpo: Article

Should Cloud Be Part of Your Backup and Disaster Recovery Plan?

How Cloud enables a fast, agile and cost-effective recovery process

Recent times have witnessed a huge shift in paradigm of data storage for backup and recovery. As the legendary Steve Jobs said, "The truth lies in the Cloud" - the introduction of the Cloud has enabled the fast and agile data recovery process which is can be more efficient, flexible and cost-effective than restoring data or systems from physical drives or tapes, as is the standard practice.

Cloud backup is the new approach to data storage and backup which allows the users to store a copy of the data on an offsite server - accessible via the network. The network that hosts the server may be private or a public one, and is often managed by some third-party service provider. Therefore, the provision of cloud solution for the data recovery services is a flourishing business market whereby the service provider charges the users in exchange for server access, storage space and bandwidth, etc.

The online backup systems typically are schedule-based; however continual backup is a possibility. Depending on the requirements of the system and application, the backup is updated at preset intermittent levels; with the aim of efficient time and bandwidth utilization. The popularity of the Cloud backup (or managed backup service) business lies in the convenience it offers. The cost is reduced due to elimination of physical resources such as hard disks from the scenario with the added benefit of the automatic execution of the backup.

Cloud-based disaster recovery are a highly viable and useful approach for ensuring business continuity.  Using a completely virtualized environment and techniques such as replicated data, services such as LAN Doctors, Inc., a New Jersey-based managed backup service was able to provide 100% uptime when one of their largest clients - a major processor of insurance claims, was hit by a hurricane, lost internet connectivity - and was unable to process claims.

This kind of near-realtime "off-site" disaster recovery capability is now available to organizations of all sizes - not just those large enough to afford redundant data centers with high speed network connections.

The use of Cloud for backup and disaster recovery will grow - the increase in demand of the cloud storage is due mainly to the exponential increase in the more critical data amounts of the organizations over time. Increasingly, organizations are replicating not only data - but entire virtual systems to the Cloud.  Adding to the Cloud's advantages is the reduced price, flexibility of repeated testing and the non-rigid structure of the Cloud which gives you full opportunity to scale up or down as per your requirements.  The flexibility to restore from physical to Cloud-based virtual machine adds to the attraction.

Why Cloud Is Better
The most common traditional backup mechanism used is to store the data backup offsite.  For small business owners, sometimes that means putting a tape or disk drive in the computer bag and bringing it home.  For others, tapes/disks are sent overnight to a secure location. The most common problems with this approach are that either the data is not being stored offsite (due to human or procedural error), or else the data and systems are not being backed up frequently enough.  Furthermore, when a recovery is necessary, the media typically need to be transported back on-site.  If the data backup is stored locally, then there is the chance of a regional problem impacting the ability to recover. In retrospect, cloud offers a complete regionally-immune mechanism for online data recovery by creating a backup online at a remote site and enabling prompt data recovery when required.  Backups can be done as often as required.

Other Cloud-based recovery services include fail-over servers. In this scenario, in the event of server failure, a virtualized server and all the data can be spun up - while the failed server is recovered.

The Cloud provides significant advantages to many organizations - it enables a full data recovery mechanism by using backups, fail-over servers and a storage site remotely placed so as to keep it safe from the local or regional factors.  Meanwhile, the organizations avoid the cost and effort associated with maintaining all that backup infrastructure.

The large corporations - those which can afford redundant and remote compute capacity, and typically already have sophisticated recovery mechanisms running, can benefit by leveraging the Cloud where appropriate - and hence experience even better results than before. Of course, for a large organization to exercise and experience benefits of Cloud to its full in this area, it would need to consider the architecture and applications of their systems and the kind of technology deployed.

Or Is It?
The biggest concern for people and enterprises when it comes to the Cloud is the security of their data and the issue of their privacy.  Data from IDC show that 93 percent of US companies are backing up at least some data to the Cloud; whereas that number falls to about 63% in Western Europe and even further (57%) in Asia-Pacific region.  The biggest reason European and Asia-Pacific organizations give for not leveraging Cloud for backup?  Security.

There can also be latency issues in dealing with effectively streaming large amounts of data to the Cloud - versus (for example) having a data storage appliance with built-in deduplication and data compression.

Cloud or Local?  The Verdict
The answer is clearly "it depends".  Backup should never be treated as a "one-size fits all" thing.  Your backup and recovery mechanisms need to be matched to your particular technological and business needs.  There's simply no substitute for knowing your own requirements, the capability of various technologies, and carrying out a thorough evaluation.  Don't be surprised if you end up with both Cloud and local - some systems simply require local backup (either for business, regulatory or technological reasons).

With the average size of an organization's data growing at 40% a year, one thing is certain -  there is a lot of backing up that needs to get done, both locally and on the Cloud.

More Stories By Hollis Tibbetts

Hollis Tibbetts, or @SoftwareHollis as his 50,000+ followers know him on Twitter, is listed on various “top 100 expert lists” for a variety of topics – ranging from Cloud to Technology Marketing, Hollis is by day Evangelist & Software Technology Director at Dell Software. By night and weekends he is a commentator, speaker and all-round communicator about Software, Data and Cloud in their myriad aspects. You can also reach Hollis on LinkedIn – linkedin.com/in/SoftwareHollis. His latest online venture is OnlineBackupNews - a free reference site to help organizations protect their data, applications and systems from threats. Every year IT Downtime Costs $26.5 Billion In Lost Revenue. Even with such high costs, 56% of enterprises in North America and 30% in Europe don’t have a good disaster recovery plan. Online Backup News aims to make sure you all have the news and tips needed to keep your IT Costs down and your information safe by providing best practices, technology insights, strategies, real-world examples and various tips and techniques from a variety of industry experts.

Hollis is a regularly featured blogger at ebizQ, a venue focused on enterprise technologies, with over 100,000 subscribers. He is also an author on Social Media Today "The World's Best Thinkers on Social Media", and maintains a blog focused on protecting data: Online Backup News.
He tweets actively as @SoftwareHollis

Additional information is available at HollisTibbetts.com

All opinions expressed in the author's articles are his own personal opinions vs. those of his employer.

@MicroservicesExpo Stories
The 19th International Cloud Expo has announced that its Call for Papers is open. Cloud Expo, to be held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, brings together Cloud Computing, Big Data, Internet of Things, DevOps, Digital Transformation, Microservices and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding business opportuni...
Internet of @ThingsExpo, taking place November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with the 19th International Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world and ThingsExpo Silicon Valley Call for Papers is now open.
Node.js and io.js are increasingly being used to run JavaScript on the server side for many types of applications, such as websites, real-time messaging and controllers for small devices with limited resources. For DevOps it is crucial to monitor the whole application stack and Node.js is rapidly becoming an important part of the stack in many organizations. Sematext has historically had a strong support for monitoring big data applications such as Elastic (aka Elasticsearch), Cassandra, Solr, S...
"We provide DevOps solutions. We also partner with some key players in the DevOps space and we use the technology that we partner with to engineer custom solutions for different organizations," stated Himanshu Chhetri, CTO of Addteq, in this SYS-CON.tv interview at DevOps at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
In his session at @DevOpsSummit at 19th Cloud Expo, Yoseph Reuveni, Director of Software Engineering at Jet.com, will discuss Jet.com's journey into containerizing Microsoft-based technologies like C# and F# into Docker. He will talk about lessons learned and challenges faced, the Mono framework tryout and how they deployed everything into Azure cloud. Yoseph Reuveni is a technology leader with unique experience developing and running high throughput (over 1M tps) distributed systems with extre...
There's a lot of things we do to improve the performance of web and mobile applications. We use caching. We use compression. We offload security (SSL and TLS) to a proxy with greater compute capacity. We apply image optimization and minification to content. We do all that because performance is king. Failure to perform can be, for many businesses, equivalent to an outage with increased abandonment rates and angry customers taking to the Internet to express their extreme displeasure.
SYS-CON Events announced today that LeaseWeb USA, a cloud Infrastructure-as-a-Service (IaaS) provider, will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. LeaseWeb is one of the world's largest hosting brands. The company helps customers define, develop and deploy IT infrastructure tailored to their exact business needs, by combining various kinds cloud solutions.
Adding public cloud resources to an existing application can be a daunting process. The tools that you currently use to manage the software and hardware outside the cloud aren’t always the best tools to efficiently grow into the cloud. All of the major configuration management tools have cloud orchestration plugins that can be leveraged, but there are also cloud-native tools that can dramatically improve the efficiency of managing your application lifecycle. In his session at 18th Cloud Expo, ...
SYS-CON Events announced today that Venafi, the Immune System for the Internet™ and the leading provider of Next Generation Trust Protection, will exhibit at @DevOpsSummit at 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Venafi is the Immune System for the Internet™ that protects the foundation of all cybersecurity – cryptographic keys and digital certificates – so they can’t be misused by bad guys in attacks...
Ovum, a leading technology analyst firm, has published an in-depth report, Ovum Decision Matrix: Selecting a DevOps Release Management Solution, 2016–17. The report focuses on the automation aspects of DevOps, Release Management and compares solutions from the leading vendors.
SYS-CON Events has announced today that Roger Strukhoff has been named conference chair of Cloud Expo and @ThingsExpo 2016 Silicon Valley. The 19th Cloud Expo and 6th @ThingsExpo will take place on November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. "The Internet of Things brings trillions of dollars of opportunity to developers and enterprise IT, no matter how you measure it," stated Roger Strukhoff. "More importantly, it leverages the power of devices and the Interne...
This is a no-hype, pragmatic post about why I think you should consider architecting your next project the way SOA and/or microservices suggest. No matter if it’s a greenfield approach or if you’re in dire need of refactoring. Please note: considering still keeps open the option of not taking that approach. After reading this, you will have a better idea about whether building multiple small components instead of a single, large component makes sense for your project. This post assumes that you...
Sharding has become a popular means of achieving scalability in application architectures in which read/write data separation is not only possible, but desirable to achieve new heights of concurrency. The premise is that by splitting up read and write duties, it is possible to get better overall performance at the cost of a slight delay in consistency. That is, it takes a bit of time to replicate changes initiated by a "write" to the read-only master database. It's eventually consistent, and it'...
Before becoming a developer, I was in the high school band. I played several brass instruments - including French horn and cornet - as well as keyboards in the jazz stage band. A musician and a nerd, what can I say? I even dabbled in writing music for the band. Okay, mostly I wrote arrangements of pop music, so the band could keep the crowd entertained during Friday night football games. What struck me then was that, to write parts for all the instruments - brass, woodwind, percussion, even k...
SYS-CON Events announced today that Isomorphic Software will exhibit at DevOps Summit at 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Isomorphic Software provides the SmartClient HTML5/AJAX platform, the most advanced technology for building rich, cutting-edge enterprise web applications for desktop and mobile. SmartClient combines the productivity and performance of traditional desktop software with the simp...
DevOps at Cloud Expo – being held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA – announces that its Call for Papers is open. Born out of proven success in agile development, cloud computing, and process automation, DevOps is a macro trend you cannot afford to miss. From showcase success stories from early adopters and web-scale businesses, DevOps is expanding to organizations of all sizes, including the world's largest enterprises – and delivering real results. Am...
When people aren’t talking about VMs and containers, they’re talking about serverless architecture. Serverless is about no maintenance. It means you are not worried about low-level infrastructural and operational details. An event-driven serverless platform is a great use case for IoT. In his session at @ThingsExpo, Animesh Singh, an STSM and Lead for IBM Cloud Platform and Infrastructure, will detail how to build a distributed serverless, polyglot, microservices framework using open source tec...
The Internet of Things will challenge the status quo of how IT and development organizations operate. Or will it? Certainly the fog layer of IoT requires special insights about data ontology, security and transactional integrity. But the developmental challenges are the same: People, Process and Platform and how we integrate our thinking to solve complicated problems. In his session at 19th Cloud Expo, Craig Sproule, CEO of Metavine, will demonstrate how to move beyond today's coding paradigm ...
Keeping pace with advancements in software delivery processes and tooling is taxing even for the most proficient organizations. Point tools, platforms, open source and the increasing adoption of private and public cloud services requires strong engineering rigor – all in the face of developer demands to use the tools of choice. As Agile has settled in as a mainstream practice, now DevOps has emerged as the next wave to improve software delivery speed and output. To make DevOps work, organization...

Let's just nip the conflation of these terms in the bud, shall we?

"MIcro" is big these days. Both microservices and microsegmentation are having and will continue to have an impact on data center architecture, but not necessarily for the same reasons. There's a growing trend in which folks - particularly those with a network background - conflate the two and use them to mean the same thing.

They are not.

One is about the application. The other, the network. T...