Welcome!

Microservices Expo Authors: Pat Romanski, Liz McMillan, Elizabeth White, Mehdi Daoudi, Flint Brenton

Related Topics: Microservices Expo

Microservices Expo: Article

BCP Lessons Learned and New Ideas for IT Infrastructure Continuity

Learn How to Justify the Creation of Disaster Recovery Facilities

Businesses in the southeastern United States have been hit hard with hurricanes in the last few years, and 2008 was no exception. As a project manager and CBCP for over 1600 disaster recovery deployments I can share real examples of how entire data centers were failed over to the DR operations center in preparation for hurricanes, while others (due to poor planning) did not have the same success. Those that were successful were efficient in organizing the RTO of their communication servers which helped them prioritize the recovery efforts as well utilize creative testing procedures in order to not disrupt normal business activity. The first priority of a BCP is to ensure the safety of the employees, but being able to communicate to those needed is also an important step for successfully executing a BCP. Because of this preparedness many businesses I have heard from were able to proactively allow their employees evacuate and still provide them remote access for business operations from almost anywhere. I will review a few of the  examples of architecture, solutions and best practices for exercising controls in those events as well as discuss what future technology may be utilized to better help justify the creation of disaster recovery facilities.

10 Professional Practices for BCP
There are ten professional practices for business continuity planning; all equally important and if followed appropriately will allow you to create a solid foundation to build upon. For the purpose of this article I will summarize the professional practices, but for more information visit the Disaster Recovery International Institute (www.drii.org). DRII is an excellent resource for BCP and is a consortium of business continuity professionals dedicated to setting industry standards and sharing knowledge around the practice of business continuity management.

The first step in building a BCP is Program Initiation and Management. This step is designed to establish executive approval, support and justification for the need of a resiliency program. Start with building a dedicated team that is committed to supporting the BCP initiative and selecting team members that can effectively manage roles and responsibilities for their portion of the plan. Cost justification is often a hurdle in establishing the need for disaster recovery facilities, so one tip would be to utilize your current assets such as other offices or co-location facilities. You can also work with the IT department to help tie in the IT management budget into the BCP so that you are not just providing continuity in the event of a disaster, but also high availability for day-to-day operational maintenance.

The next couple of steps are important in determining the risk (risk evaluation) your organization faces from either a natural or environment disaster perspective and then determine the business impact (BIA) should one of those events occur. This will help you determine the next step in the business continuity strategy you design and implement to meet your defined recovery point (RPO) and time (RTO) objectives. Once those objectives and controls are defined you will need to integrate emergency response and operations in order to define the process in which a disaster is declared and what prompts the initiation of the BCP.

These previous steps are what allow you to design and implement a comprehensive strategy that meets the requirements of your company’s objectives. I have seen companies try to short cut these previous steps and immediately skip to implementing a solution, only to find out that their infrastructure doesn’t have enough power, bandwidth, resources and or executive approval to support the controls implemented. So the lesson learned is, don’t try to take short cuts and jump into something you have never done before. Following the previous steps will allow you to proceed and likely prevent challenges you may face during the deployment and execution of your plan.

The next three steps include designing and implementing the BCP, generating awareness and training your organization on what to do in event of a disaster, then exercising those plans regularly. Exercising BCP is typically recommended to be tied to your change control process which means the plan should be reviewed any time there is a change within the organization that may affect the plan. (That can be anything as small as a software update to some of the business critical servers to a BCP member leaving the company.) Depending on the situation, exercises could take place as frequently as once a month or at very least 2-3 times per year so that there is a consistent awareness of the plan and procedures.

The last two practices, crisis communication and coordinating with external agencies is really the culmination of the previous practices and will ultimately be the success or failure of your plan. In the event of a disaster, communication is critical to coordinating with emergency responders and your own business continuity team to make sure evacuations and safety procedures are implemented effectively.

When Planning and Exercising is Done Right
Planning is your best friend when it comes to rolling out controls for a business continuity solution. Starting with executive buy in though budget, infrastructure, process, procedures, testing and ultimately execution you can’t plan enough. And when it’s done right deployments go smoothly. However, is more than one way to go about this. As the saying goes “Don’t eat the elephant all in one bite”. Breaking down your overall rollout plan into smaller projects will help you better manage details as well as prioritize the order of the overall deployment. Here are some quotes from companies who did it right and were glad they did after Hurricane Ike made landfall:

  • “All is OK and thanks. Our files were mirrored to our Austin facility with no loss of data or applications. Winds tore a 30'x30' hole in the building roof.  The water damage was bad.  The computer servers were spared but alot of workstations were soaked.  Houston operations were running in Austin just before the hurricane hit and the transfer was seamless.”
  • “Thanks, our company is doing just fine. With our replicated data to one of our other locations, we were up and seeing patients once the patients could get to us. We appreciate your concern, and your overall support of our organization. On behalf of our organization, we want to say thank you!”
  • “Yes we did make it out alive; we activated our business contingency plan, and relocated to Dallas. Luckily our solution allowed us to failover and business continued. “

Exercising the business continuity plan on a regular basis helped these companies not only be prepared but assured that they were ready for anything. And with the adaption of new technologies for IT infrastructure, testing those plans are even easier to exercise while minimizing impact to production operations. In previous years testing business continuity plans for the data center usually required shutting down the entire production facility and running through the restoration process. With the adoption of real-time replication software, co-location facilities and virtualization testing can be accomplished with minimal impact to a production environment. If you have a dedicated disaster recovery facility with hot standby servers you could just segment the networks from each other and bring the site online. However, you had to be very careful about making sure those two sites weren’t talking to each other via domains or active directory services.

How Dynamic Infrastructure Is being used to facilitate BCP Exercise

Dynamic Infrastructure is defined by some as ‘the ability to rapidly move and provision workloads with security and inherent protection’. It may be a new idea to you, but it is being adopted within the IT community with great success. Dynamic Infrastructure not only simplifies the disaster recovery procedures for data center managers, but also provides the ability to use those same controls for day-to-day operations to keep your business operations available all the time - not just during disasters. With the adoption of virtualization technologies saving costs on hardware, power and cooling, data center management budgets can be combined with BCP for maximizing infrastructure availability. These technologies also assist BCP exercises by simulating recovery servers and sites without bringing down production servers. Some solutions like VMware® Site Recovery Manager have this feature but also have some inherent issues. For instance, in the event of a real disaster the virtual solution doesn’t have any failback capability. Typically once that process has been started there is no turning back without a complete restoration which could take days depending on the number of systems and or volume of data that needed to be restored. Dynamic Infrastructure provides the functionality that others are missing as well as allowing for rapid failback capabilities for smaller or “little d” disasters, which are more likely to impact a business critical system.

The Next Generation of BCP
With future technology delivering Dynamic Infrastructure, cloud computing and mobile communication devices, learning how they can protect IT infrastructure for Business Continuity Planning has never been more important. Many management services are offering remote or mobile access for initiating some of these data center management functions. Imagine if you could initiate a failover of a server via your iPhone or BlackBerry®. The reality is that it isn’t very far off. It’s  possible that many business- critical services could be run via cloud computing so that services are available anywhere they are needed - even if there was a disaster at the production facility.

However, this begs the question. Who is protecting the cloud and what is their business continuity plan?

More Stories By Brace Rennels

Brace Rennels is a passionate and experienced interactive marketing professional who thrives on building high energy marketing teams to drive global web strategies, SEO, social media and online PR web marketing. Recognized as an early adopter of technology and applying new techniques to innovative creative marketing, drive brand awareness, lead generation and revenue. As a Sr. Manager Global of Website Strategies his responsibilities included developing and launching global social media, SEO and web marketing initiatives and strategy. Recognized for applying innovative solutions to address unique problems and manage business relationships to effectively accomplish enterprise objectives. An accomplished writer, blogger and author for several publications on various marketing, social media and technical subjects such as industry trends, cloud computing, virtualization, website marketing, disaster recovery and business continuity. Publications include CIO.com, Enterprise Storage Journal, TechNewsWorld, Sys-Con, eWeek and Peer to Peer Magazine. Follow more of Brace's writing on his blog: http://bracerennels.com

@MicroservicesExpo Stories
With the rise of DevOps, containers are at the brink of becoming a pervasive technology in Enterprise IT to accelerate application delivery for the business. When it comes to adopting containers in the enterprise, security is the highest adoption barrier. Is your organization ready to address the security risks with containers for your DevOps environment? In his session at @DevOpsSummit at 21st Cloud Expo, Chris Van Tuin, Chief Technologist, NA West at Red Hat, will discuss: The top security r...
DevOps at Cloud Expo – being held October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA – announces that its Call for Papers is open. Born out of proven success in agile development, cloud computing, and process automation, DevOps is a macro trend you cannot afford to miss. From showcase success stories from early adopters and web-scale businesses, DevOps is expanding to organizations of all sizes, including the world's largest enterprises – and delivering real r...
The “Digital Era” is forcing us to engage with new methods to build, operate and maintain applications. This transformation also implies an evolution to more and more intelligent applications to better engage with the customers, while creating significant market differentiators. In both cases, the cloud has become a key enabler to embrace this digital revolution. So, moving to the cloud is no longer the question; the new questions are HOW and WHEN. To make this equation even more complex, most ...
The last two years has seen discussions about cloud computing evolve from the public / private / hybrid split to the reality that most enterprises will be creating a complex, multi-cloud strategy. Companies are wary of committing all of their resources to a single cloud, and instead are choosing to spread the risk – and the benefits – of cloud computing across multiple providers and internal infrastructures, as they follow their business needs. Will this approach be successful? How large is the ...
21st International Cloud Expo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud strategy. Me...
Many organizations adopt DevOps to reduce cycle times and deliver software faster; some take on DevOps to drive higher quality and better end-user experience; others look to DevOps for a clearer line-of-sight to customers to drive better business impacts. In truth, these three foundations go together. In this power panel at @DevOpsSummit 21st Cloud Expo, moderated by DevOps Conference Co-Chair Andi Mann, industry experts will discuss how leading organizations build application success from all...
You know you need the cloud, but you’re hesitant to simply dump everything at Amazon since you know that not all workloads are suitable for cloud. You know that you want the kind of ease of use and scalability that you get with public cloud, but your applications are architected in a way that makes the public cloud a non-starter. You’re looking at private cloud solutions based on hyperconverged infrastructure, but you’re concerned with the limits inherent in those technologies.
‘Trend’ is a pretty common business term, but its definition tends to vary by industry. In performance monitoring, trend, or trend shift, is a key metric that is used to indicate change. Change is inevitable. Today’s websites must frequently update and change to keep up with competition and attract new users, but such changes can have a negative impact on the user experience if not managed properly. The dynamic nature of the Internet makes it necessary to constantly monitor different metrics. O...
Today companies are looking to achieve cloud-first digital agility to reduce time-to-market, optimize utilization of resources, and rapidly deliver disruptive business solutions. However, leveraging the benefits of cloud deployments can be complicated for companies with extensive legacy computing environments. In his session at 21st Cloud Expo, Craig Sproule, founder and CEO of Metavine, will outline the challenges enterprises face in migrating legacy solutions to the cloud. He will also prese...
Enterprises are moving to the cloud faster than most of us in security expected. CIOs are going from 0 to 100 in cloud adoption and leaving security teams in the dust. Once cloud is part of an enterprise stack, it’s unclear who has responsibility for the protection of applications, services, and data. When cloud breaches occur, whether active compromise or a publicly accessible database, the blame must fall on both service providers and users. In his session at 21st Cloud Expo, Ben Johnson, C...
Agile has finally jumped the technology shark, expanding outside the software world. Enterprises are now increasingly adopting Agile practices across their organizations in order to successfully navigate the disruptive waters that threaten to drown them. In our quest for establishing change as a core competency in our organizations, this business-centric notion of Agile is an essential component of Agile Digital Transformation. In the years since the publication of the Agile Manifesto, the conn...
As DevOps methodologies expand their reach across the enterprise, organizations face the daunting challenge of adapting related cloud strategies to ensure optimal alignment, from managing complexity to ensuring proper governance. How can culture, automation, legacy apps and even budget be reexamined to enable this ongoing shift within the modern software factory?
The nature of the technology business is forward-thinking. It focuses on the future and what’s coming next. Innovations and creativity in our world of software development strive to improve the status quo and increase customer satisfaction through speed and increased connectivity. Yet, while it's exciting to see enterprises embrace new ways of thinking and advance their processes with cutting edge technology, it rarely happens rapidly or even simultaneously across all industries.
These days, APIs have become an integral part of the digital transformation journey for all enterprises. Every digital innovation story is connected to APIs . But have you ever pondered over to know what are the source of these APIs? Let me explain - APIs sources can be varied, internal or external, solving different purposes, but mostly categorized into the following two categories. Data lakes is a term used to represent disconnected but relevant data that are used by various business units wit...
"When we talk about cloud without compromise what we're talking about is that when people think about 'I need the flexibility of the cloud' - it's the ability to create applications and run them in a cloud environment that's far more flexible,” explained Matthew Finnie, CTO of Interoute, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
"NetApp's vision is how we help organizations manage data - delivering the right data in the right place, in the right time, to the people who need it, and doing it agnostic to what the platform is," explained Josh Atwell, Developer Advocate for NetApp, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
One of the biggest challenges with adopting a DevOps mentality is: new applications are easily adapted to cloud-native, microservice-based, or containerized architectures - they can be built for them - but old applications need complex refactoring. On the other hand, these new technologies can require relearning or adapting new, oftentimes more complex, methodologies and tools to be ready for production. In his general session at @DevOpsSummit at 20th Cloud Expo, Chris Brown, Solutions Marketi...
Leading companies, from the Global Fortune 500 to the smallest companies, are adopting hybrid cloud as the path to business advantage. Hybrid cloud depends on cloud services and on-premises infrastructure working in unison. Successful implementations require new levels of data mobility, enabled by an automated and seamless flow across on-premises and cloud resources. In his general session at 21st Cloud Expo, Greg Tevis, an IBM Storage Software Technical Strategist and Customer Solution Architec...
Most of the time there is a lot of work involved to move to the cloud, and most of that isn't really related to AWS or Azure or Google Cloud. Before we talk about public cloud vendors and DevOps tools, there are usually several technical and non-technical challenges that are connected to it and that every company needs to solve to move to the cloud. In his session at 21st Cloud Expo, Stefano Bellasio, CEO and founder of Cloud Academy Inc., will discuss what the tools, disciplines, and cultural...
DevOps is often described as a combination of technology and culture. Without both, DevOps isn't complete. However, applying the culture to outdated technology is a recipe for disaster; as response times grow and connections between teams are delayed by technology, the culture will die. A Nutanix Enterprise Cloud has many benefits that provide the needed base for a true DevOps paradigm. In their Day 3 Keynote at 20th Cloud Expo, Chris Brown, a Solutions Marketing Manager at Nutanix, and Mark Lav...