Click here to close now.


Microservices Expo Authors: Brian Daleiden, Elizabeth White, Mav Turner, Dana Gardner, Pat Romanski

Related Topics: @CloudExpo, Java IoT, Microservices Expo, Containers Expo Blog, IoT User Interface, Agile Computing

@CloudExpo: Article

Avoiding the Hidden Costs That Derail Cloud Projects

The Challenge: Making Your Private Cloud Fit Your IT Infrastructure Puzzle

Most companies that have embarked on a private cloud journey find themselves in one of two unfortunate positions: they've already spent much more than they had planned or they're struggling with how to make sure costs don't get out of hand. These are typically companies with sophisticated IT organizations - organizations that ask tough questions and put detailed plans in place. For example, an international bank spent millions of dollars and six months of professional services time before scrapping their existing cloud project and restarting it with a completely new approach and toolset.

The Challenge: Making Your Private Cloud Fit Your IT Infrastructure Puzzle
Cloud automation vendors make deploying a private cloud sound easy. If you take their basic out-of-the-box capability, the good ones will probably take you anywhere from a few hours to a few days to get a simple self-service private cloud working. While that may make a nice proof-of-concept demo, will that actually meet the needs of how you manage your infrastructure or will you need to replace prior technology and best practice investments to make your cloud work?

Cloud management is not a standalone entity. For your cloud to be successful, it needs to integrate and work with your existing management infrastructure and best practices. As you evaluate cloud management platforms, you need to assess how each tool works with your current and future management ecosystem. Your cloud management choice will not only impact prior investments, it can also limit your future choices. In order to avoid some of the hidden private cloud costs, evaluate how cloud management options will fit with your existing IT ecosystem.

  • Deployment Technologies
    Does your cloud management plaform work with the current technologies used to deploy your infrastructure? This includes both the private resources in your data centers and public cloud resources. Does it support the operating system, server virtualization tools, and desktop technologies being used today as well as the ones you may want to use in the future?
  • Management Infrastructure
    Typically, the delivery of a private cloud service requires a work order ticket to be generated, an internal database accessed, and that specific tools be used to deploy software, monitor the environment and take corrective action. How easily does your cloud management platform work with your current management tools and processess? Will you need to replace these tools or pay for extensive customization to make your cloud management solution work?
  • Best Practices
    As part of continuous process improvement, companies should always be looking to streamline and improve their processess. Deploying a private cloud is a large paradigm shift and some process changes will likely be needed to facilitate end-to-end automation. However, your cloud management software should not force changes on you that don't make sense within the guidelines established for your company. Remember that substantial changes required by the vendor are likely to be costly in terms of time and effort, if not also technology.
  • Custom Self-Service Portal
    All cloud management products provide some level of self-service capabilities. An out-of-the-box self-service portal simplifies initial deployment. However, what if your company already has a self-service portal or existing work order ticketing system? The last thing you will need is yet another portal. How easily can your existing portal be integrated with your cloud management services and will you need to spend time and money reproducing all the security in the custom portal?

Cloud Management Extensibility
Extensibility is also a critical factor in private cloud costs. Wikipedia defines extensibility as: "In systems architecture, extensibility means the system is designed to include hooks and mechanisms for expanding and enhancing the capabilities without having to make major changes to the system infrastructure." Often this means making modifications at runtime without requiring changes to the original source code.

Most cloud automation products will only automate a portion of your provisioning, ongoing management, or decommissioning processes. Therefore, an extensible architecture, combined with multi-vendor support, are fundamental components of cloud management platforms as they're needed to facilitate integration with the current IT infrastructure and management ecosystem.

With regard to extensibility, cloud management software products typically fall into one of the following two categories:

  • Prescriptive Tools
    Many cloud management solutions were built for a specific problem, like lab management, and have prescribed processes, limited interoperability, and lack the extensibility features needed to adapt to more broad-scale deployment requirements.

Any tool that requires drastic changes to existing management tools, infrastructure components, or operational processes will result in additional capital costs required to replace existing technology as well as additional investment in people who can use this new technology and processes.

The other challenge is that your company will likely be unable to achieve the savings you have envisioned because the automation solution will not meet the needs of the various business units. These business groups will either stay with their current manual process, reducing the percentage of your infrastructure that can be moved to an on-demand cloud, or they will implement a different cloud solution that does not provide your company with the operational scalability and savings you could have had with a single integrated solution.

  • Automation Toolkits
    Some vendors provide very basic cloud management capabilities and augment their cloud management offering by providing separate run book toolkits or "orchestration" products. This option allows companies to completely customize their cloud solution. However, there are multiple hidden costs associated with this implementation choice:

Initial services costs outweigh the software costs
These solutions tend to require lengthy and expensive custom services projects where services typically cost three times as much as the software.

Customized solutions are not easily extended to other business
In addition to the higher upfront costs, cloud automation solutions built with an automation toolkit tend to be built specifically for the needs of a single business. When companies try and expand the use of the highly customized solutions, they either have further customization costs or suffer from limited adoption across the enterprise.

Customized solutions make upgrades to newer release difficult
Many customizations strand the implementation at a specific release, making upgrades to newer versions difficult and costly.

Mitigating Private Cloud's Hidden Costs
Hopefully you now have a better understanding of some of the hidden cloud deployment costs and how your automation choice can not only affect costs but also impact your actual savings. It's important that you can adapt and expand automation with tools targeted at both IT operations as well as developers. In order to enable the quickest time-to-cloud value, companies should consider the following capabilities when evaluating cloud management platform software:

  • Comprehensive out-of-the-box functionality
    First and foremost, you will want a cloud management solution with a comprehensive set of out-of-the-box cloud management features. Many vendors only focus on initial provisioning capabilities. Make sure your cloud management platform automates the complete life cycle including ongoing management, resource reclamation, and decommissioning including archiving. The more features available out-of-the-box, the less need for costly custom services to extend the product's core functionality.
  • Broad multi-vendor support
    When evaluating cloud management options, make sure that the tool you choose can orchestrate end-to-end delivery across all the technology and management components that make up your implementation. Most vendors only support components from their own offerings. Unless you're a single-vendor shop, that means you may need to discard your prior investments and be locked into that vendor's technology in the future. Multi-vendor support includes technologies used in your private cloud as well as public cloud resources.
  • Policy enabled extensibility
    How extensible is your cloud management platform by just changing configuration parameters? Can you select different provisioning workflows, collect custom data, define resource limits and service levels, or create custom approvals or reclamation workflows? These are just a few of the many customizations you should be able to make via policies. The more you can customize your cloud deployment via policies, the quicker and more cost-effectively you will be able to deploy a private cloud infrastructure that meets company's specific needs.
  • Business-aware governance
    Being able to modify the behavior of your cloud via policies is important, but just as important is the granularity of the policies that can be configured. They must be granular enough to allow different business groups to have different services that are built and constructed using different processes, resources and service levels. For example, the way you provision and manage IT resources can be quite different for dev/test vs. production vs. desktops. Business-aware governance and control is fundamental to meeting the unique needs of each business and driving broader cross-group adoption of cloud services.
  • Modify out-of-the-box automation
    Can you easily add tasks or call scripts at various states in the machine's life cycle? Is there a visual workflow editing tool and a library of predefined activities that simplify the customization process? For example: How easily can you add a self-service command to perform a specific function, access/retrieve information from a custom DB as part of the provisioning process, or execute a script to customize a machine configuration? Are you modifying the workflows that ship with the product or is this a separate run book automation or "orchestration" tool that you need to bolt onto the cloud management tool?
  • Automate additional tasks
    Can the cloud automation platform be used to automate additional tasks that go well beyond simple modifications to out-of-the-box processes? For example, one company extended the process used to provision new desktops to also automate the process of onboarding new employees. If you need this level of extensibility, one factor that should be considered is the availability of developers with this skill set. Automation tools based on de facto standards like Visual Studio and .NET will be much easier to find developers for than a vendor-specific automation tool.

Implementing and managing a private or hybrid cloud doesn't have to be so expensive. Make sure you're armed with the knowledge needed to fully evaluate your cloud vendor's offerings for potential hidden costs. Otherwise your business may find itself putting cloud projects on hold or having to justify a much-increased budget.

More Stories By Rich Bourdeau

Rich Bourdeau is VP of Marketing at DynamicOps. He has over 20 years of experience in developing, managing and marketing IT infrastructure management solutions for enterprises. Rich has spent the last four years at DynamicOps helping companies deploy and manage their private cloud infrastructures. He is a regular contributor to the DynamicOps blog and has authored papers on Must Have Cloud Management Capabilities as well as Building the Business Case for Private Cloud. Rich can be reached at [email protected] if you want to learn more about cloud management.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.

@MicroservicesExpo Stories
In today’s pharmaceutical supply chain, counterfeit activity is thriving. As pharma companies have expanded target markets and outsourced production over the last decade, the supply chain has become increasingly global, virtual, and vulnerable. Illicit activity has thrived, and patients have suffered, with hundreds of thousands dying each year from counterfeit and contaminated drugs. More than 40 countries have responded with new laws that regulate prescription medications as they travel throug...
The Internet of Things is clearly many things: data collection and analytics, wearables, Smart Grids and Smart Cities, the Industrial Internet, and more. Cool platforms like Arduino, Raspberry Pi, Intel's Galileo and Edison, and a diverse world of sensors are making the IoT a great toy box for developers in all these areas. In this Power Panel at @ThingsExpo, moderated by Conference Chair Roger Strukhoff, panelists discussed what things are the most important, which will have the most profound...
As organizations shift towards IT-as-a-service models, the need for managing & protecting data residing across physical, virtual, and now cloud environments grows with it. CommVault can ensure protection & E-Discovery of your data - whether in a private cloud, a Service Provider delivered public cloud, or a hybrid cloud environment – across the heterogeneous enterprise.
Naturally, new and exciting technologies and trends like software defined networking, the Internet of Things and the cloud tend to get the lion’s share of attention these days, including when it comes to security. However, it’s important to never forget that at the center of it all is still the enterprise network. And as evidenced by the ever-expanding landslide of data breaches that could have been prevented or at least their impact lessened by better practicing network security basics, it’s ...
PubNub has announced the release of BLOCKS, a set of customizable microservices that give developers a simple way to add code and deploy features for realtime apps.PubNub BLOCKS executes business logic directly on the data streaming through PubNub’s network without splitting it off to an intermediary server controlled by the customer. This revolutionary approach streamlines app development, reduces endpoint-to-endpoint latency, and allows apps to better leverage the enormous scalability of PubNu...
Put the word continuous in front of many things and we help define DevOps: continuous delivery, continuous testing, continuous assessment, and there is more. The next BriefingsDirect DevOps thought leadership discussion explores the concept of continuous processes around the development and deployment of applications and systems. Put the word continuous in front of many things and we help define DevOps: continuous delivery, continuous testing, continuous assessment, and there is more.
Growth hacking is common for startups to make unheard-of progress in building their business. Career Hacks can help Geek Girls and those who support them (yes, that's you too, Dad!) to excel in this typically male-dominated world. Get ready to learn the facts: Is there a bias against women in the tech / developer communities? Why are women 50% of the workforce, but hold only 24% of the STEM or IT positions? Some beginnings of what to do about it! In her Day 2 Keynote at 17th Cloud Expo, San...
In today's enterprise, digital transformation represents organizational change even more so than technology change, as customer preferences and behavior drive end-to-end transformation across lines of business as well as IT. To capitalize on the ubiquitous disruption driving this transformation, companies must be able to innovate at an increasingly rapid pace. Traditional approaches for driving innovation are now woefully inadequate for keeping up with the breadth of disruption and change facin...
I recently attended and was a speaker at the 4th International Internet of @ThingsExpo at the Santa Clara Convention Center. I also had the opportunity to attend this event last year and I wrote a blog from that show talking about how the “Enterprise Impact of IoT” was a key theme of last year’s show. I was curious to see if the same theme would still resonate 365 days later and what, if any, changes I would see in the content presented.
You may have heard about the pets vs. cattle discussion – a reference to the way application servers are deployed in the cloud native world. If an application server goes down it can simply be dropped from the mix and a new server added in its place. The practice so far has mostly been applied to application deployments. Management software on the other hand is treated in a very special manner. Dedicated resources are set aside to run the management software components and several alerting syst...
Culture is the most important ingredient of DevOps. The challenge for most organizations is defining and communicating a vision of beneficial DevOps culture for their organizations, and then facilitating the changes needed to achieve that. Often this comes down to an ability to provide true leadership. As a CIO, are your direct reports IT managers or are they IT leaders? The hard truth is that many IT managers have risen through the ranks based on their technical skills, not their leadership ab...
It's been a busy time for tech's ongoing infatuation with containers. Amazon just announced EC2 Container Registry to simply container management. The new Azure container service taps into Microsoft's partnership with Docker and Mesosphere. You know when there's a standard for containers on the table there's money on the table, too. Everyone is talking containers because they reduce a ton of development-related challenges and make it much easier to move across production and testing environm...
Hiring the wrong candidate can cost a company hundreds of thousands of dollars, and result in lost profit and productivity during the search for a replacement. In fact, the Harvard Business Review has found that as much as 80 percent of turnover is caused by bad hiring decisions. But when your organization has implemented DevOps, the job is about more than just technical chops. It’s also about core behaviors: how they work with others, how they make decisions, and how those decisions translate t...
In his General Session at DevOps Summit, Asaf Yigal, Co-Founder & VP of Product at, explored the value of Kibana 4 for log analysis and provided a hands-on tutorial on how to set up Kibana 4 and get the most out of Apache log files. He examined three use cases: IT operations, business intelligence, and security and compliance. Asaf Yigal is co-founder and VP of Product at log analytics software company In the past, he was co-founder of social-trading platform Currensee, which...
People want to get going with DevOps or Continuous Delivery, but need a place to start. Others are already on their way, but need some validation of their choices. A few months ago, I published the first volume of DevOps and Continuous Delivery reference architectures which has now been viewed over 50,000 times on SlideShare (it's free to registration required). Three things helped people in the deck: (1) the reference architectures, (2) links to the sources for each architectur...
The Internet of Things (IoT) is growing rapidly by extending current technologies, products and networks. By 2020, Cisco estimates there will be 50 billion connected devices. Gartner has forecast revenues of over $300 billion, just to IoT suppliers. Now is the time to figure out how you’ll make money – not just create innovative products. With hundreds of new products and companies jumping into the IoT fray every month, there’s no shortage of innovation. Despite this, McKinsey/VisionMobile data...
One of the most important tenets of digital transformation is that it’s customer-driven. In fact, the only reason technology is involved at all is because today’s customers demand technology-based interactions with the companies they do business with. It’s no surprise, therefore, that we at Intellyx agree with Patrick Maes, CTO, ANZ Bank, when he said, “the fundamental element in digital transformation is extreme customer centricity.” So true – but note the insightful twist that Maes adde...
Just over a week ago I received a long and loud sustained applause for a presentation I delivered at this year’s Cloud Expo in Santa Clara. I was extremely pleased with the turnout and had some very good conversations with many of the attendees. Over the next few days I had many more meaningful conversations and was not only happy with the results but also learned a few new things. Here is everything I learned in those three days distilled into three short points.
DevOps is about increasing efficiency, but nothing is more inefficient than building the same application twice. However, this is a routine occurrence with enterprise applications that need both a rich desktop web interface and strong mobile support. With recent technological advances from Isomorphic Software and others, rich desktop and tuned mobile experiences can now be created with a single codebase – without compromising functionality, performance or usability. In his session at DevOps Su...
As organizations realize the scope of the Internet of Things, gaining key insights from Big Data, through the use of advanced analytics, becomes crucial. However, IoT also creates the need for petabyte scale storage of data from millions of devices. A new type of Storage is required which seamlessly integrates robust data analytics with massive scale. These storage systems will act as “smart systems” provide in-place analytics that speed discovery and enable businesses to quickly derive meaningf...