Microservices Expo Authors: Liz McMillan, Kareen Kircher, Andreas Grabner, Roger Strukhoff, Carmen Gonzalez

Related Topics: @CloudExpo, Java IoT, Microservices Expo, Containers Expo Blog, IoT User Interface, Agile Computing

@CloudExpo: Article

Avoiding the Hidden Costs That Derail Cloud Projects

The Challenge: Making Your Private Cloud Fit Your IT Infrastructure Puzzle

Most companies that have embarked on a private cloud journey find themselves in one of two unfortunate positions: they've already spent much more than they had planned or they're struggling with how to make sure costs don't get out of hand. These are typically companies with sophisticated IT organizations - organizations that ask tough questions and put detailed plans in place. For example, an international bank spent millions of dollars and six months of professional services time before scrapping their existing cloud project and restarting it with a completely new approach and toolset.

The Challenge: Making Your Private Cloud Fit Your IT Infrastructure Puzzle
Cloud automation vendors make deploying a private cloud sound easy. If you take their basic out-of-the-box capability, the good ones will probably take you anywhere from a few hours to a few days to get a simple self-service private cloud working. While that may make a nice proof-of-concept demo, will that actually meet the needs of how you manage your infrastructure or will you need to replace prior technology and best practice investments to make your cloud work?

Cloud management is not a standalone entity. For your cloud to be successful, it needs to integrate and work with your existing management infrastructure and best practices. As you evaluate cloud management platforms, you need to assess how each tool works with your current and future management ecosystem. Your cloud management choice will not only impact prior investments, it can also limit your future choices. In order to avoid some of the hidden private cloud costs, evaluate how cloud management options will fit with your existing IT ecosystem.

  • Deployment Technologies
    Does your cloud management plaform work with the current technologies used to deploy your infrastructure? This includes both the private resources in your data centers and public cloud resources. Does it support the operating system, server virtualization tools, and desktop technologies being used today as well as the ones you may want to use in the future?
  • Management Infrastructure
    Typically, the delivery of a private cloud service requires a work order ticket to be generated, an internal database accessed, and that specific tools be used to deploy software, monitor the environment and take corrective action. How easily does your cloud management platform work with your current management tools and processess? Will you need to replace these tools or pay for extensive customization to make your cloud management solution work?
  • Best Practices
    As part of continuous process improvement, companies should always be looking to streamline and improve their processess. Deploying a private cloud is a large paradigm shift and some process changes will likely be needed to facilitate end-to-end automation. However, your cloud management software should not force changes on you that don't make sense within the guidelines established for your company. Remember that substantial changes required by the vendor are likely to be costly in terms of time and effort, if not also technology.
  • Custom Self-Service Portal
    All cloud management products provide some level of self-service capabilities. An out-of-the-box self-service portal simplifies initial deployment. However, what if your company already has a self-service portal or existing work order ticketing system? The last thing you will need is yet another portal. How easily can your existing portal be integrated with your cloud management services and will you need to spend time and money reproducing all the security in the custom portal?

Cloud Management Extensibility
Extensibility is also a critical factor in private cloud costs. Wikipedia defines extensibility as: "In systems architecture, extensibility means the system is designed to include hooks and mechanisms for expanding and enhancing the capabilities without having to make major changes to the system infrastructure." Often this means making modifications at runtime without requiring changes to the original source code.

Most cloud automation products will only automate a portion of your provisioning, ongoing management, or decommissioning processes. Therefore, an extensible architecture, combined with multi-vendor support, are fundamental components of cloud management platforms as they're needed to facilitate integration with the current IT infrastructure and management ecosystem.

With regard to extensibility, cloud management software products typically fall into one of the following two categories:

  • Prescriptive Tools
    Many cloud management solutions were built for a specific problem, like lab management, and have prescribed processes, limited interoperability, and lack the extensibility features needed to adapt to more broad-scale deployment requirements.

Any tool that requires drastic changes to existing management tools, infrastructure components, or operational processes will result in additional capital costs required to replace existing technology as well as additional investment in people who can use this new technology and processes.

The other challenge is that your company will likely be unable to achieve the savings you have envisioned because the automation solution will not meet the needs of the various business units. These business groups will either stay with their current manual process, reducing the percentage of your infrastructure that can be moved to an on-demand cloud, or they will implement a different cloud solution that does not provide your company with the operational scalability and savings you could have had with a single integrated solution.

  • Automation Toolkits
    Some vendors provide very basic cloud management capabilities and augment their cloud management offering by providing separate run book toolkits or "orchestration" products. This option allows companies to completely customize their cloud solution. However, there are multiple hidden costs associated with this implementation choice:

Initial services costs outweigh the software costs
These solutions tend to require lengthy and expensive custom services projects where services typically cost three times as much as the software.

Customized solutions are not easily extended to other business
In addition to the higher upfront costs, cloud automation solutions built with an automation toolkit tend to be built specifically for the needs of a single business. When companies try and expand the use of the highly customized solutions, they either have further customization costs or suffer from limited adoption across the enterprise.

Customized solutions make upgrades to newer release difficult
Many customizations strand the implementation at a specific release, making upgrades to newer versions difficult and costly.

Mitigating Private Cloud's Hidden Costs
Hopefully you now have a better understanding of some of the hidden cloud deployment costs and how your automation choice can not only affect costs but also impact your actual savings. It's important that you can adapt and expand automation with tools targeted at both IT operations as well as developers. In order to enable the quickest time-to-cloud value, companies should consider the following capabilities when evaluating cloud management platform software:

  • Comprehensive out-of-the-box functionality
    First and foremost, you will want a cloud management solution with a comprehensive set of out-of-the-box cloud management features. Many vendors only focus on initial provisioning capabilities. Make sure your cloud management platform automates the complete life cycle including ongoing management, resource reclamation, and decommissioning including archiving. The more features available out-of-the-box, the less need for costly custom services to extend the product's core functionality.
  • Broad multi-vendor support
    When evaluating cloud management options, make sure that the tool you choose can orchestrate end-to-end delivery across all the technology and management components that make up your implementation. Most vendors only support components from their own offerings. Unless you're a single-vendor shop, that means you may need to discard your prior investments and be locked into that vendor's technology in the future. Multi-vendor support includes technologies used in your private cloud as well as public cloud resources.
  • Policy enabled extensibility
    How extensible is your cloud management platform by just changing configuration parameters? Can you select different provisioning workflows, collect custom data, define resource limits and service levels, or create custom approvals or reclamation workflows? These are just a few of the many customizations you should be able to make via policies. The more you can customize your cloud deployment via policies, the quicker and more cost-effectively you will be able to deploy a private cloud infrastructure that meets company's specific needs.
  • Business-aware governance
    Being able to modify the behavior of your cloud via policies is important, but just as important is the granularity of the policies that can be configured. They must be granular enough to allow different business groups to have different services that are built and constructed using different processes, resources and service levels. For example, the way you provision and manage IT resources can be quite different for dev/test vs. production vs. desktops. Business-aware governance and control is fundamental to meeting the unique needs of each business and driving broader cross-group adoption of cloud services.
  • Modify out-of-the-box automation
    Can you easily add tasks or call scripts at various states in the machine's life cycle? Is there a visual workflow editing tool and a library of predefined activities that simplify the customization process? For example: How easily can you add a self-service command to perform a specific function, access/retrieve information from a custom DB as part of the provisioning process, or execute a script to customize a machine configuration? Are you modifying the workflows that ship with the product or is this a separate run book automation or "orchestration" tool that you need to bolt onto the cloud management tool?
  • Automate additional tasks
    Can the cloud automation platform be used to automate additional tasks that go well beyond simple modifications to out-of-the-box processes? For example, one company extended the process used to provision new desktops to also automate the process of onboarding new employees. If you need this level of extensibility, one factor that should be considered is the availability of developers with this skill set. Automation tools based on de facto standards like Visual Studio and .NET will be much easier to find developers for than a vendor-specific automation tool.

Implementing and managing a private or hybrid cloud doesn't have to be so expensive. Make sure you're armed with the knowledge needed to fully evaluate your cloud vendor's offerings for potential hidden costs. Otherwise your business may find itself putting cloud projects on hold or having to justify a much-increased budget.

More Stories By Rich Bourdeau

Rich Bourdeau is VP of Marketing at DynamicOps. He has over 20 years of experience in developing, managing and marketing IT infrastructure management solutions for enterprises. Rich has spent the last four years at DynamicOps helping companies deploy and manage their private cloud infrastructures. He is a regular contributor to the DynamicOps blog and has authored papers on Must Have Cloud Management Capabilities as well as Building the Business Case for Private Cloud. Rich can be reached at [email protected] if you want to learn more about cloud management.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.

@MicroservicesExpo Stories
DevOps is a term that comes full of controversy. A lot of people are on the bandwagon, while others are waiting for the term to jump the shark, and eventually go back to business as usual. Regardless of where you are along the specturm of loving or hating the term DevOps, one thing is certain. More and more people are using it to describe a system administrator who uses scripts, or tools like, Chef, Puppet or Ansible, in order to provision infrastructure. There is also usually an expectation of...
DevOps is speeding towards the IT world like a freight train and the hype around it is deafening. There is no reason to be afraid of this change as it is the natural reaction to the agile movement that revolutionized development just a few years ago. By definition, DevOps is the natural alignment of IT performance to business profitability. The relevance of this has yet to be quantified but it has been suggested that the route to the CEO’s chair will come from the IT leaders that successfully ma...
As we enter the final week before the 19th International Cloud Expo | @ThingsExpo in Santa Clara, CA, it's time for me to reflect on six big topics that will be important during the show. Hybrid Cloud This general-purpose term seems to provide a comfort zone for many enterprise IT managers. It sounds reassuring to be able to work with one of the major public-cloud providers like AWS or Microsoft Azure while still maintaining an on-site presence.
The best way to leverage your Cloud Expo presence as a sponsor and exhibitor is to plan your news announcements around our events. The press covering Cloud Expo and @ThingsExpo will have access to these releases and will amplify your news announcements. More than two dozen Cloud companies either set deals at our shows or have announced their mergers and acquisitions at Cloud Expo. Product announcements during our show provide your company with the most reach through our targeted audiences.
This is a no-hype, pragmatic post about why I think you should consider architecting your next project the way SOA and/or microservices suggest. No matter if it’s a greenfield approach or if you’re in dire need of refactoring. Please note: considering still keeps open the option of not taking that approach. After reading this, you will have a better idea about whether building multiple small components instead of a single, large component makes sense for your project. This post assumes that you...
As software becomes more and more complex, we, as software developers, have been splitting up our code into smaller and smaller components. This is also true for the environment in which we run our code: going from bare metal, to VMs to the modern-day Cloud Native world of containers, schedulers and microservices. While we have figured out how to run containerized applications in the cloud using schedulers, we've yet to come up with a good solution to bridge the gap between getting your conta...
DevOps is being widely accepted (if not fully adopted) as essential in enterprise IT. But as Enterprise DevOps gains maturity, expands scope, and increases velocity, the need for data-driven decisions across teams becomes more acute. DevOps teams in any modern business must wrangle the ‘digital exhaust’ from the delivery toolchain, "pervasive" and "cognitive" computing, APIs and services, mobile devices and applications, the Internet of Things, and now even blockchain. In this power panel at @...
DevOps theory promotes a culture of continuous improvement built on collaboration, empowerment, systems thinking, and feedback loops. But how do you collaborate effectively across the traditional silos? How can you make decisions without system-wide visibility? How can you see the whole system when it is spread across teams and locations? How do you close feedback loops across teams and activities delivering complex multi-tier, cloud, container, serverless, and/or API-based services?
SYS-CON Events announced today that SoftNet Solutions will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. SoftNet Solutions specializes in Enterprise Solutions for Hadoop and Big Data. It offers customers the most open, robust, and value-conscious portfolio of solutions, services, and tools for the shortest route to success with Big Data. The unique differentiator is the ability to architect and ...
Today every business relies on software to drive the innovation necessary for a competitive edge in the Application Economy. This is why collaboration between development and operations, or DevOps, has become IT’s number one priority. Whether you are in Dev or Ops, understanding how to implement a DevOps strategy can deliver faster development cycles, improved software quality, reduced deployment times and overall better experiences for your customers.
Without lifecycle traceability and visibility across the tool chain, stakeholders from Planning-to-Ops have limited insight and answers to who, what, when, why and how across the DevOps lifecycle. This impacts the ability to deliver high quality software at the needed velocity to drive positive business outcomes. In his session at @DevOpsSummit 19th Cloud Expo, Eric Robertson, General Manager at CollabNet, will show how customers are able to achieve a level of transparency that enables everyon...
At its core DevOps is all about collaboration. The lines of communication must be opened and it takes some effort to ensure that they stay that way. It’s easy to pay lip service to trends and talk about implementing new methodologies, but without action, real benefits cannot be realized. Success requires planning, advocates empowered to effect change, and, of course, the right tooling. To bring about a cultural shift it’s important to share challenges. In simple terms, ensuring that everyone k...
What do dependency resolution, situational awareness, and superheroes have in common? Meet Chris Corriere, a DevOps/Software Engineer at Autotrader, speaking on creative ways to maximize usage of all of the above. Mark Miller, Community Advocate and senior storyteller at Sonatype, caught up with Chris to learn more about what his team is up to.
@DevOpsSummit has been named the ‘Top DevOps Influencer' by iTrend. iTrend processes millions of conversations, tweets, interactions, news articles, press releases, blog posts - and extract meaning form them and analyzes mobile and desktop software platforms used to communicate, various metadata (such as geo location), and automation tools. In overall placement, @DevOpsSummit ranked as the number one ‘DevOps Influencer' followed by @CloudExpo at third, and @MicroservicesE at 24th.
SYS-CON Events announced today that Super Micro Computer, Inc., a global leader in Embedded and IoT solutions, will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 7-9, 2017, at the Javits Center in New York City, NY. Supermicro (NASDAQ: SMCI), the leading innovator in high-performance, high-efficiency server technology, is a premier provider of advanced server Building Block Solutions® for Data Center, Cloud Computing, Enterprise IT, Hadoop/Big Data, HPC and ...
JetBlue Airways uses virtual environments to reduce software development costs, centralize performance testing, and create a climate for continuous integration and real-time monitoring of mobile applications. The next BriefingsDirect Voice of the Customer performance engineering case study discussion examines how JetBlue Airways in New York uses virtual environments to reduce software development costs, centralize performance testing, and create a climate for continuous integration and real-tim...
Without lifecycle traceability and visibility across the tool chain, stakeholders from Planning-to-Ops have limited insight and answers to who, what, when, why and how across the DevOps lifecycle. This impacts the ability to deliver high quality software at the needed velocity to drive positive business outcomes. In his general session at @DevOpsSummit at 19th Cloud Expo, Eric Robertson, General Manager at CollabNet, will discuss how customers are able to achieve a level of transparency that e...
So you think you are a DevOps warrior, huh? Put your money (not really, it’s free) where your metrics are and prove it by taking The Ultimate DevOps Geek Quiz Challenge, sponsored by DevOps Summit. Battle through the set of tough questions created by industry thought leaders to earn your bragging rights and win some cool prizes.
SYS-CON Events announced today that LeaseWeb USA, a cloud Infrastructure-as-a-Service (IaaS) provider, will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. LeaseWeb is one of the world's largest hosting brands. The company helps customers define, develop and deploy IT infrastructure tailored to their exact business needs, by combining various kinds cloud solutions.
“Being able to take needless work out of the system is more important than being able to put more work into the system.” This is one of my favorite quotes from Gene Kim’s book, The Phoenix Project, and it plays directly into why we're announcing the DevOps Express initiative today. Tracing the Steps. For years now, I have witnessed needless work being performed across the DevOps industry. No, not within our clients DevOps and continuous delivery practices. I have seen it in the buyer’s journe...