Welcome!

Microservices Expo Authors: Liz McMillan, Elizabeth White, Astadia CloudGPS, Jason Bloomberg, Karthick Viswanathan

Related Topics: Microservices Expo, @CloudExpo

Microservices Expo: Blog Feed Post

The Business Intelligence A Cloud Paradox

Simultaneously one of the best use-cases for cloud as well as the worst. What’s IT to do?

Simultaneously one of the best use-cases for cloud as well as the worst. What’s IT to do?

David Linthicum, SOA and cloud pundit and all-around interesting technology guy, recently pointed out a short post on business intelligence (BI) vendors joining forces with the cloud to offer cloud-based BI services.

Four open-source and proprietary vendors on Wednesday announced a new partnership resulting in a cloud-based BI (business intelligence) stack.

Jaspersoft and Talend will respectively lend their open-source BI and data-integration technologies to the integrated offering, which also employs Vertica's analytic database and RightScale's management software for cloud-based application deployments.

Thought #1: That’s a perfect use case for cloud! Business intelligence processing is (a) compute intensive and (b) interval based (periodic processing; BI processing and reports are generally scheduled occurrences). It is a rare organization that builds OLAP cubes and runs ETL processes and generates reports all the time. But when they do, look out, they can bring a server (or three) to their knees.

Thought #2: That’s a horrible use case for cloud! The data, though it may be anonymized to remove personally identifiable information/account data, is still sensitive. It’s not any one field or combination of fields that are sensitive, it’s the whole data set. That combination of data is used to make business decisions, analyze business performance, and provides a great view of an organization’s current operating and financial status. That kind of data is not something you want shared outside the organization.


WHY IS THE DATA SO IMPORTANT?


Some of the data used for business intelligence and data mining operations is not all that interesting. But some of it contains the very data from which businesses can and do make very critical business-oriented decisions. Some of the data being analyzed consists of sales and demographics: past, present, and future. Some of that data can be interpreted as information about the financial health of an organization which, for some companies, is not something that should be handed off to a third-party without some fairly stringent assurances regarding the security of that data both from prying eyes and theft.

The last time I took a hard look at BI solutions I managed to convince the powers that be to ship me a copy of the subscription database. To a publishing company the subscription database, and all the data that describes those subscribers, is a goldmine. Even though I then worked for the same organization and the testing was being conducted in an isolated environment the data was stripped, masked, and as anonymized as possible lest it “leak” out into the real world. It was that important to the organization that the data be safe that most of the juicy bits were effectively gone by the time I got my hands on it.

This is not an uncommon scenario. The data often churned through by business intelligence systems is extremely sensitive and crucial to the day-to-day decisions made regarding the business. This is not just sales data, it’s the keys to the kingdom, effectively. For a competitor to get their hands on that data would be disastrous. Thus, it is hard to believe any organization would trust a third-party provider with that data.

Not sure about that? Remember that BI systems and reports are supposed to enable business decision makers to answer questions like:

  • What product is selling well and at what price point in area X?
  • What are buyers in demographic Y currently spending their dollars on?
  • Who buys products like Z?

Imagine a fierce competitor getting their hands on that data, and what they could do with it. Consider the impact on the organization if competing businesses can answer those questions for both themselves and your organization? “Not good” would be an understatement.

But the fact is that such systems are the perfect use-case for cloud given their periodic and highly compute intensive demands on the data center.


A SOLUTION: PRIVATE CLOUD


warning-private-cloud If ever there was a good use-case scenario for a private, internal cloud BI systems are it. The ability to consume additional resources, on-demand across the data center in a distributed way would certainly decrease the overall operating and capital expenses often associated with business intelligence initiatives and the data – the very important, sensitive data – would remain safely locked up within the confines a data center over which the organization has complete (one hopes) control.

Now, given the mix of vendors involved in the aforementioned venture that kicked off this quandary, it appears to be the case that this will be an offering more along the lines of Salesforce.com. Salesforce has, of course, done well with ensuring the security of its sensitive data and providing the isolation required by many customers to trust essentially outsourcing such a business-critical function (SFA). Seriously – when have you heard of a breach in Salesforce security leading to data leakage? Exactly. So it is not beyond imagining that a BI-related venture based on a similar shared platform/isolated data (multi-tenant) model might entice some away from investing in expensive hardware and software to support BI efforts internally.

The difference between the data housed in Salesforce and data shoved into BI systems, however, is enough to continue to be cautious about pushing such responsibility off to the cloud. This really isn’t about the security of the cloud, it’s about the value – and risk – of the data to the organization, and whether the potential savings would offset the risk. Many organizations are likely to say “no, no it doesn’t.” Thus it is a good idea to consider the potential benefits of building out an internal cloud instead. With a quarter of IT executives recently surveyed initiating private cloud implementations in 2009 anyway, it makes sense to look to BI as a possible early contender for deployment in an internal cloud-based architecture.

 

Follow me on Twitter View Lori's profile on SlideShare friendfeedicon_facebook AddThis Feed Button Bookmark and Share

Related blogs & articles:

Read the original blog entry...

More Stories By Lori MacVittie

Lori MacVittie is responsible for education and evangelism of application services available across F5’s entire product suite. Her role includes authorship of technical materials and participation in a number of community-based forums and industry standards organizations, among other efforts. MacVittie has extensive programming experience as an application architect, as well as network and systems development and administration expertise. Prior to joining F5, MacVittie was an award-winning Senior Technology Editor at Network Computing Magazine, where she conducted product research and evaluation focused on integration with application and network architectures, and authored articles on a variety of topics aimed at IT professionals. Her most recent area of focus included SOA-related products and architectures. She holds a B.S. in Information and Computing Science from the University of Wisconsin at Green Bay, and an M.S. in Computer Science from Nova Southeastern University.

@MicroservicesExpo Stories
"We focus on SAP workloads because they are among the most powerful but somewhat challenging workloads out there to take into public cloud," explained Swen Conrad, CEO of Ocean9, Inc., in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
"As we've gone out into the public cloud we've seen that over time we may have lost a few things - we've lost control, we've given up cost to a certain extent, and then security, flexibility," explained Steve Conner, VP of Sales at Cloudistics,in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
"Peak 10 is a hybrid infrastructure provider across the nation. We are in the thick of things when it comes to hybrid IT," explained , Chief Technology Officer at Peak 10, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
"I think DevOps is now a rambunctious teenager – it’s starting to get a mind of its own, wanting to get its own things but it still needs some adult supervision," explained Thomas Hooker, VP of marketing at CollabNet, in this SYS-CON.tv interview at DevOps Summit at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
"I will be talking about ChatOps and ChatOps as a way to solve some problems in the DevOps space," explained Himanshu Chhetri, CTO of Addteq, in this SYS-CON.tv interview at @DevOpsSummit at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
Your homes and cars can be automated and self-serviced. Why can't your storage? From simply asking questions to analyze and troubleshoot your infrastructure, to provisioning storage with snapshots, recovery and replication, your wildest sci-fi dream has come true. In his session at @DevOpsSummit at 20th Cloud Expo, Dan Florea, Director of Product Management at Tintri, provided a ChatOps demo where you can talk to your storage and manage it from anywhere, through Slack and similar services with...
If you are thinking about moving applications off a mainframe and over to open systems and the cloud, consider these guidelines to prioritize what to move and what to eliminate. On the surface, mainframe architecture seems relatively simple: A centrally located computer processes data through an input/output subsystem and stores its computations in memory. At the other end of the mainframe are printers and terminals that communicate with the mainframe through protocols. For all of its apparen...
Many organizations are now looking to DevOps maturity models to gauge their DevOps adoption and compare their maturity to their peers. However, as enterprise organizations rush to adopt DevOps, moving past experimentation to embrace it at scale, they are in danger of falling into the trap that they have fallen into time and time again. Unfortunately, we've seen this movie before, and we know how it ends: badly.
DevOps at Cloud Expo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 21st Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to w...
From manual human effort the world is slowly paving its way to a new space where most process are getting replaced with tools and systems to improve efficiency and bring down operational costs. Automation is the next big thing and low code platforms are fueling it in a significant way. The Automation era is here. We are in the fast pace of replacing manual human efforts with machines and processes. In the world of Information Technology too, we are linking disparate systems, softwares and tool...
All organizations that did not originate this moment have a pre-existing culture as well as legacy technology and processes that can be more or less amenable to DevOps implementation. That organizational culture is influenced by the personalities and management styles of Executive Management, the wider culture in which the organization is situated, and the personalities of key team members at all levels of the organization. This culture and entrenched interests usually throw a wrench in the work...
There is a huge demand for responsive, real-time mobile and web experiences, but current architectural patterns do not easily accommodate applications that respond to events in real time. Common solutions using message queues or HTTP long-polling quickly lead to resiliency, scalability and development velocity challenges. In his session at 21st Cloud Expo, Ryland Degnan, a Senior Software Engineer on the Netflix Edge Platform team, will discuss how by leveraging a reactive stream-based protocol,...
DevOps sees the coming together of practices, philosophies, and tools that allow you to create services and applications very quickly. This means that you can improve on your apps and evolve them at a much faster rate than those developers who are using traditional software development processes. We’ve talked about DevOps, in general, a great deal, but today, we’re going to dig a little deeper and take a look at Java DevOps specifically.
In his session at 20th Cloud Expo, Mike Johnston, an infrastructure engineer at Supergiant.io, discussed how to use Kubernetes to set up a SaaS infrastructure for your business. Mike Johnston is an infrastructure engineer at Supergiant.io with over 12 years of experience designing, deploying, and maintaining server and workstation infrastructure at all scales. He has experience with brick and mortar data centers as well as cloud providers like Digital Ocean, Amazon Web Services, and Rackspace. H...
With continuous delivery (CD) almost always in the spotlight, continuous integration (CI) is often left out in the cold. Indeed, it's been in use for so long and so widely, we often take the model for granted. So what is CI and how can you make the most of it? This blog is intended to answer those questions. Before we step into examining CI, we need to look back. Software developers often work in small teams and modularity, and need to integrate their changes with the rest of the project code b...
From personal care products to groceries and movies on demand, cloud-based subscriptions are fulfilling the needs of consumers across an array of market sectors. Nowhere is this shift to subscription services more evident than in the technology sector. By adopting an Everything-as-a-Service (XaaS) delivery model, companies are able to tailor their computing environments to shape the experiences they want for customers as well as their workforce.
If you read a lot of business and technology publications, you might think public clouds are universally preferred over all other cloud options. To be sure, the numbers posted by Amazon Web Services (AWS) and Microsoft’s Azure platform are nothing short of impressive. Statistics reveal that public clouds are growing faster than private clouds and analysts at IDC predict that public cloud growth will be 3 times that of private clouds by 2019.
"Outscale was founded in 2010, is based in France, is a strategic partner to Dassault Systémes and has done quite a bit of work with divisions of Dassault," explained Jackie Funk, Digital Marketing exec at Outscale, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
"At the keynote this morning we spoke about the value proposition of Nutanix, of having a DevOps culture and a mindset, and the business outcomes of achieving agility and scale, which everybody here is trying to accomplish," noted Mark Lavi, DevOps Solution Architect at Nutanix, in this SYS-CON.tv interview at @DevOpsSummit at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
SYS-CON Events announced today that Calligo has been named “Bronze Sponsor” of SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Calligo is an innovative cloud service provider offering mid-sized companies the highest levels of data privacy. Calligo offers unparalleled application performance guarantees, commercial flexibility and a personalized support service from its globally located cloud platfor...