Welcome!

Microservices Expo Authors: Elizabeth White, Liz McMillan, Pat Romanski, Sematext Blog, Olivier Huynh Van

Related Topics: Microservices Expo, Java IoT, Industrial IoT, IoT User Interface, @CloudExpo, @BigDataExpo

Microservices Expo: Article

Big Data Is Not Just About Marketing: Don’t Forget the IT Department’s Needs

Advances in machine intelligence bring new excitement and value

Few, if any, information technology subjects have garnered more attention over the past two years than Big Data. It's a savior. It's evil. It's the killer app of killer apps. And now, according to Gartner analyst Svetlana Sicular, "Big Data Is Falling into the Trough of Disillusionment."

This disillusionment is giving me a little bit of Big Data fatigue - at least in the sense that so much buzz is focused on what Big Data can do for marketing and business intelligence departments. Lost amid all the hype and hoopla is the story of how predictive analytics can help IT teams better understand and support the business applications that are the very lifeblood of their enterprise. After all, predicting the right service to offer your online customer won't help if the customer experiences sluggish application performance.

And Big Data is not going away. Big Data begets Very Big Data, and so on. Analysts are projecting that astronomical amounts of money will be spent on analyzing and using information. This includes projections that millions of data scientists are going to be hired to make sense of all this. You and I know that few if any of those data scientists will be monitoring application or infrastructure performance.

Application performance monitoring is a critical job that can substantially impact a company's brand and bottom line. The fact is that this is an incredibly tough assignment because of all the variables that can negatively impact performance. It is like telling an Ops pro, "You don't have to find a needle in a haystack; you have to find an unspecified number of needles in an unspecified number of haystacks." As databases and other apps get bigger and more distributed, this is almost impossible to do with human intelligence and traditional tools.

The good news is that predictive analytics for IT solutions are far simpler and increasingly more affordable than their Big Data counterparts. It is important for all of us to bang the drum louder about the business value that predictive analytics can provide for IT, not just for application performance, but for people performance too. The industry needs to discuss the risks of fielding powerful and complex applications without arming IT Ops and Support with similarly powerful tools to ensure their availability and performance.

Why Predictive Analytics for IT Is So Cool - and Worth Talking About
Most currently available analytical tools that can forecast human behavior give users exactly what they ask for - and that is part of the problem. The more variables you have in an equation, the more relationships exist. It's getting more difficult all the time to know what questions to ask.

The cutting edge of predictive analytics for IT uses advanced machine intelligence to scan data patterns to detect anomalies and other relationships that human analysts cannot see, at least not see quickly or without the help of data scientists. Using machine intelligence as part of IT performance management is like having your own personal R2D2, or an android like Star Trek's Lieutenant Commander Data. In fact, pairing machine intelligence with human intelligence is the future of problem solving and prediction - you can see it working today to identify root causes of performance failures and limit unplanned downtime. It is quite cool. There is hope for the disillusioned.

Additionally, the list of use cases for predictive analytics in IT is growing. We see organizations using it all the time to predict and prevent service disruptions. If something does go wrong, users can often find the source of the disruption much faster than they can with just human analysis. I have found that in some cases, machine intelligence can identify root causes of performance failures up to 90 percent faster than human intelligence alone can.

We can already see innovations on the near horizon that will make predictive analytics powered by advanced machine intelligence even better equipped to serve IT Ops' needs. Integrating performance management with security threat management is a good example. All of this is good news for IT Ops pros because their jobs are increasingly vital to an organization's success in this era of widely distributed infrastructures.

This is why companies have to emphasize the business value of predictive analytics for IT in conversations about application and infrastructure management. If you forget about IT Ops' needs when contemplating the deployment of data-heavy business applications, you put your network and your organization as a whole at risk.

Predictive analytics in IT is a breath of fresh air in the Big Data conversation. It gets me excited - far from being disillusioned.

More Stories By Mark Jaffe

Mark Jaffe is CEO of Prelert, the first company to provide 100% self-learning predictive analytics solutions to dramatically improve IT operations. He is a serial software entrepreneur who has been instrumental in the success of numerous software companies. Over his 23 years high tech experience, Jaffe has held leadership roles in product marketing, software sales and executive management.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@MicroservicesExpo Stories
More and more companies are looking to microservices as an architectural pattern for breaking apart applications into more manageable pieces so that agile teams can deliver new features quicker and more effectively. What this pattern has done more than anything to date is spark organizational transformations, setting the foundation for future application development. In practice, however, there are a number of considerations to make that go beyond simply “build, ship, and run,” which changes ho...
SYS-CON Events announced today that eCube Systems, a leading provider of middleware modernization, integration, and management solutions, will exhibit at @DevOpsSummit at 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. eCube Systems offers a family of middleware evolution products and services that maximize return on technology investment by leveraging existing technical equity to meet evolving business needs. ...
Using new techniques of information modeling, indexing, and processing, new cloud-based systems can support cloud-based workloads previously not possible for high-throughput insurance, banking, and case-based applications. In his session at 18th Cloud Expo, John Newton, CTO, Founder and Chairman of Alfresco, described how to scale cloud-based content management repositories to store, manage, and retrieve billions of documents and related information with fast and linear scalability. He addres...
SYS-CON Events announced today that Commvault, a global leader in enterprise data protection and information management, has been named “Bronze Sponsor” of SYS-CON's 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Commvault is a leading provider of data protection and information management solutions, helping companies worldwide activate their data to drive more value and business insight and to transform moder...
The many IoT deployments around the world are busy integrating smart devices and sensors into their enterprise IT infrastructures. Yet all of this technology – and there are an amazing number of choices – is of no use without the software to gather, communicate, and analyze the new data flows. Without software, there is no IT. In this power panel at @ThingsExpo, moderated by Conference Chair Roger Strukhoff, panelists will look at the protocols that communicate data and the emerging data analy...
Large enterprises today are juggling an enormous variety of network equipment. Business users are asking for specific network throughput guarantees when it comes to their critical applications, legal departments require compliance with mandated regulatory frameworks, and operations are asked to do more with shrinking budgets. All these requirements do not easily align with existing network architectures; hence, network operators are continuously faced with a slew of granular parameter change req...
Monitoring of Docker environments is challenging. Why? Because each container typically runs a single process, has its own environment, utilizes virtual networks, or has various methods of managing storage. Traditional monitoring solutions take metrics from each server and applications they run. These servers and applications running on them are typically very static, with very long uptimes. Docker deployments are different: a set of containers may run many applications, all sharing the resource...
All clouds are not equal. To succeed in a DevOps context, organizations should plan to develop/deploy apps across a choice of on-premise and public clouds simultaneously depending on the business needs. This is where the concept of the Lean Cloud comes in - resting on the idea that you often need to relocate your app modules over their life cycles for both innovation and operational efficiency in the cloud. In his session at @DevOpsSummit at19th Cloud Expo, Valentin (Val) Bercovici, CTO of So...
There is little doubt that Big Data solutions will have an increasing role in the Enterprise IT mainstream over time. Big Data at Cloud Expo - to be held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA - has announced its Call for Papers is open. Cloud computing is being adopted in one form or another by 94% of enterprises today. Tens of billions of new devices are being connected to The Internet of Things. And Big Data is driving this bus. An exponential increase is...
SYS-CON Events announced today that Tintri Inc., a leading producer of VM-aware storage (VAS) for virtualization and cloud environments, will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Tintri VM-aware storage is the simplest for virtualized applications and cloud. Organizations including GE, Toyota, United Healthcare, NASA and 6 of the Fortune 15 have said “No to LUNs.” With Tintri they mana...
Whether they’re located in a public, private, or hybrid cloud environment, cloud technologies are constantly evolving. While the innovation is exciting, the end mission of delivering business value and rapidly producing incremental product features is paramount. In his session at @DevOpsSummit at 19th Cloud Expo, Kiran Chitturi, CTO Architect at Sungard AS, will discuss DevOps culture, its evolution of frameworks and technologies, and how it is achieving maturity. He will also cover various st...
Internet of @ThingsExpo, taking place November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with the 19th International Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world and ThingsExpo Silicon Valley Call for Papers is now open.
SYS-CON Events has announced today that Roger Strukhoff has been named conference chair of Cloud Expo and @ThingsExpo 2016 Silicon Valley. The 19th Cloud Expo and 6th @ThingsExpo will take place on November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. "The Internet of Things brings trillions of dollars of opportunity to developers and enterprise IT, no matter how you measure it," stated Roger Strukhoff. "More importantly, it leverages the power of devices and the Interne...
Video experiences should be unique and exciting! But that doesn’t mean you need to patch all the pieces yourself. Users demand rich and engaging experiences and new ways to connect with you. But creating robust video applications at scale can be complicated, time-consuming and expensive. In his session at @ThingsExpo, Zohar Babin, Vice President of Platform, Ecosystem and Community at Kaltura, will discuss how VPaaS enables you to move fast, creating scalable video experiences that reach your...
In his general session at 18th Cloud Expo, Lee Atchison, Principal Cloud Architect and Advocate at New Relic, discussed cloud as a ‘better data center’ and how it adds new capacity (faster) and improves application availability (redundancy). The cloud is a ‘Dynamic Tool for Dynamic Apps’ and resource allocation is an integral part of your application architecture, so use only the resources you need and allocate /de-allocate resources on the fly.
DevOps at Cloud Expo – being held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA – announces that its Call for Papers is open. Born out of proven success in agile development, cloud computing, and process automation, DevOps is a macro trend you cannot afford to miss. From showcase success stories from early adopters and web-scale businesses, DevOps is expanding to organizations of all sizes, including the world's largest enterprises – and delivering real results. Am...
SYS-CON Events announced today that LeaseWeb USA, a cloud Infrastructure-as-a-Service (IaaS) provider, will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. LeaseWeb is one of the world's largest hosting brands. The company helps customers define, develop and deploy IT infrastructure tailored to their exact business needs, by combining various kinds cloud solutions.
Much of the value of DevOps comes from a (renewed) focus on measurement, sharing, and continuous feedback loops. In increasingly complex DevOps workflows and environments, and especially in larger, regulated, or more crystallized organizations, these core concepts become even more critical. In his session at @DevOpsSummit at 18th Cloud Expo, Andi Mann, Chief Technology Advocate at Splunk, showed how, by focusing on 'metrics that matter,' you can provide objective, transparent, and meaningful f...
About a year ago we tuned into “the need for speed” and how a concept like "serverless computing” was increasingly catering to this. We are now a year further and the term “serverless” is taking on unexpected proportions. With some even seeing it as the successor to cloud in general or at least as a successor to the clouds’ poorer cousin in terms of revenue, hype and adoption: PaaS. The question we need to ask is whether this constitutes an example of Hype Hopping: to effortlessly pivot to the ...
The Internet of Things will challenge the status quo of how IT and development organizations operate. Or will it? Certainly the fog layer of IoT requires special insights about data ontology, security and transactional integrity. But the developmental challenges are the same: People, Process and Platform and how we integrate our thinking to solve complicated problems. In his session at 19th Cloud Expo, Craig Sproule, CEO of Metavine, will demonstrate how to move beyond today's coding paradigm ...