| By Sid Probstein | Article Rating: |
|
| March 15, 2013 10:15 AM EDT | Reads: |
2,257 |
There is a backlash growing against the term "Big Data." Some of the negativity is just because of hype; people are attaching the name to their company for any reason, absurd reasons, and/or no reason at all.
I recently saw a pitch by a new venture that "creates Big Data for your business." Literally, they will create some for you if you don't already have any. It's hardly the most egregious example. We've seen mega-vendors twist their acquisitions into "Big Data" products, even though some of these technologies are 32-bit only, or have data sheets trumpeting claims like "handle up to 10M records." Big Data, indeed.

Another driver of the backlash is the cognitive dissonance that results from being told Big Data is all about huge data volumes or infrastructure that deal with it. Big Data has clearly emerged in the context of volume, but most companies are not Facebook, Zynga or the Large Hadron Collider. They simply do not have trucks filled with data unexpectedly arriving at the loading docks. Technical and data managers who grok the nature of the problem reject Big Data as a term in this context. They may even call it BS.
Yet another reason is disappointment and/or failure, as a result of overinvesting in "the volume problem." I recently spoke with a large bank that jumped on a popular open source product bandwagon, years before everyone else. They spent a fortune to do what they could have done much more easily and cheaply with existing tools. The lead manager admitted their team was more "driven by volume" and the hyped technologies used by exciting companies. They didn't consider that solving a different problem might produce more value for the bank, much more cost-effectively.
Where is Big Data headed? The good news is that rather than being rejected, the phenomenon of Big Data is morphing. It is becoming the art and science of actually using information to make decisions - more than ever before. And it is being driven by the success of companies that actually do that.
The real Big Data is driven by several factors... for one, the rapid creation of data, including voluminous data, from technical systems that interact with lots of people, where all those interactions are a multiple of the number of transactions that may ultimately occur. Another is the significant fall in the costs of storage and compute power, plus the emergence of 64-bit platforms that can use far more memory. But the real, underlying driver is...value.
Companies that have combined data volume with ubiquitous computing power and have actually brought the information together and analyzed it have found more... more customers, more profits and more growth. This is why Big Data is truly a phenomenon. Better approaches can be realized most everywhere. It cuts across industries, sectors, even countries. It is not just about things we have already defined well: volume, velocity, variety, etc. It is about the need to compete, and win, using information. Sometimes it is about figuring out how to get the data to make a better decision, and not just moving forward with gut instinct, in lieu of that.
It will stay big because when you look at what it really takes to make better decisions, there is a lot to it. Structured and unstructured. Internal and external. SQL and NoSQL. Volume, velocity and variety. Big Data is the discovery of how much data is not being used, and then realizing that changing that fact is the real challenge...and the real opportunity.
Published March 15, 2013 Reads 2,257
Copyright © 2013 SYS-CON Media, Inc. — All Rights Reserved.
Syndicated stories and blog feeds, all rights reserved by the author.
More Stories By Sid Probstein
Sid Probstein is the Chief Technology Officer of Attivio, responsible for product & technology strategy, implementation and delivery. He has over 20 years of experience in managing R&D organizations and delivering award-winning, high-value enterprise software and solutions. Previously, he was CTO at GetConnected, Inc. (GCi), a market-leading transaction processing platform enabling the sale of digital services. He was also Vice President of Technology at Fast Search & Transfer, a global enterprise search company that is now part of Microsoft Corporation.
Prior to Fast, Sid was Vice President of Engineering at Northern Light Technology, where he was responsible for production of the first enterprise version of the search engine. He also served as Director of Software Engineering at Freemark Communications, and a Principal Architect/System Manager at John Hancock Financial Services.
- Cloud People: A Who's Who of Cloud Computing
- Cloud Expo New York Speaker Profile: Dave Linthicum – Cloud Technology Partners
- Cloud Expo New York: Cloud Is Changing the Economics of Business
- Best CIO Practices Shared from SHI’s Customers
- Cloud Expo New York: Deploying Hybrid Cloud for Performance and Uptime
- Cloud Expo New York: Delivering Digital Marketing on the Cloud
- Big Data Isn’t About the Database, It’s About the Application
- Cloud Expo New York: Rethink IT and Reinvent Business with IBM SmartCloud
- Cloudant to Exhibit at Cloud Expo & Big Data Expo New York
- BEA Updates WebLogic SOA Portal for Web 2.0 Era
- How to Move Your Oracle Databases to Amazon EC2 Cloud
- The Accessibility of the Cloud
- Cloud People: A Who's Who of Cloud Computing
- Cloud Expo New York: Best CIO Practices Shared from SHI’s Customers
- Cloud Expo New York Speaker Profile: Dave Linthicum – Cloud Technology Partners
- Cloud Expo New York: Cloud Is Changing the Economics of Business
- Cloud Expo New York: How to Use Google Apps Script
- Cloud Computing Bootcamp at Cloud Expo New York
- Rackspace Hosting Named “Platinum Plus Sponsor” of Cloud Expo New York
- Best CIO Practices Shared from SHI’s Customers
- Cloud Expo New York: Why Big Data Is Really About Small Data
- Cloud Expo New York: Deploying Hybrid Cloud for Performance and Uptime
- Cloud Expo New York: Delivering Digital Marketing on the Cloud
- Small Cancers, Big Data, and a Life Examined
- The i-Technology Right Stuff
- The Top 150 Players in Cloud Computing
- Who Are The All-Time Heroes of i-Technology?
- Where Are RIA Technologies Headed in 2008?
- Get the Message
- i-Technology Viewpoint: Is Web 2.0 the Global SOA?
- ESB Myth Busters: 10 Enterprise Service Bus Myths Debunked
- i-Technology Viewpoint: Thinking Outside the VC Box
- i-Technology Viewpoint: When to Leave Your First IT Job
- SOA Web Services Edge Conference Coverage on SYS-CON.TV
- SYS-CON.TV's "SOA Web Services" and "Enterprise Open Source" Programs To Air in December
- Five Reasons Why Web 2.0 Matters






















