|By Adrian Bridgwater||
|November 23, 2012 10:00 AM EST||
Big Data is everywhere. Predictive analytics and real time in-memory computing isn't everywhere.
This truth (if we can accept it to be so) represents something of an imbalance.
As a subset of data mining, predictive analytics driven by in-memory computing efficiencies now has an opportunity to bring real-time analysis and insight to fast-moving live transactional data flows. Or to put it another (rather shorter) way, we can now start to manage and understand Big Data better than ever.
Application use cases here might typically include:
- Climate simulation
- Oil exploration
- Financial analysis and scientific research
- Telecommunications, to name but seven good examples
If we combine contemporary approaches to predictive analytics with the newly arrived Intel Xeon Phi coprocessor that produces what is claimed to be over one teraflop per second in terms of workload computational power for highly-parallel workloads, then CIOs can start to think about what "50-processor core computing" will mean for us in the very near future.
Pushing forward in this space is SAP with its HANA in-memory computing appliance and platform. The firm is openly partnering with HP, Oracle, Cognizant and variety of other big (and smaller specialist) players to form strategic alliances that will help further the uptake of this kind of technology.
Why Is Analytics Working Better?
Part of the reason that in-memory predictive analytics intelligence is now becoming so important and much easier to bring to bear is hardware related and part of it is a software-related development.
On the hardware end, Intel has worked to sharpen data throughput between memory and processor cores. This means that work that goes on right in the heart of the machine that might have traveled at around five Gigabytes per second (Gbps) five years ago, now has a chance to move at 100 Gbps. On the software end, firms like HP and SAP have been working to produce what are typically referred to as "business process solutions" that can produce "context-aware experiences" to enable one sense-and-respond scenarios and, therefore, faster and more personalized interactions with customers.
As a matter of interest, HP also works to provide datacenter services to SAP that support its enterprise-wide hosting solutions for e-business applications - but that's another story.
In terms of actual application solutions running on SAP HANA, new products include the SAP Liquidity Risk Management application, the SAP Accelerated Trade Promotion Planning application and SAP Operational Process Intelligence software.
"These innovations show how SAP is rapidly delivering real-time, data-centric and industry-specific applications on the SAP HANA platform," said Dr Vishal Sikka, member of the SAP executive board for technology and innovation.
To take one example, SAP Liquidity Risk Management aims to provide banks with the ability to perform real-time, high-speed liquidity risk management and reporting on very large volumes of cash flows. In future then, banks will be able to instantly measure key liquidity risk ratios (such as the Basel III liquidity coverage ratio) and cash flow gaps to resolve potential liquidity bottlenecks. The application aims to allow banks to apply different stress scenarios, such as adjusted run-off rates and bond haircuts, to gain a deeper understanding of how market volatility can impact liquidity positions.
Lessons for CIOs
Now you don't have to be a bank CIO or financial analyst to understand the wider importance of this technology, i.e., this is the "harnessing of Big Data" catchline that you've already heard bandied about by countless IT firm's press departments, except now it's really happening.
The lesson for CIOs and the software application developers serving them is that we now have a route to predictive real-time analysis and the power to view billions of stored records and live transactional data at the same time. CIOs should look to their solution architects and business process experts to compose the analytical data models that will drive the next phase of their technology growth.
SAP is not the only firm driving this space, but its work to publicize its competencies in this arena is very prevalent. The fact that SAP pushes many of the interfaces for managing the result of its data analysis to both Apple iPad (and now Windows 8 format) mobile devices may have confounded Steve Jobs at the time, but this is the firm's proof point for showing off its Big Data number crunching applications. One day, quite soon, none of this will be a surprise.
This post first appeared on Enterprise CIO Forum.
Get deep visibility into the performance of your databases and expert advice for performance optimization and tuning. You can't get application performance without database performance. Give everyone on the team a comprehensive view of how every aspect of the system affects performance across SQL database operations, host server and OS, virtualization resources and storage I/O. Quickly find bottlenecks and troubleshoot complex problems.
Dec. 9, 2016 11:45 AM EST Reads: 2,232
Application transformation and DevOps practices are two sides of the same coin. Enterprises that want to capture value faster, need to deliver value faster – time value of money principle. To do that enterprises need to build cloud-native apps as microservices by empowering teams to build, ship, and run in production. In his session at @DevOpsSummit at 19th Cloud Expo, Neil Gehani, senior product manager at HPE, discussed what every business should plan for how to structure their teams to delive...
Dec. 9, 2016 11:45 AM EST Reads: 1,533
DevOps is being widely accepted (if not fully adopted) as essential in enterprise IT. But as Enterprise DevOps gains maturity, expands scope, and increases velocity, the need for data-driven decisions across teams becomes more acute. DevOps teams in any modern business must wrangle the ‘digital exhaust’ from the delivery toolchain, "pervasive" and "cognitive" computing, APIs and services, mobile devices and applications, the Internet of Things, and now even blockchain. In this power panel at @...
Dec. 9, 2016 11:30 AM EST Reads: 1,004
SYS-CON Events announced today that Dataloop.IO, an innovator in cloud IT-monitoring whose products help organizations save time and money, has been named “Bronze Sponsor” of SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Dataloop.IO is an emerging software company on the cutting edge of major IT-infrastructure trends including cloud computing and microservices. The company, founded in the UK but now based in San Fran...
Dec. 9, 2016 11:00 AM EST Reads: 702
@DevOpsSummit at Cloud taking place June 6-8, 2017, at Javits Center, New York City, is co-located with the 20th International Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to wait for long developm...
Dec. 9, 2016 10:15 AM EST Reads: 1,925
Today’s IT environments are increasingly heterogeneous, with Linux, Java, Oracle and MySQL considered nearly as common as traditional Windows environments. In many cases, these platforms have been integrated into an organization’s Windows-based IT department by way of an acquisition of a company that leverages one of those platforms. In other cases, the applications may have been part of the IT department for years, but managed by a separate department or singular administrator. Still, whether...
Dec. 9, 2016 09:45 AM EST Reads: 575
As we enter the final week before the 19th International Cloud Expo | @ThingsExpo in Santa Clara, CA, it's time for me to reflect on six big topics that will be important during the show. Hybrid Cloud: This general-purpose term seems to provide a comfort zone for many enterprise IT managers. It sounds reassuring to be able to work with one of the major public-cloud providers like AWS or Microsoft Azure while still maintaining an on-site presence.
Dec. 9, 2016 04:45 AM EST Reads: 2,985
I’m a huge fan of open source DevOps tools. I’m also a huge fan of scaling open source tools for the enterprise. But having talked with my fair share of companies over the years, one important thing I’ve learned is that you can’t scale your release process using open source tools alone. They simply require too much scripting and maintenance when used that way. Scripting may be fine for smaller organizations, but it’s not ok in an enterprise environment that includes many independent teams and to...
Dec. 9, 2016 02:45 AM EST Reads: 800
Between 2005 and 2020, data volumes will grow by a factor of 300 – enough data to stack CDs from the earth to the moon 162 times. This has come to be known as the ‘big data’ phenomenon. Unfortunately, traditional approaches to handling, storing and analyzing data aren’t adequate at this scale: they’re too costly, slow and physically cumbersome to keep up. Fortunately, in response a new breed of technology has emerged that is cheaper, faster and more scalable. Yet, in meeting these new needs they...
Dec. 9, 2016 01:45 AM EST Reads: 1,970
In his general session at 19th Cloud Expo, Manish Dixit, VP of Product and Engineering at Dice, discussed how Dice leverages data insights and tools to help both tech professionals and recruiters better understand how skills relate to each other and which skills are in high demand using interactive visualizations and salary indicator tools to maximize earning potential. Manish Dixit is VP of Product and Engineering at Dice. As the leader of the Product, Engineering and Data Sciences team at D...
Dec. 9, 2016 12:45 AM EST Reads: 1,235
More and more companies are looking to microservices as an architectural pattern for breaking apart applications into more manageable pieces so that agile teams can deliver new features quicker and more effectively. What this pattern has done more than anything to date is spark organizational transformations, setting the foundation for future application development. In practice, however, there are a number of considerations to make that go beyond simply “build, ship, and run,” which changes how...
Dec. 9, 2016 12:45 AM EST Reads: 5,146
SYS-CON Events has announced today that Roger Strukhoff has been named conference chair of Cloud Expo and @ThingsExpo 2017 New York. The 20th Cloud Expo and 7th @ThingsExpo will take place on June 6-8, 2017, at the Javits Center in New York City, NY. "The Internet of Things brings trillions of dollars of opportunity to developers and enterprise IT, no matter how you measure it," stated Roger Strukhoff. "More importantly, it leverages the power of devices and the Internet to enable us all to im...
Dec. 9, 2016 12:30 AM EST Reads: 927
In IT, we sometimes coin terms for things before we know exactly what they are and how they’ll be used. The resulting terms may capture a common set of aspirations and goals – as “cloud” did broadly for on-demand, self-service, and flexible computing. But such a term can also lump together diverse and even competing practices, technologies, and priorities to the point where important distinctions are glossed over and lost.
Dec. 8, 2016 09:15 PM EST Reads: 1,685
Monitoring of Docker environments is challenging. Why? Because each container typically runs a single process, has its own environment, utilizes virtual networks, or has various methods of managing storage. Traditional monitoring solutions take metrics from each server and applications they run. These servers and applications running on them are typically very static, with very long uptimes. Docker deployments are different: a set of containers may run many applications, all sharing the resource...
Dec. 8, 2016 07:45 PM EST Reads: 5,765
Logs are continuous digital records of events generated by all components of your software stack – and they’re everywhere – your networks, servers, applications, containers and cloud infrastructure just to name a few. The data logs provide are like an X-ray for your IT infrastructure. Without logs, this lack of visibility creates operational challenges for managing modern applications that drive today’s digital businesses.
Dec. 8, 2016 05:00 PM EST Reads: 1,827
Financial Technology has become a topic of intense interest throughout the cloud developer and enterprise IT communities. Accordingly, attendees at the upcoming 20th Cloud Expo at the Javits Center in New York, June 6-8, 2017, will find fresh new content in a new track called FinTech.
Dec. 8, 2016 04:45 PM EST Reads: 2,279
You have great SaaS business app ideas. You want to turn your idea quickly into a functional and engaging proof of concept. You need to be able to modify it to meet customers' needs, and you need to deliver a complete and secure SaaS application. How could you achieve all the above and yet avoid unforeseen IT requirements that add unnecessary cost and complexity? You also want your app to be responsive in any device at any time. In his session at 19th Cloud Expo, Mark Allen, General Manager of...
Dec. 8, 2016 04:45 PM EST Reads: 1,876
@DevOpsSummit taking place June 6-8, 2017 at Javits Center, New York City, is co-located with the 20th International Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. @DevOpsSummit at Cloud Expo New York Call for Papers is now open.
Dec. 8, 2016 04:30 PM EST Reads: 1,997
The 20th International Cloud Expo has announced that its Call for Papers is open. Cloud Expo, to be held June 6-8, 2017, at the Javits Center in New York City, brings together Cloud Computing, Big Data, Internet of Things, DevOps, Containers, Microservices and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding business opportunity. Submit your speaking proposal ...
Dec. 8, 2016 04:15 PM EST Reads: 2,347
"Dice has been around for the last 20 years. We have been helping tech professionals find new jobs and career opportunities," explained Manish Dixit, VP of Product and Engineering at Dice, in this SYS-CON.tv interview at 19th Cloud Expo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
Dec. 8, 2016 02:15 PM EST Reads: 1,217