Click here to close now.


Microservices Expo Authors: Pat Romanski, Liz McMillan, Yeshim Deniz, Elizabeth White, Lori MacVittie

Related Topics: @CloudExpo, Microservices Expo, Open Source Cloud, Containers Expo Blog, Apache

@CloudExpo: Article

Big Data: The ‘Perfect Storm’ Syndrome

An exclusive Q&A with James Weir, CTO and Co-Founder of UShareSoft

"Cloud computing represents a paradigm shift for IT, transforming computing power into a utility," observed James Weir, CTO and Co-Founder of UShareSoft, in this exclusive Q&A with Cloud Expo Conference Chair Jeremy Geelan. "While cloud adoption remains in the early stages," Weir continued, "this shift means that the overall market will grow massively in the coming years."

Cloud Computing Journal: Agree or disagree? - "While the IT savings aspect is compelling, the strongest benefit of cloud computing is how it enhances business agility."

James Weir: Agree. Cloud computing is not just about cost savings but adding value and creating new business opportunities. Many of the customers I speak to definitely see these benefits too. Cloud computing enhances business agility by providing "self-service" access to compute, network and storage resources through automation. And we're now seeing enterprise customers and cloud providers start to focus on the next big open question: software agility. Software delivery to the cloud needs to benefit from the same automated process to provide users with on-demand access to IT applications. UShareSoft's tools are designed to do just that.

The UShareSoft booth at 10th Cloud Expo | Cloud Expo New York

Cloud Computing Journal: Which of the recent big acquisitions within the Cloud and/or Big Data space have most grabbed your attention as a sign of things to come?

Weir: In the cloud IaaS space, the recent purchase of - a UShareSoft partner - by Citrix is definitely a sign of things to come. There are a number of IaaS vendors out there - Eucalyptus, Abiquo, Nimbula, Flexiant to name but a few. Consolidation in this space is going to continue, and many of the large IT vendors are looking for ways to enhance their cloud platforms.

Cloud Computing Journal: In its recent "Sizing the Cloud" report Forrester Research said it expects the global cloud computing market to reach $241BN in 2020 compared to $40.7BN in 2010 - is that kind of rapid growth trajectory being reflected in your own company or in your view is the Forrester number a tad over-optimistic?

Weir: Cloud computing represents a paradigm shift for IT, transforming computing power into a utility. While cloud adoption remains in the early stages, this shift means that the overall market will grow massively in the coming years. We're certainly seeing expanding interest in UShareSoft's products - registrations for our online platform alone have gone up by 300% in the past couple of months.

Cloud Computing Journal: Which do you think is the most important cloud computing standard still to tackle?

Weir: There is still a need for API standards to specify how clouds interoperate, how to provision and manage software in the cloud. Customers need an exit strategy for changing cloud providers and ensuring they can move workloads between clouds. While some early work has been done in this area, it's actually becoming harder rather than easier; the huge growth in PaaS, for example, has meant a proliferation of private APIs. There is a real need to standardize these APIs.

Cloud Computing Journal: Big Data has existed since the early days of computing; why, then, do you think there is such an industry buzz around it right now?

Weir: It's the "perfect storm" syndrome: several trends are converging to make Big Data one of the buzzwords of 2012. The amount of data we produce continues to explode, particularly with the growing use of social media. Last year's London riots alone, for example, generated an estimated 2.6 million tweets. Analysis of these tweets helped reveal how the network was used by people to collectively dispel and clarify false information. Furthermore, commodity hardware, cloud computing and open source software mean the large number of machines needed for intense calculation are available at a relatively low cost without a large upfront investment. Big Data is becoming accessible to a much larger number of companies.

Cloud Computing Journal: Do you think Big Data will only ever be used for analytical purposes, or do you envisage that it will actually enable new products?

Weir: We believe that Big Data is already being used for new products. Companies like Google and Facebook crunch huge amounts of user data and interactions to deliver customized, highly personal adverts to individual users. Innovation is ripe in the cloud computing and Big Data space, so new products and business opportunities are likely to emerge in this area.

More Stories By Jeremy Geelan

Jeremy Geelan is Chairman & CEO of the 21st Century Internet Group, Inc. and an Executive Academy Member of the International Academy of Digital Arts & Sciences. Formerly he was President & COO at Cloud Expo, Inc. and Conference Chair of the worldwide Cloud Expo series. He appears regularly at conferences and trade shows, speaking to technology audiences across six continents. You can follow him on twitter: @jg21.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.

@MicroservicesExpo Stories
Between the compelling mockups and specs produced by analysts, and resulting applications built by developers, there exists a gulf where projects fail, costs spiral, and applications disappoint. Methodologies like Agile attempt to address this with intensified communication, with partial success but many limitations. In his session at DevOps Summit, Charles Kendrick, CTO and Chief Architect at Isomorphic Software, will present a revolutionary model enabled by new technologies. Learn how busine...
DevOps has often been described in terms of CAMS: Culture, Automation, Measuring, Sharing. While we’ve seen a lot of focus on the “A” and even on the “M”, there are very few examples of why the “C" is equally important in the DevOps equation. In her session at @DevOps Summit, Lori MacVittie, of F5 Networks, will explore HTTP/1 and HTTP/2 along with Microservices to illustrate why a collaborative culture between Dev, Ops, and the Network is critical to ensuring success.
The APN DevOps Competency highlights APN Partners who demonstrate deep capabilities delivering continuous integration, continuous delivery, and configuration management. They help customers transform their business to be more efficient and agile by leveraging the AWS platform and DevOps principles.
Any Ops team trying to support a company in today’s cloud-connected world knows that a new way of thinking is required – one just as dramatic than the shift from Ops to DevOps. The diversity of modern operations requires teams to focus their impact on breadth vs. depth. In his session at DevOps Summit, Adam Serediuk, Director of Operations at xMatters, Inc., will discuss the strategic requirements of evolving from Ops to DevOps, and why modern Operations has begun leveraging the “NoOps” approa...
Containers are changing the security landscape for software development and deployment. As with any security solutions, security approaches that work for developers, operations personnel and security professionals is a requirement. In his session at @DevOpsSummit, Kevin Gilpin, CTO and Co-Founder of Conjur, will discuss various security considerations for container-based infrastructure and related DevOps workflows.
At DevOps Summit NY there’s been a whole lot of talk about not just DevOps, but containers, IoT, and microservices. Sessions focused not just on the cultural shift needed to grow at scale with a DevOps approach, but also made sure to include the network ”plumbing” needed to ensure success as applications decompose into the microservice architectures enabling rapid growth and support for the Internet of (Every)Things.
For it to be SOA – let alone SOA done right – we need to pin down just what "SOA done wrong" might be. First-generation SOA with Web Services and ESBs, perhaps? But then there's second-generation, REST-based SOA. More lightweight and cloud-friendly, but many REST-based SOA practices predate the microservices wave. Today, microservices and containers go hand in hand – only the details of "container-oriented architecture" are largely on the drawing board – and are not likely to look much like S...
In their session at DevOps Summit, Asaf Yigal, co-founder and the VP of Product at, and Tomer Levy, co-founder and CEO of, will explore the entire process that they have undergone – through research, benchmarking, implementation, optimization, and customer success – in developing a processing engine that can handle petabytes of data. They will also discuss the requirements of such an engine in terms of scalability, resilience, security, and availability along with how the archi...
The web app is agile. The REST API is agile. The testing and planning are agile. But alas, data infrastructures certainly are not. Once an application matures, changing the shape or indexing scheme of data often forces at best a top down planning exercise and at worst includes schema changes that force downtime. The time has come for a new approach that fundamentally advances the agility of distributed data infrastructures. Come learn about a new solution to the problems faced by software organ...
Our guest on the podcast this week is Jason Bloomberg, President at Intellyx. When we build services we want them to be lightweight, stateless and scalable while doing one thing really well. In today's cloud world, we're revisiting what to takes to make a good service in the first place. Listen in to learn why following "the book" doesn't necessarily mean that you're solving key business problems.
IT data is typically silo'd by the various tools in place. Unifying all the log, metric and event data in one analytics platform stops finger pointing and provides the end-to-end correlation. Logs, metrics and custom event data can be joined to tell the holistic story of your software and operations. For example, users can correlate code deploys to system performance to application error codes.
Apps and devices shouldn't stop working when there's limited or no network connectivity. Learn how to bring data stored in a cloud database to the edge of the network (and back again) whenever an Internet connection is available. In his session at 17th Cloud Expo, Bradley Holt, Developer Advocate at IBM Cloud Data Services, will demonstrate techniques for replicating cloud databases with devices in order to build offline-first mobile or Internet of Things (IoT) apps that can provide a better, ...
Containers are revolutionizing the way we deploy and maintain our infrastructures, but monitoring and troubleshooting in a containerized environment can still be painful and impractical. Understanding even basic resource usage is difficult - let alone tracking network connections or malicious activity. In his session at DevOps Summit, Gianluca Borello, Sr. Software Engineer at Sysdig, will cover the current state of the art for container monitoring and visibility, including pros / cons and li...
Despite all the talk about public cloud services and DevOps, you would think the move to cloud for enterprises is clear and simple. But in a survey of almost 1,600 IT decision makers across the USA and Europe, the state of the cloud in enterprise today is still fraught with considerable frustration. The business case for apps in the real world cloud is hybrid, bimodal, multi-platform, and difficult. Download this report commissioned by NTT Communications to see the insightful findings – registra...
Manufacturing has widely adopted standardized and automated processes to create designs, build them, and maintain them through their life cycle. However, many modern manufacturing systems go beyond mechanized workflows to introduce empowered workers, flexible collaboration, and rapid iteration. Such behaviors also characterize open source software development and are at the heart of DevOps culture, processes, and tooling.
Overgrown applications have given way to modular applications, driven by the need to break larger problems into smaller problems. Similarly large monolithic development processes have been forced to be broken into smaller agile development cycles. Looking at trends in software development, microservices architectures meet the same demands. Additional benefits of microservices architectures are compartmentalization and a limited impact of service failure versus a complete software malfunction....
The last decade was about virtual machines, but the next one is about containers. Containers enable a service to run on any host at any time. Traditional tools are starting to show cracks because they were not designed for this level of application portability. Now is the time to look at new ways to deploy and manage applications at scale. In his session at @DevOpsSummit, Brian “Redbeard” Harrington, a principal architect at CoreOS, will examine how CoreOS helps teams run in production. Attende...
With containerization using Docker, the orchestration of containers using Kubernetes, the self-service model for provisioning your projects and applications and the workflows we built in OpenShift is the best in class Platform as a Service that enables introducing DevOps into your organization with ease. In his session at DevOps Summit, Veer Muchandi, PaaS evangelist with RedHat, will provide a deep dive overview of OpenShift v3 and demonstrate how it helps with DevOps.
As the world moves towards more DevOps and microservices, application deployment to the cloud ought to become a lot simpler. The microservices architecture, which is the basis of many new age distributed systems such as OpenStack, NetFlix and so on, is at the heart of Cloud Foundry - a complete developer-oriented Platform as a Service (PaaS) that is IaaS agnostic and supports vCloud, OpenStack and AWS. In his session at 17th Cloud Expo, Raghavan "Rags" Srinivas, an Architect/Developer Evangeli...
In a report titled “Forecast Analysis: Enterprise Application Software, Worldwide, 2Q15 Update,” Gartner analysts highlighted the increasing trend of application modernization among enterprises. According to a recent survey, 45% of respondents stated that modernization of installed on-premises core enterprise applications is one of the top five priorities. Gartner also predicted that by 2020, 75% of