Click here to close now.

Welcome!

Microservices Journal Authors: Pat Romanski, Liz McMillan, XebiaLabs Blog, Elizabeth White, Louis Evans

Related Topics: Microservices Journal, Linux, Open Source, Web 2.0, Cloud Expo, Apache, Big Data Journal

Microservices Journal: Article

Data Is Up, Data Is Down, Data Is on the Move

Connectivity is everything

Data is going up and data is going down. Its endless upward spiral to the cloud is being lauded as the platform and paradigm that we must now adhere to for future IT efficiency. At the same time, data is going down. It is being processed and (crucially here) it is being ‘analyzed' at an in-memory level, where new speed efficiencies outstrip the power of disk-based alternative options.

Data is on the move too of course. Mobile data (and most important of all, enterprise mobile data) is tracing a fast-paced location-aware fluid and functional vortex around us as the devices now keep up the application capabilities in this space.

Nokia shipped its latest Lumia 920 handheld with a promise to users that they have just bought the "world's best business smartphone" no less. Marketing-speak aside though, the ability to use apps on this type of unit that differ (by and large) from desktop equivalents only in terms of screen size is something of a revelation.

Connectivity is everything and if a businessperson can Skype on his or her phone rather than use a laptop or desktop (which they can now), then why wouldn't they?

Devices such as Nokia's latest offering should never have been marketed as smartphones; they are half-size mini tablets that happen to have a phone in them. This is game-changing stuff and no mistaking the term ‘superphone' has already started to be used to attempt to distinguish the newer models of later 2012 and onward.

Companies like SAP and HP are trying hard to break some of the mold here. SAP is pushing enterprise level mobile applications to the fore on devices that were not initially intended to host mission-critical apps supporting firm's systems of record. We're talking about the iPad for one, plus the rest of the tablet universe as it now orbits the software application development focused arm of the galaxy.

HP doesn't want to see the high-end laptop (or low and medium-end laptop for that matter) get left out of the rush to enterprise mobility. The company's Mobile Enterprise Solution Architecture Consulting division is only a stone's throw away from its Enterprise Mobility Services detachment, which, surprise surprise is aligned toward SAP technologies. The big guys know which side their bread is buttered on and they know the fat content too.

A Splattering Splunking Mess of Data Detritus
With this up, down, left and right of data on the move through mobile channels, some of them socially fueled... and many of them being disparate, disconnected and lacking any cohesive level of integration... is not always good news.

It might sound like it represents user freedom and it probably does; but it's a nightmare waiting to happen to the system administrator (sysadmins) and/or the database administrator (DBA) who have to sit in the engine room and get covered in a splattering splunking mess of data detritus as they attempt to track and pin down data status at every level.

Enter Splunk, a piece of Unix-derived data manipulation software that has been engineered and built for the purpose of diagnosing and troubleshooting software application problems in environments/platforms ranging from Amazon Web Services (AWS), Salesforce.com's Heroku, Google's App Engine and the Rackspace cloud.

Released by the firm at the back end of last year is Splunk Storm. This monitoring tool is focused on analyzing what Splunk refers to as "critical business metrics" so that, by viewing its results, operational controls can be tuned appropriately.

Rage Against the Machine (log)
IT industry analyst Robin Bloor writes in his 10 Companies & Technologies To Watch in 2013 piece this January that Splunk has built a technology and a business by enabling swift access to machine data: the data that resides in machine logs of every kind throughout computer networks from web logs to system management logs.

"It was swiftly adopted by many IT departments mainly for the operational management capabilities it enabled. But fairly soon companies began to discover that machine-generated data was a rich source of business information. Splunk had built a fast engine and platform for analyzing such data. This has now become a formidable business intelligence engine," writes Bloor.

Splunk's senior director of product marketing Sanjay Meta claims that Splunk can be "pointed at anything" in terms of the breadth of its potential usage. This is because it doesn't work to impose a schema upon the data that it captures at the point of execution.

Moving one step further, the ability of Splunk to "create schemas on the fly"(the columns and rows that describe the interrelationships of a database table) gives the software its greatest boost for freedom and potential power.

This new multi-dimensional environment for CIOs to perform their data management across is further complicated by multi-temperature data forms; we next move to classify hold, tepid and cold data depending upon its usage in real-time analytics.

Not all of this is going to be simple by any means. Nokia's "business" smartphone does have a strong Windows Phone 8 Xbox360 connected games option too. Perhaps that distraction is there for a good reason?

•   •   •

This post first appeared on CIO Enterprise Forum.

More Stories By Adrian Bridgwater

Adrian Bridgwater is a freelance journalist and corporate content creation specialist focusing on cross platform software application development as well as all related aspects software engineering, project management and technology as a whole.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@MicroservicesExpo Stories
of cloud, colocation, managed services and disaster recovery solutions, will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. TierPoint, LLC, is a leading national provider of information technology and data center services, including cloud, colocation, disaster recovery and managed IT services, with corporate headquarters in St. Louis, MO. TierPoint was formed through the strategic combination of some of t...
SYS-CON Events announced today that Soha will exhibit at SYS-CON's DevOps Summit New York, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. Soha delivers enterprise-grade application security, on any device, as agile as the cloud. This turnkey, cloud-based service enables customers to solve secure application access and delivery challenges that traditional or virtualized network solutions cannot solve because they are too expensive, inflexible and operational...
There's a real buzz about microservices and containers in the application development and DevOps communities, and of course these are topics we've been talking about a great deal lately here at XebiaLabs too. Microservices and containers offer many attractive features, not least the potential for enhanced flexibility, and a robust architecture based on best-fit services. What we at XebiaLabs are really interested in is how organizations can effectively deliver microservices-based apps to bett...
SYS-CON Events announced today that Vicom Computer Services, Inc., a provider of technology and service solutions, will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. They are located at booth #427. Vicom Computer Services, Inc. is a progressive leader in the technology industry for over 30 years. Headquartered in the NY Metropolitan area. Vicom provides products and services based on today’s requirements...
SYS-CON Events announced today that Tufin, the market-leading provider of Security Policy Orchestration Solutions, will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. As the market leader of Security Policy Orchestration, Tufin automates and accelerates network configuration changes while maintaining security and compliance. Tufin's award-winning Orchestration Suite™ gives IT organizations the power and a...
Today, the demand for new applications is growing at an unprecedented rate throughout lines of business and across industries. Customer expectations for mobile and e-commerce capabilities are transforming software development speed and quality into a competitive differentiator for even the most unlikely businesses. For existing software development shops, the proliferation of platforms, increasing need for total global uptime, and accelerating pace of industry disruption by fast-paced startups h...
SYS-CON Events announced today that MangoApps will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY., and the 17th International Cloud Expo®, which will take place on November 3–5, 2015, at the Santa Clara Convention Center in Santa Clara, CA. MangoApps provides private all-in-one social intranets allowing workers to securely collaborate from anywhere in the world and from any device. Social, mobile, and eas...
SYS-CON Events announced today that Cloudian, Inc., the leading provider of hybrid cloud storage solutions, will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. Cloudian, Inc., is a Foster City, California - based software company specializing in cloud storage software. The main product is Cloudian, an Amazon S3-compliant cloud object storage platform, the bedrock of cloud computing systems, that enables c...
Change becomes the central principle of today’s enterprises, and thus business agility becomes the most important characteristic our organizations must exhibit. Agile Architecture lays out a best practice approach for achieving this agility – and thus drives and coordinates the other revolutions, as both digital and DevOps are about being able to deal with change better as well.
What exactly is a cognitive application? In her session at 16th Cloud Expo, Ashley Hathaway, Product Manager at IBM Watson, will look at the services being offered by the IBM Watson Developer Cloud and what that means for developers and Big Data. She'll explore how IBM Watson and its partnerships will continue to grow and help define what it means to be a cognitive service, as well as take a look at the offerings on Bluemix. She will also check out how Watson and the Alchemy API team up to off...
Thought experiment: let’s say your app gets a message from somewhere, perhaps from another app, but you don’t know from where. The message contains the number 47 but no other information. What should your app do with the message? The answer: nothing. There’s no way for your app to make any sense out of a single datum with no context, no additional information or metadata about the datum itself. Now, let’s scale up this thought experiment to a data lake. There are a few common definitions o...
The 17th International Cloud Expo has announced that its Call for Papers is open. 17th International Cloud Expo, to be held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA, brings together Cloud Computing, APM, APIs, Microservices, Security, Big Data, Internet of Things, DevOps and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding bu...
The 5th International DevOps Summit, co-located with 17th International Cloud Expo – being held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA – announces that its Call for Papers is open. Born out of proven success in agile development, cloud computing, and process automation, DevOps is a macro trend you cannot afford to miss. From showcase success stories from early adopters and web-scale businesses, DevOps is expanding to organizations of all sizes, including the...
The concept and subsequent adoption of 'Containerization'' is growing at a rapid speed with the support of almost every other major player in the industry. This concept is much more efficient than the Virtualization which has been a major option for Infrastructure optimization in the past decade. The following factors distinguish a Container from a Virtual Machine. Containers contain Only the Application Specific libraries and binaries. They do not include a guest operating system. Rather ...
How do you securely enable access to your applications in AWS without exposing any attack surfaces? The answer is usually very complicated because application environments morph over time in response to growing requirements from your employee base, your partners and your customers. In his session at 16th Cloud Expo, Haseeb Budhani, CEO and Co-founder of Soha, will share five common approaches that DevOps teams follow to secure access to applications deployed in AWS, Azure, etc., and the frict...
As we recently previewed (read more about our London PoP in Jesse's post), Blue Box is opening a new Data Center in London, but hadn't announced the provider. Today we're excited to partner with TelecityGroup, whom we've selected as our data center partner in London. We chose their Powergate location, which is one of the U.K.'s most advanced, flexible and energy efficient carrier-neutral data centres. Why does that matter to you? Well, when customers choose Blue Box, they're trusting us with ...
Cloud Expo New York is happening from June 9 - 11. This event brings together the worlds of Cloud Computing, DevOps, IoT, WebRTC, Big Data and SDDC. We hope to see you there-members of the Blue Box team will exhibit in booth 218 next to the DevOps area. Plus, our Chief Product Officer, Hernan Alvarez, will present his talk "The Cloud Has a Down-and-Dirty Lining" as part of the Operations track in the DevOps Summit portion of the event on June 9 at 11 am. Learn more about his session her...
SYS-CON Events announced today that Column Technologies, a global technology solutions company, will exhibit at SYS-CON's DevOps Summit 2015 New York, which will take place June 9-11, 2015, at the Javits Center in New York City, NY. Established in 1998, Column Technologies is a leader in application performance and infrastructure management for commercial and federal markets. The company is headquartered in the United States, with a diverse and talented team of more than 350 employees around th...
Financial services organizations were among the earliest enterprise adopters of cloud computing. The ability to leverage massive compute, storage and networking resources via RESTful APIs and automated tools like Chef and Puppet made it possible for their high-horsepower IT users to develop a whole new array of applications. Companies like Wells Fargo, Fidelity and BBVA are visible, vocal and engaged supporters of the OpenStack community, running production clouds for applications ranging from d...
Operationalizing the network continues to be a driving force behind DevOps and SDN. The ability to solve real problems using programmability to automate and orchestrate infrastructure provisioning and configuration across the application release process remains the hope for many interested in one or the other - and often times both. A recent Avaya sponsored, Dynamic Markets survey (reg required) dove deep into the demesne of SDN and found that many of the problems companies have - and expect ...