Click here to close now.

Welcome!

@MicroservicesE Blog Authors: Pat Romanski, Elizabeth White, Mark O'Neill, Rex Morrow, Datical, Sematext Blog

Related Topics: ThingsExpo® Blog, Java IoT, @MicroservicesE Blog, Linux Containers, Agile Computing, CloudExpo® Blog, SDN Journal

ThingsExpo® Blog: Article

Internet of Things (IoT) and Unpredictable Cloud Traffic

Everything from jet engines to refrigerators is joining the Internet of Things, pushing networks to the brink

Unpredictable Cloud Traffic Can Cast a Shadow on a Metro Network

User obsession with digital information shows no signs of abating. As users create, share, and consume content, network traffic volume goes up, growing an average of 30 to 50 percent annually.[1] The increased adoption of cloud technology has made round-the-clock access to content easy.

However, connecting users to content is not just about volume. Bandwidth is driven by applications, which have changed how, when, and where bandwidth is created, used, generated, and originated, making it far less predictable and much harder to manage. The following eight examples show how unpredictable traffic impacts the metro network.

1. Popular video content release
Netflix is the biggest single driver of traffic on the Internet, accounting for 34.2 percent of all downstream usage during primetime hours. The company's new business model of appealing to binge viewers by releasing entire seasons of programs at the same time creates tremendous traffic spikes. Sixteen percent of Netflix subscribers streamed at least one episode on the day Season 2 of House of Cards was released.[2]

2. Mobile handset apps
With an installed base of more than 600 million devices, network operators need to be prepared for Apple's iOS upgrades or suffer from the deluge. Over 50 percent of Apple device users upgraded their device to iOS 7 within two to three days of its release, with 30 percent upgrading within the first day. One study showed that 22 percent of capable devices upgraded to iOS 7 within 10 hours of release.[3] At nearly 1GB per install, each upgrade sucked up bandwidth quickly. Upgrades are predictable, but the traffic from users learning about new features, posting opinions in online forums, or uploading HD how-to videos can increase traffic for days or weeks.

3. 24-hour news cycle
While TV is still the primary news source for consumers, a growing number - currently 28 percent of those under 50 in the U.S. - turn to the Internet for breaking news.[4] Global news coverage of events such as political upheavals, sporting events, or natural disasters is viewed online instantly by billions. To serve the 24-hour news cycle, data is pulled off servers around the world and around the corner, creating geographic unpredictability.

4. Viral videos
Who could have predicted that a Korean singer would rack up two billion YouTube views? This milestone set by "Gangnam Style" is not the only time a viral video has jammed up networks. Ylvis' "The Fox (What Does the Fox Say?)," Jean Claude Van Damme's "Epic Split," or even kitten antics demonstrate that viewers' interests and demand windows are unpredictable. HD is the preferred format for viral reposting, forwarding, and copy-catting. Viewing statistics for highly social videos differ from those for non-viral videos; viral videos tend to peak more sharply and drop off more rapidly.[5]

5. The shift from standard-definition to HD television
HD needs more bandwidth to stream content. YouTube now allows videos to be posted in HD; every minute, 48 hours' worth of video is uploaded to the service.[6] HD will soon be replaced by 4K, which has four times the pixels of today's 1080-pixel HD, creating even more exponential bandwidth growth (Netflix recommends a 25 Mb/s connection for that service).

6. End-user devices
245.4 million tablets will ship worldwide in 2014, along with 1.4 billion smartphones.[7] Due to their limited storage capacity, these devices require network connectivity to deliver full enjoyment to their users by pulling content, video, and games out of data centers. The more powerful these devices become, the more bandwidth they use. Studies have shown that traffic originating from tablets and mobile phones is growing annually by 104 and 79 percent, respectively.[8]

7. Internet of Things
Everything from jet engines to refrigerators is joining the Internet of Things, pushing networks to the brink. In a new Boeing 747, almost every part of the plane is connected to the Internet, recording and, in some cases, sending continuous streams of data about its status. General Electric Co. has said that in a single flight, one of its jet engines generates half a terabyte of data.

8. End-user mobility
Devices are highly portable and change traffic patterns throughout the day. To manage the traffic, service provider networks are becoming larger and more complex. Traditionally, service providers built out networks by adding more and bigger routers; because this traffic is unpredictable, networks are often overprovisioned to handle unforeseen spikes. With this approach, networks are not getting smarter as they grow. Instead, they are becoming more complex and power- and space-hungry, causing data centers and central offices to run out of both physical space and electrical capacity. In many facilities, new equipment cannot be added unless something is removed first - there is just nowhere to put it or plug it in.

  1. http://zone.tmcnet.com
  2. http://multichannel.com/
  3. http://www.macrumors.com
  4. http://www.gallup.com/
  5. australianscience.com
  6. http://www.youtube.com/
  7. http://techcrunch.com/
  8. http://techcrunch.com/

More Stories By Brian Lavallée

Brian Lavallée is the Director of Technology & Solutions Marketing with global responsibility for Ciena’s packet networking solutions. He has over 20 years of telecommunications experience with previous roles in Product Line Management, Systems Engineering, Research & Development, and Manufacturing. During his career, he has worked in various areas of optical networking including access, metro, regional, long haul, and submarine networks. He holds a Bachelor of Electrical Engineering degree from Concordia University and an MBA in Marketing from McGill University, both located in Montréal, Québec, Canada.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@MicroservicesExpo Stories
Bill Doerrfeld at Nordic APIs has written today about how APIs are evolving the B2B landscape. This is a particularly interesting article for me, because my personal background is working for an EDI provider, where I linked EDI processes from the private network to the Internet, over 15 years ago. Vordel was founded to allow new Web Services APIs to be used for B2B. Axway, a B2B software company, acquired Vordel in 2012 to link B2B with Web APIs. This caused a domino effect, with other API Manag...
The 5th International DevOps Summit, co-located with 17th International Cloud Expo – being held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA – announces that its Call for Papers is open. Born out of proven success in agile development, cloud computing, and process automation, DevOps is a macro trend you cannot afford to miss. From showcase success stories from early adopters and web-scale businesses, DevOps is expanding to organizations of all sizes, including the...
Node.js and io.js are increasingly being used to run JavaScript on the server side for many types of applications, such as websites, real-time messaging and controllers for small devices with limited resources. For DevOps it is crucial to monitor the whole application stack and Node.js is rapidly becoming an important part of the stack in many organizations. Sematext has historically had a strong support for monitoring big data applications such as Elastic (aka Elasticsearch), Cassandra, Solr, S...

Let's just nip the conflation of these terms in the bud, shall we?

"MIcro" is big these days. Both microservices and microsegmentation are having and will continue to have an impact on data center architecture, but not necessarily for the same reasons. There's a growing trend in which folks - particularly those with a network background - conflate the two and use them to mean the same thing.

They are not.

One is about the application. The other, the network. T...

I read an insightful article this morning from Bernard Golden on DZone discussing the DevOps conundrum facing many enterprises today – is it better to build your own DevOps tools or go commercial? For Golden, the question arose from his observations at a number of DevOps Days events he has attended, where typically the audience is composed of startup professionals: “I have to say, though, that a typical feature of most presentations is a recitation of the various open source products and compo...
An effective way of thinking in Big Data is composed of a methodical framework for dealing with the predicted shortage of 50-60% of the qualified Big Data resources in the U.S. This holistic model comprises the scientific and engineering steps that are involved in accelerating Big Data solutions: problem, diagnosis, facts, analysis, hypothesis, solution, prototype and implementation. In his session at Big Data Expo®, Tony Shan focused on the concept, importance, and considerations for each of t...
This is the final installment of the six-part series Microservices and PaaS. It seems like forever since I attended Adrian Cockroft's meetup focusing on microservices. It's actually only been a couple of months, but much has happened since then: countless articles, meetups, and conference sessions focusing on microservices have been delivered, many meetings and design efforts at companies moving towards a microservices-based approach have been endured, and five installments of this blog series ...
In the first four parts of this series I presented an introduction to microservices along with a handful of emerging microservices patterns, and a discussion of some of the downsides and challenges to using microservices. The most recent installment of this series looked at ten ways that PaaS facilitates microservices development and adoption. In this post I’ll cover some words of wisdom, advice intended for individuals, teams, and organizations considering a move to microservices. I've gleaned...
With major technology companies and startups seriously embracing IoT strategies, now is the perfect time to attend @ThingsExpo in Silicon Valley. Learn what is going on, contribute to the discussions, and ensure that your enterprise is as "IoT-Ready" as it can be! Internet of @ThingsExpo, taking place Nov 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 17th Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading in...
It's 2:15pm on a Friday, and I'm sitting in the keynote hall at PyCon 2013 fidgeting through a succession of lightning talks that have very little relevance to my life. Topics like "Python code coverage techniques" (ho-hum) and "Controlling Christmas lights with Python” (yawn - I wonder if there's anything new on Hacker News)...when Solomon Hykes takes the stage, unveils Docker, and the world shifts. If you haven't seen it yet, you should watch the video of Solomon's Pycon The Future of Linux C...
SYS-CON Media named Andi Mann editor of DevOps Journal. DevOps Journal is focused on this critical enterprise IT topic in the world of cloud computing. DevOps Journal brings valuable information to DevOps professionals who are transforming the way enterprise IT is done. Andi Mann, Vice President, Strategic Solutions, at CA Technologies, is an accomplished digital business executive with extensive global expertise as a strategist, technologist, innovator, marketer, communicator, and thought lea...
Virtualization is everywhere. Enormous and highly profitable companies have been built on nothing but virtualization. And nowhere has virtualization made more of an impact than in Cloud Computing, the rampant and unprecedented adoption of which has been the direct result of the wide availability of virtualization software and techniques that enabled it. But does the cloud actually require virtualization?
Container technology is sending shock waves through the world of cloud computing. Heralded as the 'next big thing,' containers provide software owners a consistent way to package their software and dependencies while infrastructure operators benefit from a standard way to deploy and run them. Containers present new challenges for tracking usage due to their dynamic nature. They can also be deployed to bare metal, virtual machines and various cloud platforms. How do software owners track the usag...
Containers Expo Blog covers the world of containers, as this lightweight alternative to virtual machines enables developers to work with identical dev environments and stacks. Containers Expo Blog offers top articles, news stories, and blog posts from the world's well-known experts and guarantees better exposure for its authors than any other publication. Bookmark Containers Expo Blog ▸ Here Follow new article posts on Twitter at @ContainersExpo
The release of Kibana 4.x has had an impact on monitoring and other related activities.  In this post we’re going to get specific and show you how to add Node.js monitoring to the Kibana 4 server app.  Why Node.js?  Because Kibana 4 now comes with a little Node.js server app that sits between the Kibana UI and the […]
In this scenarios approach Joe Thykattil, Technology Architect & Sales at TimeWarner / Navisite, presented examples that will allow business-savvy professionals to make informed decisions based on a sound business model. This model covered the technology options in detail as well as a financial analysis. The TCO (Total Cost of Ownership) and ROI (Return on Investment) demonstrated how to start, develop and formulate a business case that will allow both small and large scale projects to achieve...
Storage administrators find themselves walking a line between meeting employees’ demands to use public cloud storage services, and their organizations’ need to store information on-premises for security, performance, cost and compliance reasons. However, as file sharing protocols like CIFS and NFS continue to lose their relevance, simply relying only on a NAS-based environment creates inefficiencies that hurt productivity and the bottom line. IT wants to implement cloud storage it can purchase a...
After a couple of false starts, cloud-based desktop solutions are picking up steam, driven by trends such as BYOD and pervasive high-speed connectivity. In his session at 15th Cloud Expo, Seth Bostock, CEO of IndependenceIT, cut through the hype and the acronyms, and discussed the emergence of full-featured cloud workspaces that do for the desktop what cloud infrastructure did for the server. He also discussed VDI vs DaaS, implementation strategies and evaluation criteria.
I’ve been thinking a bit about microservices (μServices) recently. My immediate reaction is to think: “Isn’t this just yet another new term for the same stuff, Web Services->SOA->APIs->Microservices?” Followed shortly by the thought, “well yes it is, but there are some important differences/distinguishing factors.” Microservices is an evolutionary paradigm born out of the need for simplicity (i.e., get away from the ESB) and alignment with agile (think DevOps) and scalable (think Containerizati...
There’s a lot of discussion around managing outages in production via the likes of DevOps principles and the corresponding software development lifecycles that does enable higher quality output from development, however, one cannot lay all blame for “bugs” and failures at the feet of those responsible for coding and development. As developers incorporate features and benefits of these paradigm shift, there is a learning curve and a point of not-knowing-what-is-not-known. Sometimes, the only way ...