Welcome!

Microservices Expo Authors: Elizabeth White, Yeshim Deniz, Liz McMillan, Ian Khan, Pat Romanski

Related Topics: SDN Journal, Java IoT, Microservices Expo, Linux Containers, Containers Expo Blog, @CloudExpo

SDN Journal: Blog Post

Complexity Kills Networks

Over 20 years of networking have created an astounding amount of capabilities

In reviewing some opportunities for Plexxi this week, I was reminded that we have made things very hard on ourselves. Through no one’s fault but our own we have created monsters of networks that are impossible to maintain, debug, diagnose and understand.

I have been lucky in my career. Most of it has been in an R&D organization for a large network vendor, but always in positions where I was close to customers, close to customer networks, and of course with that comes the “close to customer networks that are not working well”. And while there are always exceptions, in most of these troublesome networks, the sheer complexity of the network contributed significantly to the problem at hand, even if the end result was a bug.

Finding and fixing issues in networks is often one of these activities where you spent almost half your time understanding the network and its intricacies, a quarter of the time debugging and diagnosing the actual problem, and a last quarter producing, testing and implementing the solution. And so often the problem is hidden in the understanding of the network. An additional link that was not documented. A spanning tree config that was slightly different on one switch. A LAG with slightly different LACP timers. One vendor’s version of MLAG behaving just slightly different than another. And the guy that configured it no longer works here.

Whether it is a support person hunting for a problem, or a sales engineer trying to propose a new design or product, the process always almost starts with pictures. Network diagrams are the most powerful thing we produce. They are also the most misleading piece of information we produce because without fail they are wrong. Or missing something that is really important for that one specific item you are chasing. Network engineers and architects love to draw, our world exists of boxes, circles and lines between them. The challenge is that a 2 dimensional representation of a network is always going to be abstracted and therefore will always miss something. A network diagram that articulates the overall architecture and design of a network is absolutely key and with a clean sheet of paper we always start out with something that is sensible, easy to understand and typically simple. And then weeks, months and even years of incremental needs and requirements start eating away at the clean design.

Over 20 years of networking have created an astounding amount of capabilities. What we have taught our switches and routers to do is really amazing, and our packet forwarding chip vendors have done an equally outstanding job keeping up pushing these capabilities into hardware. And lots of these capabilities slowly make it into your network, chipping away at what was the “perfect” architecture. In the end, we are configuring individual devices with endless amounts of functions. Functions that should be so simple you should not have to configure them by hand.

We all know that ethernet networks need to be loop free. It should be dreadfully simple to instruct your devices to “make it so”. Except that we have at least five ways to ensure it is loop free. And then only for a specific portion of the network. We all know VoIP traffic should get  preferred treatment over regular internet or other traffic. But in the end we configure complicated access lists and mappings to DSCP values that then map into queues that then have to be hand crafted into a scheduling mechanism we believe does not mess up the original voice traffic we cared about, or the other important traffic. We know routers needs to exchange subnet information for reachability. But we end up with rather complicated protocols that have endless options, some apply globally, some to interfaces, some need filtering, some need adjusted timers, you name it.

Your equipment vendor will tell you that there will be bugs. A switch or router is no different than a regular application, there are millions of lines of code and bug free code does not exist. We as vendors need to help the network architect, manager and operator. We have to make it much easier to implement the functionality you require. You can help yourself by uncluttering your network as a regular activity. Think back to those pristine network diagrams you created before the network was installed. Instead of adjusting the diagram to represent reality, perhaps it is worth spending some time adjusting the network back to the diagram.

[Today's fun fact: there is an actual website where you can submit network diagrams to be rated by the viewing public. Really. http://www.ratemynetworkdiagram.com]

The post Complexity Kills Networks appeared first on Plexxi.

Read the original blog entry...

More Stories By Marten Terpstra

Marten Terpstra is a Product Management Director at Plexxi Inc. Marten has extensive knowledge of the architecture, design, deployment and management of enterprise and carrier networks.

@MicroservicesExpo Stories
SYS-CON Events announced today that Sheng Liang to Keynote at SYS-CON's 19th Cloud Expo, which will take place on November 1-3, 2016 at the Santa Clara Convention Center in Santa Clara, California.
Much of the value of DevOps comes from a (renewed) focus on measurement, sharing, and continuous feedback loops. In increasingly complex DevOps workflows and environments, and especially in larger, regulated, or more crystallized organizations, these core concepts become even more critical. In his session at @DevOpsSummit at 18th Cloud Expo, Andi Mann, Chief Technology Advocate at Splunk, showed how, by focusing on 'metrics that matter,' you can provide objective, transparent, and meaningful f...
Just over a week ago I received a long and loud sustained applause for a presentation I delivered at this year’s Cloud Expo in Santa Clara. I was extremely pleased with the turnout and had some very good conversations with many of the attendees. Over the next few days I had many more meaningful conversations and was not only happy with the results but also learned a few new things. Here is everything I learned in those three days distilled into three short points.
Digitization is driving a fundamental change in society that is transforming the way businesses work with their customers, their supply chains and their people. Digital transformation leverages DevOps best practices, such as Agile Parallel Development, Continuous Delivery and Agile Operations to capitalize on opportunities and create competitive differentiation in the application economy. However, information security has been notably absent from the DevOps movement. Speed doesn’t have to negat...
With online viewership and sales growing rapidly, enterprises are interested in understanding how they analyze performance to positively impact business metrics. Deeper insight into the user experience is needed to understand why conversions are dropping and/or bounce rates are increasing or, preferably, to understand what has been helping these metrics improve. The digital performance management industry has evolved as application performance management companies have broadened their scope beyo...
While DevOps promises a better and tighter integration among an organization’s development and operation teams and transforms an application life cycle into a continual deployment, Chef and Azure together provides a speedy, cost-effective and highly scalable vehicle for realizing the business values of this transformation. In his session at @DevOpsSummit at 19th Cloud Expo, Yung Chou, a Technology Evangelist at Microsoft, will present a unique opportunity to witness how Chef and Azure work tog...
In this strange new world where more and more power is drawn from business technology, companies are effectively straddling two paths on the road to innovation and transformation into digital enterprises. The first path is the heritage trail – with “legacy” technology forming the background. Here, extant technologies are transformed by core IT teams to provide more API-driven approaches. Legacy systems can restrict companies that are transitioning into digital enterprises. To truly become a lea...
Your business relies on your applications and your employees to stay in business. Whether you develop apps or manage business critical apps that help fuel your business, what happens when users experience sluggish performance? You and all technical teams across the organization – application, network, operations, among others, as well as, those outside the organization, like ISPs and third-party providers – are called in to solve the problem.
Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud strategy. Meanwhile, 94% of enterprises are using some form of XaaS - software, platform, and infrastructure as a service.
As applications are promoted from the development environment to the CI or the QA environment and then into the production environment, it is very common for the configuration settings to be changed as the code is promoted. For example, the settings for the database connection pools are typically lower in development environment than the QA/Load Testing environment. The primary reason for the existence of the configuration setting differences is to enhance application performance. However, occas...
Internet of @ThingsExpo, taking place November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with the 19th International Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world and ThingsExpo Silicon Valley Call for Papers is now open.
If you’re responsible for an application that depends on the data or functionality of various IoT endpoints – either sensors or devices – your brand reputation depends on the security, reliability, and compliance of its many integrated parts. If your application fails to deliver the expected business results, your customers and partners won't care if that failure stems from the code you developed or from a component that you integrated. What can you do to ensure that the endpoints work as expect...
Apache Hadoop is a key technology for gaining business insights from your Big Data, but the penetration into enterprises is shockingly low. In fact, Apache Hadoop and Big Data proponents recognize that this technology has not yet achieved its game-changing business potential. In his session at 19th Cloud Expo, John Mertic, director of program management for ODPi at The Linux Foundation, will explain why this is, how we can work together as an open data community to increase adoption, and the i...
SYS-CON Events announced today that Tintri Inc., a leading producer of VM-aware storage (VAS) for virtualization and cloud environments, will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Tintri VM-aware storage is the simplest for virtualized applications and cloud. Organizations including GE, Toyota, United Healthcare, NASA and 6 of the Fortune 15 have said “No to LUNs.” With Tintri they mana...
SYS-CON Events announced today that Numerex Corp, a leading provider of managed enterprise solutions enabling the Internet of Things (IoT), will exhibit at the 19th International Cloud Expo | @ThingsExpo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Numerex Corp. (NASDAQ:NMRX) is a leading provider of managed enterprise solutions enabling the Internet of Things (IoT). The Company's solutions produce new revenue streams or create operating...
24Notion is full-service global creative digital marketing, technology and lifestyle agency that combines strategic ideas with customized tactical execution. With a broad understand of the art of traditional marketing, new media, communications and social influence, 24Notion uniquely understands how to connect your brand strategy with the right consumer. 24Notion ranked #12 on Corporate Social Responsibility - Book of List.
In his general session at 18th Cloud Expo, Lee Atchison, Principal Cloud Architect and Advocate at New Relic, discussed cloud as a ‘better data center’ and how it adds new capacity (faster) and improves application availability (redundancy). The cloud is a ‘Dynamic Tool for Dynamic Apps’ and resource allocation is an integral part of your application architecture, so use only the resources you need and allocate /de-allocate resources on the fly.
Cloud Expo 2016 New York at the Javits Center New York was characterized by increased attendance and a new focus on operations. These were both encouraging signs for all involved in Cloud Computing and all that it touches. As Conference Chair, I work with the Cloud Expo team to structure three keynotes, numerous general sessions, and more than 150 breakout sessions along 10 tracks. Our job is to balance the state of enterprise IT today with the trends that will be commonplace tomorrow. Mobile...
DevOps and microservices are permeating software engineering teams broadly, whether these teams are in pure software shops but happen to run a business, such Uber and Airbnb, or in companies that rely heavily on software to run more traditional business, such as financial firms or high-end manufacturers. Microservices and DevOps have created software development and therefore business speed and agility benefits, but they have also created problems; specifically, they have created software sec...
Analysis of 25,000 applications reveals 6.8% of packages/components used included known defects. Organizations standardizing on components between 2 - 3 years of age can decrease defect rates substantially. Open source and third-party packages/components live at the heart of high velocity software development organizations. Today, an average of 106 packages/components comprise 80 - 90% of a modern application, yet few organizations have visibility into what components are used where.