Welcome!

Microservices Expo Authors: Elizabeth White, AppNeta Blog, Gopala Krishna Behara, Sridhar Chalasani, Tirumala Khandrika

Related Topics: Microservices Expo, Java IoT, Microsoft Cloud, Machine Learning , Agile Computing, @CloudExpo

Microservices Expo: Article

Learning to Expect the Unexpected: Load Test Before It’s Too Late

Unfortunately, many organizations tend to treat load testing as one of those activities that they can put off until a later day

At times, I can be a bit of a procrastinator. If there is no pressing need to clean out the garage this week, shop for holiday gifts, or do my taxes, I can easily be convinced to let it go until next week or next month. Inevitably, though, something happens that makes me wish I hadn't delayed quite as long as I did. The garage gets flooded, for example, and the boxes that I had been meaning to organize get soaked and destroyed... or my Valentine's Day gift doesn't get shipped in time and I'm left holding the bag. I'm sure many of you can think of your own examples.

Unfortunately, many organizations tend to treat load testing as one of those activities that they can put off until a later day. You can almost imagine what they're thinking: "Our website is up and handling the daily load with little difficulty. Yes, there's a major advertising campaign - or new product launch, or major news release, or something similar - coming, but that's a few months away, and we have plenty of time to prepare for it." Then, inevitably something happens, testing doesn't get completed and the website is flooded with traffic that it is unable to handle. If you're the one responsible for the fall-out from such an event, it's time to stop procrastinating and start load testing. By load testing, I'm not just talking about throwing a bunch of simultaneous users at your website. I'm talking about generating a realistic load so you get results your developers and infrastructure team will actually pay attention to. This involves modeling real-world factors in your user loads, including users accessing your website and applications from mobile devices and from lots of different geographies. With proper load testing you can be prepared when the unexpected deluge of users hits your site. You'll know what your site can handle, and how it will respond. More important, you can put mechanisms and procedures in place to help ensure your site will scale - or at least fail gracefully - and avoid the organizational embarrassment and opportunity cost of a major outage.

Perhaps you're still not convinced that some event could happen tomorrow that sends a tidal wave of users your way. That's what Florida Gulf Coast University (FGCU) thought in March of 2013, when the school's basketball team scored an unprecedented and unexpected series of victories in the 2013 NCAA Men's Division I Basketball Tournament. Suddenly, what was a relatively unknown school outside of Florida was thrust into the national limelight, and millions of people wanted to learn more about it. What happened? The university's website crashed. At exactly the time when FCGU could present a positive image of itself to a wide, interested audience, the website failed under load. To be clear, I have no inside information about what tests FGCU may have performed if any, but I can infer that the tests were either inadequate or that the results were not taken seriously. As a result, what could have been a public relations slam dunk turned into a missed opportunity.

Sure, you say, but that's a once-in-a-generation occurrence, and you're a business not a university. Consider this. While watching the Super Bowl, I saw a rather cryptic commercial for a company I hadn't heard of before. Like many people around the country, I wanted to know more so I visited the company's website. What did I find? It had crashed.

And they weren't alone. Coke, Acura, and other big names experienced similar outages. It's true that running a Super Bowl add does not really qualify as an "unexpected event." Surely, many individuals in each of those companies knew the ads would run, yet still the web team was left looking unprepared. Perhaps they had not tested with a realistic, geographically distributed user load? It is not inconceivable that in some cases the web teams were not aware that the ad would run. Can you say with 100% confidence that you know exactly when your company's next big campaign will launch? What if a mistake is made - one outside the control of anyone in your organization? Is your website ready today to handle the traffic generated by such an event? If not, how will it fail?

So far, the examples I've cited have resulted in maybe a little embarrassment, a bit (or more) of revenue loss, and some brand tarnishing. But, it's easier to imagine a more dire scenario. People depend on the web today like never before. Websites that serve the public interest and public safety are expected to perform and deliver up-to-date information that the public needs at all times.

During the terrorist hunt after the tragic marathon bombing in Boston earlier this year, the FBI had held a press conference alerting the public of the identification of the suspects. Among the discussion was the release of a URL that contained photos of the suspects. Living just a few miles from where the bombing took place, I, like most of the people watching the press conference, tried to bring up the website only to find a "website not available" message. While the outage seemed to be resolved promptly, I can only imagine the ramifications if the site had remained down.

 

While the latter example might be extreme, all of these situations had one thing in common: the organizations did not expect the causes of the failures to ever occur in the first place. If they had, obviously they would have done more to protect against it. Instead of wracking your brain to think about all the possible causes of traffic spikes such as a water main breaking, a major storm approaching or a competitor's site going down, just test it so you know if and how you can handle the spike. This will ensure you have the answers to those questions you will be sure to get should an unforeseeable event impact your site. The fact is unlikely events occur all the time. Our job as load testers is to understand how our software will perform when they do. Since learning to expect the unexpected, I realize it's all about preparation, not procrastination.

This weekend, I'm cleaning out the garage... maybe I'll even get a jump on my holiday shopping.

More Stories By Steve Weisfeldt

Steve Weisfeldt is a Senior Performance Engineer at Neotys, a provider of load testing software for Web applications. Previously, he has worked as the President of Engine 1 Consulting, a services firm specializing in all facets of test automation. Prior to his involvement at Engine 1 Consulting, he was a Senior Systems Engineer at Aternity. Prior to that, Steve spent seven years at automated testing vendor Segue Software (acquired by Borland). While spending most of his time at Segue delivering professional services and training, he was also involved in pre-sales and product marketing efforts.

Being in the load and performance testing space since 1999, Steve has been involved in load and performance testing projects of all sizes, in industries that span the retail, financial services, insurance and manufacturing sectors. His expertise lies in enabling organizations to optimize their ability to develop, test and launch high-quality applications efficiently, on-time and on-budget. Steve graduated from the University of Massachusetts-Lowell with a BS in Electrical Engineering and an MS in Computer Engineering.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@MicroservicesExpo Stories
DevOps is often described as a combination of technology and culture. Without both, DevOps isn't complete. However, applying the culture to outdated technology is a recipe for disaster; as response times grow and connections between teams are delayed by technology, the culture will die. A Nutanix Enterprise Cloud has many benefits that provide the needed base for a true DevOps paradigm. In his Day 3 Keynote at 20th Cloud Expo, Chris Brown, a Solutions Marketing Manager at Nutanix, will explore t...
The IT industry is undergoing a significant evolution to keep up with cloud application demand. We see this happening as a mindset shift, from traditional IT teams to more well-rounded, cloud-focused job roles. The IT industry has become so cloud-minded that Gartner predicts that by 2020, this cloud shift will impact more than $1 trillion of global IT spending. This shift, however, has left some IT professionals feeling a little anxious about what lies ahead. The good news is that cloud computin...
As Enterprise business moves from Monoliths to Microservices, adoption and successful implementations of Microservices become more evident. The goal of Microservices is to improve software delivery speed and increase system safety as scale increases. Documenting hurdles and problems for the use of Microservices will help consultants, architects and specialists to avoid repeating the same mistakes and learn how and when to use (or not use) Microservices at the enterprise level. The circumstance w...
SYS-CON Events announced today that Auditwerx will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Auditwerx specializes in SOC 1, SOC 2, and SOC 3 attestation services throughout the U.S. and Canada. As a division of Carr, Riggs & Ingram (CRI), one of the top 20 largest CPA firms nationally, you can expect the resources, skills, and experience of a much larger firm combined with the accessibility and attent...
SYS-CON Events announced today that HTBase will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. HTBase (Gartner 2016 Cool Vendor) delivers a Composable IT infrastructure solution architected for agility and increased efficiency. It turns compute, storage, and fabric into fluid pools of resources that are easily composed and re-composed to meet each application’s needs. With HTBase, companies can quickly prov...
Everyone wants to use containers, but monitoring containers is hard. New ephemeral architecture introduces new challenges in how monitoring tools need to monitor and visualize containers, so your team can make sense of everything. In his session at @DevOpsSummit, David Gildeh, co-founder and CEO of Outlyer, will go through the challenges and show there is light at the end of the tunnel if you use the right tools and understand what you need to be monitoring to successfully use containers in your...
What if you could build a web application that could support true web-scale traffic without having to ever provision or manage a single server? Sounds magical, and it is! In his session at 20th Cloud Expo, Chris Munns, Senior Developer Advocate for Serverless Applications at Amazon Web Services, will show how to build a serverless website that scales automatically using services like AWS Lambda, Amazon API Gateway, and Amazon S3. We will review several frameworks that can help you build serverle...
Buzzword alert: Microservices and IoT at a DevOps conference? What could possibly go wrong? In this Power Panel at DevOps Summit, moderated by Jason Bloomberg, the leading expert on architecting agility for the enterprise and president of Intellyx, panelists peeled away the buzz and discuss the important architectural principles behind implementing IoT solutions for the enterprise. As remote IoT devices and sensors become increasingly intelligent, they become part of our distributed cloud enviro...
@DevOpsSummit has been named the ‘Top DevOps Influencer' by iTrend. iTrend processes millions of conversations, tweets, interactions, news articles, press releases, blog posts - and extract meaning form them and analyzes mobile and desktop software platforms used to communicate, various metadata (such as geo location), and automation tools. In overall placement, @DevOpsSummit ranked as the number one ‘DevOps Influencer' followed by @CloudExpo at third, and @MicroservicesE at 24th.
By now, every company in the world is on the lookout for the digital disruption that will threaten their existence. In study after study, executives believe that technology has either already disrupted their industry, is in the process of disrupting it or will disrupt it in the near future. As a result, every organization is taking steps to prepare for or mitigate unforeseen disruptions. Yet in almost every industry, the disruption trend continues unabated.
In his General Session at 16th Cloud Expo, David Shacochis, host of The Hybrid IT Files podcast and Vice President at CenturyLink, investigated three key trends of the “gigabit economy" though the story of a Fortune 500 communications company in transformation. Narrating how multi-modal hybrid IT, service automation, and agile delivery all intersect, he will cover the role of storytelling and empathy in achieving strategic alignment between the enterprise and its information technology.
While DevOps most critically and famously fosters collaboration, communication, and integration through cultural change, culture is more of an output than an input. In order to actively drive cultural evolution, organizations must make substantial organizational and process changes, and adopt new technologies, to encourage a DevOps culture. Moderated by Andi Mann, panelists discussed how to balance these three pillars of DevOps, where to focus attention (and resources), where organizations might...
Microservices are a very exciting architectural approach that many organizations are looking to as a way to accelerate innovation. Microservices promise to allow teams to move away from monolithic "ball of mud" systems, but the reality is that, in the vast majority of organizations, different projects and technologies will continue to be developed at different speeds. How to handle the dependencies between these disparate systems with different iteration cycles? Consider the "canoncial problem" ...
In his session at 20th Cloud Expo, Scott Davis, CTO of Embotics, will discuss how automation can provide the dynamic management required to cost-effectively deliver microservices and container solutions at scale. He will discuss how flexible automation is the key to effectively bridging and seamlessly coordinating both IT and developer needs for component orchestration across disparate clouds – an increasingly important requirement at today’s multi-cloud enterprise.
The essence of cloud computing is that all consumable IT resources are delivered as services. In his session at 15th Cloud Expo, Yung Chou, Technology Evangelist at Microsoft, demonstrated the concepts and implementations of two important cloud computing deliveries: Infrastructure as a Service (IaaS) and Platform as a Service (PaaS). He discussed from business and technical viewpoints what exactly they are, why we care, how they are different and in what ways, and the strategies for IT to transi...
Thanks to Docker and the DevOps revolution, microservices have emerged as the new way to build and deploy applications — and there are plenty of great reasons to embrace the microservices trend. If you are going to adopt microservices, you also have to understand that microservice architectures have many moving parts. When it comes to incident management, this presents an important difference between microservices and monolithic architectures. More moving parts mean more complexity to monitor an...
All organizations that did not originate this moment have a pre-existing culture as well as legacy technology and processes that can be more or less amenable to DevOps implementation. That organizational culture is influenced by the personalities and management styles of Executive Management, the wider culture in which the organization is situated, and the personalities of key team members at all levels of the organization. This culture and entrenched interests usually throw a wrench in the work...
The Internet of Things is clearly many things: data collection and analytics, wearables, Smart Grids and Smart Cities, the Industrial Internet, and more. Cool platforms like Arduino, Raspberry Pi, Intel's Galileo and Edison, and a diverse world of sensors are making the IoT a great toy box for developers in all these areas. In this Power Panel at @ThingsExpo, moderated by Conference Chair Roger Strukhoff, panelists discussed what things are the most important, which will have the most profound e...
DevOps is often described as a combination of technology and culture. Without both, DevOps isn't complete. However, applying the culture to outdated technology is a recipe for disaster; as response times grow and connections between teams are delayed by technology, the culture will die. A Nutanix Enterprise Cloud has many benefits that provide the needed base for a true DevOps paradigm.
For organizations that have amassed large sums of software complexity, taking a microservices approach is the first step toward DevOps and continuous improvement / development. Integrating system-level analysis with microservices makes it easier to change and add functionality to applications at any time without the increase of risk. Before you start big transformation projects or a cloud migration, make sure these changes won’t take down your entire organization.