Welcome!

Microservices Expo Authors: Pat Romanski, Elizabeth White, Stackify Blog, Liz McMillan, Yeshim Deniz

Related Topics: Microservices Expo, Java IoT, Microsoft Cloud, Machine Learning , Agile Computing, @CloudExpo

Microservices Expo: Article

Learning to Expect the Unexpected: Load Test Before It’s Too Late

Unfortunately, many organizations tend to treat load testing as one of those activities that they can put off until a later day

At times, I can be a bit of a procrastinator. If there is no pressing need to clean out the garage this week, shop for holiday gifts, or do my taxes, I can easily be convinced to let it go until next week or next month. Inevitably, though, something happens that makes me wish I hadn't delayed quite as long as I did. The garage gets flooded, for example, and the boxes that I had been meaning to organize get soaked and destroyed... or my Valentine's Day gift doesn't get shipped in time and I'm left holding the bag. I'm sure many of you can think of your own examples.

Unfortunately, many organizations tend to treat load testing as one of those activities that they can put off until a later day. You can almost imagine what they're thinking: "Our website is up and handling the daily load with little difficulty. Yes, there's a major advertising campaign - or new product launch, or major news release, or something similar - coming, but that's a few months away, and we have plenty of time to prepare for it." Then, inevitably something happens, testing doesn't get completed and the website is flooded with traffic that it is unable to handle. If you're the one responsible for the fall-out from such an event, it's time to stop procrastinating and start load testing. By load testing, I'm not just talking about throwing a bunch of simultaneous users at your website. I'm talking about generating a realistic load so you get results your developers and infrastructure team will actually pay attention to. This involves modeling real-world factors in your user loads, including users accessing your website and applications from mobile devices and from lots of different geographies. With proper load testing you can be prepared when the unexpected deluge of users hits your site. You'll know what your site can handle, and how it will respond. More important, you can put mechanisms and procedures in place to help ensure your site will scale - or at least fail gracefully - and avoid the organizational embarrassment and opportunity cost of a major outage.

Perhaps you're still not convinced that some event could happen tomorrow that sends a tidal wave of users your way. That's what Florida Gulf Coast University (FGCU) thought in March of 2013, when the school's basketball team scored an unprecedented and unexpected series of victories in the 2013 NCAA Men's Division I Basketball Tournament. Suddenly, what was a relatively unknown school outside of Florida was thrust into the national limelight, and millions of people wanted to learn more about it. What happened? The university's website crashed. At exactly the time when FCGU could present a positive image of itself to a wide, interested audience, the website failed under load. To be clear, I have no inside information about what tests FGCU may have performed if any, but I can infer that the tests were either inadequate or that the results were not taken seriously. As a result, what could have been a public relations slam dunk turned into a missed opportunity.

Sure, you say, but that's a once-in-a-generation occurrence, and you're a business not a university. Consider this. While watching the Super Bowl, I saw a rather cryptic commercial for a company I hadn't heard of before. Like many people around the country, I wanted to know more so I visited the company's website. What did I find? It had crashed.

And they weren't alone. Coke, Acura, and other big names experienced similar outages. It's true that running a Super Bowl add does not really qualify as an "unexpected event." Surely, many individuals in each of those companies knew the ads would run, yet still the web team was left looking unprepared. Perhaps they had not tested with a realistic, geographically distributed user load? It is not inconceivable that in some cases the web teams were not aware that the ad would run. Can you say with 100% confidence that you know exactly when your company's next big campaign will launch? What if a mistake is made - one outside the control of anyone in your organization? Is your website ready today to handle the traffic generated by such an event? If not, how will it fail?

So far, the examples I've cited have resulted in maybe a little embarrassment, a bit (or more) of revenue loss, and some brand tarnishing. But, it's easier to imagine a more dire scenario. People depend on the web today like never before. Websites that serve the public interest and public safety are expected to perform and deliver up-to-date information that the public needs at all times.

During the terrorist hunt after the tragic marathon bombing in Boston earlier this year, the FBI had held a press conference alerting the public of the identification of the suspects. Among the discussion was the release of a URL that contained photos of the suspects. Living just a few miles from where the bombing took place, I, like most of the people watching the press conference, tried to bring up the website only to find a "website not available" message. While the outage seemed to be resolved promptly, I can only imagine the ramifications if the site had remained down.

 

While the latter example might be extreme, all of these situations had one thing in common: the organizations did not expect the causes of the failures to ever occur in the first place. If they had, obviously they would have done more to protect against it. Instead of wracking your brain to think about all the possible causes of traffic spikes such as a water main breaking, a major storm approaching or a competitor's site going down, just test it so you know if and how you can handle the spike. This will ensure you have the answers to those questions you will be sure to get should an unforeseeable event impact your site. The fact is unlikely events occur all the time. Our job as load testers is to understand how our software will perform when they do. Since learning to expect the unexpected, I realize it's all about preparation, not procrastination.

This weekend, I'm cleaning out the garage... maybe I'll even get a jump on my holiday shopping.

More Stories By Steve Weisfeldt

Steve Weisfeldt is a Senior Performance Engineer at Neotys, a provider of load testing software for Web applications. Previously, he has worked as the President of Engine 1 Consulting, a services firm specializing in all facets of test automation. Prior to his involvement at Engine 1 Consulting, he was a Senior Systems Engineer at Aternity. Prior to that, Steve spent seven years at automated testing vendor Segue Software (acquired by Borland). While spending most of his time at Segue delivering professional services and training, he was also involved in pre-sales and product marketing efforts.

Being in the load and performance testing space since 1999, Steve has been involved in load and performance testing projects of all sizes, in industries that span the retail, financial services, insurance and manufacturing sectors. His expertise lies in enabling organizations to optimize their ability to develop, test and launch high-quality applications efficiently, on-time and on-budget. Steve graduated from the University of Massachusetts-Lowell with a BS in Electrical Engineering and an MS in Computer Engineering.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@MicroservicesExpo Stories
Regardless of what business you’re in, it’s increasingly a software-driven business. Consumers’ rising expectations for connected digital and physical experiences are driving what some are calling the "Customer Experience Challenge.” In his session at @DevOpsSummit at 20th Cloud Expo, Marco Morales, Director of Global Solutions at CollabNet, will discuss how organizations are increasingly adopting a discipline of Value Stream Mapping to ensure that the software they are producing is poised to o...
DevOps at Cloud Expo – being held October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA – announces that its Call for Papers is open. Born out of proven success in agile development, cloud computing, and process automation, DevOps is a macro trend you cannot afford to miss. From showcase success stories from early adopters and web-scale businesses, DevOps is expanding to organizations of all sizes, including the world's largest enterprises – and delivering real r...
Cloud promises the agility required by today’s digital businesses. As organizations adopt cloud based infrastructures and services, their IT resources become increasingly dynamic and hybrid in nature. Managing these require modern IT operations and tools. In his session at 20th Cloud Expo, Raj Sundaram, Senior Principal Product Manager at CA Technologies, will discuss how to modernize your IT operations in order to proactively manage your hybrid cloud and IT environments. He will be sharing bes...
SYS-CON Events announced today that CollabNet, a global leader in enterprise software development, release automation and DevOps solutions, will be a Bronze Sponsor of SYS-CON's 20th International Cloud Expo®, taking place from June 6-8, 2017, at the Javits Center in New York City, NY. CollabNet offers a broad range of solutions with the mission of helping modern organizations deliver quality software at speed. The company’s latest innovation, the DevOps Lifecycle Manager (DLM), supports Value S...
SYS-CON Events announced today that Peak 10, Inc., a national IT infrastructure and cloud services provider, will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Peak 10 provides reliable, tailored data center and network services, cloud and managed services. Its solutions are designed to scale and adapt to customers’ changing business needs, enabling them to lower costs, improve performance and focus intern...
DevOps is often described as a combination of technology and culture. Without both, DevOps isn't complete. However, applying the culture to outdated technology is a recipe for disaster; as response times grow and connections between teams are delayed by technology, the culture will die. A Nutanix Enterprise Cloud has many benefits that provide the needed base for a true DevOps paradigm. In his Day 3 Keynote at 20th Cloud Expo, Chris Brown, a Solutions Marketing Manager at Nutanix, will explore t...
This talk centers around how to automate best practices in a multi-/hybrid-cloud world based on our work with customers like GE, Discovery Communications and Fannie Mae. Today’s enterprises are reaping the benefits of cloud computing, but also discovering many risks and challenges. In the age of DevOps and the decentralization of IT, it’s easy to over-provision resources, forget that instances are running, or unintentionally expose vulnerabilities.
Most DevOps journeys involve several phases of maturity. Research shows that the inflection point where organizations begin to see maximum value is when they implement tight integration deploying their code to their infrastructure. Success at this level is the last barrier to at-will deployment. Storage, for instance, is more capable than where we read and write data. In his session at @DevOpsSummit at 20th Cloud Expo, Josh Atwell, a Developer Advocate for NetApp, will discuss the role and value...
It has never been a better time to be a developer! Thanks to cloud computing, deploying our applications is much easier than it used to be. How we deploy our apps continues to evolve thanks to cloud hosting, Platform-as-a-Service (PaaS), and now Function-as-a-Service. FaaS is the concept of serverless computing via serverless architectures. Software developers can leverage this to deploy an individual "function", action, or piece of business logic. They are expected to start within milliseconds...
You know you need the cloud, but you’re hesitant to simply dump everything at Amazon since you know that not all workloads are suitable for cloud. You know that you want the kind of ease of use and scalability that you get with public cloud, but your applications are architected in a way that makes the public cloud a non-starter. You’re looking at private cloud solutions based on hyperconverged infrastructure, but you’re concerned with the limits inherent in those technologies.
There are two main reasons for infrastructure automation. First, system administrators, IT professionals and DevOps engineers need to automate as many routine tasks as possible. That’s why we build tools at Stackify to help developers automate processes like application performance management, error monitoring, and log management; automation means you have more time for mission-critical tasks. Second, automation makes the management of complex, diverse environments possible and allows rapid scal...
One of the biggest challenges with adopting a DevOps mentality is: new applications are easily adapted to cloud-native, microservice-based, or containerized architectures - they can be built for them - but old applications need complex refactoring. On the other hand, these new technologies can require relearning or adapting new, oftentimes more complex, methodologies and tools to be ready for production. In his general session at @DevOpsSummit at 20th Cloud Expo, Chris Brown, Solutions Marketi...
We all know that end users experience the internet primarily with mobile devices. From an app development perspective, we know that successfully responding to the needs of mobile customers depends on rapid DevOps – failing fast, in short, until the right solution evolves in your customers' relationship to your business. Whether you’re decomposing an SOA monolith, or developing a new application cloud natively, it’s not a question of using microservices - not doing so will be a path to eventual ...
SYS-CON Events announced today that Linux Academy, the foremost online Linux and cloud training platform and community, will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Linux Academy was founded on the belief that providing high-quality, in-depth training should be available at an affordable price. Industry leaders in quality training, provided services, and student certification passes, its goal is to c...
SYS-CON Events announced today that Fusion, a leading provider of cloud services, will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Fusion, a leading provider of integrated cloud solutions to small, medium and large businesses, is the industry’s single source for the cloud. Fusion’s advanced, proprietary cloud service platform enables the integration of leading edge solutions in the cloud, including cloud...
SYS-CON Events announced today that HTBase will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. HTBase (Gartner 2016 Cool Vendor) delivers a Composable IT infrastructure solution architected for agility and increased efficiency. It turns compute, storage, and fabric into fluid pools of resources that are easily composed and re-composed to meet each application’s needs. With HTBase, companies can quickly prov...
@DevOpsSummit at Cloud taking place June 6-8, 2017, at Javits Center, New York City, is co-located with the 20th International Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to wait for long developm...
With 10 simultaneous tracks, keynotes, general sessions and targeted breakout classes, Cloud Expo and @ThingsExpo are two of the most important technology events of the year. Since its launch over eight years ago, Cloud Expo and @ThingsExpo have presented a rock star faculty as well as showcased hundreds of sponsors and exhibitors! In this blog post, I provide 7 tips on how, as part of our world-class faculty, you can deliver one of the most popular sessions at our events. But before reading the...
The purpose of this article is draw attention to key SaaS services that are commonly overlooked during contact signing that are essential to ensuring they meet the expectations and requirements of the organization and provide guidance and recommendations for process and controls necessary for achieving quality SaaS contractual agreements.
SYS-CON Events announced today that OpsGenie will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Founded in 2012, OpsGenie is an alerting and on-call management solution for dev and ops teams. OpsGenie provides the tools needed to design actionable alerts, manage on-call schedules and escalations, and ensure that the right people are notified at the right time, using multiple notification methods.