Click here to close now.

Welcome!

Microservices Journal Authors: Liz McMillan, Elizabeth White, Carmen Gonzalez, Alena Prokharchyk, XebiaLabs Blog

Related Topics: Microservices Journal, Java, XML, .NET, AJAX & REA, Open Web

Microservices Journal: Article

GUI Versus Script: Is This Old Load Testing Debate Now Over?

New breed of hybrid load testing solutions

The first step in performance or load testing a web application is to create a realistic test script. This script, representing a specific type of end user, contains steps that are fully automated transactions flows. Often, complex behaviors need to be emulated as part of these flows. To incorporate the needed behavior or to handle complex scenarios, testers need to customize these load scripts. The question is whether you utilize a tool that takes a GUI driven approach for script customization/manipulation, or whether you choose a tool which requires the use of a programming language.

As Performance testers, we typically evaluate several load testing tools before diving into a project. Some of us prefer the GUI driven approach to creating load scripts because, being results driven, we want to get the test up and running as quickly as possible. The GUI approach saves us time and there is no programming involved thus the learning curve is also extremely fast. These GUI scripts are typically easily modified by having their parameters and values organized in a visually obvious format. And just because a tool is easy to use, doesn't mean that it's only for beginners. Remember the good old days of MS-DOS? Eeek, thank goodness for GUI driven DOS (Windows).

Some testers (mistakenly) dismiss the GUI driven approach as being too limited for complicated behaviors. Old school testers insist on only utilizing program-based scripts because past experience has led them to think that this is the most flexible or the only choice for handling complicated behaviors. All too often, the perception is that GUI driven scripts limit the level of customizations possible to emulate a real user. This opinion is likely based on experiences with rudimentary GUI tools on the market that are too basic and limited in their capabilities such as handling dynamic content and varying the transactions flows.

However, there is a new breed in load testing solutions, designed and built to handle the most complex advanced scenarios. These are true enterprise-class solutions which provide a hybrid approach by containing both GUI and programming features. The power behind this hybrid approach enables the user to emulate even the most complex behavior but it also includes time saving features which can only be offered by a GUI solution.

Let's get really technical for a minute to highlight an example: Some tools provide the common "programming" tools like loops and conditions. Recorded values of parameters are easily replaced by variables with a click of the mouse. NeoLoad, an example of a modern enterprise solution, goes further to provide even more advanced features. Some specific examples include: 1) "Wait Until" Action to the current execution thread until certain conditions have been verified 2) "Shared Queue" Action to use values from one VU's response as input in an entirely different VU execution 3) a "While" Action allows various transactions, such as web pages, to be iterated while a condition remains false 4) "Try ...Catch" Action to break out of the script based on Validation or Assertions and go to the End phase. The use of nested actions creates even more complex behaviors. All of these advanced scenarios are accomplished without programming! PUSHtechnology which is rapidly being deployed in today's RIA's adds even more complexity. With asynchronous updates pushed to/from the page independent of complete page refreshes...imagine this programming nightmare! NeoLoad has a way to solve this problem using cutting edge technology that can "listen" for PUSH behavior (all polling or streaming requests) and wrap all these asynchronous requests into a GUI fork Action, even calculating the average time interval between execution, then presents you with a newly modified script to emulate these load pattern characteristics. Again, all of these GUI centric features allow further manipulation without the need for programming.

Admittedly, there are rare occasions which call for programming and the new breed solution has a Javascript Action with a complete API to give it a "hybrid" of GUI and coding capability. Again, simply drag the Javascript action into the place where you want it executed and add the java or javascript required. Accomplish things like computation of variables, logging values to files, manipulating cookies, etc.. Incorporating the javascript feature allows for unlimited flexibility in scripting.
As the script becomes more complicated, it's nice to have this hierarchical GUI-type view.

New breed solutions not only allow for complex behaviors...the GUI approach has other time saving embedded assets. To handle dynamic parameters, NeoLoad is delivered with an ever evolving list of known architectural framework dynamic parameters which are automatically detected and handled by a wizard. The search and replace feature finds strings embedded in any request (body, header, URL's, XML tree, partial matches, etc.) and replaces or concatenates to the string with any data or variable - choose to replace entire string or just part of the string. There's an automatic extraction feature to take data from any response and use it to populate the value of a variable. You can enable/disable specific transactions at a page level or embedded request level which a click of the mouse to isolate transactions of interest. Target an entirely different QA/Performance/Production environment - change the Servers field from host where you initially made the recording to the new server name and port. Debug scripts easily using the side-by-side comparison feature with a tab isolating only the differences of recorded vs. replayed values.

From this perspective, the great debate over choosing a GUI driven or programming approach is over...eliminate the tradeoffs and choose a hybrid which has a powerful GUI and also extends the flexibility for programming. Skip most of the manual programming and only use coding where it's required. Both experts and beginners can agree there is now a solution which meets all of the load & performance testing challenges of your own unique web application. Introducing the "GUI hybrid".

More Stories By Rebecca Clinard

Rebecca Clinard is a Senior Performance Engineer at Neotys, a provider of load testing software for Web applications. Previously, she worked as a web application performance engineer for Bowstreet, Fidelity Investments, Bottomline Technologies and Timberland companies, industries spanning retail, financial services, insurance and manufacturing. Her expertise lies in creating realistic load tests and performance tuning multi-tier deployments. She has been orchestrating and conducting performance tests since 2001. Clinard graduated from University of New Hampshire with a BS and also holds a UNIX Certificate from Worcester Polytechnic Institute.

@MicroservicesExpo Stories
SYS-CON Events announced today that MangoApps will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY., and the 17th International Cloud Expo®, which will take place on November 3–5, 2015, at the Santa Clara Convention Center in Santa Clara, CA. MangoApps provides private all-in-one social intranets allowing workers to securely collaborate from anywhere in the world and from any device. Social, mobile, and eas...
There is no doubt that Big Data is here and getting bigger every day. Building a Big Data infrastructure today is no easy task. There are an enormous number of choices for database engines and technologies. To make things even more challenging, requirements are getting more sophisticated, and the standard paradigm of supporting historical analytics queries is often just one facet of what is needed. As Big Data growth continues, organizations are demanding real-time access to data, allowing immed...
The world's leading Cloud event, Cloud Expo has launched Microservices Journal on the SYS-CON.com portal, featuring over 19,000 original articles, news stories, features, and blog entries. DevOps Journal is focused on this critical enterprise IT topic in the world of cloud computing. Microservices Journal offers top articles, news stories, and blog posts from the world's well-known experts and guarantees better exposure for its authors than any other publication. Follow new article posts on T...
One of the most frequently requested Rancher features, load balancers are used to distribute traffic between docker containers. Now Rancher users can configure, update and scale up an integrated load balancing service to meet their application needs, using either Rancher's UI or API. To implement our load balancing functionality we decided to use HAproxy, which is deployed as a contianer, and managed by the Rancher orchestration functionality. With Rancher's Load Balancing capability, users ...
There are 182 billion emails sent every day, generating a lot of data about how recipients and ISPs respond. Many marketers take a more-is-better approach to stats, preferring to have the ability to slice and dice their email lists based numerous arbitrary stats. However, fundamentally what really matters is whether or not sending an email to a particular recipient will generate value. Data Scientists can design high-level insights such as engagement prediction models and content clusters that a...
SYS-CON Events announced today the IoT Bootcamp – Jumpstart Your IoT Strategy, being held June 9–10, 2015, in conjunction with 16th Cloud Expo and Internet of @ThingsExpo at the Javits Center in New York City. This is your chance to jumpstart your IoT strategy. Combined with real-world scenarios and use cases, the IoT Bootcamp is not just based on presentations but includes hands-on demos and walkthroughs. We will introduce you to a variety of Do-It-Yourself IoT platforms including Arduino, Ras...
What’s hot in today’s cloud computing world? Containers are fast becoming a viable alternative to virtualization for the right use cases. But to understand why containers can be a better option, we need to first understand their origins. In basic terms, containers are application-centric environments that help isolate and run workloads far more efficiently than the traditional hypervisor technology found in commodity cloud Infrastructure as a Service. Modern operating systems (Linux, Windows, e...

As a company making software for Continuous Delivery and Devops at scale, at XebiaLabs we’re pretty much always in discussions with users about the benefits and challenges of new development styles, application architectures, and runtime platforms. Unsurprisingly, many of these discussions right now focus on microservices on the application side and containers and related frameworks […]

The post May. 3, 2015 10:00 AM EDT  Reads: 1,725

The cloud has transformed how we think about software quality. Instead of preventing failures, we must focus on automatic recovery from failure. In other words, resilience trumps traditional quality measures. Continuous delivery models further squeeze traditional notions of quality. Remember the venerable project management Iron Triangle? Among time, scope, and cost, you can only fix two or quality will suffer. Only in today's DevOps world, continuous testing, integration, and deployment upend...
Financial services organizations were among the earliest enterprise adopters of cloud computing. The ability to leverage massive compute, storage and networking resources via RESTful APIs and automated tools like Chef and Puppet made it possible for their high-horsepower IT users to develop a whole new array of applications. Companies like Wells Fargo, Fidelity and BBVA are visible, vocal and engaged supporters of the OpenStack community, running production clouds for applications ranging from d...
Chuck Piluso will present a study of cloud adoption trends and the power and flexibility of IBM Power and Pureflex cloud solutions. Speaker Bio: Prior to Data Storage Corporation (DSC), Mr. Piluso founded North American Telecommunication Corporation, a facilities-based Competitive Local Exchange Carrier licensed by the Public Service Commission in 10 states, serving as the company's chairman and president from 1997 to 2000. Between 1990 and 1997, Mr. Piluso served as chairman & founder of ...
To manage complex web services with lots of calls to the cloud, many businesses have invested in Application Performance Management (APM) and Network Performance Management (NPM) tools. Together APM and NPM tools are essential aids in improving a business's infrastructure required to support an effective web experience... but they are missing a critical component - Internet visibility. Internet connectivity has always played a role in customer access to web presence, but in the past few years u...
Working with Big Data is challenging, especially when decision makers depend on market insights and intelligence from your data but don't have quick access to it or find it unusable. In their session at 6th Big Data Expo, Ian Khan, Global Strategic Positioning & Brand Manager at Solgenia; Zel Bianco, President, CEO and Co-Founder of Interactive Edge of Solgenia; and Ermanno Bonifazi, CEO & Founder at Solgenia, discussed how a revolutionary cloud-based BI along with mobile analytics is already c...
Operationalizing the network continues to be a driving force behind DevOps and SDN. The ability to solve real problems using programmability to automate and orchestrate infrastructure provisioning and configuration across the application release process remains the hope for many interested in one or the other - and often times both. A recent Avaya sponsored, Dynamic Markets survey (reg required) dove deep into the demesne of SDN and found that many of the problems companies have - and expect ...
We just finished the first O’Reilly Software Architecture Conference and the overwhelming most popular topic was microservices. Why all the hype about an architectural style? Microservices are the first post-DevOps revolution architecture. The DevOps revolution highlighted how much inadvertent friction an outdated operations mindset can cause, starting the move towards automating away manual tasks.
This is my first blog post at AppDynamics, and I have to say that it’s great to be aboard. It’s been a hectic first couple of weeks, but the energy, enthusiasm and friendliness of everyone I have met has made me very excited about 2015! AppDynamics has a market leading APM and analytics platform but it also takes great people to make a great company – and AppDynamics has a wealth of talent! So to start my blogging life at AppDynamics I want to focus on something that is a red-hot buzzword in IT...
Cloud computing seems destined to be the way enterprises will use information technology. The drastic cost reductions and impressive operational improvements make the transition an unstoppable trend. The “What is cloud computing?” question now, however, seems to be morphing into “Where is cloud computing going?” While software-as-a-service (SaaS) providers see their market rocketing upward as the easiest and quickest path for cloud adoption, infrastructure-as-a-service providers are suffering...
Software is eating the world. Companies that were not previously in the technology space now find themselves competing with Google and Amazon on speed of innovation. As the innovation cycle accelerates, companies must embrace rapid and constant change to both applications and their infrastructure, and find a way to deliver speed and agility of development without sacrificing reliability or efficiency of operations. In her Day 2 Keynote DevOps Summit, Victoria Livschitz, CEO of Qubell, discussed...
SYS-CON Events announced today that Vicom Computer Services, Inc., a provider of technology and service solutions, will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. They are located at booth #427. Vicom Computer Services, Inc. is a progressive leader in the technology industry for over 30 years. Headquartered in the NY Metropolitan area. Vicom provides products and services based on today’s requirements...
SYS-CON Events announced today that Blue Box has been named “Bronze Sponsor” of SYS-CON's DevOps Summit New York, which will take place June 9-11, 2015, at the Javits Center in New York City, NY. Blue Box delivers Private Cloud as a Service (PCaaS) to a worldwide customer base. Built on a technology platform leveraging decades of operational expertise in cloud and distributed systems, Blue Box Cloud is a managed private cloud product available in both hosted and on-prem versions. Each Blue Box ...