Click here to close now.

Welcome!

Microservices Journal Authors: Pat Romanski, Srinivasan Sundara Rajan, Louis Evans, Elizabeth White, Blue Box Blog

Related Topics: Wireless, Java, Microservices Journal, Virtualization, Web 2.0

Wireless: Article

Mobile Performance Testing: Demystified

A look at how to approach performance / load testing extranet mobile applications

How does the approach to performance / load testing extranet mobile applications change from testing other RIAs? In some ways, not much. Yes, the user activity for every mobile application will be unique, but the same goes for every web application. Different technology stacks, different deployments, different load patterns, different types of users profiles, and different content delivery… All make each web application, in its own right, unique. The approach to methodical performance testing for capacity planning and identifying scalability issues remains the same.

The mobile application could be a web site accessed via a URL or it could be a native mobile application loaded onto your device. The list of mobile devices keeps growing, but currently the most popular are Tablets, PDA’s, Droids, Blackberry, iPhone, iPad, Smartphones, etc. Supporting testing from these devices is important, but what’s even more important in your mobile load testing strategy is to generate traffic that represents the way users are actually going to access this mobile application. Whether it’s an ecommerce application being accessed via a Safari browser or an installed mobile app which makes webservice calls out to a feed, the load testing tool must generate the correct type of user connections and generate realistic load. This is the exact same challenge with testing non-mobile web applications as well.

Mobile applications are being developed and deployed rapidly, using a variety of cutting edge protocols and behaviors. The load tool must support the latest technologies in order to effectively address mobile apps. You need the ability to record a script either straight from the mobile device, from an emulator, or from a mobile browser. Handling behaviors such as asynchronous behaviors of PUSH technology becomes a requirement in many mobile applications. As important as the design of a performance test case scenario, now the load generation piece must either mimic the unique characteristics of mobile devices or have the ability to generate the load straight from the device. For example: headers, number of connection threads, etc. All these characteristics are important elements to emulate when conducting web and mobile performance testing.

What’s different about mobile? Mobile applications are being built using network efficiencies which aim in relying less on the intermittent characteristics of mobile networks. It is the variable network conditions that cause delays in response times which in turn affect the duration that ports or sockets are kept open — an environmental resource usage that is frequently seen with mobile applications. It’s because of this variable network connectivity that the user experience isn’t always an absolute known: the speed of the network depends on your device, your network plan (WIFI, 3G, 4G, ATT, etc), your geographic location, network connectivity, the network usage vs. bandwidth, and so on. Your load tool needs to have the option of emulating these bandwidth speeds to more accurately capture response times. Developers concentrate on what can be controlled: building efficient mobile apps which require less network overhead. There are many techniques to reduce the network traffic, all of which contribute to making responses less dependent on the network. “Conservation” is the approach of reducing network roundtrips by decreasing embedded requests, using local storage on the device for caching static files, enabling transfer compression, avoiding redirects, minimizing data content size, reducing number and length of cookies, removing lint from code (white spaces and comments), organizing the delivery for incremental rendering, aggregating requests and using PUSH behaviors. Creating lighter-weight mobile applications allows the overall end user experience to be less dependent on the device network vulnerabilities.

In the end however, the approach to load testing an extranet mobile application remains the same. You have goals: number of concurrent users, expected response times, load patterns etc. Using the right load tool, you can emulate this activity. You then identify capacity and saturation points and alleviate these bottlenecks in order to scale to a higher workload. You already know the drill for doing this and if you don’t, please refer to 11 Tips to Becoming a Better Performance Engineer. It sounds simple, but mobile performance testing is an interesting and vast topic so check back in for future posts on the subject from some of my colleagues.

More Stories By Rebecca Clinard

Rebecca Clinard is a Senior Performance Engineer at Neotys, a provider of load testing software for Web applications. Previously, she worked as a web application performance engineer for Bowstreet, Fidelity Investments, Bottomline Technologies and Timberland companies, industries spanning retail, financial services, insurance and manufacturing. Her expertise lies in creating realistic load tests and performance tuning multi-tier deployments. She has been orchestrating and conducting performance tests since 2001. Clinard graduated from University of New Hampshire with a BS and also holds a UNIX Certificate from Worcester Polytechnic Institute.

@MicroservicesExpo Stories
Today, the demand for new applications is growing at an unprecedented rate throughout lines of business and across industries. Customer expectations for mobile and e-commerce capabilities are transforming software development speed and quality into a competitive differentiator for even the most unlikely businesses. For existing software development shops, the proliferation of platforms, increasing need for total global uptime, and accelerating pace of industry disruption by fast-paced startups h...
SYS-CON Events announced today that Column Technologies, a global technology solutions company, will exhibit at SYS-CON's DevOps Summit 2015 New York, which will take place June 9-11, 2015, at the Javits Center in New York City, NY. Established in 1998, Column Technologies is a leader in application performance and infrastructure management for commercial and federal markets. The company is headquartered in the United States, with a diverse and talented team of more than 350 employees around th...
Financial services organizations were among the earliest enterprise adopters of cloud computing. The ability to leverage massive compute, storage and networking resources via RESTful APIs and automated tools like Chef and Puppet made it possible for their high-horsepower IT users to develop a whole new array of applications. Companies like Wells Fargo, Fidelity and BBVA are visible, vocal and engaged supporters of the OpenStack community, running production clouds for applications ranging from d...
As we recently previewed (read more about our London PoP in Jesse's post), Blue Box is opening a new Data Center in London, but hadn't announced the provider. Today we're excited to partner with TelecityGroup, whom we've selected as our data center partner in London. We chose their Powergate location, which is one of the U.K.'s most advanced, flexible and energy efficient carrier-neutral data centres. Why does that matter to you? Well, when customers choose Blue Box, they're trusting us with ...
Cloud Expo New York is happening from June 9 - 11. This event brings together the worlds of Cloud Computing, DevOps, IoT, WebRTC, Big Data and SDDC. We hope to see you there-members of the Blue Box team will exhibit in booth 218 next to the DevOps area. Plus, our Chief Product Officer, Hernan Alvarez, will present his talk "The Cloud Has a Down-and-Dirty Lining" as part of the Operations track in the DevOps Summit portion of the event on June 9 at 11 am. Learn more about his session her...
Operationalizing the network continues to be a driving force behind DevOps and SDN. The ability to solve real problems using programmability to automate and orchestrate infrastructure provisioning and configuration across the application release process remains the hope for many interested in one or the other - and often times both. A recent Avaya sponsored, Dynamic Markets survey (reg required) dove deep into the demesne of SDN and found that many of the problems companies have - and expect ...
We just finished the first O’Reilly Software Architecture Conference and the overwhelming most popular topic was microservices. Why all the hype about an architectural style? Microservices are the first post-DevOps revolution architecture. The DevOps revolution highlighted how much inadvertent friction an outdated operations mindset can cause, starting the move towards automating away manual tasks.
SYS-CON Media announced today that Blue Box as launched a popular blog feed on Cloud Computing Journal. Cloud Computing Journal aims to help open the eyes of Enterprise IT professionals to the economics and strategies that utility/cloud computing provides. Blue Box Cloud gives you unequaled agility, without the burden of designing, deploying and managing your own infrastructure. It’s the right choice when public cloud just won’t do. Blue Box Cloud is a managed Private Cloud as a Service (...
Back in 2009 I posted about the “Great Cloud Shakeout” and the coming market consolidation into a few very large clouds. Nearly 5 1/2 years later and it’s about (long past?) time I took another look to see how I did. Back then I predicted that the market would be dominated by “mega CSPs” by the name of Amazon, Google and Microsoft. Note that this was during a period of Cambrian Explosion in the CSP market – it seems like everybody in the hosting business wanted to be a cloud provider....
SYS-CON Events announced today that Ciqada will exhibit at SYS-CON's @ThingsExpo, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. Ciqada™ makes it easy to connect your products to the Internet. By integrating key components - hardware, servers, dashboards, and mobile apps - into an easy-to-use, configurable system, your products can quickly and securely join the internet of things. With remote monitoring, control, and alert messaging capability, you will mee...
With the advent of micro-services, the application design paradigm has undergone a major shift. The days of developing monolithic applications are over. We are bringing in the principles (read SOA) hereto the preserve of applications or system integration space into the application development world. Since the micro-services are consumed within the application, the need of ESB is not there. There is no message transformation or mediations required. But service discovery and load balancing of ...
Chef and Canonical announced a partnership to integrate and distribute Chef with Ubuntu. Canonical is integrating the Chef automation platform with Canonical's Machine-As-A-Service (MAAS), enabling users to automate the provisioning, configuration and deployment of bare metal compute resources in the data center. Canonical is packaging Chef 12 server in upcoming distributions of its Ubuntu open source operating system and will provide commercial support for Chef within its user base.
A few weeks ago, SmartBear hosted API Craft Boston with the folks from Akana, Ian Goldsmith and Laura Heritage, to talk about microservices. It was an extremely informative presentation of where microservices came from, what it solves, and considerations around how it might fit into an organizational API strategy. It’s one thing to read everyone else’s opinions on blogs, twitter, etc. It’s great to go to workshops and conferences, but this was so intelligently presented (and for a meetup too)...
While DevOps most critically and famously fosters collaboration, communication, and integration through cultural change, culture is more of an output than an input. In order to actively drive cultural evolution, organizations must make substantial organizational and process changes, and adopt new technologies, to encourage a DevOps culture. Moderated by Andi Mann, panelists will discuss how to balance these three pillars of DevOps, where to focus attention (and resources), where organizations m...
of cloud, colocation, managed services and disaster recovery solutions, will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. TierPoint, LLC, is a leading national provider of information technology and data center services, including cloud, colocation, disaster recovery and managed IT services, with corporate headquarters in St. Louis, MO. TierPoint was formed through the strategic combination of some of t...
How do you securely enable access to your applications in AWS without exposing any attack surfaces? The answer is usually very complicated because application environments morph over time in response to growing requirements from your employee base, your partners and your customers. In his session at 16th Cloud Expo, Haseeb Budhani, CEO and Co-founder of Soha, will share five common approaches that DevOps teams follow to secure access to applications deployed in AWS, Azure, etc., and the frict...
SYS-CON Events announced today that Soha will exhibit at SYS-CON's DevOps Summit New York, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. Soha delivers enterprise-grade application security, on any device, as agile as the cloud. This turnkey, cloud-based service enables customers to solve secure application access and delivery challenges that traditional or virtualized network solutions cannot solve because they are too expensive, inflexible and operational...
SYS-CON Events announced today that Vicom Computer Services, Inc., a provider of technology and service solutions, will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. They are located at booth #427. Vicom Computer Services, Inc. is a progressive leader in the technology industry for over 30 years. Headquartered in the NY Metropolitan area. Vicom provides products and services based on today’s requirements...
What exactly is a cognitive application? In her session at 16th Cloud Expo, Ashley Hathaway, Product Manager at IBM Watson, will look at the services being offered by the IBM Watson Developer Cloud and what that means for developers and Big Data. She'll explore how IBM Watson and its partnerships will continue to grow and help define what it means to be a cognitive service, as well as take a look at the offerings on Bluemix. She will also check out how Watson and the Alchemy API team up to off...
Thought experiment: let’s say your app gets a message from somewhere, perhaps from another app, but you don’t know from where. The message contains the number 47 but no other information. What should your app do with the message? The answer: nothing. There’s no way for your app to make any sense out of a single datum with no context, no additional information or metadata about the datum itself. Now, let’s scale up this thought experiment to a data lake. There are a few common definitions o...