Welcome!

Microservices Expo Authors: Pat Romanski, Karthick Viswanathan, Liz McMillan, Elizabeth White, Automic Blog

Related Topics: Java IoT, Microservices Expo, @CloudExpo, @DevOpsSummit

Java IoT: Article

SaaS Performance | @CloudExpo @Catchpoint #DevOps #WebPerf #AI #SaaS

SaaS providers need better tools to manage performance, enabling them to get ahead of problems

Managing Performance for SaaS-Based Applications

Software as a service (SaaS), one of the earliest and most successful cloud services, has reached mainstream status. According to Cisco, by 2019 more than four-fifths (83 percent) of all data center traffic will be based in the cloud, up from 65 percent today. The majority of this traffic will be applications.

Businesses of all sizes are adopting a variety of SaaS-based services - everything from collaboration tools to mission-critical commerce-oriented applications. The rise in SaaS usage has many positive benefits, but one drawback is that as demand grows, SaaS providers are having a harder time ensuring a high-performing (fast, reliable) end-user experience - at the same time performance expectations are growing higher than ever.

SaaS Providers Struggle to Meet Modern Day User Performance Expectations
Websites and applications must be fast. People want to read an article as soon as it's clicked; shoppers will abandon their cart on an ecommerce site if the website is too slow; customers expect to be able to quickly make transactions - and the list goes on. According to Google's latest research (February 2017), as page load time increases from 1 second to 7 seconds, the likelihood of a visitor abandoning the page increases 113 percent. For SaaS companies to be successful, they need to adopt the same laser focus on the end-user experience that has fueled the rise of ecommerce and B2B applications.

Meeting these performance demands is proving to be a significant challenge. One recent survey of SaaS providers found more than half reported difficulties in delivering sufficient performance levels, while more than a quarter said their organizations had incurred financial penalties as a result of unmet service-level agreements. Twenty-one percent of respondents whose organizations had an unplanned service interruption said it resulted in the loss of a customer relationship. Among those SaaS providers suffering financial penalties, the average cost incurred was $359,000 - not including the time and effort spent finding and fixing the source of performance declines.

Why Is Ensuring Superior Performance So Difficult?
Ensuring strong performance levels is proving difficult for several reasons:

Infrastructure Build-Outs - As many SaaS providers expand into new geographies and support more businesses, they are adding infrastructure as well as partitioning more existing systems. According to the SaaS provider survey mentioned above, almost half of respondents noted they have at least doubled the number of systems supporting their workloads and applications over the past two years. While this helps them support more customers, there is a nasty side effect - greater complexity, which makes it harder to find and fix the source of performance problems when they do occur.

Users' Geographic Expansion - Heightening these performance challenges is the growth of end users in new geographies. Application performance tends to deteriorate based on distance from the SaaS provider's data center. This means as end users move further away, there are more variables standing between them and the data center which can degrade performance - networks, ISPs, even browsers. This makes it impossible for SaaS providers to gauge worldwide performance levels for a specific SaaS user, based solely on the experiences of end users in just one or two geographies.

To expand and improve geographic reach, many SaaS providers build out their infrastructure, which in turn adds more complexity. The net result is a vicious cycle that ultimately results in decreased visibility into infrastructure health and end-user application performance.

The Capricious Nature of the Internet - Full SaaS provider outages are rare, but when they do happen, they can be disastrous. The Amazon S3 outage on February 28 served as the latest example, causing widespread availability issues for thousands of websites, apps, and IoT devices.

There have been other instances recently - in February 2016, Office 365 went dark for wide swaths of Europe. In August 2015, a Google data center in Belgium was struck by successive lightning strikes, causing problems for numerous Google cloud infrastructure service users. Not even tech giants like Amazon, Microsoft, or Google are immune to acts of God or nature. Inevitable outages are not the fault of these providers - rather, the "ripple effect" is the result of the tendency for business users to concentrate too much work in the hands of a single provider.

More common than full-blown outages are instances of SaaS applications just not performing well. Even though many SaaS providers have monitoring systems in place, 54 percent report the primary way they find out about performance problems is through customer complaints.

Managing Performance Must Be a Shared Endeavor
SaaS providers need better tools to manage performance, enabling them to get ahead of problems before their customers' end users are affected. This is a fundamental shift from traditional application performance management (APM) to what Gartner refers to as digital experience management (DEM). DEM treats the end-user experience as the ultimate metric, and identifies how the myriad of underlying services, systems, and components influence it. This approach is consistent with a recent EMA survey in which more than three quarters of respondents prioritized the ability to troubleshoot and analyze root causes of application performance problems, down to the platform level.

As the number of performance-impacting variables increases, SaaS providers may find themselves drowning in data, but searching for insights. They need advanced analytics to make data more actionable by identifying the cause of performance issues, swiftly and accurately. Sometimes performance issues are within the SaaS provider's control (such as when a particular region or data center requires more capacity). Other times, the issue may not be directly within the IT team's control - for example, a slow ISP or CDN. Even with these external factors, the information is still useful because time spent unnecessarily "war-rooming" can be avoided.

Business users of SaaS services should also be contributing to the performance management effort. They should consistently measure their SaaS providers' response levels, as well as monitor and measure real end- user performance at the closest points of geographic proximity. This is the key to gaining the most realistic view of end-user performance levels around the world. Having this information can help SaaS users uphold provider SLAs, but perhaps, more important, identify performance problems in advance and quickly determine if the problem is with the cloud service provider, or another component or internal infrastructure element.

Finally, as the recent Amazon S3 example demonstrated, SaaS users should always have a redundancy plan in place for their critical applications. In essence, they need to architect for failure. This may require an investment of time and effort, but can make all the difference in keeping SaaS-based businesses running smoothly when faced with a completely unpredictable event.

Conclusion
The growth in SaaS reliance is not going away, and SaaS providers cannot afford setbacks. When the SaaS platform that employees spend 80% of their day on goes down, productivity, and therefore a company's bottom line, takes a hit.

SaaS providers will continue to struggle with rapid growth and increasing complexity as business users port more mission-critical applications to the cloud and end users demand increasingly higher levels of performance and productivity.

This situation has the potential to escalate unless SaaS providers address the issue head-on with new approaches that evolve APM to DEM. Business users must also do their part. Ultimately, this can translate to more proactive, productive performance management, with less finger pointing and war rooming and more accurate, decisive issue resolution.

More Stories By Mehdi Daoudi

Mehdi Daoudi is the co-founder and CEO of Catchpoint Systems, a premier provider of web performance testing and monitoring solutions. His team has expertise in designing, building, operating, scaling and monitoring highly transactional Internet services used by thousands of companies that impact the experience of millions of users.

Before Catchpoint Systems, Mehdi spent 10+ years at DoubleClick and Google, where he was responsible for Quality of Services, buying, building, deploying, and using monitoring solutions to keep an eye on an infrastructure that delivered billions of transactions daily.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@MicroservicesExpo Stories
"DivvyCloud as a company set out to help customers automate solutions to the most common cloud problems," noted Jeremy Snyder, VP of Business Development at DivvyCloud, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
"At the keynote this morning we spoke about the value proposition of Nutanix, of having a DevOps culture and a mindset, and the business outcomes of achieving agility and scale, which everybody here is trying to accomplish," noted Mark Lavi, DevOps Solution Architect at Nutanix, in this SYS-CON.tv interview at @DevOpsSummit at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
From manual human effort the world is slowly paving its way to a new space where most process are getting replaced with tools and systems to improve efficiency and bring down operational costs. Automation is the next big thing and low code platforms are fueling it in a significant way. The Automation era is here. We are in the fast pace of replacing manual human efforts with machines and processes. In the world of Information Technology too, we are linking disparate systems, softwares and tool...
"We focus on SAP workloads because they are among the most powerful but somewhat challenging workloads out there to take into public cloud," explained Swen Conrad, CEO of Ocean9, Inc., in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
"As we've gone out into the public cloud we've seen that over time we may have lost a few things - we've lost control, we've given up cost to a certain extent, and then security, flexibility," explained Steve Conner, VP of Sales at Cloudistics,in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
Your homes and cars can be automated and self-serviced. Why can't your storage? From simply asking questions to analyze and troubleshoot your infrastructure, to provisioning storage with snapshots, recovery and replication, your wildest sci-fi dream has come true. In his session at @DevOpsSummit at 20th Cloud Expo, Dan Florea, Director of Product Management at Tintri, provided a ChatOps demo where you can talk to your storage and manage it from anywhere, through Slack and similar services with...
"I think DevOps is now a rambunctious teenager – it’s starting to get a mind of its own, wanting to get its own things but it still needs some adult supervision," explained Thomas Hooker, VP of marketing at CollabNet, in this SYS-CON.tv interview at DevOps Summit at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
"Peak 10 is a hybrid infrastructure provider across the nation. We are in the thick of things when it comes to hybrid IT," explained , Chief Technology Officer at Peak 10, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
"I will be talking about ChatOps and ChatOps as a way to solve some problems in the DevOps space," explained Himanshu Chhetri, CTO of Addteq, in this SYS-CON.tv interview at @DevOpsSummit at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
With continuous delivery (CD) almost always in the spotlight, continuous integration (CI) is often left out in the cold. Indeed, it's been in use for so long and so widely, we often take the model for granted. So what is CI and how can you make the most of it? This blog is intended to answer those questions. Before we step into examining CI, we need to look back. Software developers often work in small teams and modularity, and need to integrate their changes with the rest of the project code b...
If you are thinking about moving applications off a mainframe and over to open systems and the cloud, consider these guidelines to prioritize what to move and what to eliminate. On the surface, mainframe architecture seems relatively simple: A centrally located computer processes data through an input/output subsystem and stores its computations in memory. At the other end of the mainframe are printers and terminals that communicate with the mainframe through protocols. For all of its apparen...
SYS-CON Events announced today that Calligo has been named “Bronze Sponsor” of SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Calligo is an innovative cloud service provider offering mid-sized companies the highest levels of data privacy. Calligo offers unparalleled application performance guarantees, commercial flexibility and a personalized support service from its globally located cloud platfor...
There is a huge demand for responsive, real-time mobile and web experiences, but current architectural patterns do not easily accommodate applications that respond to events in real time. Common solutions using message queues or HTTP long-polling quickly lead to resiliency, scalability and development velocity challenges. In his session at 21st Cloud Expo, Ryland Degnan, a Senior Software Engineer on the Netflix Edge Platform team, will discuss how by leveraging a reactive stream-based protocol,...
In his session at 20th Cloud Expo, Mike Johnston, an infrastructure engineer at Supergiant.io, discussed how to use Kubernetes to set up a SaaS infrastructure for your business. Mike Johnston is an infrastructure engineer at Supergiant.io with over 12 years of experience designing, deploying, and maintaining server and workstation infrastructure at all scales. He has experience with brick and mortar data centers as well as cloud providers like Digital Ocean, Amazon Web Services, and Rackspace. H...
All organizations that did not originate this moment have a pre-existing culture as well as legacy technology and processes that can be more or less amenable to DevOps implementation. That organizational culture is influenced by the personalities and management styles of Executive Management, the wider culture in which the organization is situated, and the personalities of key team members at all levels of the organization. This culture and entrenched interests usually throw a wrench in the work...
DevOps is good for organizations. According to the soon to be released State of DevOps Report high-performing IT organizations are 2X more likely to exceed profitability, market share, and productivity goals. But how do they do it? How do they use DevOps to drive value and differentiate their companies? We recently sat down with Nicole Forsgren, CEO and Chief Scientist at DORA (DevOps Research and Assessment) and lead investigator for the State of DevOps Report, to discuss the role of measure...
DevOps sees the coming together of practices, philosophies, and tools that allow you to create services and applications very quickly. This means that you can improve on your apps and evolve them at a much faster rate than those developers who are using traditional software development processes. We’ve talked about DevOps, in general, a great deal, but today, we’re going to dig a little deeper and take a look at Java DevOps specifically.
Many organizations are now looking to DevOps maturity models to gauge their DevOps adoption and compare their maturity to their peers. However, as enterprise organizations rush to adopt DevOps, moving past experimentation to embrace it at scale, they are in danger of falling into the trap that they have fallen into time and time again. Unfortunately, we've seen this movie before, and we know how it ends: badly.
"Outscale was founded in 2010, is based in France, is a strategic partner to Dassault Systémes and has done quite a bit of work with divisions of Dassault," explained Jackie Funk, Digital Marketing exec at Outscale, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
From personal care products to groceries and movies on demand, cloud-based subscriptions are fulfilling the needs of consumers across an array of market sectors. Nowhere is this shift to subscription services more evident than in the technology sector. By adopting an Everything-as-a-Service (XaaS) delivery model, companies are able to tailor their computing environments to shape the experiences they want for customers as well as their workforce.