Welcome!

Microservices Expo Authors: Stackify Blog, Elizabeth White, Pat Romanski, Liz McMillan, Yeshim Deniz

Related Topics: Java IoT, Microservices Expo, @CloudExpo, @DevOpsSummit

Java IoT: Article

SaaS Performance | @CloudExpo @Catchpoint #DevOps #WebPerf #AI #SaaS

SaaS providers need better tools to manage performance, enabling them to get ahead of problems

Managing Performance for SaaS-Based Applications

Software as a service (SaaS), one of the earliest and most successful cloud services, has reached mainstream status. According to Cisco, by 2019 more than four-fifths (83 percent) of all data center traffic will be based in the cloud, up from 65 percent today. The majority of this traffic will be applications.

Businesses of all sizes are adopting a variety of SaaS-based services - everything from collaboration tools to mission-critical commerce-oriented applications. The rise in SaaS usage has many positive benefits, but one drawback is that as demand grows, SaaS providers are having a harder time ensuring a high-performing (fast, reliable) end-user experience - at the same time performance expectations are growing higher than ever.

SaaS Providers Struggle to Meet Modern Day User Performance Expectations
Websites and applications must be fast. People want to read an article as soon as it's clicked; shoppers will abandon their cart on an ecommerce site if the website is too slow; customers expect to be able to quickly make transactions - and the list goes on. According to Google's latest research (February 2017), as page load time increases from 1 second to 7 seconds, the likelihood of a visitor abandoning the page increases 113 percent. For SaaS companies to be successful, they need to adopt the same laser focus on the end-user experience that has fueled the rise of ecommerce and B2B applications.

Meeting these performance demands is proving to be a significant challenge. One recent survey of SaaS providers found more than half reported difficulties in delivering sufficient performance levels, while more than a quarter said their organizations had incurred financial penalties as a result of unmet service-level agreements. Twenty-one percent of respondents whose organizations had an unplanned service interruption said it resulted in the loss of a customer relationship. Among those SaaS providers suffering financial penalties, the average cost incurred was $359,000 - not including the time and effort spent finding and fixing the source of performance declines.

Why Is Ensuring Superior Performance So Difficult?
Ensuring strong performance levels is proving difficult for several reasons:

Infrastructure Build-Outs - As many SaaS providers expand into new geographies and support more businesses, they are adding infrastructure as well as partitioning more existing systems. According to the SaaS provider survey mentioned above, almost half of respondents noted they have at least doubled the number of systems supporting their workloads and applications over the past two years. While this helps them support more customers, there is a nasty side effect - greater complexity, which makes it harder to find and fix the source of performance problems when they do occur.

Users' Geographic Expansion - Heightening these performance challenges is the growth of end users in new geographies. Application performance tends to deteriorate based on distance from the SaaS provider's data center. This means as end users move further away, there are more variables standing between them and the data center which can degrade performance - networks, ISPs, even browsers. This makes it impossible for SaaS providers to gauge worldwide performance levels for a specific SaaS user, based solely on the experiences of end users in just one or two geographies.

To expand and improve geographic reach, many SaaS providers build out their infrastructure, which in turn adds more complexity. The net result is a vicious cycle that ultimately results in decreased visibility into infrastructure health and end-user application performance.

The Capricious Nature of the Internet - Full SaaS provider outages are rare, but when they do happen, they can be disastrous. The Amazon S3 outage on February 28 served as the latest example, causing widespread availability issues for thousands of websites, apps, and IoT devices.

There have been other instances recently - in February 2016, Office 365 went dark for wide swaths of Europe. In August 2015, a Google data center in Belgium was struck by successive lightning strikes, causing problems for numerous Google cloud infrastructure service users. Not even tech giants like Amazon, Microsoft, or Google are immune to acts of God or nature. Inevitable outages are not the fault of these providers - rather, the "ripple effect" is the result of the tendency for business users to concentrate too much work in the hands of a single provider.

More common than full-blown outages are instances of SaaS applications just not performing well. Even though many SaaS providers have monitoring systems in place, 54 percent report the primary way they find out about performance problems is through customer complaints.

Managing Performance Must Be a Shared Endeavor
SaaS providers need better tools to manage performance, enabling them to get ahead of problems before their customers' end users are affected. This is a fundamental shift from traditional application performance management (APM) to what Gartner refers to as digital experience management (DEM). DEM treats the end-user experience as the ultimate metric, and identifies how the myriad of underlying services, systems, and components influence it. This approach is consistent with a recent EMA survey in which more than three quarters of respondents prioritized the ability to troubleshoot and analyze root causes of application performance problems, down to the platform level.

As the number of performance-impacting variables increases, SaaS providers may find themselves drowning in data, but searching for insights. They need advanced analytics to make data more actionable by identifying the cause of performance issues, swiftly and accurately. Sometimes performance issues are within the SaaS provider's control (such as when a particular region or data center requires more capacity). Other times, the issue may not be directly within the IT team's control - for example, a slow ISP or CDN. Even with these external factors, the information is still useful because time spent unnecessarily "war-rooming" can be avoided.

Business users of SaaS services should also be contributing to the performance management effort. They should consistently measure their SaaS providers' response levels, as well as monitor and measure real end- user performance at the closest points of geographic proximity. This is the key to gaining the most realistic view of end-user performance levels around the world. Having this information can help SaaS users uphold provider SLAs, but perhaps, more important, identify performance problems in advance and quickly determine if the problem is with the cloud service provider, or another component or internal infrastructure element.

Finally, as the recent Amazon S3 example demonstrated, SaaS users should always have a redundancy plan in place for their critical applications. In essence, they need to architect for failure. This may require an investment of time and effort, but can make all the difference in keeping SaaS-based businesses running smoothly when faced with a completely unpredictable event.

Conclusion
The growth in SaaS reliance is not going away, and SaaS providers cannot afford setbacks. When the SaaS platform that employees spend 80% of their day on goes down, productivity, and therefore a company's bottom line, takes a hit.

SaaS providers will continue to struggle with rapid growth and increasing complexity as business users port more mission-critical applications to the cloud and end users demand increasingly higher levels of performance and productivity.

This situation has the potential to escalate unless SaaS providers address the issue head-on with new approaches that evolve APM to DEM. Business users must also do their part. Ultimately, this can translate to more proactive, productive performance management, with less finger pointing and war rooming and more accurate, decisive issue resolution.

More Stories By Mehdi Daoudi

Mehdi Daoudi is the co-founder and CEO of Catchpoint Systems, a premier provider of web performance testing and monitoring solutions. His team has expertise in designing, building, operating, scaling and monitoring highly transactional Internet services used by thousands of companies that impact the experience of millions of users.

Before Catchpoint Systems, Mehdi spent 10+ years at DoubleClick and Google, where he was responsible for Quality of Services, buying, building, deploying, and using monitoring solutions to keep an eye on an infrastructure that delivered billions of transactions daily.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@MicroservicesExpo Stories
It has never been a better time to be a developer! Thanks to cloud computing, deploying our applications is much easier than it used to be. How we deploy our apps continues to evolve thanks to cloud hosting, Platform-as-a-Service (PaaS), and now Function-as-a-Service. FaaS is the concept of serverless computing via serverless architectures. Software developers can leverage this to deploy an individual "function", action, or piece of business logic. They are expected to start within milliseconds...
Most DevOps journeys involve several phases of maturity. Research shows that the inflection point where organizations begin to see maximum value is when they implement tight integration deploying their code to their infrastructure. Success at this level is the last barrier to at-will deployment. Storage, for instance, is more capable than where we read and write data. In his session at @DevOpsSummit at 20th Cloud Expo, Josh Atwell, a Developer Advocate for NetApp, will discuss the role and value...
You know you need the cloud, but you’re hesitant to simply dump everything at Amazon since you know that not all workloads are suitable for cloud. You know that you want the kind of ease of use and scalability that you get with public cloud, but your applications are architected in a way that makes the public cloud a non-starter. You’re looking at private cloud solutions based on hyperconverged infrastructure, but you’re concerned with the limits inherent in those technologies.
Regardless of what business you’re in, it’s increasingly a software-driven business. Consumers’ rising expectations for connected digital and physical experiences are driving what some are calling the "Customer Experience Challenge.” In his session at @DevOpsSummit at 20th Cloud Expo, Marco Morales, Director of Global Solutions at CollabNet, will discuss how organizations are increasingly adopting a discipline of Value Stream Mapping to ensure that the software they are producing is poised to o...
DevOps at Cloud Expo – being held October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA – announces that its Call for Papers is open. Born out of proven success in agile development, cloud computing, and process automation, DevOps is a macro trend you cannot afford to miss. From showcase success stories from early adopters and web-scale businesses, DevOps is expanding to organizations of all sizes, including the world's largest enterprises – and delivering real r...
Cloud promises the agility required by today’s digital businesses. As organizations adopt cloud based infrastructures and services, their IT resources become increasingly dynamic and hybrid in nature. Managing these require modern IT operations and tools. In his session at 20th Cloud Expo, Raj Sundaram, Senior Principal Product Manager at CA Technologies, will discuss how to modernize your IT operations in order to proactively manage your hybrid cloud and IT environments. He will be sharing bes...
SYS-CON Events announced today that CollabNet, a global leader in enterprise software development, release automation and DevOps solutions, will be a Bronze Sponsor of SYS-CON's 20th International Cloud Expo®, taking place from June 6-8, 2017, at the Javits Center in New York City, NY. CollabNet offers a broad range of solutions with the mission of helping modern organizations deliver quality software at speed. The company’s latest innovation, the DevOps Lifecycle Manager (DLM), supports Value S...
SYS-CON Events announced today that Peak 10, Inc., a national IT infrastructure and cloud services provider, will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Peak 10 provides reliable, tailored data center and network services, cloud and managed services. Its solutions are designed to scale and adapt to customers’ changing business needs, enabling them to lower costs, improve performance and focus intern...
DevOps is often described as a combination of technology and culture. Without both, DevOps isn't complete. However, applying the culture to outdated technology is a recipe for disaster; as response times grow and connections between teams are delayed by technology, the culture will die. A Nutanix Enterprise Cloud has many benefits that provide the needed base for a true DevOps paradigm. In his Day 3 Keynote at 20th Cloud Expo, Chris Brown, a Solutions Marketing Manager at Nutanix, will explore t...
This talk centers around how to automate best practices in a multi-/hybrid-cloud world based on our work with customers like GE, Discovery Communications and Fannie Mae. Today’s enterprises are reaping the benefits of cloud computing, but also discovering many risks and challenges. In the age of DevOps and the decentralization of IT, it’s easy to over-provision resources, forget that instances are running, or unintentionally expose vulnerabilities.
There are two main reasons for infrastructure automation. First, system administrators, IT professionals and DevOps engineers need to automate as many routine tasks as possible. That’s why we build tools at Stackify to help developers automate processes like application performance management, error monitoring, and log management; automation means you have more time for mission-critical tasks. Second, automation makes the management of complex, diverse environments possible and allows rapid scal...
One of the biggest challenges with adopting a DevOps mentality is: new applications are easily adapted to cloud-native, microservice-based, or containerized architectures - they can be built for them - but old applications need complex refactoring. On the other hand, these new technologies can require relearning or adapting new, oftentimes more complex, methodologies and tools to be ready for production. In his general session at @DevOpsSummit at 20th Cloud Expo, Chris Brown, Solutions Marketi...
We all know that end users experience the internet primarily with mobile devices. From an app development perspective, we know that successfully responding to the needs of mobile customers depends on rapid DevOps – failing fast, in short, until the right solution evolves in your customers' relationship to your business. Whether you’re decomposing an SOA monolith, or developing a new application cloud natively, it’s not a question of using microservices - not doing so will be a path to eventual ...
SYS-CON Events announced today that Linux Academy, the foremost online Linux and cloud training platform and community, will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Linux Academy was founded on the belief that providing high-quality, in-depth training should be available at an affordable price. Industry leaders in quality training, provided services, and student certification passes, its goal is to c...
SYS-CON Events announced today that Fusion, a leading provider of cloud services, will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Fusion, a leading provider of integrated cloud solutions to small, medium and large businesses, is the industry’s single source for the cloud. Fusion’s advanced, proprietary cloud service platform enables the integration of leading edge solutions in the cloud, including cloud...
SYS-CON Events announced today that HTBase will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. HTBase (Gartner 2016 Cool Vendor) delivers a Composable IT infrastructure solution architected for agility and increased efficiency. It turns compute, storage, and fabric into fluid pools of resources that are easily composed and re-composed to meet each application’s needs. With HTBase, companies can quickly prov...
@DevOpsSummit at Cloud taking place June 6-8, 2017, at Javits Center, New York City, is co-located with the 20th International Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to wait for long developm...
With 10 simultaneous tracks, keynotes, general sessions and targeted breakout classes, Cloud Expo and @ThingsExpo are two of the most important technology events of the year. Since its launch over eight years ago, Cloud Expo and @ThingsExpo have presented a rock star faculty as well as showcased hundreds of sponsors and exhibitors! In this blog post, I provide 7 tips on how, as part of our world-class faculty, you can deliver one of the most popular sessions at our events. But before reading the...
The purpose of this article is draw attention to key SaaS services that are commonly overlooked during contact signing that are essential to ensuring they meet the expectations and requirements of the organization and provide guidance and recommendations for process and controls necessary for achieving quality SaaS contractual agreements.
SYS-CON Events announced today that OpsGenie will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Founded in 2012, OpsGenie is an alerting and on-call management solution for dev and ops teams. OpsGenie provides the tools needed to design actionable alerts, manage on-call schedules and escalations, and ensure that the right people are notified at the right time, using multiple notification methods.