Welcome!

Microservices Expo Authors: Liz McMillan, Pat Romanski, Mamoon Yunus, Elizabeth White, Mehdi Daoudi

Related Topics: @CloudExpo, Java IoT, Microservices Expo, Linux Containers, Agile Computing, Cloud Security

@CloudExpo: Article

How to Compare Hosting Companies’ Speed & Reliability

In an 'always-on' world, there’s never a time when someone isn't surfing through your website

What do you look for when you choose a Web hosting provider? These days, it seems difficult to compare the differences between each service, whether you're talking about supported languages, databases or bandwidth. You might be tempted to pick the cheapest provider and plan in hopes of saving a few dollars. However, you should not overlook the importance of speed and reliability.

Take a small business for example - if its website is down or under-performing, the host is actually hurting the business. Even if the hosting were $1 per month, losing $100 in revenue because of unreliable performance means the customer loses $101. At that price, they could afford to grow their business to a dedicated server.

For the past year, my Hosting Performance Monitoring team at GoDaddy has scrutinized our environment and made some changes to make sure we are offering best in breed web hosting. Offering your customers a reliable, stable and fast platform is the most important feature you can provide. But that means more than just "Is the site up?" or "Is it fast?" You need to ask, "Is it up and fast all the time?"

In an "always-on" world, there's never a time when someone isn't surfing through your Website. Therefore, you want to double check that your Web hosting provider is fast and has great uptime, consistently. Outlined below is our tried and true performance and reliability measurement method, and a sample of results from studies that we've conducted.

The Hosting Reliability Measurement Method

1. Identify Your Providers
Make a list of the hosting companies you want to compare. It can be two for a head-to-head comparison, or hundreds to get an understanding of the entire industry.

2. Get Accounts
Purchase a Web hosting account from each company. Depending on the provider, this step can be daunting - some companies' sites make it incredibly difficult. For example, certain providers asked us to email or fax in our driver's license or credit card to buy an account.

3. Deploy the WordPress Sites
Load a cloned WordPress site to each hosting provider. This site should be completely single-sourced, which means the site only loads from its own resources, i.e. it doesn't reference any third-party scripts, images, etc. This makes the tests purely about the server's performance.

4. Audit
After setting up all the sites, make sure they're identical before you start testing. One way to do this is through webpagetest.org. Load each of your sites, then compare the Bytes In, Requests, and make sure there's only one domain listed in the Domains tab.

5. Measure
There are plenty of measurement techniques. You can pick any combination you see fit. We recommend trying a combination of the following:

Once you have all of the data on file, you can share it with the world! If you want to take your observations on a longer term, you can use APIs from the sites you used to perform the tests that automatically updates daily, weekly or monthly.

Here's a sample output from our own trials using two of the techniques we've outlined here. It compares GoDaddy cPanel to 6 of its closest competitors from January 1 2014 through March 1 2014.  The competitors listed here (A through F) are real competitors.

Pingdom, Response Time*                                            Pingdom, Downtime*

(Jan 1, 2014 through Mar 1, 2014)                                   (Jan 1, 2014 through Mar 1, 2014)

*Disclaimer: based on one site per product. It is not necessarily representative of the provider's product as a whole.

Analysis: In 60 days, 99.9% uptime means ~90 minutes down. Anything more should be unacceptable and likely violates the provider's uptime guarantee.

Competitor C and D had respectable response time averages at 0.804 seconds and 0.857 seconds, but should be disqualified for having worse than 99.9% uptime with 5,853 minutes (that's 4d 1h 33m) and 199 minutes of downtime.  Doesn't matter what the speed is, this much downtime should not be tolerated.

GoDaddy cPanel performed exceptionally well, with the lowest response times and better than 99.9% uptime. GoDaddy cPanel is the clear performance winner in this 60-day study.

Gomez Results

Jan 1, 2014 through Mar 1, 2014

*Disclaimer: based on one site per product.  It is not necessarily representative of the provider's product as a whole.

Analysis: This is full-page load, in this case 15 page objects (i.e., CSS, JS, images) totally approximately 750KB. Gomez test nodes are sitting on high bandwidth connections on the edge of their networks in top tier data centers. This is not the typical home user on wifi sitting 100 feet away through 4 walls, it's fast. Gomez nodes have latency to tend with, however. Whichever Gomez node location is fastest for a provider is very likely the closest node to the provider.

GoDaddy cPanel performed under 1.0s on avg, at 0.743s, throughout the 60 day period. Competitor D was close at 1.001s

Conclusion
There are very few, if any, Web hosting performance studies available to help consumers make the right choice. We urge industry review analysts to adopt the method described in this article because we believe it provides a comprehensive view of how hosting companies perform. It's straightforward, too. Just set up a cloned WordPress site on a few different hosts, and then use a tool like Pingdom to monitor performance.

If we can get trusted, third-party sources to publish information like this on a continual basis, customers will have all of the information they need to make informed decisions.

More Stories By David Koopman

David Koopman is Principal Engineer, Hosting Infrastructure Performance Engineering Team at GoDaddy. He leads the Hosting Performance Team at GoDaddy and is responsible for measuring and monitoring performance of thousands of servers, hosting millions of websites. His team works closely with product and infrastructure teams to ensure consistent performance across the GoDaddy web hosting product line.

Since joining GoDaddy in 2002 as a software developer, David has helped transform the company’s Web-based email product into a multi-million account operation. During his tenure at GoDaddy, he has held several development positions including Dedicated and VPS Hosting Development Manager, Architect, Sr. VP of Product Development, Chief Technology Officer, Chief Scientist and Principal Engineer.

Prior to joining GoDaddy, David was the Technical Director of The Web Mark, a medical Internet services company. He attained a BS in Computer Science from Southwest Missouri State University and is a certified Project Management Professional (PMP).

When not developing new product ideas at GoDaddy, David enjoys spending time with his family, skiing, off-roading and boating.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@MicroservicesExpo Stories
In his session at 20th Cloud Expo, Scott Davis, CTO of Embotics, discussed how automation can provide the dynamic management required to cost-effectively deliver microservices and container solutions at scale. He also discussed how flexible automation is the key to effectively bridging and seamlessly coordinating both IT and developer needs for component orchestration across disparate clouds – an increasingly important requirement at today’s multi-cloud enterprise.
IT organizations are moving to the cloud in hopes to approve efficiency, increase agility and save money. Migrating workloads might seem like a simple task, but what many businesses don’t realize is that application migration criteria differs across organizations, making it difficult for architects to arrive at an accurate TCO number. In his session at 21st Cloud Expo, Joe Kinsella, CTO of CloudHealth Technologies, will offer a systematic approach to understanding the TCO of a cloud application...
API Security has finally entered our security zeitgeist. OWASP Top 10 2017 - RC1 recognized API Security as a first class citizen by adding it as number 10, or A-10 on its list of web application vulnerabilities. We believe this is just the start. The attack surface area offered by API is orders or magnitude larger than any other attack surface area. Consider the fact the APIs expose cloud services, internal databases, application and even legacy mainframes over the internet. What could go wrong...
The goal of Continuous Testing is to shift testing left to find defects earlier and release software faster. This can be achieved by integrating a set of open source functional and performance testing tools in the early stages of your software delivery lifecycle. There is one process that binds all application delivery stages together into one well-orchestrated machine: Continuous Testing. Continuous Testing is the conveyer belt between the Software Factory and production stages. Artifacts are m...
In IT, we sometimes coin terms for things before we know exactly what they are and how they’ll be used. The resulting terms may capture a common set of aspirations and goals – as “cloud” did broadly for on-demand, self-service, and flexible computing. But such a term can also lump together diverse and even competing practices, technologies, and priorities to the point where important distinctions are glossed over and lost.
In his session at @DevOpsSummit at 20th Cloud Expo, Kelly Looney, director of DevOps consulting for Skytap, showed how an incremental approach to introducing containers into complex, distributed applications results in modernization with less risk and more reward. He also shared the story of how Skytap used Docker to get out of the business of managing infrastructure, and into the business of delivering innovation and business value. Attendees learned how up-front planning allows for a clean sep...
Most companies are adopting or evaluating container technology - Docker in particular - to speed up application deployment, drive down cost, ease management and make application delivery more flexible overall. As with most new architectures, this dream takes a lot of work to become a reality. Even when you do get your application componentized enough and packaged properly, there are still challenges for DevOps teams to making the shift to continuous delivery and achieving that reduction in cost ...
Enterprise architects are increasingly adopting multi-cloud strategies as they seek to utilize existing data center assets, leverage the advantages of cloud computing and avoid cloud vendor lock-in. This requires a globally aware traffic management strategy that can monitor infrastructure health across data centers and end-user experience globally, while responding to control changes and system specification at the speed of today’s DevOps teams. In his session at 20th Cloud Expo, Josh Gray, Chie...
"At the keynote this morning we spoke about the value proposition of Nutanix, of having a DevOps culture and a mindset, and the business outcomes of achieving agility and scale, which everybody here is trying to accomplish," noted Mark Lavi, DevOps Solution Architect at Nutanix, in this SYS-CON.tv interview at @DevOpsSummit at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
We have already established the importance of APIs in today’s digital world (read about it here). With APIs playing such an important role in keeping us connected, it’s necessary to maintain the API’s performance as well as availability. There are multiple aspects to consider when monitoring APIs, from integration to performance issues, therefore a general monitoring strategy that only accounts for up-time is not ideal.
Web services have taken the development world by storm, especially in recent years as they've become more and more widely adopted. There are naturally many reasons for this, but first, let's understand what exactly a web service is. The World Wide Web Consortium (W3C) defines "web of services" as "message-based design frequently found on the Web and in enterprise software". Basically, a web service is a method of sending a message between two devices through a network. In practical terms, this ...
In his session at 20th Cloud Expo, Mike Johnston, an infrastructure engineer at Supergiant.io, discussed how to use Kubernetes to set up a SaaS infrastructure for your business. Mike Johnston is an infrastructure engineer at Supergiant.io with over 12 years of experience designing, deploying, and maintaining server and workstation infrastructure at all scales. He has experience with brick and mortar data centers as well as cloud providers like Digital Ocean, Amazon Web Services, and Rackspace. H...
All organizations that did not originate this moment have a pre-existing culture as well as legacy technology and processes that can be more or less amenable to DevOps implementation. That organizational culture is influenced by the personalities and management styles of Executive Management, the wider culture in which the organization is situated, and the personalities of key team members at all levels of the organization. This culture and entrenched interests usually throw a wrench in the work...
As many know, the first generation of Cloud Management Platform (CMP) solutions were designed for managing virtual infrastructure (IaaS) and traditional applications. But that’s no longer enough to satisfy evolving and complex business requirements. In his session at 21st Cloud Expo, Scott Davis, Embotics CTO, will explore how next-generation CMPs ensure organizations can manage cloud-native and microservice-based application architectures, while also facilitating agile DevOps methodology. He wi...
When you focus on a journey from up-close, you look at your own technical and cultural history and how you changed it for the benefit of the customer. This was our starting point: too many integration issues, 13 SWP days and very long cycles. It was evident that in this fast-paced industry we could no longer afford this reality. We needed something that would take us beyond reducing the development lifecycles, CI and Agile methodologies. We made a fundamental difference, even changed our culture...
We have Continuous Integration and we have Continuous Deployment, but what’s continuous across all of what we do is people. Even when tasks are automated, someone wrote the automation. So, Jayne Groll evangelizes about Continuous Everyone. Jayne is the CEO of the DevOps Institute and the author of Agile Service Management Guide. She talked about Continuous Everyone at the 2016 All Day DevOps conference. She describes it as "about people, culture, and collaboration mapped into your value streams....
These days, change is the only constant. In order to adapt and thrive in an ever-advancing and sometimes chaotic workforce, companies must leverage intelligent tools to streamline operations. While we're only at the dawn of machine intelligence, using a workflow manager will benefit your company in both the short and long term. Think: reduced errors, improved efficiency and more empowered employees-and that's just the start. Here are five other reasons workflow automation is leading a revolution...
Docker is sweeping across startups and enterprises alike, changing the way we build and ship applications. It's the most prominent and widely known software container platform, and it's particularly useful for eliminating common challenges when collaborating on code (like the "it works on my machine" phenomenon that most devs know all too well). With Docker, you can run and manage apps side-by-side - in isolated containers - resulting in better compute density. It's something that many developer...
While some vendors scramble to create and sell you a fancy solution for monitoring your spanking new Amazon Lambdas, hear how you can do it on the cheap using just built-in Java APIs yourself. By exploiting a little-known fact that Lambdas aren’t exactly single-threaded, you can effectively identify hot spots in your serverless code. In his session at @DevOpsSummit at 21st Cloud Expo, Dave Martin, Product owner at CA Technologies, will give a live demonstration and code walkthrough, showing how ...
Did you know that you can develop for mainframes in Java? Or that the testing and deployment can be automated across mobile to mainframe? In his session and demo at @DevOpsSummit at 21st Cloud Expo, Dana Boudreau, a Senior Director at CA Technologies, will discuss how increasingly teams are developing with agile methodologies, using modern development environments, and automating testing and deployments, mobile to mainframe.